Cloudflare's battle-tested Rust proxy framework that handles 40M+ requests/sec in production - now open source for building custom network services

Ever wondered how Cloudflare handles massive internet traffic without breaking a sweat? Meet Pingora, their internal Rust framework that’s been quietly processing over 40 million requests per second in production for years. While most of us struggle with basic load balancing, Cloudflare just open-sourced the same battle-hardened technology that powers a significant chunk of the internet’s infrastructure.

This isn’t another toy proxy - Pingora delivers HTTP/1 and HTTP/2 proxying, supports multiple TLS backends (OpenSSL, BoringSSL, s2n-tls), handles gRPC and WebSocket proxying, and includes graceful reloading without dropping connections. The framework is built for customization with programmable load balancing strategies and comprehensive observability. Plus, it’s memory-safe Rust, so you can sleep better than those maintaining legacy C/C++ network services.

If you’re building performance-critical network services or tired of wrestling with inflexible proxies, this is your chance to use the same tech stack that keeps major websites running. The documentation includes a quick-start guide for building a load balancer, and with 26k+ stars, the community momentum is already strong. Fair warning: the caching APIs are still experimental, but the core proxy functionality is production-proven at internet scale.

⭐ Stars: 26069
💻 Language: Rust
🔗 Repository: cloudflare/pingora