This talk from Shmoocon 2013 is about the next level in scalability: systems that handle 10 MILLION concurrent connections. Such systems already exist, though instead of being called “servers” they are called “devices”, like firewalls, IPS, DPI, load balancers, carrier NAT, etc.
It’s not hardware that makes these systems scale, but software. Indeed, many of these scalable “devices” are simply x86 servers with a different logo on the front panel. This talk broadly covers the major areas of making a scalable system from a standard x86 desktop, discussing asynchronous event driven design, custom stacks, multi-core programming, low-level optimizations, and security.
Author: Robert David Graham CEO of Errata Security Created the first IPS (BlackICE Guard), which is now sold as “Proventia”, which scales to 10 million concurrent connections on x86 hardware.