Client-Side Load Balancing at a Million Requests Per Second

Client-Side Load Balancing at a Million Requests Per Second

摘要

Zalando将内部高扇出流量从共享边缘负载均衡器Skipper迁移到进程内客户端负载均衡。通过xxHash64一致性哈希环、基于占用率的负载均衡和N环缓启动，消除了延迟尖峰，将Skipper集群从50+ Pod缩减至8个，并节省了25%的计算成本。