在Pinterest使用AWS EC2处理网络限速
[
[
·
·
Jia Zhan, Senior Staff Software Engineer, Pinterest
Sachin Holla, Principal Solution Architect, AWS
Jia Zhan, 高级员工软件工程师, Pinterest
Sachin Holla, 首席解决方案架构师, AWS
Summary
总结
Pinterest is a visual search engine and powers over 550¹ million monthly active users globally. Pinterest’s infrastructure runs on AWS and leverages Amazon EC2 instances for its compute fleet. In recent years, while managing Pinterest’s EC2 infrastructure, particularly for our essential online storage systems, we identified a significant challenge: the lack of clear insights into EC2’s network performance and its direct impact on our applications’ reliability and performance. In this blog post, we’ll discuss our experiences in identifying the challenges associated with EC2 network throttling. We’ll also delve into how we developed network performance monitoring for the Pinterest EC2 fleet and discuss various techniques we implemented to manage network bursts, ensuring dependable network performance for our critical online serving workloads.
Pinterest 是一个视觉搜索引擎，全球每月活跃用户超过 5.5 亿。Pinterest 的基础设施运行在 AWS 上，并利用 Amazon EC2 实例作为其计算集群。近年来，在管理 Pinterest 的 EC2 基础设施，特别是我们的关键在线存储系统时，我们发现了一个重大挑战：缺乏对 EC2 网络性能的清晰洞察，以及其对我们应用程序可靠性和性能的直接影响。在这篇博客文章中，我们将讨论我们在识别与 EC2 网络限流相关的挑战方面的经验。我们还将深入探讨我们如何为 Pinterest EC2 集群开发网络性能监控，并讨论我们实施的各种技术，以管理网络突发，确保我们关键在线服务工作负载的可靠网络性能。
Motivation
动机
To illustrate why we are committed to conducting network performance analysis for our online workloads, we’ll share some recent examples from our production environment at Pinterest.
为了说明我们为何致力于对在线工作负载进行网络性能分析，我们将分享一些来自Pinterest生产环境的近期示例。
User Sequence Serving
用户序列服务
Real time user sequence became very popular at Pinterest since its launch and drove significant user engagement wins. With the continuous addition of user events and features...