Netflix的云效率

Context

背景

At Netflix, we use Amazon Web Services (AWS) for our cloud infrastructure needs, such as compute, storage, and networking to build and run the streaming platform that we love. Our ecosystem enables engineering teams to run applications and services at scale, utilizing a mix of open-source and proprietary solutions. In turn, our self-serve platforms allow teams to create and deploy, sometimes custom, workloads more efficiently. This diverse technological landscape generates extensive and rich data from various infrastructure entities, from which, data engineers and analysts collaborate to provide actionable insights to the engineering organization in a continuous feedback loop that ultimately enhances the business.

在Netflix，我们使用Amazon Web Services (AWS) 来满足我们的云基础设施需求，例如计算、存储和网络，以构建和运行我们喜爱的流媒体平台。我们的生态系统使工程团队能够大规模运行应用程序和服务，利用开源和专有解决方案的混合。反过来，我们的自助平台允许团队更高效地创建和部署，有时是定制的工作负载。这种多样化的技术环境从各种基础设施实体中生成了广泛而丰富的数据，数据工程师和分析师通过合作为工程组织提供可操作的洞察，形成一个持续的反馈循环，最终提升业务。

One crucial way in which we do this is through the democratization of highly curated data sources that sunshine usage and cost patterns across Netflix’s services and teams. The Data & Insights organization partners closely with our engineering teams to share key efficiency metrics, empowering internal stakeholders to make informed business decisions.

我们实现这一目标的一个关键方式是通过高度策划的数据源的民主化，这些数据源展示了Netflix服务和团队的使用和成本模式。数据与洞察组织与我们的工程团队紧密合作，分享关键的效率指标，使内部利益相关者能够做出明智的业务决策。

Data is Key

数据是关键

This is where our team, Platform DSE (Data Science Engineering), comes in to enable our engineering partners to understand what resources they’re using, how effectively and efficiently they use those resources, and the cost associated with their resource usage. We want our downstream consumers to make cost conscious decisions using our datasets.

这就是我们团队，Platform DSE（数据科学工程），帮助我们的工程合作伙伴了解他们正在使用的资源，他们如何有效和高效地使用这些资源，以及与资源使用相关的成本的地方。我们希望我们的下游消费者能够使用我们的数据集做出成本意识的决策。

To address these numerous analytic needs in a scalable way, we’ve developed a ...