在 Netflix 规模上启动可观测性

With special thanks to my stunning colleagues: Mallika Rao, Esmir Mesic, Hugo Marques

特别感谢我的出色同事：Mallika Rao，Esmir Mesic，Hugo Marques

Introduction

介绍

At Netflix, we manage over a thousand global content launches each month, backed by billions of dollars in annual investment. Ensuring the success and discoverability of each title across our platform is a top priority, as we aim to connect every story with the right audience to delight our members. To achieve this, we are committed to building robust systems that deliver comprehensive observability, enabling us to take full accountability for every title on our service.

在Netflix，我们每月管理超过一千个全球内容发布，背后是每年数十亿美元的投资。确保每个标题在我们平台上的成功和可发现性是我们的首要任务，因为我们旨在将每个故事与合适的观众联系起来，以取悦我们的会员。为此，我们致力于构建强大的系统，提供全面的可观测性，使我们能够对服务上的每个标题负全责。

The Challenge of Title Launch Observability

标题发布可观察性的挑战

As engineers, we’re wired to track system metrics like error rates, latencies, and CPU utilization — but what about metrics that matter to a title’s success?

作为工程师，我们习惯于跟踪系统指标，如错误率、延迟和 CPU 利用率——但对于一个标题的成功来说，哪些指标是重要的呢？

Consider the following example of two different Netflix Homepages:

请考虑以下两个不同的Netflix主页示例：

Sample Homepage A

示例主页 A

Sample Homepage B

示例主页 B

To a basic recommendation system, the two sample pages might appear equivalent as long as the viewer watches the top title. Yet, these pages couldn’t be more different. Each title represents countless hours of effort and creativity, and our systems need to honor that uniqueness.

对于一个基本的推荐系统来说，只要观众观看顶部标题，这两个示例页面可能看起来是等同的。然而，这些页面却截然不同。每个标题都代表了无数小时的努力和创造力，我们的系统需要尊重这种独特性。

How do we bridge this gap? How can we design systems that recognize these nuances and empower every title to shine and bring joy to our members?

我们如何弥合这一差距？我们如何设计能够识别这些细微差别并使每个标题都能闪耀并为我们的会员带来快乐的系统？

The Operational Needs of a Personalization System

个性化系统的操作需求

In the early days of Netflix Originals, our launch team would huddle together at midnight, manually verifying that titles appeared in all the right places. While this hands-on approach worked for a handf...