在Pinterest的统一Flink源。流式数据处理

Lu Niu & Chen Qin | Software Engineers, Stream Processing Platform Team

卢牛和陈琴 | 软件工程师，流处理平台团队

To best serve Pinners, creators, and advertisers, Pinterest leverages Flink as its stream processing engine. Flink is a data processing engine for stateful computation over data streams. It provides rich streaming APIs, exact-once support, and state checkpointing, which are essential to build stable and scalable streaming applications. Nowadays Flink is widely used in companies like Alibaba, Netflix, and Uber in mission critical use cases.

为了更好地服务品客、创作者和广告商，Pinterest利用Flink作为其流处理引擎。Flink是一个数据处理引擎，用于数据流的有状态计算。它提供了丰富的流媒体API、精确的一次性支持和状态检查点，这些都是建立稳定和可扩展的流媒体应用的关键。如今，Flink被广泛用于阿里巴巴、Netflix和Uber等公司的关键任务案例中。

Xenon is the Flink-based stream processing platform at Pinterest. The mission is to build a reliable, scalable, easy-to-use, and efficient stream platform to enable data-driven products and timely decision making. This system includes:

Xenon是Pinterest的基于Flink的流处理平台。其任务是建立一个可靠、可扩展、易于使用和高效的流平台，以实现数据驱动的产品和及时的决策。这个系统包括

Reliable and up-to-date Flink compute engine
可靠的、最新的Flink计算引擎
Improved Pinterest dev velocity on stream application development
提高Pinterest开发流应用的速度
Platform reliability and efficiency
平台的可靠性和效率
Security & Compliance
安全与合规
Documentation, User Education, and Community
文档、用户教育和社区

Xenon has enabled several critical use cases, including:

Xenon已经实现了几个关键的使用案例，包括。

Ads real-time ingestion, spending, and reporting — Calculate spending against budget limits in real time to quickly adjust budget pacing and update advertisers with more timely reporting results.
广告实时摄取、支出和报告--根据预算限额实时计算支出，快速调整预算节奏，并以更及时的报告结果更新广告商。
Fast signals — Make content signals available quickly after content creation and use these signals in ML pipelines for a customized user experience.
快速信号--在内容创建后迅速提供内容信号，并在ML管道中使用这些信号以获得定制的用户体验。
Realtime Trust & Safety — Reduce levels of unsafe content as close to content creation time as possible.
实时信任与安全 - 尽可能在接近内容创建时间时减少不安全内容的水平。
Content activation — Distribute fresh creator content and surface engagement metrics to crea...