From Homegrown to Flink: Migrating a Stateful Ad Event Join at Scale

From Homegrown to Flink: Migrating a Stateful Ad Event Join at Scale

摘要

Flink替代了自研的广告事件流处理方案，通过KeyedCoProcessFunction实现高效两方状态连接，结合RocksDB调优与3分钟增量检查点，将资源消耗降低70%以上，成本从€80降至€30/天，事件匹配率提升0.5%，并实现安全自动扩缩容。