构建高吞吐量支付账户处理

In this blog, we dive into the technical challenges of processing financial updates for hot user accounts at scale. A hot user account in this context is a hot-key phenomenon observed in our User Account financial data store, whose disproportionately high number of changes in a row becomes too much for the system to keep up‌ with. We detail how we built the User Account Batch Processing system to handle over 30 update operations per second per user account while maintaining strict consistency guarantees. Let’s explore what we learned from building this system.

在本文中，我们深入探讨了为热门用户账户大规模处理财务更新的技术挑战。在此上下文中，热门用户账户是我们 User Account 财务数据存储中观察到的热键现象，其连续的高变更数量使系统难以跟上。我们详细介绍了如何构建 User Account Batch Processing 系统，以每用户账户每秒处理超过 30 个更新操作，同时保持严格的一致性保证。让我们探索从构建此系统中学到的经验。

Our core payments platform, Gulfstream, serves as an integrated, SOX-compliant platform built on double-entry accounting principles. It uses a job/transaction-based architecture and processes millions of transactions daily. The system maintains the basic accounting principle that money flows between accounts without creation or destruction, and provides an immutable audit trail via UACs (User Account Changelogs).

我们的核心支付平台 Gulfstream 是一个集成的、SOX 合规平台，基于复式记账原则构建。它采用基于作业/事务的架构，每天处理数百万笔交易。该系统维护了货币在账户之间流动而不创造或销毁的基本会计原则，并通过 UACs (User Account Changelogs) 提供不可变的审计轨迹。

However, as the platform grew, certain user accounts experienced extreme traffic bursts and volume resulting in hot-key issues that overwhelmed the standard processing pipeline. By 2023, some user accounts needed to handle far more than our system’s limit of 3-4 update operations per second.

然而，随着平台的增长，某些用户账户经历了极端流量爆发和容量，导致 hot-key 问题，压垮了标准的处理管道。到 2023 年，一些用户账户需要处理远超我们系统’s 3-4 次/秒更新操作限制的量。

For example, large marketplace operators process tens of thousands of ‌daily bulk adjustments against a single user account, taking 21-24 hours to complete. Fleet operators tend to create hundreds of thousands of daily transactions, taking more than a day to complete. Fleet operators experiencing massive payment bursts at s...