通过Dropbox中的消息系统模型发展我们的基础设施

The asynchronous platform at Dropbox integrates a suite of services that enable tasks and workflows to function independently without having to wait on one another. This is pretty important to our work as developers: It empowers any service within Dropbox to initiate and schedule tasks, seamlessly supporting over 400 product use cases—including Dropbox Dash and our other AI innovations—and efficiently routing more than 30 million tasks every minute. It also handles change data capture (CDC) use cases, where changes in our underlying storage system, including the FileSystem, are relayed to various product lambdas and processes. In short, it helps us ensure impactful and efficient business operations.

Dropbox的异步平台集成了一套服务，使任务和工作流能够独立运行，而无需相互等待。这对我们作为开发人员的工作非常重要：它使Dropbox中的任何服务能够启动和调度任务，顺利支持超过400个产品用例——包括Dropbox Dash和我们的其他AI创新——并高效地路由每分钟超过3000万任务。它还处理变更数据捕获（CDC）用例，其中底层存储系统（包括文件系统）的更改被传递给各种产品lambda和进程。简而言之，它帮助我们确保有影响力和高效的业务运营。

This implementation was essential to our growth from where we were a couple of years ago. Back then, the asynchronous platform struggled with scalability and reliability, frequently falling short of the demands of our expanding product portfolio. For product engineers, the platform posed additional hurdles due to limited developer productivity tools, making it cumbersome to build and iterate on asynchronous workflows. Today’s transformation into a robust and scalable system marks a dramatic shift from those early challenges—it enables innovation at a desired pace.

这一实现对我们从几年前的成长至关重要。那时，异步平台在可扩展性和可靠性方面面临挑战，常常无法满足我们不断扩展的产品组合的需求。对于产品工程师来说，由于开发者生产力工具有限，平台带来了额外的障碍，使得构建和迭代异步工作流变得繁琐。今天转型为一个强大且可扩展的系统标志着从早期挑战的戏剧性转变——它使创新能够以所需的速度进行。

In this blog, we’ll introduce an open messaging system model (MSM), which played a key role in evolving our platform. It helped us build a unified event-driven system capable of orchestrating a wide range of asynchronous tasks and meeting future needs, especially as we focus on AI. Inspired by the Open Systems Interconnection (OSI) model, the MSM divides our platform into fiv...