Uber的强大数据库备份恢复

Uber leverages storage technologies to run its real-time operations. This includes storing online data in open-source databases like MySQL®, Apache Cassandra®, etcd®, and Apache Zookeeper®, as well as Uber’s homegrown storage solutions like Docstore and Schemaless hosted on top of Uber’s Stateful Platform.

Uber利用存储技术来运行其实时操作。这包括将在线数据存储在开源数据库中，如MySQL®、Apache Cassandra®、etcd®和Apache Zookeeper®，以及Uber自家开发的存储解决方案，如Docstore和Schemaless，这些解决方案托管在Uber的状态平台之上。

Database backup recovery is vital for Uber’s business continuity and disaster recovery scenarios. This supports use cases like outage mitigation, recovery from data corruption, and forensics and regulatory compliance. It also supports production-like environment simulation for load testing, data integrity, and security.

数据库备份恢复对 Uber 的业务连续性和灾难恢复场景至关重要。这支持诸如故障缓解、数据损坏恢复以及取证和合规性等用例。它还支持类似生产环境的模拟，以进行负载测试、数据完整性和安全性。

Uber’s online storage solutions hold 10s of petabytes to serve critical business operations. They also serve millions to billions of requests per second across Uber’s global business verticals. With that scale, close to 100 PB of data is backed up from databases at different intervals. TBs to PBs of data can be restored within a few minutes to a few hours.

Uber 的在线存储解决方案存储了数十个 PB 的数据，以支持关键业务操作。它们还在 Uber 的全球业务垂直领域每秒处理数百万到数十亿的请求。在这样的规模下，近 100 PB 的数据在不同的时间间隔内从数据库中备份。TB 到 PB 的数据可以在几分钟到几小时内恢复。

This blog describes recent developments in Uber’s robust backup recovery system for online databases.

本博客描述了Uber在线数据库强大备份恢复系统的最新进展。

Evolving Uber’s backup recovery system at scale presented multiple challenges:

在规模上演变 Uber 的备份恢复系统面临多个挑战：

Rudimentary backup scheduling: Previously, backups were naively scheduled in a periodic best-effort manner. There was no consideration of current network resources, host resources, prioritization, rate limiting, or observability along the system. This led to spiky backup workload utilization, causing multiple issues that required a slow mechanism to resume backups.
初步备份调度：之前，备份是以周期性尽力而为的方式天真地调度的。没有考虑当前的网络资源、主机资源、优先级、速率限制或系统的可观察性。这导致...