将Uber的计算平台迁移到Kubernetes：一段技术旅程

In 2024, the Uber stateless container orchestration platform completed a migration from Apache Mesos® to Kubernetes®.

在2024年，Uber的无状态容器编排平台完成了从Apache Mesos®到Kubernetes®的迁移。

This blog is the first in a multi-part series about Kubernetes migration use cases. Uber is gradually converging to Kubernetes for batch, stateless, and storage use cases. The goal is to leverage industry-standard technology, rich built-in functionality, and stability. This blog describes how we migrated all shared stateless workloads to Kubernetes. It describes our migration journey, including the motivation behind the migration, the challenges we faced, and the solutions we implemented to ensure a seamless transition. We discuss our infrastructure, key principles guiding the migration, customizations, scalability achievements, unexpected issues, and our plans for collaboration with the open-source community. The next blog will explore how Uber migrated DSW batch job workloads from Peloton to Kubernetes. Future blogs will explore additional workload and architecture migrations.

这篇博客是关于Kubernetes迁移用例的多部分系列中的第一篇。Uber正在逐步向Kubernetes整合批处理、无状态和存储用例。目标是利用行业标准技术、丰富的内置功能和稳定性。这篇博客描述了我们如何将所有共享的无状态工作负载迁移到Kubernetes。它描述了我们的迁移旅程，包括迁移背后的动机、我们面临的挑战以及我们实施的解决方案，以确保无缝过渡。我们讨论了我们的基础设施、指导迁移的关键原则、定制、可扩展性成就、意外问题以及我们与开源社区合作的计划。下一篇博客将探讨Uber如何将DSW批处理作业工作负载从Peloton迁移到Kubernetes。未来的博客将探讨其他工作负载和架构的迁移。

The Container Platform team manages more than 50 compute clusters across multiple regions/zones on both on-prem data centers and cloud providers like Oracle® Cloud and Google Cloud™. Each cluster has around 5,000-7,500 hosts, around 250,000 cores, and around 50,000 pods. They power Uber’s 4,000 services that use around 3 million cores. These services get deployed 100,000 times a day, which results in 1.5 million pod launches a day at the rate of 120-130 pods/second in a single cluster. These clusters power Uber’s service federation layer, Up, which developers use to manage their service lifecycle.

容器平台团队管理着超过50个计算集群，分布在多个区域/区域，包括本地数据中心和云提供商，如Oracle® Cloud和Google Cloud™。每个集群...