eBay的全局二级索引

eBay’s NuData [1] database platform is built from the ground up to be a cloud-native, distributed, highly scalable and performant. We not only adopted state-of-the-art technologies to overcome the technical challenges that come with building a database platform at this scale, but we also invested heavily in operationalizing it, with capabilities of self-serving, monitoring and alerting and auto remediation. Our database platform has been in production for the past four years, handling critical eBay data used for customer items, orders and payments. We have petabytes of data spanning across several different data centers.

eBay的NuData[1]数据库平台从一开始就被打造为一个云原生、分布式、高度可扩展和高性能的平台。我们不仅采用了最先进的技术来克服建立如此规模的数据库平台所带来的技术挑战,而且还在运营方面进行了大量投资,使其具有自我服务、监测和警报以及自动补救的能力。我们的数据库平台在过去四年里一直在生产,处理用于客户项目、订单和付款的关键eBay数据。我们有几十亿字节的数据,跨越几个不同的数据中心。

In this article, we introduce how we solved the technical challenge of managing indexes for a distributed database by building a Global Secondary Index (GSI) that is extremely fast and consistent. In particular, our GSI system provides full-fledged features as below. 

在这篇文章中,我们介绍了我们是如何通过建立一个极其快速和一致的全局二级索引(GSI)来解决分布式数据库的索引管理的技术挑战。特别是,我们的GSI系统提供了以下完整的功能。

  • High scalability: Our horizontally scalable architecture does not limit the volumes of indexes.
  • 高可扩展性。我们的横向可扩展架构并不限制索引的数量。
  • Fault tolerance: To provide high availability, we manage replicas in local and geographically remote locations leveraging our organic solution. (NuRaft [2])
  • 容错性。为了提供高可用性,我们利用我们的有机解决方案,在本地和地理上的远程位置管理副本。(NuRaft [2])
  • High performance: In addition to performance advantage from having replicas, we leverage our organic storage engine solution (Jungle [5]) to optimize storage performance.
  • 高性能。除了拥有复制的性能优势外,我们还利用我们的有机存储引擎解决方案(Jungle [5])来优化存储性能。
  • Flexible resource management: Taking the advantages of horizontal scalable architecture is not free. We carefully operationalized flexible resource management to efficiently support dynamically changing users’ requirements.
  • 灵活的资源管理。利用横向可扩展架构的优势并不是免费的。我们仔细操作了灵活的资源管理,以有效地支持动态变化的用户需求。
  • Self served ...
开通本站会员,查看完整译文。

首页 - Wiki
Copyright © 2011-2024 iteam. Current version is 2.125.1. UTC+08:00, 2024-05-17 11:10
浙ICP备14020137号-1 $访客地图$