Grab 的 Data Mesh 第 II 部分:认证背后的基础工具
Introduction
引言
In Part I, we discussed why Grab is investing in a data mesh, referred to as the Signals Marketplace within Grab, as part of our evolving data culture. We also explained how data certification aids teams in reliably reusing data across different domains. However, cultural change doesn’t occur through principles alone; it happens when tools reshape people’s daily behaviors. Therefore, it is crucial for us to develop effective platforms that integrate these practices.
In Part I 中,我们讨论了为什么 Grab 正在投资 data mesh,在 Grab 内部称为 Signals Marketplace,作为我们不断演进的数据文化的一部分。我们还解释了数据认证如何帮助团队可靠地在不同域之间重用数据。然而,文化变革不仅仅通过原则发生;它发生在工具重塑人们日常行为时。因此,对我们来说,开发整合这些实践的有效平台至关重要。
This follow-up focuses on these platforms that make certification work at Grab:
这份后续文章聚焦于使 Grab 的认证机制运转的这些平台:
- Hubble – the central metadata management platform with a built-in certification engine.
- Hubble – 带有内置认证引擎的中央元数据管理平台。
- Genchi – the data quality observability platform.
- Genchi – 数据质量可观测性平台。
- Data Contract Registry – the central service for managing data contracts.
- Data Contract Registry – 用于管理数据合约的中央服务。
Together, these platforms turn data mesh principles into an operational system that scales across hundreds of thousands of datasets, streams, attributes, and metrics.
这些平台共同将 data mesh 原则转化为一个可扩展到数十万数据集、流、属性和指标的操作系统。
Hubble: The data discovery and governance layer
Hubble:数据发现和治理层
Hubble is Grab’s central metadata management platform and data catalog for all data assets, including datasets, dashboards, metrics, Machine learning (ML) models, and more. Built on top of the open‑source DataHub and heavily extended for Grab’s needs, it is the discovery and governance layer for the Signals Marketplace.
Hubble 是 Grab 的中央 metadata 管理平台和 data catalog,用于所有 data assets,包括 datasets、dashboards、metrics、Machine learning (ML) models 等。建立在开源 DataHub 之上,并为 Grab 的需求进行了大量扩展,它是 Signals Marketplace 的发现和治理层。

Figure 1. Hubble cataloging data assets across various data platforms in Grab.
图 1. Hubble 在 Grab 的各种数据平台中编目数据资产。
What Hubble does for data mesh
Hubble 对 data mesh 的作用
For cert...