Grab 中的 Data Mesh 第 II 部分：认证背后的基础工具

Introduction

引言

In Part I, we discussed why Grab is investing in a data mesh, referred to as the Signals Marketplace within Grab, as part of our evolving data culture. We also explained how data certification aids teams in reliably reusing data across different domains. However, cultural change doesn’t occur through principles alone; it happens when tools reshape people’s daily behaviors. Therefore, it is crucial for us to develop effective platforms that integrate these practices.

在第一部分中，我们讨论了为什么 Grab 正在投资数据网格，即 Grab 内部称为Signals Marketplace的数据网格，作为我们不断演进的数据文化的一部分。我们还解释了数据认证如何帮助团队可靠地在不同域之间重用数据。然而，文化变革不仅仅通过原则发生；它发生在工具重塑人们日常行为时。因此，对我们来说，开发整合这些实践的有效平台至关重要。

This follow-up focuses on these platforms that make certification work at Grab:

这篇后续文章重点介绍使 Grab 的认证机制发挥作用的这些平台：

• Hubble – the central metadata management platform with a built-in certification engine.
• Hubble – 内置认证引擎的中央元数据管理平台。
• Genchi – the data quality observability platform.
• Genchi – 数据质量可观测性平台。
• Data Contract Registry – the central service for managing data contracts.
• Data Contract Registry – 用于管理数据契约的中央服务。

Together, these platforms turn data mesh principles into an operational system that scales across hundreds of thousands of datasets, streams, attributes, and metrics.

这些平台共同将 data mesh 原则转化为可跨数十万数据集、流、属性和指标扩展的操作系统。

Hubble: The data discovery and governance layer

Hubble：数据发现和治理层

Hubble is Grab’s central metadata management platform and data catalog for all data assets, including datasets, dashboards, metrics, Machine learning (ML) models, and more. Built on top of the open‑source DataHub and heavily extended for Grab’s needs, it is the discovery and governance layer for the Signals Marketplace.

Hubble 是 Grab 的中央元数据管理平台和数据目录，用于所有数据资产，包括数据集、仪表板、指标、机器学习 (ML) 模型等。它基于开源 DataHub 构建，并针对 Grab 的需求进行了大量扩展，是 Signals Marketplace 的发现和治理层。

Figure 1. Hubble cataloging data assets across various data platforms in Grab.

图 1. Hubble 在 Grab 的各种数据平台中编目数据资产。

What Hubble does for data mesh

Hubble 为 data mesh 做了什么

For certification and data mesh, Hubble provides a few key capabilities:

对...