下一代的数据平台是数据网。

Here’s why.

原因就在这里。

As enterprises become more agile, centralization appears more and more as a thing of the past world, a waterfall world. The same appears to be true with data platforms. Therefore, we are building a Data Mesh, this next generation of data platforms for PayPal Credit. This post details the evolution of data platforms, highlights their problems, and why we decided to build a Data Mesh. I will detail the four principles of the Data Mesh, how to get started, look at the architecture, and describe some of the challenges.

随着企业变得更加灵活，集中化似乎越来越成为过去的世界，一个瀑布式的世界。数据平台似乎也是如此。因此，我们正在建立一个数据网，这个PayPal信贷的下一代数据平台。这篇文章详细介绍了数据平台的演变，强调了它们的问题，以及为什么我们决定建立一个数据网格。我将详细介绍数据网的四个原则，如何开始，看一下架构，并描述一些挑战。

Evolution of data platforms

数据平台的演变

Before diving in the details of the Data Mesh, let’s review how the information industry came to this situation.

在深入了解数据网的细节之前，让我们回顾一下信息产业是如何走到这一步的。

Sixty-five million years ago, dinosaurs… no, I will not go that far away in time. In 1971, Edgar Codd invented the third normal form, the key to relational databases. Soon after that, enterprises starting seeing the benefits of aggregating data, which opened the way to the creation of data warehouses.

六千五百万年前，恐龙......不，我不会走到那么远的时间。1971年，埃德加-科德（Edgar Codd）发明了第三种正常形式，这是关系型数据库的关键。此后不久，企业开始看到聚合数据的好处，这为数据仓库的建立开辟了道路。

With data warehouses came the need for more rigor in data management: you were creating a warehouse for data, so like in a logistics warehouse, aisles, shelves, and spaces must be clearly identified. You had to design the data warehouse to accommodate incoming data and build ETL (extract, transform, and load) processes to fill the warehouse. Enterprises were now capable to perform analytics to a new dimension. Unfortunately, warehouses are not very flexible and with the increasing number of data sources, onboarding data became complex.

有了数据仓库，就需要更严格的数据管理：你是在为数据创建一个仓库，所以就像在物流仓库一样，过道、货架和空间必须被清楚地识别。你必须设计数据仓库以适应传入的数据，并建立ETL（提取、转换和加载）流程来填充仓库。企业现在有能力将分析工作做到一个新的层面。不幸的是，仓库不是很灵活，随着数据源数量的增加，入库数据变得复杂。

Let’s imagine a retail company, Great Parts, with ...