Pinterest的HBase弃用通知

Alberto Ordonez Pereira | Senior Staff Software Engineer; Lianghong Xu | Senior Manager, Engineering;

Alberto Ordonez Pereira | 高级软件工程师; Lianghong Xu | 高级经理, 工程;

This blog marks the first of a three-part series describing our journey at Pinterest transition from managing multiple online storage services supported by HBase to a brand new serving architecture with a new datastore and a unified storage service.

这篇博客是Pinterest的旅程的第一部分,描述了我们从管理多个由HBase支持的在线存储服务过渡到全新的服务架构的过程,其中包括新的数据存储和统一的存储服务。

In this introductory post, we will provide an overview of how HBase is used at Pinterest, why we decided to migrate away from it and the high-level execution path. The subsequent blog post will delve into how we looked into our specific needs, evaluated multiple candidates and decided on the adoption of a new database technology. Finally, the last entry in this series will describe how we modernized our serving layer by consolidating multiple independent storage services into a unified multi-model, multi-backend storage framework.

在这篇介绍性文章中,我们将概述HBase在Pinterest的使用方式,以及我们为什么决定迁移到其他数据库技术和高层次的执行路径。接下来的博客文章将深入探讨我们如何研究我们的特定需求,评估多个候选方案,并决定采用新的数据库技术。最后,本系列的最后一篇文章将描述我们如何通过将多个独立存储服务整合成统一的多模型、多后端存储框架来现代化我们的服务层。

Overview of HBase at Pinterest

Pinterest上的HBase概述

Introduced in 2013, HBase was Pinterest’s first NoSQL datastore. Along with the rising popularity of NoSQL, HBase quickly became one of the most widely used storage backends at Pinterest. Since then, it has served as a foundational infrastructure building block in our tech stack, powering a number of in-house and open-source systems including our graph service (Zen), wide column store (UMS), monitoring storage (OpenTSDB), metrics reporting (Pinalytics), transactional DB (Omid/Sparrow), indexed datastore (Ixia), etc. These systems together enabled numerous use cases that allowed Pinterest to significantly scale its business as we continued to grow our user base and evolve the products over the past 10 years. Examples include smartfeed, URL crawler, user messages, pinner notifications,...

开通本站会员,查看完整译文。

Accueil - Wiki
Copyright © 2011-2024 iteam. Current version is 2.137.1. UTC+08:00, 2024-11-15 12:16
浙ICP备14020137号-1 $Carte des visiteurs$