Pinterest Druid假日负载测试

Isabel Tallam | Senior Software Engineer; Jian Wang | Senior Software Engineer; Jiaqi Gu| Senior Software Engineer; Yi Yang | Senior Software Engineer; and Kapil Bajaj | Engineering Manager, Real-timeAnalytics team

Isabel Tallam | 高级软件工程师;Jian Wang | 高级软件工程师;Jiaqi Gu | 高级软件工程师;Yi Yang | 高级软件工程师;Kapil Bajaj | 工程经理,Real-timeAnalytics团队

Like many companies, Pinterest sees an increase in traffic in the last three months of the year. We need to make sure our systems are ready for this increase in traffic so we don’t run into any unexpected problems. This is especially important as Pinners come to Pinterest at this time for holiday planning and shopping. Therefore, we do a yearly exercise of testing our systems with additional load. During this time, we verify that our systems are able to handle the expected traffic increase. On Druid we look at several checks to verify:

像许多公司一样,Pinterest在一年的最后三个月里流量会增加。我们需要确保我们的系统为这一流量增长做好准备,这样我们就不会遇到任何意外问题。这一点尤其重要,因为品客在这个时候会到Pinterest进行假日计划和购物。因此,我们每年都会用额外的负载测试我们的系统。在这段时间里,我们验证我们的系统能够处理预期的流量增长。在Druid上,我们看了几个检查来验证。

  • Queries: We make sure the service is able to handle the expected increase in QPS while at the same time supporting the P99 Latency SLA our clients need.
  • 查询。我们确保服务能够处理预期增加的QPS,同时支持我们客户需要的P99延迟SLA。
  • Ingestion: We verify that the real-time ingestion is able to handle the increase in data.
  • 摄取。我们验证实时摄取是否能够处理数据的增加。
  • Increase in Data size: We confirm that the storage system has sufficient capacity to handle the increased data volume.
  • 数据量的增加。我们确认存储系统有足够的容量来处理增加的数据量。

In this post, we’ll provide details about how we run the holiday load test and verify Druid is able to handle the expected increases mentioned above.

在这篇文章中,我们将提供关于我们如何进行假期负载测试的细节,并验证Druid能够处理上述的预期增长。

Graph showing September through December with Pinterest traffic increases at the end of the year. Pins on the graph show users looking for inspiration for fall and winter holidays.

Pinterest traffic increases as users look for inspiration for holidays.

Pinterest的流量增加,因为用户在寻找假期的灵感。

How We Run Load Tests

我们如何进行负载测试

As mentioned above, the areas our teams focus on are:

如上所述,我们的团队关注的领域是。

  • Can the system handle increased query traffic?
  • 系统能否处理增加的查询流量?
  • Can the system handle the increase in data ingestion?
  • 系统...
开通本站会员,查看完整译文。

首页 - Wiki
Copyright © 2011-2024 iteam. Current version is 2.125.3. UTC+08:00, 2024-05-20 21:36
浙ICP备14020137号-1 $访客地图$