Web性能回归检测（第3部分）

Michelle Vu; Web Performance Engineer |

Michelle Vu; 网络性能工程师 |

In this article we will focus on the systems we have in place to proactively detect and prevent regressions from being fully released in production.

在本文中，我们将重点介绍我们所采取的措施，以主动检测和防止回归在生产环境中完全发布。

A/B Experiment Checks

A/B实验检查

Collecting performance metrics internally allows us to pipe these logs into our internal experiments framework. Pinterest has an excellent culture of wrapping any major user-impacting changes in an A/B experiment, which enables us to detect the performance impact of these changes. Below, we will describe how experiment regressions are detected and handled.

内部收集性能指标使我们能够将这些日志导入我们的内部实验框架。Pinterest在将任何重大影响用户的更改包装成A/B实验方面有着良好的文化，这使我们能够检测到这些更改的性能影响。下面，我们将描述如何检测和处理实验回归。

Graded Experiment Regressions

分级实验回归

Experiments that show a significant performance regression for five or more days of the last seven days of the experiment trigger Sslack alerts and Jira tickets, which communicate information about the regression and track progress towards fixing it. Thresholds are defined per metric to grade the regression and a specific set of next steps covering experiment ramping, investigation, mitigation, and tradeoff discussions are defined for each severity level (e.g., experiment ramping is blocked for high severity regressions).

在过去七天的实验中，如果出现五天或更多天的显著性能回归，将触发Slack警报和Jira工单，以传达有关回归的信息并跟踪修复进度。每个指标都定义了阈值来评估回归，并为每个严重程度级别定义了一组特定的下一步操作，包括实验逐步增加、调查、缓解和权衡讨论（例如，对于高严重性回归，实验逐步增加被阻止）。

Figure 9: Example Jira ticket that is automatically generated when a performance regression is detected in an A/B experiment

图9：当检测到A/B实验中的性能回归时，自动生成的示例Jira工单

Experiments Dashboard

实验仪表板

For every experiment, we show all of the top line performance metrics in the main dashboard of core metrics. This shows the relative percentage increase (red) or decrease (blue) for each PWT and Core Web Vital metric:

对于每个实验，我们在核心指标的主要仪表板中显示所有顶级性能指标。这显示了每个PWT和核心Web Vital指标的相对百分比增加（红色）或减少（蓝色）：

Figure 10: Top line performance metrics shown in the main dashboard for A/B experiments

图10：A/B实验主仪表板中显示的...