通过度量感知的发布来保护应用健康和消费者体验
As part of our ongoing efforts to enhance product development while safeguarding app health and the consumer experience, we are introducing metric-aware rollouts for experiments. Metric-aware rollouts refer to established decision rules to flag issues with automated checks on standardized app quality metrics during the new feature rollout process.
作为我们不断努力提升产品开发的一部分,同时保障应用程序健康和消费者体验,我们正在引入基于指标的实验发布。基于指标的实验发布是指在新功能发布过程中,通过建立决策规则,在标准化应用质量指标上进行自动检查,以发现问题。
Every action DoorDash takes focuses on enhancing the consumer experience. Through deploying metric-aware rollouts, we aim to prevent performance degradation and other problems for our customers when we add new elements or products. This new feature allows us to experiment and innovate while continuing to safeguard app health and deliver a delightful user experience.
DoorDash所采取的每一项行动都专注于提升消费者体验。通过部署基于指标的实验发布,我们旨在在添加新元素或产品时,预防性能下降和其他问题对我们的客户造成影响。这一新功能使我们能够进行实验和创新,同时继续保障应用程序的健康,并提供愉悦的用户体验。
Product development inherently involves risks. Experimentation and rapid product releases can lead to unexpected consequences. At DoorDash, we have occasionally seen such unintended effects in the form of increased app latency, higher error rates, and — in extreme cases — app crashes. Shipping experiments could potentially degrade app latency, directly impacting the consumer experience, which is always at the forefront of our minds
产品开发本质上涉及风险。实验和快速产品发布可能导致意想不到的后果。在DoorDash,我们有时会看到这种意外效应,例如应用程序延迟增加、错误率提高,以及在极端情况下应用程序崩溃。发布实验可能会导致应用程序延迟增加,直接影响消费者体验,而消费者体验始终是我们首要考虑的。
The key issues before implementation of metric-aware rollouts include awareness, metrics and process standardization, and traceability. Lacking app quality metrics leaves experiment owners in the dark about app degradation. Without standardized metrics, app health tracking becomes inconsistent. Problematic rollouts are not paused or blocked when metrics degrade. Metric owners and app page owners don’t know which experiments are impacting metrics, meaning it can take several weeks to identify the cause of degradation. The...