使用 Gemini 进行 Android Journey Tests:CI 搭建与 11 周回顾

Android User Interface (UI) testing has a reputation problem. Engineers care about quality but the traditional approach to automated UI testing creates many problems. Tests referring to specific view IDs break when a designer moves a button or a developer refactors a component. Writing one test takes hours. Maintaining a suite of tests becomes someone’s full-time job.
Android 用户界面 (UI) 测试存在声誉问题。工程师们关心质量,但传统的自动化 UI 测试方法制造了许多问题。当设计师移动按钮或开发者重构组件时,引用特定 view ID 的测试就会失败。编写一个测试需要花费数小时。维护一套测试变成了某人的全职工作。
When Android Journeys powered by Gemini was announced, most Android teams hadn’t heard of it. It was in a pre-release canary feature drop, not the stable Android Studio channel, and the documentation was sparse. We wanted to know if it actually worked for us: Google’s AI UI testing tool built into Android Studio that lets you write tests in plain English instead of actual code. Not in a controlled demo environment. In a real production codebase, Ignite, REA Group’s customer-facing Android app, with real Continuous Integration (CI) infrastructure and a real team that has other things to do.
当由 Gemini 提供支持的 Android Journeys 宣布推出时,大多数 Android 团队都还没听说过它。它处于预发布的 canary 功能推送中,而不是稳定的 Android Studio 渠道,并且文档非常稀少。我们想知道它对我们是否真的有效:这是 Google 内置于 Android Studio 中的 AI UI 测试工具,可让您用纯英语而不是实际代码来编写测试。不是在受控的演示环境中。而是在真实的生产代码库 Ignite(REA Group 面向客户的 Android 应用)中,拥有真实的 Continuous Integration (CI) 基础设施和一个还有其他事情要做的真实团队。
Ignite is the self-service platform real estate agents, property managers, and principals use to manage listings, enquiries, inspections, and performance insights on the go. The experiment let us test whether AI-driven UI testing could speed up how we ship features and catch regressions earlier, enabling faster, more reliable delivery and fewer bugs reaching production.
Ignite 是房地产经纪人、物业经理和负责人使用的自助服务平台,用于随时随地管理房源、咨询、看房和业绩洞察。该实验让我们测试了 AI 驱动的 UI 测试是否能加快我们发布功能的速度并更早地发现回归问题,从而实现更快速、更可靠的交付,并减少流入生产环境的 bug。
We ran an 11-week experiment to find out. Google’s own error messages misled us, Firebase Test Lab couldn’t support it, CI setup con...