Agent Skills
› codeaholicguy/ai-devkit
› dev-smoke
dev-smoke
GitHub针对代码变更执行端到端冒烟测试,通过沙箱脚本验证用户流程。在单元测试通过后或需快速验证影响时使用,确保功能正常运行并报告结果。
Trigger Scenarios
需要验证代码变更对CLI、API或UI的影响
单元测试通过但缺乏端到端测试覆盖
用户要求进行冒烟、E2E或影响检查
Install
npx skills add codeaholicguy/ai-devkit --skill dev-smoke -g -y
SKILL.md
Frontmatter
{
"name": "dev-smoke",
"description": "AI DevKit · Smoke-test the user flows a change affects (CLI, API, UI) end to end with a disposable sandboxed script against the real app. Use before calling a feature or fix done, when unit tests pass but the flow is untested, or when users ask for a smoke, e2e, or impact check."
}
Smoke
Exercise the flows a change touches the way a user would, then throw the script away. Report with verify; use dev-testing for permanent tests.
Rules
- Drive the real entry point: built binary, running server, CLI, UI, or job. Imported functions and mocks are not smoke checks.
- Sandbox everything: temp dir, isolated
HOMEand config, empty git hooks, seeded test data, test accounts and tokens. - Never use production, shared environments, real accounts or credentials, or paid APIs. Ask before outward-facing side effects: messages, emails, webhooks, deploys, pushes.
- Start servers on a dedicated port, wait until they respond, and stop the whole process tree on exit. Never reuse or kill the user's own servers.
- Keep secrets out of the script and its output.
- Write the script outside the repo; commit it only if the user asks to promote it.
- Timebox setup. If the app cannot run locally, say what was not checked instead of faking a pass.
Workflow
- Read the change:
git diffagainst the base branch, plus untracked files. - Map impact outward: changed symbols -> callers -> entry points (commands, routes, screens, jobs, hooks, config, migrations) -> user flows. Add adjacent flows sharing the changed code, config, or data; note skipped flows and why.
- List scenarios as setup / action / expected result, ordered by risk. Wait for the user to add or cut flows; when running unattended, proceed and include the list in the report.
- Search memory for known setup:
npx ai-devkit@latest memory search --query "<project> smoke setup" --tags "smoke". Build once, then write the script fromreferences/smoke-template.sh(CLI, API) orreferences/web-smoke-template.mjs(browser). Each check asserts output, files, HTTP status, or exit code, not just "it ran"; API checks also assert the body and one error case (bad input, missing auth). Print PASS/FAIL per check and exit non-zero on any failure. - Run it and read the full output.
- On a failure, first rule out a wrong check (selector, timing, setup), then rerun it on the base commit in a separate worktree (
dev-worktree) to separate regressions from pre-existing failures. - Report with
verify: scenarios, command, exit code, per-check result, pre-existing failures, flows not covered. - Delete the script and sandbox, or offer to promote valuable checks into permanent tests or the project's release smoke suite. Store non-obvious setup:
npx ai-devkit@latest memory store --title "<project> smoke setup" --content "<start command, port, health URL, seeding, traps>" --tags "smoke".
UI and Web
- Use the harness's browser tool when available (for example Claude in Chrome or a Playwright MCP server); otherwise the web template, with Playwright installed in the sandbox.
- Use a fresh browser context per check, and act like a user: navigate, click, fill forms, submit.
- Assert visible content, URL, network status, and zero console errors, not just that the page loaded. Match visible elements by role or text; hidden duplicates (mobile menus, templates) cause false failures.
- UI impact includes shared components, layouts, global styles, and every route rendering the changed component. Check narrow viewports or dark mode when layout or theming changed.
- Save a screenshot per check as evidence, and read it before judging a failure.
- Not covered: native mobile apps, desktop apps, pixel-level visual diffs. Report them as unchecked.
Stop
Pause when impacted flows are unclear, a scenario needs anything the Rules forbid, setup needs destructive actions, or failures come from the environment rather than the change.
Version History
- d2e170a Current 2026-11-02 14:56


