Agent Skills › openclaw/openclaw › openclaw-testing

openclaw-testing

GitHub

指导 OpenClaw 测试策略,涵盖 PR CI、本地验证及远程证明的选择。提供缺陷复现、代码变更检查及文档验证的触发场景与执行规范,确保高效且准确的测试覆盖。

.agents/skills/openclaw-testing/SKILL.md openclaw/openclaw

触发场景

需要选择或执行 OpenClaw 测试用例时 诊断测试失败原因并确定修复责任方时 评估环境敏感或发布级测试路由时

安装

npx skills add openclaw/openclaw --skill openclaw-testing -g -y
更多选项

非标准路径

npx skills add https://github.com/openclaw/openclaw/tree/main/.agents/skills/openclaw-testing -g -y

不安装直接使用

npx skills use openclaw/openclaw@openclaw-testing

指定 Agent (Claude Code)

npx skills add openclaw/openclaw --skill openclaw-testing -a claude-code -g -y

安装 repo 全部 skill

npx skills add openclaw/openclaw --all -g -y

预览 repo 内 skill

npx skills add openclaw/openclaw --list

SKILL.md

Frontmatter
{
    "name": "openclaw-testing",
    "description": "Choose proportional OpenClaw tests\/checks, diagnose failures, route environment-sensitive or release proof to its owner."
}

OpenClaw Testing

Proof policy

  • PR CI = default broad proof. Change builds + focused tests pass → open ready PR. CI runs broad suites; never delay PR for pre-PR suite runs.

  • Before PR, prove narrowly: touched tests with pnpm test <file> --maxWorkers=1, targeted typecheck, lint, format. Prefer local proof for trusted, bounded work when dependencies and current host capacity are qualified. Local execution is optional: a focused command can still load a large compiler graph or expand to broad lanes.

  • Choose remote proof deliberately. Use PR CI for broad proof; Crabbox/Testbox may cover expensive checks, a busy or unqualified local host, another OS/device, live providers/channels, long E2E, or heavy benchmarks. Acquire only when the command is ready and capacity is granted promptly. If queued, stop only the task-owned allocation; use PR CI or a safe local scope. Keep uncovered platform-specific proof pending. Never force heavy work onto a busy machine or chain providers. Use the smallest profile proven for the selected workload.

  • Never rerun or re-push just for green. Fix real failures; read available CI failure classification before attributing red.

  • Prove changed contract, complete required gates, finish. Broaden/repeat only for changed inputs, failures, or named unresolved risk.

  • Follow scoped AGENTS.md; authoring/reviewing tests: use boundary guide and test-audit.

Select the proof

  • Select proof for touched contract; reuse valid proof (rerun for changed inputs or missing coverage); finish workflow's required gates within user/host limits; report unrun checks and gaps. Prove user-visible behavior through real flow when feasible; external APIs need live contract proof; isolated mock-Gateway harness = valid channel boundary proof. Docs-only: docs sanity and git diff --check.

  • Runtime defect: reproduce real entry point; rerun it + relevant siblings.

  • Trusted source: pnpm changed:lanes --json, focused tests + targeted typecheck/lint/format; pnpm check:changed = optional smart local check.

  • Public SDK/plugin contract: representative consumers, not all-plugin sweep.

  • Build output, lazy imports, package boundaries: include pnpm build.

  • Workflow: git diff --check + pnpm check:workflows.

  • Docs only: relevant docs/link/format checks + git diff --check; no runtime tests.

  • Read on demand: local commands, Crabbox, OpenClaw remote setup, package/Docker proof, release CI, plugin release matrix, Docker authoring, channel skill/ Control UI E2E.

  • An isolated mock-Gateway harness is valid channel boundary proof; state live gaps. Prove user-visible behavior through the real flow when feasible; external APIs require live contract proof. Read the scoped channel/platform guide for live-channel or native-app work. Telegram claims require Test Server userbot proof with Convex-leased credentials. Platform claims require real-device evidence; macOS permission proof requires a stable signed app.

  • Release proof: preserve candidate/Tooling SHAs; never grants publication authority.

Source and state boundaries

  • Never execute untrusted contributor/fork code, wrappers, config locally. Use secretless fork CI or sanitized direct AWS through Crabbox; never credential-hydrated Testbox. Credentialed execution: maintainer approval after review required; never hydrate untrusted lease.
  • Isolated state + free port. Never restart, edit, or test operator Gateway/real data without explicit per-task approval. Preserve unrelated processes and shared dependency installs.
  • Concurrent test/check commands: separate OPENCLAW_VITEST_FS_MODULE_CACHE_PATH values or run serially; checks can run Vitest too. Repository wrappers only, never raw Vitest. Prepared linked worktrees: node scripts/run-vitest.mjs <file> --maxWorkers=1 avoids pnpm reconciliation; PR CI runs the broad checks.

CI failures

  • PR CI fails → pnpm test:ci-failed <pr>; read pre-existing/new/unknown classification.
  • Fix new failures; investigate unknown → pnpm test:ci-failed <pr> --run until selected tests pass locally → push once.
  • --run enables OPENCLAW_NODE_TEST_PLAN_CONTINUE_ON_FAILURE=1: collect ordinary failures across selected configs, while infrastructure failures still stop; use the same opt-in for manual focused reruns.
  • Pre-existing failures: failure-table landing rule. Matching signatures ≠ job-name-only attribution.
  • Never gh run rerun to chase green; never local full suite for CI repair.
  • Bind diagnosis to exact SHA + job. Fetch failed logs once; prefer exact run/job state over stale PR rollups.
  • Distinguish product, harness, infrastructure, credentials, superseded-run cancellation. Snapshots pass macOS/fail CI: reproduce Linux/Node bytes before regenerating.

Baseline and expected-failure exceptions

Narrow baseline, snapshot, ignore, and expected-failure exceptions are implementer decisions only when each entry is verified against source and the PR records its reason (for example, tool-owned metadata in an upgrade snapshot while user data stays exact). Never mask a real regression or user-data change. Blanket or unverified exceptions need approval. Exact shrink-only ratchet updates are maintenance.

Test failure policy

  • Failures = defects. Bounded reproduction attempt (same shard order first); identify owner; fix product, fixture, shared-state, ordering bugs.
  • Proven repair: add regression; cite another owner's fix when applicable.
  • Safe fix cannot be established/completed: record original failure, attempts, evidence, uncertainty in PR; continue under normal CI/review gates.
  • Unresolved failure alone neither blocks landing nor requires extra approval. Passing replay ≠ proven fix.
  • Never hide failures with retries, longer timeouts, weaker assertions, broader mocks, altered baselines.

版本历史

  • 8b78b23 当前 2026-10-20 00:20

    清理过时的 Agent 配置规则,移除冲突和重复的本地指南内容,统一遵循根目录最新规范。

  • 8e18591 2026-09-23 04:22

    简化维护者技能并同步共享工具;移除发布工作流检查中的技能散文断言;澄清变更检查中的定向测试说明;修复媒体上传指针循环并记录UI证明的容器设置路径。

  • 3374458 2026-08-20 13:29

同 Skill 集合

.agents/skills/agent-transcript/SKILL.md
.agents/skills/auto-qa/SKILL.md
.agents/skills/autoreview/SKILL.md
.agents/skills/channel-message-flows/SKILL.md
.agents/skills/claw-score/SKILL.md
.agents/skills/clawdtributor/SKILL.md
.agents/skills/clawsweeper/SKILL.md
.agents/skills/control-ui-e2e/SKILL.md
.agents/skills/crabbox/SKILL.md
.agents/skills/deslop/SKILL.md
.agents/skills/discord-clawd/SKILL.md
.agents/skills/discord-e2e/SKILL.md
.agents/skills/discord-user-post/SKILL.md
.agents/skills/discrawl/SKILL.md
.agents/skills/gitcrawl/SKILL.md
.agents/skills/graincrawl/SKILL.md
.agents/skills/notcrawl/SKILL.md
.agents/skills/openclaw-changelog-update/SKILL.md
.agents/skills/openclaw-ci-limits/SKILL.md
.agents/skills/openclaw-debugging/SKILL.md
.agents/skills/openclaw-docker-e2e-authoring/SKILL.md
.agents/skills/openclaw-ghsa-maintainer/SKILL.md
.agents/skills/openclaw-live-updater/SKILL.md
.agents/skills/openclaw-parallels-smoke/SKILL.md
.agents/skills/openclaw-performance/SKILL.md
.agents/skills/openclaw-pr-maintainer/SKILL.md
.agents/skills/openclaw-qa-testing/SKILL.md
.agents/skills/openclaw-refactor-docs/SKILL.md
.agents/skills/openclaw-release-validation/SKILL.md
.agents/skills/openclaw-repair-sweep/SKILL.md
.agents/skills/openclaw-secret-scanning-maintainer/SKILL.md
.agents/skills/openclaw-test-heap-leaks/SKILL.md
.agents/skills/openclaw-test-performance/SKILL.md
.agents/skills/openclaw-update/SKILL.md
.agents/skills/parallels-discord-roundtrip/SKILL.md
.agents/skills/plugin-sdk-impact/SKILL.md
.agents/skills/pr-simplify/SKILL.md
.agents/skills/proof-video/SKILL.md
.agents/skills/prototype-openclaw-tui/SKILL.md
.agents/skills/release-openclaw-announcement/SKILL.md
.agents/skills/release-openclaw-ci/SKILL.md
.agents/skills/release-openclaw-mac/SKILL.md
.agents/skills/release-openclaw-maintainer/SKILL.md
.agents/skills/release-openclaw-nightly/SKILL.md
.agents/skills/release-openclaw-plugin-testing/SKILL.md
.agents/skills/security-triage/SKILL.md
.agents/skills/slack-e2e/SKILL.md
.agents/skills/slacrawl/SKILL.md
.agents/skills/solid/SKILL.md

元信息

文件数
0
版本
8b78b23
Hash
f50ef0b2
收录时间
2026-08-20 13:29

首页 - Wiki
Copyright © 2011-2026 iteam. Current version is 2.156.0. UTC+08:00, 2026-11-21 16:32
浙ICP备14020137号-1