Agent Skills › google-gemini/gemini-cli › behavioral-evals

behavioral-evals

GitHub

指导创建、运行和修复 Agent 行为评估测试，用于验证决策逻辑、调试提示词偏移及防止回归。

.gemini/skills/behavioral-evals/SKILL.md google-gemini/gemini-cli

Trigger Scenarios

验证 Agent 决策逻辑调试提示词引导问题添加工作区回归测试

Install

npx skills add google-gemini/gemini-cli --skill behavioral-evals -g -y

More Options

Non-standard path

npx skills add https://github.com/google-gemini/gemini-cli/tree/main/.gemini/skills/behavioral-evals -g -y

Use without installing

npx skills use google-gemini/gemini-cli@behavioral-evals

指定 Agent (Claude Code)

npx skills add google-gemini/gemini-cli --skill behavioral-evals -a claude-code -g -y

安装 repo 全部 skill

npx skills add google-gemini/gemini-cli --all -g -y

预览 repo 内 skill

npx skills add google-gemini/gemini-cli --list

SKILL.md

Frontmatter

{
    "name": "behavioral-evals",
    "description": "Guidance for creating, running, fixing, and promoting behavioral evaluations. Use when verifying agent decision logic, debugging failures, debugging prompt steering, or adding workspace regression tests."
}

Behavioral Evals

Overview

Behavioral evaluations (evals) are tests that validate the agent's decision-making (e.g., tool choice) rather than pure functionality. They are critical for verifying prompt changes, debugging steerability, and preventing regressions.

[!NOTE] Single Source of Truth: For core concepts, policies, running tests, and general best practices, always refer to evals/README.md.

🔄 Workflow Decision Tree

Does a prompt/tool change need validation?
- No -> Normal integration tests.
- Yes -> Continue below.
Is it UI/Interaction heavy?
- Yes -> Use appEvalTest (AppRig). See creating.md.
- No -> Use evalTest (TestRig). See creating.md.
Is it a new test?
- Yes -> Set policy to USUALLY_PASSES.
- No -> ALWAYS_PASSES (locks in regression).
Are you fixing a failure or promoting a test?
- Fixing -> See fixing.md.
- Promoting -> See promoting.md.

📋 Quick Checklist

1. Setup Workspace

Seed the workspace with necessary files using the files object to simulate a realistic scenario (e.g., NodeJS project with package.json).

Details in creating.md

2. Write Assertions

Audit agent decisions using rig.setBreakpoint() (AppRig only) or index verification on rig.readToolLogs().

Details in creating.md

3. Verify

Run single tests locally with Vitest. Confirm stability locally before relying on CI workflows.

See evals/README.md for running commands.

📦 Bundled Resources

Detailed procedural guides:

creating.md: Assertion strategies, Rig selection, Mock MCPs.
fixing.md: Step-by-step automated investigation, architecture diagnosis guidelines.
promoting.md: Candidate identification criteria and threshold guidelines.