Agent Skills
› openai/plugins
› metric-pack-designer
metric-pack-designer
GitHub设计自定义指标包以扩展plugin-eval，支持团队添加本地评估标准。涵盖明确分类、定义最小有效载荷、创建清单与脚本及运行分析流程，遵循稳定ID和确定性信号等设计规范。
Trigger Scenarios
用户希望为plugin-eval添加本地评估标准
需要自定义可视化或评估规则
Install
npx skills add openai/plugins --skill metric-pack-designer -g -y
SKILL.md
Frontmatter
{
"name": "metric-pack-designer",
"description": "Design custom metric packs for plugin-eval so teams can add local evaluation rubrics that emit schema-compatible checks and metrics. Use when the user wants their own evaluation criteria or visualizations."
}
Metric Pack Designer
Use this skill when the user wants to extend plugin-eval with a local rubric.
Workflow
- Clarify the custom rubric categories and target kinds.
- Define the smallest useful
checks[]andmetrics[]payload. - Create a metric-pack manifest plus a script that prints JSON to stdout.
- Run the pack through
plugin-eval analyze <path> --metric-pack <manifest.json>.
Design Rules
- Keep IDs stable across runs so comparisons stay meaningful.
- Emit only
checks[],metrics[], and optionalartifacts[]. - Do not try to overwrite the core score or summary.
- Prefer deterministic local signals over subjective text generation.
Reference
../../references/metric-pack-manifest.md
Version History
- 11c74d6 Current 2026-07-19 09:43
