Agent SkillsalphaXiv/OpenResearch › orx-evidence

orx-evidence

GitHub

用于准备和检查实验运行证据的技能。通过设计 stdout 指标与摘要,使用 orx logs 读取持久化结果,并在报告前验证日志完整性与有效性,确保实验结论有据可依。

agent-skills/orx-evidence/SKILL.md alphaXiv/OpenResearch

触发场景

启动需验证输出的实验前 实验结束后检查结果 分析或汇报实验结果前

安装

npx skills add alphaXiv/OpenResearch --skill orx-evidence -g -y
更多选项

非标准路径

npx skills add https://github.com/alphaXiv/OpenResearch/tree/main/agent-skills/orx-evidence -g -y

不安装直接使用

npx skills use alphaXiv/OpenResearch@orx-evidence

指定 Agent (Claude Code)

npx skills add alphaXiv/OpenResearch --skill orx-evidence -a claude-code -g -y

安装 repo 全部 skill

npx skills add alphaXiv/OpenResearch --all -g -y

预览 repo 内 skill

npx skills add alphaXiv/OpenResearch --list

SKILL.md

Frontmatter
{
    "name": "orx-evidence",
    "description": "Prepare and inspect experiment run evidence: design stdout metrics and summaries, read persisted results with `orx logs`, and validate run-derived claims. Use before launching a run whose output must be judged, after a run finishes, or before analyzing or reporting run results."
}

Run logs are the evidence channel. Make the run command print everything needed to judge the result, then read it back with orx logs.

Reading run logs — orx logs

A run's terminal output is captured live while it runs and persisted afterwards.

orx logs <runId>                    # tail (the end — usually what you want)
orx logs <runId> --head             # read from the start instead
orx logs <runId> --bytes 200000     # raise the byte cap (default 64 KB, max 1 MB)
orx logs <runId> --range 4096:8192  # exact byte window [start, end)
  • The log goes to stdout; a [source] bytes a–b of N status line goes to stderr, noting if content was truncated above or below.
  • <runId> comes from orx runs <projectId>.

Make the run print its own evidence

Print everything needed to stdout: final metrics, a compact summary, and the key configuration. If a run's result is not in its log, it cannot be inspected later.

  • Print final metrics and a compact summary block at the end of the run, not just scattered during training.
  • Echo the configuration the run actually used so the log identifies the variant.
  • For a long run, print periodic one-line metrics so its trajectory remains visible through byte-range reads.

Validate before reporting

Never infer a result from run status or memory. Before accepting or reporting a run-derived claim, confirm that:

  • the log identifies the variant and effective configuration;
  • the final metric and compact summary are present;
  • the relevant trajectory is recoverable for a long run; and
  • the returned byte window actually contains the supporting output.

Truncated output is not evidence of absence. Use --head, --bytes, or --range until the relevant portion has been read. Format the resulting chat response using the evidence-and-links contract in the session playbook.

版本历史

  • 24e404e 当前 2026-09-21 23:52

同 Skill 集合

agent-skills/orx-agent-delegation/SKILL.md
agent-skills/orx-compute/SKILL.md
agent-skills/orx-create/SKILL.md
agent-skills/orx-customize/SKILL.md
agent-skills/orx-experiment-tree/SKILL.md
agent-skills/orx-figures/SKILL.md
agent-skills/orx-git/SKILL.md
agent-skills/orx-instances/SKILL.md
agent-skills/orx-lit-review/SKILL.md
agent-skills/orx-paper/SKILL.md
agent-skills/orx-reports/SKILL.md

元信息

文件数
0
版本
24e404e
Hash
1a13fac7
收录时间
2026-09-21 23:52

首页 - Wiki
Copyright © 2011-2026 iteam. Current version is 2.155.2. UTC+08:00, 2026-09-22 05:42
浙ICP备14020137号-1