Agent Skillsbrycewang-stanford/Awesome-Journal-Skills › arpsych-transparency-and-reproducibility

arpsych-transparency-and-reproducibility

GitHub

用于指导ARPsych综述中文献检索透明化及元分析可重复性。涵盖搜索协议报告、选择逻辑说明、PRISMA流程、数据代码归档及利益冲突披露,确保读者能验证文献筛选与定量合成过程。

Annual-Review-of-Psychology-Skills/skills/arpsych-transparency-and-reproducibility/SKILL.md brycewang-stanford/Awesome-Journal-Skills

Trigger Scenarios

撰写系统性文献检索并需保证可复现性时 嵌入元分析或新的定量合成时 决定存哪些材料(搜索日志、编码表等)时 需让读者或委员会验证文献选择过程时

Install

npx skills add brycewang-stanford/Awesome-Journal-Skills --skill arpsych-transparency-and-reproducibility -g -y
More Options

Non-standard path

npx skills add https://github.com/brycewang-stanford/Awesome-Journal-Skills/tree/main/Annual-Review-of-Psychology-Skills/skills/arpsych-transparency-and-reproducibility -g -y

Use without installing

npx skills use brycewang-stanford/Awesome-Journal-Skills@arpsych-transparency-and-reproducibility

指定 Agent (Claude Code)

npx skills add brycewang-stanford/Awesome-Journal-Skills --skill arpsych-transparency-and-reproducibility -a claude-code -g -y

安装 repo 全部 skill

npx skills add brycewang-stanford/Awesome-Journal-Skills --all -g -y

预览 repo 内 skill

npx skills add brycewang-stanford/Awesome-Journal-Skills --list

SKILL.md

Frontmatter
{
    "name": "arpsych-transparency-and-reproducibility",
    "description": "Use when documenting the literature search and making any embedded meta-analysis reproducible for an Annual Review of Psychology (ARPsych) review. Covers search transparency, meta-analytic rigor, and open materials; it does not run the narrative search (arpsych-literature-synthesis) or design exhibits (arpsych-tables-figures)."
}

Transparency & Reproducibility (arpsych-transparency-and-reproducibility)

When to trigger

  • The review documents a systematic search and you must report it reproducibly
  • The review embeds a meta-analysis or any new quantitative synthesis
  • You are deciding what to deposit (search log, coding sheet, effect-size data, code)
  • A reader or the Committee should be able to verify how the literature was selected

A review reports no new data — so transparency bites elsewhere

A pure narrative review has no dataset of its own, so the transparency obligation does not look like a primary-paper replication package. It bites on two things:

  1. How the literature was found and selected — the search protocol from arpsych-literature-synthesis, written up so a reader could reproduce the coverage.
  2. Any quantitative synthesis the review itself contributes — if you compute pooled effects, that is original analysis, and it must be reproducible (检索于 2026-06;以官网为准).

Post-replication-crisis, ARPsych readers expect both, and a review that asserts "the literature shows…" with no documented basis reads as less authoritative.

If the review is narrative (no meta-analysis)

  • Report the search: databases, terms, date range, inclusion/exclusion, and the stopping rule — a short, near-PRISMA-style account suffices.
  • State selection logic: why these studies and not others (especially when the field is large and you are selective).
  • Be explicit about replication status of contested effects (this is part of transparency, not just balance).

If the review embeds a meta-analysis

Then you have run original analysis and must meet quantitative-synthesis standards:

Requirement What to provide
PRISMA-style flow search → screening → included, with counts at each step
Coding protocol how effects were extracted/coded; inter-coder reliability
Effect-size dataset the extracted effects + moderators, deposited
Analysis code scripts reproducing the pooled estimates and plots
Heterogeneity + bias I², moderators, funnel/publication-bias diagnostics
Preregistration (if applicable) protocol/PROSPERO registration where the synthesis was prospective

Deposit data and code in a public repository (e.g., OSF) and cite the DOI in the review.

Required declarations (检索于 2026-06;以官网为准)

Annual Reviews requires authors to disclose potential sources of bias / conflicts of interest and to state funding; prepare these per the author pages. AI tools are not authors. Re-confirm the exact disclosure format on the live Annual Reviews pages.

Checklist

  • Search protocol written up reproducibly (databases, terms, dates, in/out, stopping rule)
  • Selection logic stated where coverage is selective
  • Replication status of contested effects made explicit
  • If meta-analytic: PRISMA-style flow with counts
  • If meta-analytic: coding protocol + inter-coder reliability reported
  • If meta-analytic: effect-size data + analysis code deposited (OSF DOI cited)
  • If meta-analytic: heterogeneity and publication-bias diagnostics reported
  • COI / potential-bias disclosure + funding prepared; AI not listed as author

Anti-patterns

  • "The literature shows…" with no documented search behind the claim
  • Reporting pooled effects with no deposited data or code (irreproducible meta-analysis)
  • A meta-analysis with no heterogeneity or publication-bias assessment
  • Treating a review's transparency like a primary-paper replication package (wrong object)
  • Omitting the conflict-of-interest / potential-bias disclosure Annual Reviews requires
  • Listing an AI tool as an author or hiding its use where disclosure is required

Output format

【Review type】narrative | embedded-meta-analysis
【Search transparency】protocol documented reproducibly? Y/N
【If meta-analysis】PRISMA flow + coding + reliability? Y/N
【Open materials】effect data + code deposited (OSF DOI)? Y/N | N/A
【Heterogeneity / bias】I² + funnel/pub-bias reported? Y/N | N/A
【Declarations】COI / bias disclosure + funding prepared; AI not author? Y/N
【Next step】→ arpsych-editor-strategy (align scope/timeline with the Editor)

Version History

  • 1839142 Current 2026-07-05 12:24

Same Skill Collection

AAAI-Skills/skills/aaai-artifact-evaluation/SKILL.md
AAAI-Skills/skills/aaai-author-response/SKILL.md
AAAI-Skills/skills/aaai-camera-ready/SKILL.md
AAAI-Skills/skills/aaai-experiments/SKILL.md
AAAI-Skills/skills/aaai-related-work/SKILL.md
AAAI-Skills/skills/aaai-reproducibility/SKILL.md
AAAI-Skills/skills/aaai-review-process/SKILL.md
AAAI-Skills/skills/aaai-submission/SKILL.md
AAAI-Skills/skills/aaai-supplementary/SKILL.md
AAAI-Skills/skills/aaai-topic-selection/SKILL.md
AAAI-Skills/skills/aaai-workflow/SKILL.md
AAAI-Skills/skills/aaai-writing-style/SKILL.md
AAMAS-Skills/skills/aamas-artifact-evaluation/SKILL.md
AAMAS-Skills/skills/aamas-author-response/SKILL.md
AAMAS-Skills/skills/aamas-camera-ready/SKILL.md
AAMAS-Skills/skills/aamas-experiments/SKILL.md
AAMAS-Skills/skills/aamas-related-work/SKILL.md
AAMAS-Skills/skills/aamas-reproducibility/SKILL.md
AAMAS-Skills/skills/aamas-review-process/SKILL.md
AAMAS-Skills/skills/aamas-submission/SKILL.md
AAMAS-Skills/skills/aamas-supplementary/SKILL.md
AAMAS-Skills/skills/aamas-topic-selection/SKILL.md
AAMAS-Skills/skills/aamas-workflow/SKILL.md
AAMAS-Skills/skills/aamas-writing-style/SKILL.md
Academy-of-Management-Annals-Skills/skills/amann-editor-strategy/SKILL.md
Academy-of-Management-Annals-Skills/skills/amann-evidence-standards/SKILL.md
Academy-of-Management-Annals-Skills/skills/amann-literature-synthesis/SKILL.md
Academy-of-Management-Annals-Skills/skills/amann-organizing-framework/SKILL.md
Academy-of-Management-Annals-Skills/skills/amann-proposal-framing/SKILL.md
Academy-of-Management-Annals-Skills/skills/amann-review-process/SKILL.md
Academy-of-Management-Annals-Skills/skills/amann-revision/SKILL.md
Academy-of-Management-Annals-Skills/skills/amann-submission/SKILL.md
Academy-of-Management-Annals-Skills/skills/amann-tables-figures/SKILL.md
Academy-of-Management-Annals-Skills/skills/amann-topic-selection/SKILL.md
Academy-of-Management-Annals-Skills/skills/amann-workflow/SKILL.md
Academy-of-Management-Annals-Skills/skills/amann-writing-style/SKILL.md
Academy-of-Management-Journal-Skills/skills/amj-contribution-framing/SKILL.md
Academy-of-Management-Journal-Skills/skills/amj-data-analysis/SKILL.md
Academy-of-Management-Journal-Skills/skills/amj-literature-positioning/SKILL.md
Academy-of-Management-Journal-Skills/skills/amj-methods/SKILL.md
Academy-of-Management-Journal-Skills/skills/amj-rebuttal/SKILL.md
Academy-of-Management-Journal-Skills/skills/amj-review-process/SKILL.md
Academy-of-Management-Journal-Skills/skills/amj-submission/SKILL.md
Academy-of-Management-Journal-Skills/skills/amj-tables-figures/SKILL.md
Academy-of-Management-Journal-Skills/skills/amj-theory-development/SKILL.md
Academy-of-Management-Journal-Skills/skills/amj-topic-selection/SKILL.md
Academy-of-Management-Journal-Skills/skills/amj-workflow/SKILL.md
Academy-of-Management-Journal-Skills/skills/amj-writing-style/SKILL.md
Academy-of-Management-Review-Skills/skills/amr-contribution-framing/SKILL.md
Academy-of-Management-Review-Skills/skills/amr-data-analysis/SKILL.md

Metadata

Files
0
Version
9f86f09
Hash
2fe5d39e
Indexed
2026-07-05 12:24

ホーム - Wiki
Copyright © 2011-2026 iteam. Current version is 2.155.2. UTC+08:00, 2026-07-30 04:20
浙ICP备14020137号-1 $お客様$