qje-robustness
GitHub专为QJE论文构建稳健性检验与在线附录，按优先级防御识别、样本、测量等威胁。利用无页码限制优势，提供详尽且逻辑清晰的附录结构，预判审稿人质疑，区分正文与附录内容，指导执行统计检查。
Trigger Scenarios
Install
npx skills add brycewang-stanford/Awesome-Journal-Skills --skill qje-robustness -g -y
SKILL.md
Frontmatter
{
"name": "qje-robustness",
"description": "Use when building the robustness suite and online appendix for a Quarterly Journal of Economics (QJE) manuscript — the extensive checks QJE referees expect, exploiting the journal's no-page-limit norm. Plans and prioritizes robustness; it does not change the core identification design."
}
Robustness & Online Appendix (qje-robustness)
When to trigger
- The main result exists but the robustness section / online appendix is thin
- You want to pre-empt the "what about X?" referee report
- You are unsure which checks are load-bearing vs. padding
- The appendix is a pile of tables with no organizing logic
QJE expectation: an exhaustive, organized appendix
QJE imposes no hard page limit and the modern QJE empirical paper carries a very extensive online appendix — the Chetty–Hendren neighborhoods papers (QJE 2018) and Chetty–Hendren–Kline–Saez (QJE 2014) are the genre standard, with online appendices dwarfing the printed text. A short robustness section signals an unfinished paper. But volume is not the goal — anticipation is. The appendix should answer, in advance, every serious threat a smart referee would raise, organized so the handling Editor can find each answer fast. Note: at submission everything ships in one PDF (no separate appendix file at the initial stage), so the appendix must be cleanly sectioned within that document. Lead with the checks that defend the identifying assumption, then measurement, then specification.
Robustness priority ladder (defend in this order)
- Identification threats first. The checks that defend exogeneity: pre-trends, placebo timing/outcomes, falsification where the channel is absent, alternative control groups, donor-pool / synthetic checks. These are not optional.
- Selection & sample. Attrition, sample-definition sensitivity, alternative inclusion windows, trimming/winsorizing, outlier robustness.
- Measurement. Alternative outcome/treatment definitions, alternative data sources, measurement-error bounds.
- Specification. Functional form, fixed-effects structure, controls in/out (and a discussion that the estimate is not control-sensitive), clustering alternatives.
- Inference. Wild-cluster bootstrap with few clusters, randomization inference, multiple-hypothesis corrections across outcomes/subgroups.
- Magnitude & external validity. Benchmark the effect size against the literature; show where the result does and does not extend.
What goes in the body vs. the appendix
| Goes in the main text | Goes in the online appendix (same PDF at submission) |
|---|---|
| The one or two checks that make or break the design | The full battery of alternative specs |
| The headline robustness figure (e.g., event study) | All variant tables, by category |
| A sentence summarizing each appendix result | Data construction, variable definitions, extra proofs |
Execution bridge (StatsPAI / Stata MCP)
Run the robustness battery, don't just enumerate it. Full map:
shared-resources/empirical-methods/execution-with-mcp.md. QJE instantiation:
- Many outcomes / specifications:
romano_wolf(step-down, FWER, accounts for cross-test correlation) orbenjamini_hochberg— report the adjusted threshold, not a grid of naive stars. - OVB sensitivity:
oster_delta/sensemakr— quantify the confounder strength that would overturn the headline. - Inference:
wild_cluster_bootstrapwith few clusters;twoway_cluster/conleywhere the dependence structure demands it. - Re-fit off one handle:
audit_result(result_id)lists the missing checks and the exactsuggest_functionto run for each — no guessing the battery. - Emit appendix-ready exhibits with
etable/did_summary_to_latex.
Keep the decisive checks in the body and the exhaustive (now actually-run) battery in
the appendix; preserve the scripts for qje-replication-package.
Checklist
- Every identification threat has a corresponding check, named and reported
- Pre-trends / placebo / falsification evidence is in the body, not buried
- Estimate shown to be insensitive to reasonable specification choices
- Few-cluster / multiple-hypothesis inference handled
- Appendix is organized by threat category, not dumped chronologically
- Appendix is cleanly sectioned within the single submission PDF
- Each appendix result is referenced and one-line-summarized in the main text
- Magnitudes benchmarked against prior estimates in the literature
Anti-patterns
- A two-paragraph robustness section in a paper claiming a causal effect (QJE's no-page-limit norm leaves no excuse)
- Appendix tables with no narrative linking them to specific threats
- Reporting only the checks that pass; hiding the fragile specification
- "Results are robust to a battery of checks (see Appendix)" with no specifics in text
- Padding the appendix with redundant specifications instead of addressing real threats
Output format
【Identification checks】[pre-trends, placebo, falsification, alt controls, ...]
【Selection/sample checks】[...]
【Measurement checks】[...]
【Specification checks】[...]
【Inference checks】[wild-cluster, RI, MHT, ...]
【Body vs. appendix split】what stays in text
【Gaps to close】[...]
【Next step】qje-tables-figures
Version History
- 1839142 Current 2026-07-05 14:18
