← All tasks
T23 · Event-Driven Trading
Days to Cover and Stock Returns
Harrison Hong et al. (5 authors), 2015 · National Bureau of Economic Research
34%
pass@1 across 16 systems
12/16
systems with ≥1 successful attempt
5/5
5/5 attempts passed for the best system
80 attempts · 16 systems × 5
Claude Code + Opus 5
80%
Claude Code + Opus 4.8
20%
Claude Code + Opus 4.7
20%
Codex + GPT-5.6-sol
20%
Codex + GPT-5.5
100%
OpenCode + Kimi-K3
40%
OpenCode + Opus 4.7
20%
OpenCode + GPT-5.5
60%
OpenCode + Sonnet 4.6
40%
OpenCode + Qwen3.7-Max
80%
OpenCode + GLM-5.2
0%
OpenCode + DeepSeek V4-Pro
0%
OpenCode + GLM-5.1
20%
OpenCode + Qwen 3.6 Plus
0%
OpenCode + MiniMax-M3
40%
OpenCode + MiniMax M2.7
0%
all checkers pass Type-A clean, Type-B fail fail checking timeout no result / incomplete
Strategy
What the paper asks for.
Sort common stocks each month by days-to-cover, computed as short interest divided by average daily share turnover, then hold an equal-weight long-low DTC / short-high DTC portfolio for the following month.
- Type
- fundamental
- Implementation
- pandas
- Rebalance
- monthly
- Long-short
- yes
Declared task setup
- Data
- One-command fetcher for WRDS-sourced task data
- Operational scope
- Fix WRDS/CRSP short-interest, shares, turnover, split, unit, and monthly-alignment conventions before evaluation.
Six-stage quantitative strategy pipeline
- 01 Data loading
- 02 Feature engineering
- 03 Model fitting
- 04 Signal generation
- 05 Portfolio construction
- 06 Execution
Checker suite
19 properties · 80 attempts.
Each row is one requirement the strategy must satisfy. The bar reports the share of observed checker verdicts that pass; missing checker output is not converted into a property verdict.
TYPE A · DOMAIN-LEVEL (9)
- A1no backfillstage · data loading77/77
- A2no global normalizestage · feature eng76/77
- A3no future data accessstage · signal gen68/77
- A4causal consistencystage · signal gen66/77
- A5no survivorship biasstage · data loading75/77
- A7data frequency alignmentstage · feature eng75/77
- A8transaction timingstage · execution65/77
- A9signal delay teststage · signal gen68/77
- A10e2e metric consistency31/77
TYPE B · PAPER-SPECIFIC (10)
- B1dtc formula§§II.A line 1252-1257 “Our baseline DTC measure divides the SR by the daily turnover ratio averaged within a month”provenance · paper-explicitstage · feature eng77/77
- B2average daily turnover formula§§II.A line 1255 “The daily turnover ratio is averaged within a month to get a monthly variable”provenance · paper-explicitstage · feature eng72/77
- B3decile sort n quantiles§Table 3 “decile portfolios sorted on DTC”provenance · paper-explicitstage · signal gen73/77
- B4cross sectional sort per month§Table 3 caption “Each month, we sort all stocks into decile portfolios based on DTC”provenance · paper-explicitstage · signal gen75/77
- B5long short assignment§Table 3 “long-short = decile 1 − decile 10”provenance · paper-explicitstage · signal gen65/77
- B6equal weight within leg§Table 3 “equal-weighted DTC long-short = 1.19% per month”provenance · paper-explicitstage · portfolio65/77
- B7one month lag signal to return§Table 3 footnote “monthly long-short returns formed from sorts on prior-month DTC”provenance · paper-explicitstage · signal gen65/77
- B8universe filter exchanges and sharecodes§§II.A line 1255 “We require stocks to be listed on NYSE, AMEX and NASDAQ and common stocks (i.e. share type code equals to 10 or 11)”provenance · paper-explicitstage · data loading77/77
- B9shortint uses split adjusted§§II.A line 1207-1228 “Short interest is measured as a fraction of shares outstanding”provenance · benchmark-specifiedstage · feature eng67/77
- B10long short dollar neutral§Table 3 “decile 1 minus decile 10”provenance · paper-explicitstage · portfolio70/77
What this task reveals
The lowest-passing observed requirement is e2e metric consistency: 31 of 77 observed checker verdicts pass. The full property list above shows whether errors concentrate in domain-level validity or the paper-specific strategy logic.