← All tasks
T29 · Systematic Allocation

Factor Timing

Valentin Haddad et al. (3 authors), 2020 · The Review of Financial Studies

0%
pass@1 across 16 systems
0/16
systems with ≥1 successful attempt
0/5
no system produced a successful attempt
80 attempts · 16 systems × 5
Claude Code + Opus 5
0%
Claude Code + Opus 4.8
0%
Claude Code + Opus 4.7
0%
Codex + GPT-5.6-sol
0%
Codex + GPT-5.5
0%
OpenCode + Kimi-K3
0%
OpenCode + Opus 4.7
0%
OpenCode + GPT-5.5
0%
OpenCode + Sonnet 4.6
0%
OpenCode + Qwen3.7-Max
0%
OpenCode + GLM-5.2
0%
OpenCode + DeepSeek V4-Pro
0%
OpenCode + GLM-5.1
0%
OpenCode + Qwen 3.6 Plus
0%
OpenCode + MiniMax-M3
0%
OpenCode + MiniMax M2.7
0%
all checkers pass Type-A clean, Type-B fail fail checking timeout no result / incomplete
Strategy

What the paper asks for.

Time-varying expected returns of the market and five anomaly PCs are predictable from factor-specific book-to-market signals, so an unconstrained mean-variance factor-timing portfolio that sets monthly weights to Sigma^{-1} E_t[r_{t+1}] improves on static factor investing.

Type
fundamental
Implementation
pandas
Rebalance
monthly
Long-short
yes
Declared task setup
Data
Bundled public task data
Operational scope
Use the authors' 55-anomaly release, an aggregate market book-to-market proxy, and a mild ridge allowance for predictive regressions.
Six-stage quantitative strategy pipeline
  1. 01 Data loading
  2. 02 Feature engineering
  3. 03 Model fitting
  4. 04 Signal generation
  5. 05 Portfolio construction
  6. 06 Execution
Checker suite

19 properties · 80 attempts.

Each row is one requirement the strategy must satisfy. The bar reports the share of observed checker verdicts that pass; missing checker output is not converted into a property verdict.

TYPE A · DOMAIN-LEVEL (8)
  • A1
    no backfill
    75/77
  • A2
    no global normalize
    60/77
  • A3
    no future data access
    64/77
  • A4
    causal consistency
    65/77
  • A6
    train test temporal order
    64/77
  • A8
    transaction timing
    74/77
  • A9
    signal delay test
    77/77
  • A10
    e2e metric consistency
    0/77
TYPE B · PAPER-SPECIFIC (11)
  • B1
    anomaly decile count
    §Sec 3.1 “sort them into 10 value-weighted portfolios for each of the 50 characteristics”
    provenance · paper-explicit
    stage · feature eng
    77/77
  • B2
    long short 10 minus 1
    §Sec 3.1 “return on portfolio 10 minus the return on portfolio 1”
    provenance · paper-explicit
    stage · feature eng
    77/77
  • B3
    market adjustment beta in sample only
    §Sec 3.1 “betas ... are estimated using only the first half”
    provenance · paper-explicit
    stage · feature eng
    60/77
  • B4
    pca calibration window
    §Sec 3.2 “we estimate Q and Lambda using only the first half of the data”
    provenance · paper-explicit
    stage · model fit
    64/77
  • B5
    num pcs equals 5
    §Sec 3.2 “these five components jointly explain nearly two-thirds of the total variation in returns”
    provenance · paper-explicit
    stage · model fit
    77/77
  • B6
    factor set is market plus 5 pcs
    §Sec 3.2 “Z_{t+1} = (R_{mkt,t+1}, PC_{1,t+1} ... PC_{5,t+1})”
    provenance · paper-explicit
    stage · model fit
    73/77
  • B7
    univariate predictive regression own bm
    §Sec 3.3 “we construct a single predictor for each portfolio: we use its net book-to-market ratio”
    provenance · paper-explicit
    stage · model fit
    73/77
  • B8
    unconstrained mean variance weights
    §Eq. 10 “optimal portfolio weights are w_t = Sigma^{-1} E_t[Z_{t+1}]”
    provenance · paper-explicit
    stage · portfolio
    77/77
  • B9
    monthly rebalance frequency
    §Sec 3.1 “monthly returns from January 1974 to December 2017”
    provenance · paper-explicit
    stage · execution
    77/77
  • B10
    forecast formula affine
    §Sec 3.3 “standard predictive regressions on valuation ratios”
    provenance · paper-explicit
    stage · signal gen
    77/77
  • B11
    market adjustment applied before pca
    §Sec 3.1 & 3.2 “we market-adjust ... We construct PCs from the 50 anomaly portfolios”
    provenance · paper-explicit
    stage · feature eng
    76/77
What this task reveals

The lowest-passing observed requirement is e2e metric consistency: 0 of 77 observed checker verdicts pass. The full property list above shows whether errors concentrate in domain-level validity or the paper-specific strategy logic.