The Academic Audit
Measured odds. No trade calls. what this means →
We re-ran the famous published quant factors — Betting-Against-Beta, low-volatility, the 52-week-high effect, book-to-market value — on a survivorship-free, cost-aware 2005–2026 panel. Most of them failed.
- 51 failed after costs
- 4 validated factor-legs
- 2 provisional
We re-ran the famous published quant factors. Most of them failed.
We took well-known strategies from the academic and practitioner literature — the kind catalogued on QuantPedia and QuantConnect, each tracing back to a published paper — and tested them the honest way: on a survivorship-free US equity panel (delisted names such as SIVBQ, FRCB, TWTR, ATVI and SGEN retained; ETFs/ETNs and leveraged/inverse products removed), with modelled, liquidity-aware costs, over a common 2005–2026 out-of-sample window.
The result is deflationary. Most of the celebrated cross-sectional factors — Betting-Against-Beta, the low-volatility effect, the 52-week-high effect, book-to-market value — turned net-negative once costs and delisted losers were put back in. Of the 57 strategies we could adjudicate, only 4 survived — and each only as a diversifying, market-neutral factor-leg. Every survivor loses money in its worst year. None is a standalone strategy.
We tested and adjudicated 57 published academic/QuantPedia strategies on a survivorship-free 2005-2026 US/FX/ETF panel with modelled costs (incl. short interest acquired from FINRA's public API). 51 failed; 4 survived as validated market-neutral factor-legs (all diversifiers with a losing worst year - none standalone); 2 remain provisional. A further 9 strategies are withheld because we could neither confirm nor refute them (missing data / no qualifying securities).
How to read this
This audit is deliberately unglamorous. Before reading any result, read these caveats — they change what the numbers mean.
- DOLLAR FIGURES ARE NOT RETURNS: every net_notional_21y is a 21-year gross-notional P&L sum at fixed-$-per-position sizing (the SAME convention that makes trend-following look like $948M). It is not a capital return and not annualized. Judge strategies by RF, placebo percentile and worst-year RF — never by the dollar figure.
- ALL genuine legs have a NEGATIVE worst-year RF (-0.65 to -0.81): each loses money in its worst year and is only useful COMBINED in a diversified book. None is a standalone tradeable strategy.
- Long/short factors are market-neutral; buy&hold is NOT their benchmark and is reported only as context for long-only/beta strategies.
- Costs are MODELLED (liquidity-aware spread by $ADV + commission), not live fills; no short-leg borrow/locate or market impact.
- Window is 2005-2026 only — post-publication, out-of-sample vs the source papers (which start earlier). A factor failing here does not refute the paper; a factor passing is regime-conditional.
- Placebo pass line (~P95) is within basket-sampling noise: marginal genuines sit within a few baskets of rejected items.
What "validated" means here: the strategy clears three independent bars — a survivorship-free/immune panel, a placebo rank-skill test at or above the 95th percentile (its real net beats 95%+ of random same-size baskets), and cost-aware net — *and* survives adversarial refutation. It is still only a diversifying factor-leg with a losing worst year, not a deployable book on its own.
Validated factor-legs (4)
- Consistent Momentum Strategy: momentum restricted to consistent-return stocks clears placebo P100 as real rank-skill, but is a crash-prone, long-leg-driven diversifier (worst-year RF -0.90).
- Earnings Quality Factor: low-accrual long/short survives survivorship-free + placebo P100 on point-in-time fundamentals; genuine one-sided rank-skill, crash-prone (worst-year RF -0.65).
- FX Carry Trade: classic carry clears placebo P97 as a real risk premium, but marginal (RF 0.99) and concentrated in the 2022–2026 rate regime; a textbook crowded crash trade.
- Size Factor - Small Capitalization Stocks Premium: the size premium survives placebo P100, but measured only on liquid large/mid names, not the microcap tail where the textbook premium actually lives.
Provisional (2)
- Momentum Factor Combined with Asset Growth Effect: passes placebo P100 but is graded SLEEVE_ONLY, very crash-prone and year-concentrated (worst-year RF -0.96).
- R&D Expenditures and Stock Returns: passes placebo P100 but is graded SLEEVE_ONLY, the most crash-prone of the set (worst-year RF -0.97) and rebalance-fragile.
Failed (51)
- Leveraged Etfs Systematic Risk Mgmt: a market-timing overlay with no rank-skill test (worst-year RF -0.96); beta, not alpha.
- Momentum and Reversal Combined with Volatility Effect in Stocks: has real rank-skill (placebo P99.5) but RF is only 0.94 and net far below passive; statistically significant yet economically uninvestable.
- Momentum Effect in Stocks in Small Portfolios: a real cross-sectional signal that is structurally tail-fragile: fails the Rule-26 jackpot test and carries the worst worst-year (-0.87) from an extreme 10-name long/short concentration.
- Paired Switching: thin placebo margin (P96), only 84 trades and a single 2016 jackpot year; too fragile to call genuine.
- Qp Market Seasonality Sell In May: a real calendar seasonal, but simply half-year reduced-beta market exposure (worst-year RF -1.0), not market-neutral alpha.
- Pre-Holiday Effect: the drift is real and survives cost stress but nets only ~$760/yr; economically negligible, not tradeable standalone.
- Asset Class Trend-Following: SPY-only trend rule; passive buy&hold beats it 4x (worst-year RF -1.0); reduced beta/timing, not alpha.
- Qpqc Hp Lowfreq Momentum: 5 of 6 FX pairs are net-negative; only USDCHF passes, and only on 9 trades; a multiple-testing artifact.
- Qpqc Risk Premia Fx: the 4-pair FX portfolio is net-negative; only USDJPY passes in isolation; a single-pair cherry-pick.
- CAPM Alpha Ranking Strategy on Dow 30 Companies: within-universe rank-skill is real (P97), but the current-Dow-30 universe is survivorship-biased and cannot be confirmed genuine without point-in-time membership.
- Combining Smart Factors Momentum and Market Portfolio: contains an explicit long market-portfolio leg, so it is not market-neutral; its return is dominated by equity beta.
- Industry Momentum - Riding Industry Bubbles: long-only (carries full equity beta) plus a partial-2026 stub contributing ~23% of P&L; a beta-plus-jackpot result, not a clean factor-leg.
- Rotation Strategy for SPY, EEM, EFA, TLT, and GLD: no rank-skill beyond the ETF basket itself (placebo P49); diversified beta, not alpha.
- Trend-following Effect in Stocks: the headline $948M is an artifact of fixed-$-per-position sizing; passive buy&hold beats it 9x and the selection placebo is only P96; beta/timing dominated.
- Asset Class Momentum Rotational System: placebo P58 (no rank-skill) and an equal-weight hold of all seven ETFs beats it; the momentum ranking adds nothing over beta.
- Pairs Trading With Country Etfs: RF 0.04 (flat) with max drawdown far above lifetime net; cost-fatal, the four-fill round-trip eats the spread.
- Short Interest Effect Long Short Version: the long/short is net-negative on FINRA data because the short-crowded leg was run over in the 2019–2026 meme-squeeze era.
- 12 Month Cycle in Cross-Section of Stocks Returns: annual return-seasonality ranking is net-negative (placebo P10); no tradeable edge after costs.
- 52-Weeks High Effect in Stocks: ranks at placebo P0 and turns net-negative after costs and delistings; a famous factor that is not free alpha in naive decile form.
- Accrual Anomaly: Sloan accruals long/short is net-negative on the survivorship-free panel; post-publication decay, no edge after costs.
- Asset Growth Effect: net-negative despite marginal rank-skill (placebo P92); the effect does not survive costs.
- Betting Against Beta Factor In Country Equity Indexes: net-negative at placebo P1; the same beta-bleed problem as the single-stock version.
- Betting Against Beta Factor in Stocks: placebo P0 and structurally short market beta, so it bleeds the equity premium every bull year; the famous factor is not investable in naive decile form.
- Combining Fundamental FSCORE and Equity Short-Term Reversals: a textbook survivorship artifact: positive on the biased panel, net-negative once delisted losers are included.
- Currency Momentum Factor: net-negative at placebo P40; no robust cross-sectional currency-momentum edge in our G10 spot data.
- Earnings Announcement Premium: real rank-skill (placebo P100) but the long/short net is negative after costs; cost-fatal on the required turnover.
- Fomc Meeting Effect Primary: the pre-FOMC drift on SPY fails the screen gate; the documented drift does not clear costs as ported.
- Fomc Meeting Effect Variant: the alternative pre-FOMC window also fails the gate; no robust tradeable FOMC-window edge net of costs.
- G-Score Investing: net-negative at placebo P1; no growth-quality edge after costs and delistings.
- Low Volatility Factor Effect in Stocks: placebo P0; the naive decile form is dominated by the short-high-vol leg and fails badly after costs.
- Momentum Factor And Style Rotation Effect: net-negative at placebo P23; no rank-skill beyond noise.
- Momentum Factor Effect In Stocks: plain 12-1 momentum is roughly flat after costs and delistings; the canonical factor barely clears zero in naive decile form.
- Net Payout Yield Effect: net-negative at placebo P15; no payout edge after costs.
- Option-Expiration Week Effect: the calendar effect on SPY fails the screen gate; no tradeable net after costs.
- Pairs Trading with Stocks: net-negative at placebo P52; the classic edge is arbitraged away and cost-fatal on modern spreads.
- Post-Earnings Announcement Effect: real rank-skill (placebo P94) but small-cap-concentrated and net-negative after costs; not tradeable at liquid-ADV scale.
- Qc Dynamic Breakout Ii: an adaptive channel-breakout on ES fails the screen gate; a technical rule with no persistent edge after costs.
- Qc Ichimoku Energy: Ichimoku signals on XLE fail the screen gate; no edge over holding the sector.
- Intraday ETF Momentum: RF -1.0 with 0/14 positive years; the last-half-hour effect does not survive costs on SPY.
- Qp Intraday Seasonality Bitcoin: time-of-day seasonality fails the screen gate after taker fees; no robust hour-of-day edge net of crypto costs.
- Qpqc Dual Thrust: an intraday range-breakout on ES fails the screen gate; a well-known technical rule with no persistent post-cost edge.
- Residual Momentum Factor: net-negative at placebo P0; residualization removes exactly the part that carried plain momentum.
- Reversal During Earnings-Announcements: net-negative at placebo P27; dominated by cost and adverse selection.
- Reversal in Post-Earnings Announcement Drift: real gross rank-skill (placebo P96) but net-negative on the two-day round-trip; cost-fatal.
- ROA Effect within Stocks: net-negative at placebo P54; gross alpha near zero in our point-in-time data, no edge after costs.
- Sector Momentum Rotational System: no rank-skill beyond the sector basket (placebo P46); diversified beta, not alpha.
- Short Term Reversal In Stocks: a real gross effect destroyed by the monthly turnover it requires; net-negative after costs.
- Value (Book-to-Market) Factor: book-to-market (HML) is net-negative; the value premium is absent or negative over our 2005–2026 sample in naive decile form.
- Gross Profitability (GP/assets): real market-neutral rank-skill (beats 99% of random baskets, placebo P99) but risk-adjusted RF is only 0.56; statistically real yet too weak to trade after costs.
- Net Share Issuance: long/short net-negative (RF -0.38); the short-the-issuers leg was run over in the 2005–2026 bull market, the same failure mode as short interest.
- Piotroski F-Score: long/short net-negative (RF -0.43), and the canonical long-only version is pure equity beta at placebo P0 (random selection does better); no selection skill on the broad panel.
A further 9 strategies are withheld because we could neither confirm nor refute them — 8 lack a required data feed (never tested) and 1 (Graham net-nets) has no qualifying securities in the modern liquid universe. We do not publish verdicts we cannot stand behind.