VotePredictor

Forecasters

The outfits that turn polls into win probabilities — FiveThirtyEight, Cook, the Economist, Sabato, Silver Bulletin and more — graded on the skill of their final pre-election call (2016–2024), against our own model. Most publish only a win probability — so the skill boards below are win-call skill. But the two that also publish a margin (538, the Economist) get a head-to-head on VotePredictor Elections' home turf.

Difficulty-adjusted skill, with uncertainty

Because forecasters cover different races, raw accuracy isn't comparable — rating only safe states flatters you. A Bayesian two-way model separates race difficulty (from how everyone did on each race) from forecaster skill, so skill is independent of which races they chose. The bar is each forecaster's 90% credible interval — it's wide when they've rated few races — and the board is ranked by a conservative estimate, so a strong record on a handful of races can't top a proven one. Lower (left) is better.

The Governor tab is 538 vs our model only. 538's gubernatorial win probabilities (2018, 2022) were recoverable from its archived forecasts; the other outfits published governor ratings as maps, not numbers, so there's nothing to grade them on. For the full field on Governor — pollsters included — see the combined and pollster boards.

#ForecasterRacesBrier90% range (wider = less data)
1FiveThirtyEightinactive6950.081
2VotePredictor Electionsour model6950.082
3JHK Forecasts4020.084
4Race to the WH2840.086
5Cook Political6270.087
6Sabato's Crystal Ball6270.089
7The Economist5100.090
8Inside Elections4010.090
9Silver Bulletin400.087
10Fox News1780.091
11Split Ticket2030.093
12DDHQ/Decision Desk5420.095
13Princeton Election Consortium1320.095
14CNalysis2840.099
15Elections Daily2590.101
16New York Times510.098
17RealClearPolitics2190.131

Margin accuracy vs the pros

The boards above grade win-calls, where the pros' proprietary modeling leads. But VotePredictor Elections' real edge is the margin — and on the same races, against the only two forecasters who publish one, it shows. We recovered 538's and the Economist's real final predicted margins (538 '18/'20/'22; Economist '20 president) and scored everyone by average margin error. VotePredictor Elections beats the Economist outright and edges 538 overall — winning on well-polled President and Senate races; 538 leads only on the thin-poll House/Governor seats where it leans on fundamentals. Lower is better.

VotePredictor Elections vs FiveThirtyEight

2018, 2020, 2022 · 504 races
Margin error (pts) — lower is betterVotePredictor ElectionsFiveThirtyEightpolls
All races · 5045.265.435.77
Competitive (<10 pts) · 2404.824.124.60
Competitive races, by officeVotePredictor ElectionsFiveThirtyEightwinner
President · 162.764.41VotePredictor Elections
Senate · 293.825.91VotePredictor Elections
Governor · 243.562.25FiveThirtyEight
House · 1715.374.06FiveThirtyEight

VotePredictor Elections vs The Economist

2020 · 51 races
Margin error (pts) — lower is betterVotePredictor ElectionsThe Economistpolls
All races · 513.004.385.50
Competitive (<10 pts) · 142.424.454.07

House: a dedicated model closes the gap

2022 · vs 538
Margin error (pts) — lower is betterlean onlyfundamentalshybrid538
All districts · 3884.934.754.814.71
Competitive (<10 pts) · 725.364.874.514.22

538 normally beats us on the House because most districts are barely polled and 538 leans on district fundamentals. A dedicated district model (538-style partisan lean + incumbency) — and a hybrid that uses district polls where they exist and fundamentals elsewhere — flips that: it matches 538 overall (4.81 vs 4.71) and nearly matches on competitive seats (4.51 vs 4.22), versus the old poll-only model's 5.37. Boundary-aligned 2022 backtest (only 2022 & 2024 share district lines); stable on a leave-one-out 2024 check (4.33MAE). Not yet a live 2026 forecast — that requires this year's redistricted maps.

Win-call skill vs a prior-result baseline

Skill is how much each forecaster's win probability beats a naive prior-result baseline on the same races — so being right about obvious races earns nothing. The Competitive tab (races under 10 points) is the real test. Click a column to sort, a name for the by-office and by-cycle breakdown.

How good the win-probability call was (Brier skill vs a prior-result baseline). All races, 2016–2024.

#NameRacesWin skillBrier
1Silver Bulletin4066%0.045
2FiveThirtyEightinactive69553%0.081
3VotePredictor Elections82851%0.087
4Cook Political62747%0.090
5Sabato's Crystal Ball62746%0.093
6Race to the WH28445%0.084
7The Economist51045%0.099
8Inside Elections40144%0.083
9JHK Forecasts40244%0.090
10Poll average (naive)82844%0.099
11DDHQ/Decision Desk54242%0.104
12Princeton Election Consortium13241%0.068
13VotePredictor Elections House segmented33238%0.126
14Split Ticket20338%0.105
15Fox News17837%0.110
16CNalysis28435%0.099
17Elections Daily25932%0.105
18New York Times5131%0.081
19RealClearPolitics2197%0.148

Compare on common races

The fairest test when coverage differs: score everyone on the exact same races — the ones they all forecast. Drag the threshold to drop low-coverage forecasters; the fewer you require, the more races the survivors share. It defaults to the fair board — the six forecasters who covered ≥500 races, on the 510 they all called. Lower the bar and watch the paradox: admit one that rated only a handful and the common set collapses toward zero. Click any name to fine-tune the set.

Two columns, two questions — click either header to sort. Brier rewards confident, well-calibrated probabilities; Called right is the blunt “did they name the winner” rate. They can disagree: a forecaster can have a better Brier yet name fewer winners (its misses are mostly near-tossups it called at ~49%), so it's worth checking both.

500 races · 6 forecasters · 510 common

Everyone scored on the 510 races all 6 selected cover — identical races, exactly apples-to-apples.

#NameBrierCalled right
1FiveThirtyEight0.08889%
2VotePredictor Elections0.09486%
3Cook Political0.09596%
4The Economist0.09986%
5Sabato's Crystal Ball0.09987%
6DDHQ/Decision Desk0.10587%

Raw Brier (for reference)

The same forecasters on the raw Brier score of their final win probability (lower is better) — not difficulty-adjusted, so safe-race coverage flatters it. The skill board above is the fairer ranking.

398 races where the final margin was within 15 points. Lower Brier is better.

#ForecasterRacesBrierCalled right
1Race to the WH1750.11782%
2FiveThirtyEight3980.12185%
3JHK Forecasts2610.12382%
4Inside Elections2270.12789%
5Cook Political3980.13193%
6The Economist3460.13680%
7Sabato's Crystal Ball3980.13782%
8Split Ticket1400.14181%
9DDHQ/Decision Desk3630.14282%
10Fox News1250.14489%
11CNalysis1750.14477%
12VotePredictor Elections3980.14679%
13Elections Daily1600.15279%
14RealClearPolitics1350.21375%