Forecasters
The outfits that turn polls into win probabilities — FiveThirtyEight, Cook, the Economist, Sabato, Silver Bulletin and more — graded on the skill of their final pre-election call (2016–2024), against our own model. Most publish only a win probability — so the skill boards below are win-call skill. But the two that also publish a margin (538, the Economist) get a head-to-head on VotePredictor Elections' home turf.
Difficulty-adjusted skill, with uncertainty
Because forecasters cover different races, raw accuracy isn't comparable — rating only safe states flatters you. A Bayesian two-way model separates race difficulty (from how everyone did on each race) from forecaster skill, so skill is independent of which races they chose. The bar is each forecaster's 90% credible interval — it's wide when they've rated few races — and the board is ranked by a conservative estimate, so a strong record on a handful of races can't top a proven one. Lower (left) is better.
The Governor tab is 538 vs our model only. 538's gubernatorial win probabilities (2018, 2022) were recoverable from its archived forecasts; the other outfits published governor ratings as maps, not numbers, so there's nothing to grade them on. For the full field on Governor — pollsters included — see the combined and pollster boards.
| # | Forecaster | Races | Brier | 90% range (wider = less data) |
|---|---|---|---|---|
| 1 | FiveThirtyEightinactive | 695 | 0.081 | |
| 2 | VotePredictor Electionsour model | 695 | 0.082 | |
| 3 | JHK Forecasts | 402 | 0.084 | |
| 4 | Race to the WH | 284 | 0.086 | |
| 5 | Cook Political | 627 | 0.087 | |
| 6 | Sabato's Crystal Ball | 627 | 0.089 | |
| 7 | The Economist | 510 | 0.090 | |
| 8 | Inside Elections | 401 | 0.090 | |
| 9 | Silver Bulletin | 40 | 0.087 | |
| 10 | Fox News | 178 | 0.091 | |
| 11 | Split Ticket | 203 | 0.093 | |
| 12 | DDHQ/Decision Desk | 542 | 0.095 | |
| 13 | Princeton Election Consortium | 132 | 0.095 | |
| 14 | CNalysis | 284 | 0.099 | |
| 15 | Elections Daily | 259 | 0.101 | |
| 16 | New York Times | 51 | 0.098 | |
| 17 | RealClearPolitics | 219 | 0.131 |
Margin accuracy vs the pros
The boards above grade win-calls, where the pros' proprietary modeling leads. But VotePredictor Elections' real edge is the margin — and on the same races, against the only two forecasters who publish one, it shows. We recovered 538's and the Economist's real final predicted margins (538 '18/'20/'22; Economist '20 president) and scored everyone by average margin error. VotePredictor Elections beats the Economist outright and edges 538 overall — winning on well-polled President and Senate races; 538 leads only on the thin-poll House/Governor seats where it leans on fundamentals. Lower is better.
VotePredictor Elections vs FiveThirtyEight
2018, 2020, 2022 · 504 races| Margin error (pts) — lower is better | VotePredictor Elections | FiveThirtyEight | polls |
|---|---|---|---|
| All races · 504 | 5.26 | 5.43 | 5.77 |
| Competitive (<10 pts) · 240 | 4.82 | 4.12 | 4.60 |
| Competitive races, by office | VotePredictor Elections | FiveThirtyEight | winner |
|---|---|---|---|
| President · 16 | 2.76 | 4.41 | VotePredictor Elections |
| Senate · 29 | 3.82 | 5.91 | VotePredictor Elections |
| Governor · 24 | 3.56 | 2.25 | FiveThirtyEight |
| House · 171 | 5.37 | 4.06 | FiveThirtyEight |
VotePredictor Elections vs The Economist
2020 · 51 races| Margin error (pts) — lower is better | VotePredictor Elections | The Economist | polls |
|---|---|---|---|
| All races · 51 | 3.00 | 4.38 | 5.50 |
| Competitive (<10 pts) · 14 | 2.42 | 4.45 | 4.07 |
House: a dedicated model closes the gap
2022 · vs 538| Margin error (pts) — lower is better | lean only | fundamentals | hybrid | 538 |
|---|---|---|---|---|
| All districts · 388 | 4.93 | 4.75 | 4.81 | 4.71 |
| Competitive (<10 pts) · 72 | 5.36 | 4.87 | 4.51 | 4.22 |
538 normally beats us on the House because most districts are barely polled and 538 leans on district fundamentals. A dedicated district model (538-style partisan lean + incumbency) — and a hybrid that uses district polls where they exist and fundamentals elsewhere — flips that: it matches 538 overall (4.81 vs 4.71) and nearly matches on competitive seats (4.51 vs 4.22), versus the old poll-only model's 5.37. Boundary-aligned 2022 backtest (only 2022 & 2024 share district lines); stable on a leave-one-out 2024 check (4.33MAE). Not yet a live 2026 forecast — that requires this year's redistricted maps.
Win-call skill vs a prior-result baseline
Skill is how much each forecaster's win probability beats a naive prior-result baseline on the same races — so being right about obvious races earns nothing. The Competitive tab (races under 10 points) is the real test. Click a column to sort, a name for the by-office and by-cycle breakdown.
How good the win-probability call was (Brier skill vs a prior-result baseline). All races, 2016–2024.
| # | Name | Races | Win skill | Brier |
|---|---|---|---|---|
| 1 | Silver Bulletin | 40 | 66% | 0.045 |
| 2 | FiveThirtyEightinactive | 695 | 53% | 0.081 |
| 3 | VotePredictor Elections | 828 | 51% | 0.087 |
| 4 | Cook Political | 627 | 47% | 0.090 |
| 5 | Sabato's Crystal Ball | 627 | 46% | 0.093 |
| 6 | Race to the WH | 284 | 45% | 0.084 |
| 7 | The Economist | 510 | 45% | 0.099 |
| 8 | Inside Elections | 401 | 44% | 0.083 |
| 9 | JHK Forecasts | 402 | 44% | 0.090 |
| 10 | Poll average (naive) | 828 | 44% | 0.099 |
| 11 | DDHQ/Decision Desk | 542 | 42% | 0.104 |
| 12 | Princeton Election Consortium | 132 | 41% | 0.068 |
| 13 | VotePredictor Elections House segmented | 332 | 38% | 0.126 |
| 14 | Split Ticket | 203 | 38% | 0.105 |
| 15 | Fox News | 178 | 37% | 0.110 |
| 16 | CNalysis | 284 | 35% | 0.099 |
| 17 | Elections Daily | 259 | 32% | 0.105 |
| 18 | New York Times | 51 | 31% | 0.081 |
| 19 | RealClearPolitics | 219 | 7% | 0.148 |
Compare on common races
The fairest test when coverage differs: score everyone on the exact same races — the ones they all forecast. Drag the threshold to drop low-coverage forecasters; the fewer you require, the more races the survivors share. It defaults to the fair board — the six forecasters who covered ≥500 races, on the 510 they all called. Lower the bar and watch the paradox: admit one that rated only a handful and the common set collapses toward zero. Click any name to fine-tune the set.
Two columns, two questions — click either header to sort. Brier rewards confident, well-calibrated probabilities; Called right is the blunt “did they name the winner” rate. They can disagree: a forecaster can have a better Brier yet name fewer winners (its misses are mostly near-tossups it called at ~49%), so it's worth checking both.
Everyone scored on the 510 races all 6 selected cover — identical races, exactly apples-to-apples.
| # | Name | Brier ▾ | Called right |
|---|---|---|---|
| 1 | FiveThirtyEight | 0.088 | 89% |
| 2 | VotePredictor Elections | 0.094 | 86% |
| 3 | Cook Political | 0.095 | 96% |
| 4 | The Economist | 0.099 | 86% |
| 5 | Sabato's Crystal Ball | 0.099 | 87% |
| 6 | DDHQ/Decision Desk | 0.105 | 87% |
Raw Brier (for reference)
The same forecasters on the raw Brier score of their final win probability (lower is better) — not difficulty-adjusted, so safe-race coverage flatters it. The skill board above is the fairer ranking.
398 races where the final margin was within 15 points. Lower Brier is better.
| # | Forecaster | Races | Brier | Called right |
|---|---|---|---|---|
| 1 | Race to the WH | 175 | 0.117 | 82% |
| 2 | FiveThirtyEight | 398 | 0.121 | 85% |
| 3 | JHK Forecasts | 261 | 0.123 | 82% |
| 4 | Inside Elections | 227 | 0.127 | 89% |
| 5 | Cook Political | 398 | 0.131 | 93% |
| 6 | The Economist | 346 | 0.136 | 80% |
| 7 | Sabato's Crystal Ball | 398 | 0.137 | 82% |
| 8 | Split Ticket | 140 | 0.141 | 81% |
| 9 | DDHQ/Decision Desk | 363 | 0.142 | 82% |
| 10 | Fox News | 125 | 0.144 | 89% |
| 11 | CNalysis | 175 | 0.144 | 77% |
| 12 | VotePredictor Elections | 398 | 0.146 | 79% |
| 13 | Elections Daily | 160 | 0.152 | 79% |
| 14 | RealClearPolitics | 135 | 0.213 | 75% |