Forecasters
The outfits that turn polls into win probabilities — FiveThirtyEight, Cook, the Economist, Sabato, Silver Bulletin and more — graded on the skill of their final pre-election call (2016–2024), against our own model. Most publish only a win probability — so the skill boards below are win-call skill. But the two that also publish a margin (538, the Economist) get a head-to-head on VotePredictor's home turf.
Difficulty-adjusted skill, with uncertainty
Because forecasters cover different races, raw accuracy isn't comparable — rating only safe states flatters you. A Bayesian two-way model separates race difficulty (from how everyone did on each race) from forecaster skill, so skill is independent of which races they chose. The bar is each forecaster's 90% credible interval — it's wide when they've rated few races — and the board is ranked by a conservative estimate, so a strong record on a handful of races can't top a proven one. Lower (left) is better.
| # | Forecaster | Races | Brier | 90% range (wider = less data) |
|---|---|---|---|---|
| 1 | FiveThirtyEight | 627 | 0.085 | |
| 2 | VotePredictorour model | 627 | 0.088 | |
| 3 | JHK Forecasts | 402 | 0.088 | |
| 4 | Race to the WH | 284 | 0.089 | |
| 5 | Cook Political | 627 | 0.091 | |
| 6 | The Economist | 510 | 0.093 | |
| 7 | Sabato's Crystal Ball | 627 | 0.094 | |
| 8 | Inside Elections | 401 | 0.094 | |
| 9 | Silver Bulletin | 40 | 0.093 | |
| 10 | Princeton Election Consortium | 132 | 0.097 | |
| 11 | Fox News | 178 | 0.098 | |
| 12 | DDHQ/Decision Desk | 542 | 0.100 | |
| 13 | Split Ticket | 203 | 0.100 | |
| 14 | CNalysis | 284 | 0.104 | |
| 15 | New York Times | 51 | 0.102 | |
| 16 | Elections Daily | 259 | 0.106 | |
| 17 | RealClearPolitics | 219 | 0.136 |
Margin accuracy vs the pros
The boards above grade win-calls, where the pros' proprietary modeling leads. But VotePredictor's real edge is the margin — and on the same races, against the only two forecasters who publish one, it shows. We recovered 538's and the Economist's real final predicted margins (538 '18/'20/'22; Economist '20 president) and scored everyone by average margin error. VotePredictor beats the Economist outright and edges 538 overall — winning on well-polled President and Senate races; 538 leads only on the thin-poll House/Governor seats where it leans on fundamentals. Lower is better.
VotePredictor vs FiveThirtyEight
2018, 2020, 2022 · 504 races| Margin error (pts) — lower is better | VotePredictor | FiveThirtyEight | polls |
|---|---|---|---|
| All races · 504 | 5.26 | 5.43 | 5.77 |
| Competitive (<10 pts) · 240 | 4.82 | 4.12 | 4.60 |
| Competitive races, by office | VotePredictor | FiveThirtyEight | winner |
|---|---|---|---|
| President · 16 | 2.76 | 4.41 | VotePredictor |
| Senate · 29 | 3.82 | 5.91 | VotePredictor |
| Governor · 24 | 3.56 | 2.25 | FiveThirtyEight |
| House · 171 | 5.37 | 4.06 | FiveThirtyEight |
VotePredictor vs The Economist
2020 · 51 races| Margin error (pts) — lower is better | VotePredictor | The Economist | polls |
|---|---|---|---|
| All races · 51 | 3.00 | 4.38 | 5.50 |
| Competitive (<10 pts) · 14 | 2.42 | 4.45 | 4.07 |
House: a dedicated model closes the gap
2022 · vs 538| Margin error (pts) — lower is better | lean only | fundamentals | hybrid | 538 |
|---|---|---|---|---|
| All districts · 388 | 4.93 | 4.75 | 4.81 | 4.71 |
| Competitive (<10 pts) · 72 | 5.36 | 4.87 | 4.51 | 4.22 |
538 normally beats us on the House because most districts are barely polled and 538 leans on district fundamentals. A dedicated district model (538-style partisan lean + incumbency) — and a hybrid that uses district polls where they exist and fundamentals elsewhere — flips that: it matches 538 overall (4.81 vs 4.71) and nearly matches on competitive seats (4.51 vs 4.22), versus the old poll-only model's 5.37. Boundary-aligned 2022 backtest (only 2022 & 2024 share district lines); stable on a leave-one-out 2024 check (4.33MAE). Not yet a live 2026 forecast — that requires this year's redistricted maps.
Win-call skill vs a prior-result baseline
Skill is how much each forecaster's win probability beats a naive prior-result baseline on the same races — so being right about obvious races earns nothing. The Competitive tab (races under 10 points) is the real test. Click a column to sort, a name for the by-office and by-cycle breakdown.
How good the win-probability call was (Brier skill vs a prior-result baseline). All races, 2016–2024.
| # | Name | Races | Win skill | Brier |
|---|---|---|---|---|
| 1 | Silver Bulletin | 40 | 66% | 0.045 |
| 2 | VotePredictor | 832 | 52% | 0.084 |
| 3 | FiveThirtyEight | 627 | 52% | 0.084 |
| 4 | Race to the WH | 284 | 48% | 0.083 |
| 5 | Cook Political | 627 | 48% | 0.090 |
| 6 | The Economist | 510 | 46% | 0.098 |
| 7 | Sabato's Crystal Ball | 627 | 46% | 0.093 |
| 8 | JHK Forecasts | 402 | 45% | 0.090 |
| 9 | Inside Elections | 401 | 45% | 0.083 |
| 10 | DDHQ/Decision Desk | 542 | 42% | 0.104 |
| 11 | Split Ticket | 203 | 39% | 0.107 |
| 12 | Princeton Election Consortium | 132 | 39% | 0.065 |
| 13 | Fox News | 178 | 38% | 0.113 |
| 14 | CNalysis | 284 | 37% | 0.100 |
| 15 | Elections Daily | 259 | 34% | 0.105 |
| 16 | New York Times | 51 | 21% | 0.081 |
| 17 | RealClearPolitics | 219 | 11% | 0.148 |
Compare on common races
The fairest test when coverage differs: score everyone on the exact same races — the ones they all forecast. Drag the threshold to drop low-coverage forecasters; the fewer you require, the more races the survivors share. It defaults to the fair board — the six forecasters who covered ≥500 races, on the 510 they all called. Lower the bar and watch the paradox: admit one that rated only a handful and the common set collapses toward zero. Click any name to fine-tune the set.
Two columns, two questions — click either header to sort. Brier rewards confident, well-calibrated probabilities; Called right is the blunt “did they name the winner” rate. They can disagree: a forecaster can have a better Brier yet name fewer winners (its misses are mostly near-tossups it called at ~49%), so it's worth checking both.
Everyone scored on the 510 races all 6 selected cover — identical races, exactly apples-to-apples.
| # | Name | Brier ▾ | Called right |
|---|---|---|---|
| 1 | FiveThirtyEight | 0.087 | 89% |
| 2 | VotePredictor | 0.095 | 85% |
| 3 | Cook Political | 0.095 | 96% |
| 4 | The Economist | 0.098 | 86% |
| 5 | Sabato's Crystal Ball | 0.100 | 87% |
| 6 | DDHQ/Decision Desk | 0.105 | 87% |
Raw Brier (for reference)
The same forecasters on the raw Brier score of their final win probability (lower is better) — not difficulty-adjusted, so safe-race coverage flatters it. The skill board above is the fairer ranking.
398 races where the final margin was within 15 points. Lower Brier is better.
| # | Forecaster | Races | Brier | Called right |
|---|---|---|---|---|
| 1 | Race to the WH | 175 | 0.117 | 82% |
| 2 | FiveThirtyEight | 398 | 0.121 | 85% |
| 3 | JHK Forecasts | 261 | 0.123 | 82% |
| 4 | Inside Elections | 227 | 0.127 | 89% |
| 5 | Cook Political | 398 | 0.131 | 93% |
| 6 | The Economist | 346 | 0.136 | 80% |
| 7 | Sabato's Crystal Ball | 398 | 0.137 | 82% |
| 8 | Split Ticket | 140 | 0.141 | 81% |
| 9 | DDHQ/Decision Desk | 363 | 0.142 | 82% |
| 10 | Fox News | 125 | 0.144 | 89% |
| 11 | CNalysis | 175 | 0.144 | 77% |
| 12 | VotePredictor | 398 | 0.146 | 79% |
| 13 | Elections Daily | 160 | 0.152 | 79% |
| 14 | RealClearPolitics | 135 | 0.213 | 75% |