Forecasters
The outfits that turn polls into win probabilities — FiveThirtyEight, Cook, the Economist, Sabato, Silver Bulletin and more — graded on the skill of their final pre-election call (2016–2024), against our own model. Most publish only a win probability — so the skill boards below are win-call skill. But the two that also publish a margin (538, the Economist) get a head-to-head on VotePredictor Elections' home turf.
Difficulty-adjusted skill, with uncertainty
Because forecasters cover different races, raw accuracy isn't comparable — rating only safe states flatters you. A Bayesian two-way model separates race difficulty (from how everyone did on each race) from forecaster skill, so skill is independent of which races they chose. The bar is each forecaster's 90% credible interval — it's wide when they've rated few races — and the board is ranked by a conservative estimate, so a strong record on a handful of races can't top a proven one. Lower (left) is better.
Governor ratings are read from Wikipedia's election-cycle tables. JHK's archive has no governor rows, so Cook, Inside Elections, Sabato and the rest enter here from the final ratings those tables record (dated columns only; a column read more than 45 days before the election is left out), converted with the same rating-to-probability table JHK uses for their House and Senate ratings: Solid 99%, Likely 90%, Lean 75%, Tilt 60%, Toss-up 50%. 538's governor rows are its own archived win probabilities (2018, 2022). Pollsters join on the combined and pollster boards.
| # | Forecaster | Races | Brier | 90% range (wider = less data) |
|---|---|---|---|---|
| 1 | FiveThirtyEightinactive | 682 | 0.071 | |
| 2 | VotePredictor Electionsour model | 765 | 0.074 | |
| 3 | JHK Forecasts | 390 | 0.077 | |
| 4 | Race to the WH | 276 | 0.079 | |
| 5 | Fox News | 242 | 0.079 | |
| 6 | Inside Elections | 537 | 0.081 | |
| 7 | Cook Political | 747 | 0.081 | |
| 8 | The Economist | 501 | 0.082 | |
| 9 | Sabato's Crystal Ball | 763 | 0.083 | |
| 10 | Silver Bulletin | 40 | 0.079 | |
| 11 | Split Ticket | 196 | 0.083 | |
| 12 | Princeton Election Consortium | 131 | 0.086 | |
| 13 | DDHQ/Decision Desk | 530 | 0.089 | |
| 14 | Elections Daily | 293 | 0.088 | |
| 15 | CNalysis | 282 | 0.090 | |
| 16 | New York Times | 51 | 0.089 | |
| 17 | RealClearPolitics | 342 | 0.115 |
Margin accuracy vs the pros
The boards above grade win-calls. This grades the margin against the only two forecasters who publish one. We recovered 538's and the Economist's real final predicted margins (538 '18/'20/'22; Economist '20 president) and scored everyone by average margin error on the same races, using our published walk-forward record — every House district, not only the polled ones. VotePredictor Elections beats the Economist outright and runs level with 538 overall (within a tenth of a point): ahead on close presidential states, behind on close Senate and governor races, and narrowly behind on the House, where 2018 decides it. Lower is better.
VotePredictor Elections vs FiveThirtyEight
2018, 2020, 2022 · 1326 races| Margin error (pts) — lower is better | VotePredictor Elections | FiveThirtyEight | polls |
|---|---|---|---|
| All races · 1326 | 4.71 | 4.86 | 5.73 |
| Competitive (<10 pts) · 290 | 4.25 | 4.13 | 4.55 |
| Competitive races, by office | VotePredictor Elections | FiveThirtyEight | winner |
|---|---|---|---|
| President · 16 | 2.75 | 4.41 | VotePredictor Elections |
| Senate · 28 | 4.23 | 3.93 | FiveThirtyEight |
| Governor · 24 | 3.24 | 2.31 | FiveThirtyEight |
| House · 222 | 4.47 | 4.33 | FiveThirtyEight |
VotePredictor Elections vs The Economist
2020 · 51 races| Margin error (pts) — lower is better | VotePredictor Elections | The Economist | polls |
|---|---|---|---|
| All races · 51 | 3.02 | 4.37 | 5.48 |
| Competitive (<10 pts) · 14 | 2.39 | 4.45 | 4.07 |
House: every district, against 538
average miss, points · lower is better| Cycle | All districts: us | 538 | Competitive: us | 538 |
|---|---|---|---|---|
| 2018 · 389 / 89 | 5.16 | 4.48 | 5.00 | 3.09 |
| 2020 · 402 / 74 | 5.20 | 5.63 | 4.55 | 5.83 |
| 2022 · 332 / 59 | 4.09 | 4.52 | 3.56 | 4.33 |
| All cycles · 1123 / 222 | 4.86 | 4.90 | 4.47 | 4.33 |
Our numbers are the published House model's own walk-forward record — district lean, incumbency and district polls, each cycle predicted from earlier cycles only — on every district 538 forecast; competitive means the final margin was within 10 points. Cook's rating, which the live forecast also uses for unpolled rated seats, is left out so the comparison is model against model. 538 is ahead overall, by 2018 alone: that year the whole-chamber environment ran four points more Democratic than our model expected. We are ahead in 2022, and on competitive seats in 2020 and 2022.
Win-call skill vs a prior-result baseline
Skill is how much each forecaster's win probability beats a naive prior-result baseline on the same races — so being right about obvious races earns nothing. The Competitive tab (races under 10 points) is the real test. Click a column to sort, a name for the by-office and by-cycle breakdown.
How good the win-probability call was (Brier skill vs a prior-result baseline). All races, 2016–2024.
| # | Name | Races | Win skill | Brier |
|---|---|---|---|---|
| 1 | Silver Bulletin | 40 | 64% | 0.045 |
| 2 | FiveThirtyEightinactive | 682 | 58% | 0.070 |
| 3 | VotePredictor Elections | 803 | 56% | 0.075 |
| 4 | Cook Political | 704 | 52% | 0.079 |
| 5 | Inside Elections | 492 | 52% | 0.071 |
| 6 | Sabato's Crystal Ball | 715 | 51% | 0.081 |
| 7 | Fox News | 242 | 50% | 0.082 |
| 8 | The Economist | 501 | 49% | 0.088 |
| 9 | Race to the WH | 276 | 49% | 0.072 |
| 10 | JHK Forecasts | 390 | 47% | 0.080 |
| 11 | DDHQ/Decision Desk | 530 | 45% | 0.093 |
| 12 | Princeton Election Consortium | 131 | 43% | 0.060 |
| 13 | Poll average (naive) | 803 | 43% | 0.096 |
| 14 | Split Ticket | 196 | 43% | 0.089 |
| 15 | Elections Daily | 293 | 43% | 0.082 |
| 16 | VotePredictor Elections House segmented | 332 | 40% | 0.120 |
| 17 | CNalysis | 282 | 40% | 0.084 |
| 18 | VotePredictor Elections House fundamentals | 321 | 35% | 0.129 |
| 19 | New York Times | 51 | 27% | 0.081 |
| 20 | RealClearPolitics | 299 | 21% | 0.121 |
Compare on common races
The fairest test when coverage differs: score everyone on the exact same races — the ones they all forecast. Drag the threshold to drop low-coverage forecasters; the fewer you require, the more races the survivors share. It defaults to the fair board — the six forecasters who covered ≥500 races, on the 510 they all called. Lower the bar and watch the paradox: admit one that rated only a handful and the common set collapses toward zero. Click any name to fine-tune the set.
Two columns, two questions — click either header to sort. Brier rewards confident, well-calibrated probabilities; Called right is the blunt “did they name the winner” rate. They can disagree: a forecaster can have a better Brier yet name fewer winners (its misses are mostly near-tossups it called at ~49%), so it's worth checking both.
Everyone scored on the 276 races all 7 selected cover — identical races, exactly apples-to-apples.
| # | Name | Brier ▾ | Called right |
|---|---|---|---|
| 1 | VotePredictor Elections | 0.061 | 92% |
| 2 | FiveThirtyEight | 0.070 | 91% |
| 3 | Cook Political | 0.071 | 99% |
| 4 | The Economist | 0.071 | 89% |
| 5 | Inside Elections | 0.074 | 95% |
| 6 | DDHQ/Decision Desk | 0.081 | 89% |
| 7 | Sabato's Crystal Ball | 0.081 | 89% |
Raw Brier (for reference)
The same forecasters on the raw Brier score of their final win probability (lower is better) — not difficulty-adjusted, so safe-race coverage flatters it. The skill board above is the fairer ranking.
392 races where the final margin was within 15 points. Lower Brier is better. Only forecasters that rated every race in the set are ranked; the rest are listed unranked, with VotePredictor's Brier on exactly the races they rated.
| # | Forecaster | Races | Brier | Called right | VP, same races |
|---|---|---|---|---|---|
| 1 | FiveThirtyEight | 392 | 0.113 | 86% | 0.118 |
| 2 | VotePredictor Elections | 392 | 0.118 | 83% | |
| 3 | Cook Political | 392 | 0.123 | 95% | 0.118 |
| 4 | Sabato's Crystal Ball | 392 | 0.129 | 83% | 0.118 |
| — | Race to the WH | 172 | 0.116 | 81% | 0.097 |
| — | Inside Elections | 222 | 0.122 | 89% | 0.102 |
| — | JHK Forecasts | 255 | 0.123 | 81% | 0.109 |
| — | Fox News | 123 | 0.123 | 93% | 0.110 |
| — | Split Ticket | 137 | 0.127 | 82% | 0.107 |
| — | The Economist | 342 | 0.128 | 80% | 0.117 |
| — | CNalysis | 172 | 0.136 | 79% | 0.097 |
| — | DDHQ/Decision Desk | 357 | 0.137 | 83% | 0.118 |
| — | Elections Daily | 158 | 0.141 | 80% | 0.098 |
| — | RealClearPolitics | 133 | 0.199 | 79% | 0.112 |