Predictium
College Basketball

College Basketball Record

Every forecast we froze, scored against the result after the game.

  • Research forecast. This model has not passed the tests we set for it before launch, so it makes no picks and shows no EV.
  • It failed one of six tests we set before running it: the middle-50% range for game totals caught 46.9% of games against a 47.0% minimum.
  • Team-level forecast: no roster, injury or minutes adjustments yet.
  • We post the night before tip and again in the morning. The record tracks whether the line moves toward our number after we post, shown whether that is good or bad.
  • Median of sportsbook lines collected before the forecast. No book is named and no price is shown.
  • Games later in the week are posted as soon as a market lists them and are re-forecast at every post until tip, as results come in. The record scores each lead time separately.

Forecasts scored

351 games scored (660 frozen forecasts), 16 freezes so far, scored Nov 17, 9:30 AM ET.

This table counts forecasts frozen within 24 hours of tip, so it lines up with earlier weeks. Longer leads are below and never added in.

FreezeGamesLog lossBrierMargin 25-75Margin 5-95Total 25-75Total 5-95
Night before freeze2280.40830.140146.6%87.9%45.3%87.9%
Morning freeze2280.40830.140146.6%87.9%45.3%87.9%
Manual run freeze1370.43290.137249.5%92.3%44.9%86.2%

By how far ahead we posted

Night before freezeGamesLog lossBrierMargin 25-75Margin 5-95Total 25-75Total 5-95
Same day2280.40870.140146.5%88.2%45.6%88.2%
1 day before tip40.38970.143150.0%75.0%25.0%75.0%
Morning freezeGamesLog lossBrierMargin 25-75Margin 5-95Total 25-75Total 5-95
Same day2280.40860.140146.5%88.2%45.6%88.2%
1 day before tip40.38950.143150.0%75.0%25.0%75.0%
Manual run freezeGamesLog lossBrierMargin 25-75Margin 5-95Total 25-75Total 5-95
Same day1350.39580.127550.4%91.8%44.4%85.9%
1 day before tip970.53470.176048.4%93.8%46.4%87.6%
2 to 3 days before tip11.03870.41740.0%100.0%100.0%100.0%

Lower log loss and Brier are better. Coverage should sit near 50% for the 25-75 range and 90% for the 5-95 range.

Early line value

Each game counts once, however many times we posted it.

Night before freezeHeadline

179 games, 9 with the line opening after we posted, median 59.8 minutes from the last snapshot to tip

GamesnMean move toward ours95% intervalMoved toward ours (of those that moved)
All games, gap over 0 pp182+0.2 pp−0.2 pp to +0.5 pp52.5%
All games, gap over 5 pp79+0.1 pp−0.4 pp to +0.6 pp51.9%
All games, gap over 10 pp41+0.4 pp+0.2 pp to +1.1 pp58.5%
Line open when we posted, gap over 0 pp173+0.1 pp−0.3 pp to +0.5 pp52.2%
Line open when we posted, gap over 5 pp76+0.1 pp−0.5 pp to +0.6 pp51.3%
Line open when we posted, gap over 10 pp40+0.5 pp+0.2 pp to +1.1 pp60.0%
Line opened after we posted, gap over 0 pp9+0.5 pp−0.1 pp to +1.3 pp60.0%
Line opened after we posted, gap over 5 pp3+1.3 pp+1.3 pp to +1.3 pp66.7%
Line opened after we posted, gap over 10 pp1−0.9 ppn/a0.0%

Morning freeze

178 games, 4 with the line opening after we posted, median 59.8 minutes from the last snapshot to tip

GamesnMean move toward ours95% intervalMoved toward ours (of those that moved)
All games, gap over 0 pp1810.0 pp−0.1 pp to +0.2 pp49.0%
All games, gap over 5 pp77+0.2 pp−0.2 pp to +0.5 pp49.3%
All games, gap over 10 pp43+0.5 pp0.0 pp to +1.4 pp56.1%
Line open when we posted, gap over 0 pp1770.0 pp−0.1 pp to +0.2 pp48.6%
Line open when we posted, gap over 5 pp74+0.2 pp−0.3 pp to +0.5 pp48.6%
Line open when we posted, gap over 10 pp42+0.5 pp+0.1 pp to +1.4 pp57.5%
Line opened after we posted, gap over 0 pp4+0.9 pp0.0 pp to +1.3 pp66.7%
Line opened after we posted, gap over 5 pp3+1.3 pp+1.3 pp to +1.3 pp66.7%
Line opened after we posted, gap over 10 pp1−0.9 ppn/a0.0%

Manual run freeze

35 games, 31 with the line opening after we posted, median 59.5 minutes from the last snapshot to tip

GamesnMean move toward ours95% intervalMoved toward ours (of those that moved)
All games, gap over 0 pp65+0.8 pp0.0 pp to +0.9 pp73.3%
All games, gap over 5 pp35+1.1 pp+1.1 pp to +1.1 pp67.7%
All games, gap over 10 pp23+1.0 pp+1.0 pp to +1.0 pp68.4%
Line open when we posted, gap over 0 pp34+0.8 pp0.0 pp to +0.9 pp73.9%
Line open when we posted, gap over 5 pp18+1.1 pp+1.1 pp to +1.1 pp68.8%
Line open when we posted, gap over 10 pp12+1.0 pp+1.0 pp to +1.0 pp70.0%
Line opened after we posted, gap over 0 pp31+0.8 pp+0.8 pp to +0.8 pp72.7%
Line opened after we posted, gap over 5 pp17+1.1 pp+1.1 pp to +1.1 pp66.7%
Line opened after we posted, gap over 10 pp11+1.0 pp+1.0 pp to +1.0 pp66.7%

Early line value by how far ahead we posted

A forecast posted days before tip gives the line more time to move, so each lead is shown on its own and never added to the figures above.

Night before freezeGamesMean move toward ours95% interval
Same day179+0.1 pp−0.2 pp to +0.5 pp
1 day before tip3+1.3 pp+1.3 pp to +1.3 pp
Morning freezeGamesMean move toward ours95% interval
Same day1780.0 pp−0.1 pp to +0.2 pp
1 day before tip3+1.3 pp+1.3 pp to +1.3 pp
Manual run freezeGamesMean move toward ours95% interval
Same day35+0.8 pp0.0 pp to +0.9 pp
1 day before tip30+0.9 pp+0.9 pp to +0.9 pp

Definitions

Early line value
Move in the market's win probability (vig removed, median across books) from the first snapshot after our freeze to the last before tip, signed toward our number, in percentage points.
Coverage
Share of games whose result fell inside our 25-75 and 5-95 percentile ranges.