College Basketball Record
Every forecast we froze, scored against the result after the game.
- Research forecast. This model has not passed the tests we set for it before launch, so it makes no picks and shows no EV.
- It failed one of six tests we set before running it: the middle-50% range for game totals caught 46.9% of games against a 47.0% minimum.
- Team-level forecast: no roster, injury or minutes adjustments yet.
- We post the night before tip and again in the morning. The record tracks whether the line moves toward our number after we post, shown whether that is good or bad.
- Median of sportsbook lines collected before the forecast. No book is named and no price is shown.
- Games later in the week are posted as soon as a market lists them and are re-forecast at every post until tip, as results come in. The record scores each lead time separately.
Forecasts scored
351 games scored (660 frozen forecasts), 16 freezes so far, scored Nov 17, 9:30 AM ET.
This table counts forecasts frozen within 24 hours of tip, so it lines up with earlier weeks. Longer leads are below and never added in.
| Freeze | Games | Log loss | Brier | Margin 25-75 | Margin 5-95 | Total 25-75 | Total 5-95 |
|---|---|---|---|---|---|---|---|
| Night before freeze | 228 | 0.4083 | 0.1401 | 46.6% | 87.9% | 45.3% | 87.9% |
| Morning freeze | 228 | 0.4083 | 0.1401 | 46.6% | 87.9% | 45.3% | 87.9% |
| Manual run freeze | 137 | 0.4329 | 0.1372 | 49.5% | 92.3% | 44.9% | 86.2% |
By how far ahead we posted
| Night before freeze | Games | Log loss | Brier | Margin 25-75 | Margin 5-95 | Total 25-75 | Total 5-95 |
|---|---|---|---|---|---|---|---|
| Same day | 228 | 0.4087 | 0.1401 | 46.5% | 88.2% | 45.6% | 88.2% |
| 1 day before tip | 4 | 0.3897 | 0.1431 | 50.0% | 75.0% | 25.0% | 75.0% |
| Morning freeze | Games | Log loss | Brier | Margin 25-75 | Margin 5-95 | Total 25-75 | Total 5-95 |
|---|---|---|---|---|---|---|---|
| Same day | 228 | 0.4086 | 0.1401 | 46.5% | 88.2% | 45.6% | 88.2% |
| 1 day before tip | 4 | 0.3895 | 0.1431 | 50.0% | 75.0% | 25.0% | 75.0% |
| Manual run freeze | Games | Log loss | Brier | Margin 25-75 | Margin 5-95 | Total 25-75 | Total 5-95 |
|---|---|---|---|---|---|---|---|
| Same day | 135 | 0.3958 | 0.1275 | 50.4% | 91.8% | 44.4% | 85.9% |
| 1 day before tip | 97 | 0.5347 | 0.1760 | 48.4% | 93.8% | 46.4% | 87.6% |
| 2 to 3 days before tip | 1 | 1.0387 | 0.4174 | 0.0% | 100.0% | 100.0% | 100.0% |
Lower log loss and Brier are better. Coverage should sit near 50% for the 25-75 range and 90% for the 5-95 range.
Early line value
Each game counts once, however many times we posted it.
Night before freezeHeadline
179 games, 9 with the line opening after we posted, median 59.8 minutes from the last snapshot to tip
| Games | n | Mean move toward ours | 95% interval | Moved toward ours (of those that moved) |
|---|---|---|---|---|
| All games, gap over 0 pp | 182 | +0.2 pp | −0.2 pp to +0.5 pp | 52.5% |
| All games, gap over 5 pp | 79 | +0.1 pp | −0.4 pp to +0.6 pp | 51.9% |
| All games, gap over 10 pp | 41 | +0.4 pp | +0.2 pp to +1.1 pp | 58.5% |
| Line open when we posted, gap over 0 pp | 173 | +0.1 pp | −0.3 pp to +0.5 pp | 52.2% |
| Line open when we posted, gap over 5 pp | 76 | +0.1 pp | −0.5 pp to +0.6 pp | 51.3% |
| Line open when we posted, gap over 10 pp | 40 | +0.5 pp | +0.2 pp to +1.1 pp | 60.0% |
| Line opened after we posted, gap over 0 pp | 9 | +0.5 pp | −0.1 pp to +1.3 pp | 60.0% |
| Line opened after we posted, gap over 5 pp | 3 | +1.3 pp | +1.3 pp to +1.3 pp | 66.7% |
| Line opened after we posted, gap over 10 pp | 1 | −0.9 pp | n/a | 0.0% |
Morning freeze
178 games, 4 with the line opening after we posted, median 59.8 minutes from the last snapshot to tip
| Games | n | Mean move toward ours | 95% interval | Moved toward ours (of those that moved) |
|---|---|---|---|---|
| All games, gap over 0 pp | 181 | 0.0 pp | −0.1 pp to +0.2 pp | 49.0% |
| All games, gap over 5 pp | 77 | +0.2 pp | −0.2 pp to +0.5 pp | 49.3% |
| All games, gap over 10 pp | 43 | +0.5 pp | 0.0 pp to +1.4 pp | 56.1% |
| Line open when we posted, gap over 0 pp | 177 | 0.0 pp | −0.1 pp to +0.2 pp | 48.6% |
| Line open when we posted, gap over 5 pp | 74 | +0.2 pp | −0.3 pp to +0.5 pp | 48.6% |
| Line open when we posted, gap over 10 pp | 42 | +0.5 pp | +0.1 pp to +1.4 pp | 57.5% |
| Line opened after we posted, gap over 0 pp | 4 | +0.9 pp | 0.0 pp to +1.3 pp | 66.7% |
| Line opened after we posted, gap over 5 pp | 3 | +1.3 pp | +1.3 pp to +1.3 pp | 66.7% |
| Line opened after we posted, gap over 10 pp | 1 | −0.9 pp | n/a | 0.0% |
Manual run freeze
35 games, 31 with the line opening after we posted, median 59.5 minutes from the last snapshot to tip
| Games | n | Mean move toward ours | 95% interval | Moved toward ours (of those that moved) |
|---|---|---|---|---|
| All games, gap over 0 pp | 65 | +0.8 pp | 0.0 pp to +0.9 pp | 73.3% |
| All games, gap over 5 pp | 35 | +1.1 pp | +1.1 pp to +1.1 pp | 67.7% |
| All games, gap over 10 pp | 23 | +1.0 pp | +1.0 pp to +1.0 pp | 68.4% |
| Line open when we posted, gap over 0 pp | 34 | +0.8 pp | 0.0 pp to +0.9 pp | 73.9% |
| Line open when we posted, gap over 5 pp | 18 | +1.1 pp | +1.1 pp to +1.1 pp | 68.8% |
| Line open when we posted, gap over 10 pp | 12 | +1.0 pp | +1.0 pp to +1.0 pp | 70.0% |
| Line opened after we posted, gap over 0 pp | 31 | +0.8 pp | +0.8 pp to +0.8 pp | 72.7% |
| Line opened after we posted, gap over 5 pp | 17 | +1.1 pp | +1.1 pp to +1.1 pp | 66.7% |
| Line opened after we posted, gap over 10 pp | 11 | +1.0 pp | +1.0 pp to +1.0 pp | 66.7% |
Early line value by how far ahead we posted
A forecast posted days before tip gives the line more time to move, so each lead is shown on its own and never added to the figures above.
| Night before freeze | Games | Mean move toward ours | 95% interval |
|---|---|---|---|
| Same day | 179 | +0.1 pp | −0.2 pp to +0.5 pp |
| 1 day before tip | 3 | +1.3 pp | +1.3 pp to +1.3 pp |
| Morning freeze | Games | Mean move toward ours | 95% interval |
|---|---|---|---|
| Same day | 178 | 0.0 pp | −0.1 pp to +0.2 pp |
| 1 day before tip | 3 | +1.3 pp | +1.3 pp to +1.3 pp |
| Manual run freeze | Games | Mean move toward ours | 95% interval |
|---|---|---|---|
| Same day | 35 | +0.8 pp | 0.0 pp to +0.9 pp |
| 1 day before tip | 30 | +0.9 pp | +0.9 pp to +0.9 pp |
Definitions
- Early line value
- Move in the market's win probability (vig removed, median across books) from the first snapshot after our freeze to the last before tip, signed toward our number, in percentage points.
- Coverage
- Share of games whose result fell inside our 25-75 and 5-95 percentile ranges.