AI vs Market Scoreboard

Name: VoxOdds AI vs Market Forecast Scoreboard
Creator: VoxOdds
License: https://creativecommons.org/licenses/by/4.0/

Every hourly AI forecast is stored with the market price captured at the same moment, then scored when the market resolves. Append-only receipts, deterministic math, losses published. Lower Brier is better. Read the full research writeup → Submit your own forecasts →

Forecasts scored

6442

15596 awaiting resolution

AI Brier (mean)

0.182

sample: 6442

Market Brier (mean)

0.131

same timestamps

AI accuracy

74%

market: 81%

Across 6442 scored forecasts, VoxOdds AI (Brier 0.182) trailed the market price (Brier 0.131) taken at the same moment. A sweep over every AI/market mixture weight (n=6442) finds no weight of AI improves on the price — the market alone is optimal so far.

Recently scored forecasts

Market	AI said	Resolved	AI Brier	Market Brier	Verdict
Counter-Strike: Vitality vs Natus Vincere (BO3) - ESL Pro League Group Stage	Vitality @ 66%	Vitality	0.116	0.119	AI closer
Counter-Strike: Vitality vs Natus Vincere (BO3) - ESL Pro League Group Stage	Vitality @ 65%	Vitality	0.121	0.119	Market closer
Counter-Strike: Vitality vs Natus Vincere (BO3) - ESL Pro League Group Stage	Vitality @ 65%	Vitality	0.125	0.119	Market closer
Counter-Strike: Vitality vs Natus Vincere (BO3) - ESL Pro League Group Stage	Vitality @ 64%	Vitality	0.131	0.119	Market closer
Counter-Strike: Vitality vs Natus Vincere (BO3) - ESL Pro League Group Stage	Vitality @ 62%	Vitality	0.144	0.119	Market closer
China Open: Alexander Zverev vs Novak Djokovic	Alexander Zverev @ 76%	Novak Djokovic	0.578	0.570	Market closer
China Open: Alexander Zverev vs Novak Djokovic	Alexander Zverev @ 75%	Novak Djokovic	0.565	0.570	AI closer
China Open: Alexander Zverev vs Novak Djokovic	Alexander Zverev @ 75%	Novak Djokovic	0.557	0.570	AI closer
China Open: Alexander Zverev vs Novak Djokovic	Alexander Zverev @ 74%	Novak Djokovic	0.544	0.570	AI closer
China Open: Alexander Zverev vs Novak Djokovic	Alexander Zverev @ 72%	Novak Djokovic	0.518	0.570	AI closer
LoL: LGD Gaming vs BNK FEARX (BO3) - Demacia Cup Global Invitational Group Stage	BNK FEARX @ 60%	BNK FEARX	0.160	0.164	AI closer
LoL: LGD Gaming vs BNK FEARX (BO3) - Demacia Cup Global Invitational Group Stage	BNK FEARX @ 60%	BNK FEARX	0.161	0.164	AI closer
LoL: LGD Gaming vs BNK FEARX (BO3) - Demacia Cup Global Invitational Group Stage	BNK FEARX @ 60%	BNK FEARX	0.157	0.164	AI closer
LoL: LGD Gaming vs BNK FEARX (BO3) - Demacia Cup Global Invitational Group Stage	BNK FEARX @ 61%	BNK FEARX	0.150	0.164	AI closer
LoL: LGD Gaming vs BNK FEARX (BO3) - Demacia Cup Global Invitational Group Stage	BNK FEARX @ 63%	BNK FEARX	0.137	0.164	AI closer
Valorant: LOUD vs Global Esports (BO3) - VCT Champions Group B	LOUD @ 57%	LOUD	0.185	0.181	Market closer
Valorant: LOUD vs Global Esports (BO3) - VCT Champions Group B	LOUD @ 58%	LOUD	0.174	0.181	AI closer
Valorant: LOUD vs Global Esports (BO3) - VCT Champions Group B	LOUD @ 59%	LOUD	0.165	0.181	AI closer
Valorant: LOUD vs Global Esports (BO3) - VCT Champions Group B	LOUD @ 61%	LOUD	0.150	0.181	AI closer
Valorant: LOUD vs Global Esports (BO3) - VCT Champions Group B	LOUD @ 65%	LOUD	0.122	0.181	AI closer
Counter-Strike: Spirit vs PARIVISION (BO3) - ESL Pro League Group Stage	Spirit @ 82%	Spirit	0.032	0.034	AI closer
Counter-Strike: Spirit vs PARIVISION (BO3) - ESL Pro League Group Stage	Spirit @ 82%	Spirit	0.033	0.034	AI closer
Counter-Strike: Spirit vs PARIVISION (BO3) - ESL Pro League Group Stage	Spirit @ 82%	Spirit	0.032	0.034	AI closer
Counter-Strike: Spirit vs PARIVISION (BO3) - ESL Pro League Group Stage	Spirit @ 83%	Spirit	0.030	0.034	AI closer
Counter-Strike: Spirit vs PARIVISION (BO3) - ESL Pro League Group Stage	Spirit @ 84%	Spirit	0.026	0.034	AI closer

Model variants — the self-correction experiment

Model	Forecasts	Brier	Market Brier	Beats market	Accuracy
blend-mkt50-v1	11943	0.125	0.117	51%	81%
blend-mkt75-v1	11261	0.118	0.117	50%	83%
blend-mkt90-v1	11102	0.117	0.116	50%	84%
gemini-2.5-flash	6442	0.182	0.131	54%	74%
gemini-2.5-flash-cal2	3874	0.136	0.125	45%	79%
gemini-3.7-flash	7777	0.129	0.119	50%	82%
gemini-3.7-flash-cal2	7766	0.119	0.119	49%	84%

blend-mkt50-v1 = the raw AI probability blended 50/50 with the market price at forecast time — a deterministic self-correction deployed after the calibration analysis showed mid-range overconfidence. If the blend's Brier beats the market's, the AI adds information beyond price.

Calibration — when the AI says X%, how often does it happen?

AI confidence	Forecasts	Realized	AI Brier	Market Brier
0-10%	8	100%	0.941	0.000
20-30%	1	100%	0.640	0.922
50-60%	419	57%	0.252	0.173
60-70%	1078	44%	0.265	0.212
70-80%	1225	59%	0.232	0.189
80-90%	981	60%	0.231	0.218
90-100%	2730	86%	0.097	0.036

Red = overconfident (events happened less often than the AI's stated probability).

AI vs market, by market line

Market line (winner's price at forecast time)	Forecasts	AI Brier	Market Brier	AI edge
mkt 95%+	1691	0.082	0.001	-0.081
mkt 80-95%	1632	0.079	0.016	-0.062
mkt 60-80%	1222	0.114	0.094	-0.020
mkt 40-60%	1084	0.276	0.230	-0.046
mkt <40% (upset)	813	0.578	0.559	-0.019

Methodology

Hourly AI forecasts are stored with the contemporaneous market price (append-only receipts). At resolution every receipt is scored: Brier = (1 - probability assigned to the eventual winner)^2, for both the AI and the market price captured at the same timestamp. Lower is better. Brier is computed only for 2-outcome markets; a winner requires one outcome priced >=0.95 at resolution. No receipt is dropped silently.

Unscorable receipts: 43782 ({'no_probability': 1, 'market_expired_unresolved': 43608, 'ambiguous_resolution': 104, 'unmatched_outcome_text': 69}) — counted, never silently dropped.

Raw JSON: /api/v1/scoreboard · Updated 2026-10-02T23:30:03.544731+00:00 · Market-implied odds, not financial advice.