Skip to content
Developer docs
Metrics

Brier score

The Brier score is a measure of forecast accuracy: the mean squared difference between each forecast probability and the outcome, which is 0 or 1. A perfect score is 0 (every forecast exactly right), and 1 is the worst possible. The score grades a market's prices or a trader's positions against what happened. Below 0.25 beats a forecaster who always says 50%, which scores 0.25 on a binary event, and below 0.15 is strong.

Formula

Brier = mean of (predicted probability - outcome)^2, where outcome is 1 or 0

Ranges from 0 (perfect) to 1 (worst). Always predicting 0.5 scores 0.25, which is the benchmark to beat.

How to read a Brier score

The Brier score is the average squared distance between what you said would happen and what did. Say 70% for something that occurs and you take a penalty of 0.09; say 70% for something that does not and the penalty is 0.49.

Squaring is the whole design. It makes confident errors far more expensive than cautious ones, which is what stops a forecaster from improving their score by forecasting 99% on everything.

The benchmark that matters

A forecaster who answers 0.5 to every question scores 0.25 without knowing anything. Any score above that is worse than refusing to have an opinion, and plenty of confident forecasting records land there.

Applied to a market rather than a person, the Brier score of the closing price is the standard measure of how well prediction markets forecast. It is also the fair comparison for a trader who claims to beat the market: same questions, same scoring rule.

Where 0xinsider uses the Brier score

Trader profiles show a Brier score on the Forecast Accuracy card, beside a calibration edge. These metrics describe different aspects of forecasting. For a single trade, closing line value compares your entry price with the price the market closed at.

Worked example

You predicted 70% for an event that occurred, 30% for one that did not, and 80% for one that did. Brier = [(0.7-1)^2 + (0.3-0)^2 + (0.8-1)^2] / 3 = [0.09 + 0.09 + 0.04] / 3 = 0.073. That is a strong score.

Brier score on 0xinsider

Closing line value

The practical version of calibration: did the price move toward your entry after you traded.

Live feed

Brier score on live data

The leaderboard ranks S, A, and B wallets, graded mostly on realized profit. The live feed lists large Polymarket trades as they fill on Pro, and 24 hours later without it.

Picks and market activity

Read the published picks or follow large trades. The free feed runs 24 hours behind; Pro has no delay.