Sideline Quant
Loading…

Accuracy record · 2026-27 · settled

Gameweek 1

In GW1 the model missed by 2.75 points a player across the 95 likely starters it scored, and the real team scored 59.

There’s one of these for every settled GW, good or bad, and I don’t touch them once they’re up. The misses are at the top, and everything they’re worked out from is further down.

Where Gameweek 1 went wrong

  • Worse than usual this week - the model was out by 2.75 points a player, against 2.44 across the season so far.
  • Too optimistic overall: it predicted 332 points for 95 likely starters, who scored 302, so it was 10% too high.
  • 11 points sat on the bench and did not count (no Bench Boost).
  • Captain Mbeumo scored 2, tripled to 6 by the Triple Captain.
  • The best team the model could legally have bought scored 38, 26% of the 148 a perfect-hindsight XI would have made.

What went right

  • The model was closer than last season's points per game on points per player: 2.75 to 2.93 on the 95 players both scored.
  • The model was closer than last season's points per game on the big misses: 3.35 to 3.38 on the 95 players both scored.
  • The model ordered the players better than last season's points per game: 0.29 to 0.27 on the 95 players both scored.
  • The team scored 59, 9 above the average manager's 50.

Not available this week

  • No haul figures for this week. The predictions it's marked against didn't keep haul probabilities, so I've nothing to score this on.
  • GW1 is marked against the predictions committed before the season started (the "seed"), because I wasn't keeping the live runs yet.
  • There's no elite comparison this week because no top-10k sample was taken.

League-wide accuracy

Scored over predicted E[minutes] > 60 (n=95 of 584 player-fixtures). Every figure below is this gameweek only; the season-to-date line beside each one is the pooled figure across all settled gameweeks.

MAE
2.75
season to date 2.44 · mean absolute error, points per player-fixture
RMSE
3.35
season to date 3.19 · punishes big misses harder
Rank corr.
0.29 (0.09–0.45)
Spearman: 1.00 means it ordered the players how the week turned out, 0 means no relationship. The bracket is a 95% row-bootstrap interval and if anything it's too narrow.
Rows
95
player-fixtures scored in this gameweek's population
Σ projected
332
points the model projected over that population
Σ realised
302
points those players actually scored (the model was +30 on the total)
P(≥6) AUC
—
not available: haul probabilities weren't kept for this run
P(≥10) AUC
—
not available: haul probabilities weren't kept for this run

Prediction vintage: 18 Aug, 21:51 UTC seed · Predictions are from the last model run before each gameweek's deadline (90 minutes before the first kickoff). A gameweek marked 'seed' is from before I kept the runs, so it's scored against the pre-season predictions I committed.

95% percentile intervals from a row-level bootstrap (1000 resamples, seeded). Player-fixtures in the same GW share fixtures and clean sheets, which makes these intervals understate the true width - read them as a floor on the uncertainty. Fewer than 50 hauls is too few to claim a result from a haul AUC.

The same error on every group of players

I never show the every-player figure on its own (SPEC §1.6), so all four are here. Whichever group you think is the right one, my number for it is on the page - just compare it with other people's on the same rows.

PopulationnMAERMSESeason MAE
Every player-fixture with a prediction5841.492.561.16
Predicted E[minutes] > 05191.672.721.35
Played at least one minute (selected on the outcome)hindsight3012.213.402.00
Predicted E[minutes] > 60headline952.753.352.44

Reliability of the stated probabilities

In each bin of predicted probability, what fraction actually happened, with a Wilson 95% interval. A calibrated forecaster's observed column tracks its predicted column. The minutes model's P(60+) is read on every gameweek, the haul probabilities on the gameweeks whose run retained them.

P(plays 60+ minutes)
played 60+ minutes · every projected player-fixture whose run kept this probability (n=584 of 584)
PredictedObserved95%n
1%1%0–5118
5%4%1–1257
8%34%23–4759
12%26%16–3858
18%41%30–5458
27%41%29–5359
38%53%41–6658
61%71%58–8158
80%85%73–9259

Against the comparators

The model's error next to a comparator's, on the same rows. If a comparator can't cover every row the model scored, I drop the rows it's missing and re-score the model on what's left. The model's headline number for the week isn't part of the comparison.

Comparator
Last season's points per game

Each player's total FPL points last season divided by his appearances, which is the number most of us reach for before a ball is kicked.

Rows covered. This comparator scored 95 of the model's 95 rows for this GW, with none of the model’s rows excluded. Every “model” number in this table is the model re-scored on exactly the 95 rows it covers, which is the only like-for-like comparison.

Population: reference arm's predicted E[minutes] > 60, imposed on every arm (n=95 of 403 player-fixtures); players with a prior-season appearance only

Last season's points per game against the model on the 95 rows both cover, Gameweek 1
MetricModel · these 95 rowsLast season's points per game
MAE
model ahead
2.752.93
RMSE
model ahead
3.353.38
Spearman rank correlation
model ahead
0.290.27
Haul AUC, 6+ points
not carried by this arm
——
Haul AUC, 10+ points
not carried by this arm
——

A dash means there’s no figure for that metric from this comparator, which isn’t the same as a zero. “No direction stated” means the data doesn’t say which way is better for that metric, and without that I don’t call a winner.

Comparator
Top-10k effective ownership

How much the top-10k sample owned each player at the last capture before the deadline, including captaincy. It doesn't come with a points prediction so I only score it as a rank.

Different rows. This comparator scored 0 of the model's 95 rows for this GW; 95 of the model’s rows are left out because it has nothing to say about them. Every “model” number in this table is the model re-scored on exactly the 0 rows it covers. Its headline error for the GW (2.75, over 95 rows) is not the one to read against this comparator.

Population:

Top-10k effective ownership against the model on the 0 rows both cover, Gameweek 1
MetricModel · these 0 rowsTop-10k effective ownership
MAE
not carried by this arm
——
RMSE
not carried by this arm
——
Spearman rank correlation
not carried by this arm
——
Haul AUC, 6+ points
not carried by this arm
——
Haul AUC, 10+ points
not carried by this arm
——

A dash means there’s no figure for that metric from this comparator, which isn’t the same as a zero. “No direction stated” means the data doesn’t say which way is better for that metric, and without that I don’t call a winner.

Comparator
FPL's own projection (ep_next)

The expected-points figure FPL publishes for each player before the GW, captured between the previous deadline and this one. It's a per-GW number and can't tell you anything about the second game in a DGW, so like the ownership figure I only score it as a rank.

Different rows. This comparator scored 0 of the model's 95 rows for this GW; 95 of the model’s rows are left out because it has nothing to say about them. Every “model” number in this table is the model re-scored on exactly the 0 rows it covers. Its headline error for the GW (2.75, over 95 rows) is not the one to read against this comparator.

Population:

FPL's own projection (ep_next) against the model on the 0 rows both cover, Gameweek 1
MetricModel · these 0 rowsFPL's own projection (ep_next)
MAE
not carried by this arm
——
RMSE
not carried by this arm
——
Spearman rank correlation
not carried by this arm
——
Haul AUC, 6+ points
not carried by this arm
——
Haul AUC, 10+ points
not carried by this arm
——

A dash means there’s no figure for that metric from this comparator, which isn’t the same as a zero. “No direction stated” means the data doesn’t say which way is better for that metric, and without that I don’t call a winner.

How the comparators are scored Lower is better for MAE and RMSE, and higher is better for Spearman and haul AUC. Which way is better is stored with each metric and the verdicts just follow that. Each baseline is scored on the model's own likely starters (expected minutes over 60) and reports the model's score over those same rows, which keeps the two numbers like for like even when the baseline can't cover every row. Overall Spearman and AUC are averages over the GWs where both sides have a value. I don't pool them across gameweeks, because that would rank a GW1 blank against a GW7 haul.

Legal-squad Team of the Week

Picked from the last model run before the deadline, at the prices captured before it, then scored on what actually happened.

Not comparable with the real entry. A fresh £100.0m squad bought from scratch every gameweek - it never pays a transfer hit or banks a price rise and nothing carries over from the week before. Think of it as a weekly check on the model's picks within the real squad rules. Nobody could run a team this way in practice, so it's not comparable with a managed entry.

XI projected
54.6
with captain 61.0
XI realised
38
with captain 40
Capture
26%
of the 148-point hindsight XI, a ceiling that ignores the budget and the club cap
Spend
£100.0m
of £100.0m · 4-5-1
The legal-squad Team of the Week for Gameweek 1
PlayerClubPosPoints
RayaArsenalGK6
GabrielArsenalDEF5
O'ReillyMan CityDEF2
VirgilLiverpoolDEF2
TarkowskiEvertonDEF6
Mbeumo(C)Man UtdMID2
B.FernandesMan UtdMID2
SzoboszlaiLiverpoolMID8
RiceArsenalMID3
WirtzLiverpoolMID2
WatkinsAston VillaFWD0
Bench (does not score)
DubravkaSpursGK0
DiopIpswich TownDEF2
DestanHull CityFWD0
Walle EgeliIpswich TownFWD1

Against the real entry

TOTW
40
XI with the captain doubled
Entry
59
before hits; none were taken this week
Difference
−19
not a like-for-like contest

Don’t read this as a head-to-head. A fresh £100.0m squad bought from scratch every gameweek - it never pays a transfer hit or banks a price rise and nothing carries over from the week before. Think of it as a weekly check on the model's picks within the real squad rules. Nobody could run a team this way in practice, so it's not comparable with a managed entry.

Deadline 21 Aug, 17:30 UTC · prediction 18 Aug, 21:51 UTC (seed) · prices 18 Jul, 13:53 UTC–21 Aug, 17:01 UTC (241 from an earlier capture) · pool 587 of 587 predicted · 587 of them had no earlier appearance to read position and club from, so those came from this gameweek

The real entry · Sideline's Team

This is the squad the model actually ran. Unlike the Team of the Week above, it has to live with its transfer hits, its bench and whatever it carried over from the week before.

Points
59
no hits taken
vs average
+9
field average 50 (FPL publishes it before hits)
vs top 10k
—
no top-10k capture for this gameweek
Overall rank
1,987,556
gameweek rank 1,987,559
Projected
65.7
Σ multiplier × xP over 15 of 15 picks, from the committed pre-season seed bundle (18 Aug, 21:51 UTC)
Bench
11
left on the bench
Transfers
0
0 paid · chip: TC
Squad value
£99.5m
£0.5m in the bank · captain Mbeumo
The entry’s squad in Gameweek 1
PlayerClubMinsBonusPoints
RayaArsenal9006
GabrielArsenal9005
O'ReillyMan City6202
VirgilLiverpool9002
CalafioriArsenal8009
TarkowskiEverton9006
B.Fernandes(V)Man Utd9002
SzoboszlaiLiverpool9018
WirtzLiverpool6202
Mbeumo(C)Man Utd9002
João PedroChelsea90211
PhillipsbenchHull City000
TavernierbenchBournemouth90310
Walle EgelibenchIpswich Town1001
Kusi-AsarebenchFulham000

Cumulative after this gameweek: 59 · captured 28 Aug, 17:08 UTC · 25 squad captures

Where these numbers come from

Predictions are from the last model run before each gameweek's deadline (90 minutes before the first kickoff). A gameweek marked 'seed' is from before I kept the runs, so it's scored against the pre-season predictions I committed.

Population scored: predicted E[minutes] > 60 (n=95 of 584 player-fixtures).

This page is a slice of the same /performance/live payload that drives the full record, which means a GW page and the season page can’t disagree. The projections themselves are published in full at /data/gw/1.

The exact rows this GW was scored on (the last run before the deadline, as it was served) are at fpl-quant-api.fly.dev/performance/live/gw/1/predictions with sha256 4d566e22…dc02. The digest is of the rows array alone as compact JSON (no whitespace), rows sorted by player then fixture, and the response says so beside it. You can recompute any number on this page from them.

What this record measures, on which rows, against which comparators and at which checkpoints was fixed in advance: the pre-registration (sha256 27307797…ba4f, checkpoints GW10, GW19, GW38).

Every settled gameweek has a page: GW1, GW2, GW3, GW4, GW5, GW6, GW7, GW8.