Why Tennis Statistics Do Not Compare Across Tournaments

A player's serve and return statistics from two tournaments look like the same measurements. They are frequently produced by different systems working to different rules.

Instrumentation is not uniform

Ball tracking, radar and automated line calling are installed on some courts and not others, often varying between show courts and outside courts at the same event.

A match played on an uninstrumented court yields only manually collected statistics. The published line for that match is thinner and produced by a different method.

Aggregating a player's season therefore combines measurements from several instrumentation regimes without any indication of which match came from which.

Radar placement changes serve speeds

Serve speed depends heavily on where the measurement is taken, since the ball decelerates continuously. Equipment sited differently produces systematically different readings.

Calibration practice also varies between events. Two tournaments can each be internally consistent while disagreeing with each other by a meaningful margin.

Fastest-serve lists compiled across events consequently mix incompatible readings. The leaderboard partly ranks tournaments rather than players.

Surface changes what the numbers mean

Rally length, first-serve effectiveness and net approach frequency all shift with surface. A player's aggregate season figures are a weighted average of the surfaces played.

A season heavier in clay events produces different numbers from a season heavier in hard courts for the same player playing the same way.

Careful analysis splits by surface for this reason. Headline career statistics almost never do, which makes them a poor basis for comparison between players with different schedules.

Definitions differ between providers

Categories such as forced errors, net points and return depth are coded to house definitions. Different events contract different providers, so the codebook changes between tournaments.

Even a mechanical statistic like an ace has edge cases, such as a serve touched but not controlled, and those are resolved differently by different operations.

The disagreements are individually small and cumulatively real. They set a floor on how precisely any cross-tournament comparison can be stated.

What comparison remains valid

Within-match comparison is sound, because both players were measured by the same system under the same conditions on the same day.

Within-tournament comparison is usually sound for matches on instrumented courts, which is why event-level analysis tends to be more defensible than season-level analysis.

Across a career, the honest framing is directional rather than precise. The numbers show shape and trend; they do not support the decimal places they are printed with.

The phrase you hear in selection meetings is that a player is one-dimensional. It is said as a criticism. I have never fully understood why, given that the format is short enough that a team only needs a handful of dimensions in total and can distribute them across eleven bodies.

Consider the batter who can only hit down the ground and only against pace. He is useless in the middle overs against two spinners on a turning surface. He is also, in the right six deliveries, the most valuable player on the field, because the thing he does badly never comes up and the thing he does well comes up repeatedly.

The counter is obvious and it is about flexibility. If a wicket falls at the wrong moment, a specialist walks into a situation he cannot handle, and you have burned a slot. That is real. But it is a scheduling problem, not a talent problem, and scheduling problems have solutions that talent problems do not.

What actually happens is worse than either. Sides pick a squad full of players who are competent in every phase and outstanding in none, then wonder why they keep posting adequate totals and losing to somebody who had one man go berserk for four overs. Competence across the board is a way of guaranteeing you are never the reason a match turns.

I would rather carry two narrow players and accept that in a third of matches one of them is dead weight. The distribution of outcomes matters more than the average, because you do not get half a trophy for finishing consistently mid-table in a knockout competition.

There is a coaching dimension to this that gets ignored. Telling a specialist to broaden his game usually makes him worse at the thing he was picked for, because the technique that lets a player hit a length ball over long-on is not the technique that lets him work it into the leg side. They fight each other. He ends up in the middle, hitting neither shot with conviction, and within a season he is a squad player.

Leave him alone. Let him be strange.

The best selections I have watched were not the most complete cricketers on the list. They were the ones whose weakness the captain had a plan to hide.