After four full weeks of play, the new England Patriots are one among only 3 undefeated teams left within the NFL,1 and their defense is getting much of the credit for their early success. The Patriots lead the league in point differential at +95 and, on the strength of defensive backs Jonathan Jones and Jason McCourty, are particularly good against the pass. new England has yet to allow a passing touchdown this year, making it one of just 10 teams since the AFL-NFL merger to accomplish that feat in the first four games of the season. And it’s not just the pass defense. The Patriots have surrendered just one touchdown in total on defense — a 1-yard run by Buffalo quarterback Josh Allen in Week 4.
Given these eye-popping stats, we would expect the Patriots to top the leaderboard in defensive expected points side per play. And that’s precisely what we discover. new England stands atop the rankings with an EPA per play quite double that of the second-ranked defense, cities.2
This list tracks well with our intuition of how defenses have performed and pass the “eye test.” new England, San Francisco, Chicago, and Buffalo appear to be good defenses, and Miami, Oakland, Baltimore, and Indianapolis seem to be bad. With 1 / 4 of the season finished, we might even be tempted to draw some conclusions from this defensive leaderboard — it looks reasonable to expect the smart defenses to stay good and the bad to remain bad. but does further evidence support make these inferences? Or are our eyes and the same data fooling us?
To find out, we took ESPN Stats group data from 2006 through 2018 and calculated the year-to-date EPA per play for each team before a given game. Then, we tested how well the team’s past performance predicted what the teams ultimately did in those games.
As an example, for a team’s fifth game of the season, we have a tendency to checked out the previous four weeks of games and calculated the EPA per play for every team.3 we then took those EPA averages and tested how well they predicted the EPA per play for that team in Game 5. If the defense was good in the first through fourth games, did it tend to stay good in the fifth? we tend to conduct this analysis for every game of the season for each offense and defense, using the data from all previous games of the season. The results were surprising.
The Future Defensive Success as Patriots Fans Would like to Believe.
There’s a lot we don’t know about teams early in the season, but after 9 or 10 games, we like to think that we have an honest plan regarding however every unit can perform in a very given game, particularly late within the season with the playoff picture focused. This seems to be partly true — for the offense, anyway. Our ability to predict a team’s offensive performance in a future game will improve because the year goes on, peaking around Game 11. But, surprisingly, this isn’t true for the defense. we know roughly as much about a team’s future defensive performance after one game of results as we do after 12 or 13.
In fairness, our ability to predict offensive performance is fairly modest,4 and by the very end of the season, we do see a small spike in our ability to predict defensive performance. but when comparing the predictive power of the 2 measures, the difference ranges from moderate to dramatic. exactly why we can’t predict defense as well is tough to say with any confidence, but it might start with our inability to fully quantify the parts of a defender’s performance that are stable over time and reliably impact a game. In other words, it’s possible that we aren’t measuring the right factor by taking the aggregate performance of the offenses a team has faced and assigned the relative success or failure to the defense. rather than capturing the strength of a team’s defensive unit, our metrics and stats may largely be mensuration a team’s strength of schedule.
Taking this read, the Patriots’ defensive performance is probably best attributed to the inept offensive performances of their opponents: the Steelers with an aging ben Roethlisberger and newly without Antonio Brown; the tanking Miami Dolphins in a four3-0 blowout; a Jets team led by quarterback Luke Falk because of Sam Darnold’s bout with mononucleosis; and a narrow win over the Bills without a concussed Allen in the fourth quarter of Week 4.
Perhaps these performances aren’t as clear a harbinger of future defensive success as Patriots fans would like to believe. Conversely, it’s potentially good news for the defenses of Indianapolis, Baltimore and Oakland.5 we should probably be hesitant to read too much into their slow starts. Things can change quickly in the NFL, especially on defense.