clock menu more-arrow no yes mobile

Filed under:

Rethinking defensive stats: 3rd down conversion rates

The Seahawk defense is allowing the 12th lowest 3rd-down conversion rate at 37%. Should it count as a weakness for an otherwise top-of-the-league unit?

Norm Hall

Is getting off the field on third down important? After much study and analysis, I've reached a conclusion-- actually, it's more like a discovery-- hell, it's a freakin' revelation:

Teams just aren't punting on 1st and 2nd down.

Snark aside, the meaningful implication here is that preventing third down conversions is not the absolute measure of a defense's ability to get off the field. They can force a turnover on an earlier down and still be good; they can give up a string of conversions on earlier downs and still be bad. It's just that the treacherous valley of third down tends to lie astride the golden path leading to the promised land of fourth down, so it gets a lot of notice.

And subjectively, when a defense reaches that (allegedly) critical third down, we think "here's their chance!" It's like watching an offense reach the red zone with an opportunity to score a touchdown. C'mon guys, you've made it this far, punch it in / punch 'em out.

More objectively, if your opponent gets a first down, you've failed to stop him and he now has three more chances to move the ball downfield.

But let's try wrapping our minds around a warped and twisted perspective: When your opponent gets a first down, they failed to score points and you have 10 more yards of opportunity to force a punt.

Turning that perspective into a strategy requires that you force your opponent to slog along a few yards at a time, so that they rarely advance the ball into scoring range before you manage to force a punt or a turnover. And, wonder of wonders, getting off the field is nowhere to be found on Pete Carroll's list of defensive priorities. Bullet point #1 is "Eliminate giving up the big play". Bullet point #3 is "Get the ball".

Are the Seahawks actually playing like this? Is it working?

Stat time!

OFI: The on-field index

We'll begin by trying to measure what, for lack of a better term, I'll call get-off-the-fieldness. (Seriously, there is no better term. I like hyphens.) The total number of defensive plays per drive is meaningful, but the real crux of the matter is how many first downs you allow. So the index is weighted as follows:

Plays per drive + 2.5 x first downs per drive

That ratio is consistent with league averages of first downs per play. It also produces a result which almost always gives a higher total number to a drive with more first downs, even if it includes fewer plays. For example, 8 plays + 2 first downs yields on "OFI" of 13. Six plays + 3 first downs yields an "OFI" of 13.5.

And just to tighten things up:

"Adjusted 1st downs" adds all touchdowns allowed (by the defense) to the number of first downs allowed. Technically, allowing a touchdown brings the drive to a halt and gets you back the ball. But it's still a success in making the line-to-gain and will be predictive (and descriptive) of a team's ability to make or stop first downs.

"Adjusted plays" simply throws out the first play of the drive, because that one was guaranteed. Subsequent plays are likely, but can be denied if there is a turnover.


ON-FIELD INDEX, STATS per DEFENSIVE DRIVE

Team Adj 1st downs Adj plays OFI
Kansas City Chiefs 1.32 3.92 7.23
Baltimore Ravens 1.41 4.14 7.66
San Francisco 49ers 1.57 4.05 7.98
New York Jets 1.49 4.32 8.04
Buffalo Bills 1.69 4.33 8.55
Houston Texans 1.69 4.41 8.65
Denver Broncos 1.83 4.24 8.81
New Orleans Saints 1.80 4.33 8.83
Detroit Lions 1.83 4.36 8.92
Tennessee Titans 1.80 4.44 8.93
Arizona Cardinals 1.81 4.43 8.95
New England Patriots 1.72 4.66 8.96
Green Bay Packers 1.80 4.59 9.09
Carolina Panthers 1.71 4.83 9.11
Seattle Seahawks 1.79 4.76 9.24
Tampa Bay Buccaneers 1.88 4.61 9.30
Cleveland Browns 1.84 4.74 9.34
Washington Redskins 2.04 4.26 9.36
Indianapolis Colts 1.88 4.79 9.48
Pittsburgh Steelers 1.82 4.94 9.48
Cincinnati Bengals 1.84 5.03 9.62
St. Louis Rams 2.06 4.64 9.80
New York Giants 2.01 4.79 9.81
Miami Dolphins 1.92 5.03 9.82
Oakland Raiders 2.03 4.84 9.91
Atlanta Falcons 2.02 4.94 9.98
Minnesota Vikings 2.13 4.75 10.08
Dallas Cowboys 2.11 4.87 10.14
Jacksonville Jaguars 2.19 4.67 10.14
Chicago Bears 2.13 4.85 10.17
Philadelphia Eagles 2.22 5.01 10.56
San Diego Chargers 2.19 5.32 10.79

The Seahawks rank a below-average 20th in plays/drive. They're a respectable 9th in adjusted 1st downs/drive, but both numbers (and their OFI) are a far cry from the team's perceived defensive quality.

VIX: The value index

Next question, then: What have opposing offenses actually produced?

League-wide, defenses are giving up 16.635 yards for every point they allow. So to weight points and yards equally, we would add the total yards allowed and 16.635 x points allowed.

But we don't want exactly that. Ostensibly, we want to measure whether the Seahawks (as compared to other teams) are playing successful all-around defense by allowing small gains. We want to identify defenses which give their team the ball back with good field position. And most importantly, we don't want to over-measure red zone defense. There's already a "bendability" index floating around cyberspace for that.

So, arbitrarily, I've selected a ratio of 3:2 in favor of measuring yards. Which makes the base index:

Yards allowed + 11.09 x points allowed

Also, we want a number that we can directly compare to the OFI. Yardage is a bigger number than first downs. So, after a little math, it was determined that the indices differed by a factor of 5.27056. We simply redefine our value index, keeping yards and points in proportion thusly:

yards allowed/5.27056 + points x 2.1041

Finally, we want to make sure that points allowed measures only the defensive effort. So I used the average starting field position of each team (on defense) and computed the variance from the league-average of the 27.79 yard line. Any extra help (or extra hurt) provided by field position was then converted to points (at 16.635 yards per) and subtracted from (or added to) the points allowed. (No adjustment is made for yards allowed. Points allowed is directly affected by field position, but yards allowed is already measured independently).

VALUE INDEX, STATS per DEFENSIVE DRIVE

Team Yards Adj points VIX
Kansas City Chiefs 22.92 1.19 6.85
New York Jets 23.53 1.42 7.46
Seattle Seahawks 25.32 1.38 7.71
Baltimore Ravens 26.38 1.40 7.95
San Francisco 49ers 25.09 1.56 8.04
Carolina Panthers 27.76 1.37 8.15
Buffalo Bills 26.90 1.55 8.36
Cleveland Browns 25.36 1.73 8.45
New England Patriots 27.74 1.53 8.48
Tennessee Titans 28.08 1.55 8.58
Cincinnati Bengals 29.25 1.45 8.60
Houston Texans 24.99 1.94 8.83
Pittsburgh Steelers 28.32 1.65 8.85
New York Giants 28.70 1.62 8.86
Tampa Bay Buccaneers 28.89 1.67 8.99
Arizona Cardinals 27.51 1.79 8.99
New Orleans Saints 29.39 1.62 8.99
Green Bay Packers 29.64 1.73 9.27
Indianapolis Colts 30.69 1.76 9.52
Oakland Raiders 30.45 1.84 9.64
Miami Dolphins 31.01 1.82 9.71
Minnesota Vikings 30.48 1.95 9.88
Denver Broncos 29.88 2.09 10.06
Washington Redskins 31.54 1.94 10.07
Dallas Cowboys 32.44 1.92 10.19
Philadelphia Eagles 33.21 1.88 10.26
Detroit Lions 32.33 2.02 10.39
St. Louis Rams 32.27 2.05 10.44
Jacksonville Jaguars 32.24 2.23 10.80
Atlanta Falcons 33.30 2.44 11.45
Chicago Bears 35.09 2.34 11.57
San Diego Chargers 38.41 2.07 11.64

The Seahawks rank 5th in yards/drive and 3rd in adjusted points/drive.

Putting it Together: The "Slog Factor"

Note that the VIX is pretty unambiguous. It measures yards and points given up. Teams with a low VIX are playing good defense.

The OFI, on the other hand, is really just a hint. We can't be sure that giving up more plays and more first downs indicates poor defensive play, but we can expect a strong correlation.

So the "slog factor" (I'm assuming that inventing a statistic is like describing a new species, granting the discoverer/creator the privilege of naming it) is simply the VIX minus the OFI. Thanks to the normalized indices, an average slog factor should be around zero. Teams with a positive slog factor are allowing opposing offenses to gain more points and yards with fewer plays and first downs. Teams with a negative slog factor are making their opponents slog, producing fewer points and yards in relationship to the number of first downs gained and plays ran.

I suppose I could've just measured "yards per first down" or "points per play", but neither is quite as comprehensive. And it also wouldn't afford the same opportunity to compare where each team ranks in the league.

DEFENSIVE SLOG FACTOR

Team OFI OFI rank VIX VIX rank Slog Factor
Seattle Seahawks 9.24 15 7.71 3 -1.54
Cincinnati Bengals 9.62 21 8.60 11 -1.02
New York Giants 9.81 23 8.86 14 -0.95
Carolina Panthers 9.11 14 8.15 6 -0.95
Cleveland Browns 9.34 17 8.45 8 -0.89
Pittsburgh Steelers 9.48 20 8.85 13 -0.63
New York Jets 8.04 4 7.46 2 -0.59
New England Patriots 8.96 12 8.48 9 -0.48
Kansas City Chiefs 7.23 1 6.85 1 -0.38
Tennessee Titans 8.93 10 8.58 10 -0.35
Tampa Bay Buccaneers 9.30 16 8.99 15 -0.32
Philadelphia Eagles 10.56 31 10.26 26 -0.30
Oakland Raiders 9.91 25 9.64 20 -0.27
Minnesota Vikings 10.08 27 9.88 22 -0.20
Buffalo Bills 8.55 5 8.36 7 -0.19
Miami Dolphins 9.82 24 9.71 21 -0.11
Arizona Cardinals 8.95 11 8.99 16 0.04
Indianapolis Colts 9.48 19 9.52 19 0.04
San Francisco 49ers 7.98 3 8.04 5 0.05
Dallas Cowboys 10.14 28 10.19 25 0.06
New Orleans Saints 8.83 8 8.99 17 0.16
Green Bay Packers 9.09 13 9.27 18 0.18
Houston Texans 8.65 6 8.83 12 0.19
Baltimore Ravens 7.66 2 7.95 4 0.29
St. Louis Rams 9.80 22 10.44 28 0.65
Jacksonville Jaguars 10.14 29 10.80 29 0.66
Washington Redskins 9.36 18 10.07 24 0.71
San Diego Chargers 10.79 32 11.64 32 0.85
Denver Broncos 8.81 7 10.06 23 1.25
Chicago Bears 10.17 30 11.57 31 1.41
Detroit Lions 8.92 9 10.39 27 1.46
Atlanta Falcons 9.98 26 11.45 30 1.47

This is a fun stat. I mean, all stats are fun, but this is like that time when the square root of 2 and pi showed up to a party as part of the same complex number.

I say that because a high/low slog factor is not inherently good or bad. It's a measure of strategic emphasis, which has to be considered alongside other information.

For teams that rank poorly in both OFI and VIX, such as the Chargers, Jaguars, and Bears, there is probably a snowball effect. Forced to play a lot of snaps, these defenses get worn down and cannot stop their opponents from piling on the points. So it's no surprise that they have the highest slog factors, and the poor defensive performance shouldn't necessarily be blamed on over-aggressive play.

(Note that one could argue that the slog factor measures nothing more than the difference between quality of run defense and quality of pass defense. But I would call one wrong. The top 12 teams in offensive DVOA collectively run the ball 43.7% of the time, versus a league average of 42.2%. Ten of the top 11 in points per drive run the ball at least 39% of the time. The top 10 teams in pass percentage (ranging from 62%-68%) collectively have fewer points per drive and fewer yards per play than league average.
If your pass defense is significantly worse than your run defense, you're over-playing the run. And possibly the short pass.)

The Texans, Saints, Redskins and Lions are all giving up too many points and yards. Detroit has the league's 9th-best OFI (meaning they get off the field well) but the second-highest slog factor. They are clearly playing too aggressively.

The Ravens' slog factor is higher than average, suggesting that perhaps they are not exploiting their excellent OFI to full effect. But given that they have an excellent VIX, the strategy seems to be working. The numbers say that the defense is giving up some extra yards and points by playing aggressively, but they're keeping themselves fresh to stay effective throughout the game.

And what of Denver? The raw numbers say that their defense is putting way too much emphasis on getting off the field. On the other hand, the Broncos' opponents are probably playing aggressively themselves, often down by multiple touchdowns and heaving the ball deep.

The Eagles, Vikings and Raiders might benefit from playing more aggressively. Their low slog factor combined with a high VIX suggests that they may be giving up points because they can't get off the field.

Further up the list we find the Bengals, Panthers, Browns, Patriots and Jets among the lowest 8 in slog factor. These teams are clamping down on both yards and points, despite giving up first downs. It's possible that these teams could benefit from focusing more on the down marker, but each is in the top 11 VIX, so it's more likely that their strategy of stopping big plays is working.

For Seattle, the slog factor is nothing short of remarkable. The proof is in the pudding, namely, the league's 3rd-best VIX. More than any other defense, the Seahawks just aren't paying a lot of attention to that first down marker. They defend the whole field on every play, knowing that someone will make a drive-killing play on defense (or a mistake on offense) before much territory is surrendered.

(A note for the curious: If we plug in the numbers for Seattle's offense, they have 4.63 adjusted plays/drive, 1.99 adjusted 1st downs per drive, and an OFI of 9.633. Their adjusted points/drive is 1.93 and yards/drive is 31.08, equaling a VIX of 9.97 and a slog factor of 0.33. I don't have offensive figures for the whole league, but the positive slog factor indicates a good proportion of explosive plays for a team that runs the ball as frequently as Seattle.)

EDIT: Here's a scatter plot with OFI on the x-axis and VIX on the y-axis:

Ofivsvix_medium