PFF's enterprise business has joined Teamworks.Learn More The consumer business remains independent, continuing to power your winning decisions through PFF.com and PFF+.

Fantasy: Using PFF Premium Stats to Win Your League, Part 2

This article is the second installment in an ongoing series examining how the myriad Premium Stats provided by PFF can be used to your advantage when assembling your fantasy team. In Part 1, we learned how team-level offensive statistics can be used to predict an offense’s collective fantasy output the following season. Part 2 applies similar team-level analyses to the defensive side of your fantasy roster.

I suppose I should begin with the following confession: I’m no IDP expert. In fact, the last fantasy league of mine to require any defensive players at all was also my first league, and it required only 3. Oh, and did I mention that this was eleven years ago?[1] My lack of enthusiasm for IDP leagues probably stemmed from the fact that, at the time my interest in fantasy football was piqued, there just weren’t a lot of IDP resources available to fantasy players. Most major fantasy publications had, at best, token analyses of defensive players. If you were lucky, you could maybe even find a cheat sheet or two. As a player who likes to have a stack of expert opinion on hand before making draft-day decisions, I just couldn’t get too excited about what amounted to a dartboard approach to building a defensive squad.

Well, a lot has changed over the past decade, and it’s probably high time I admit to myself that these IDP prejudices are outdated. Most fantasy football outlets now have multiple analysts dedicated to IDP coverage, and Pro Football Focus is no exception. In fact, the IDP staffers here at PFF, led by Jeff Ratcliffe and Ross Miles, provide a quality and depth of defensive coverage that any site would be hard-pressed to match.

This is really just a long-winded way of saying: (1) I’m not here to offer an opinion on how early you should consider drafting Von Miller, or how I think Stephon Gilmore will fare in the Bills’ secondary, and (2) there are some really qualified folks out there who can answer those exact questions. What I can offer you, however, is a macro-level view of the relationship between PFF’s complex statistics and defensive fantasy performance. The main advantage of being a PFF subscriber is the ability to access PFF’s Premium Stats. But what good is any stat about a player or a team, Premium or otherwise, if you can’t use that information to gain an edge over your league mates?

That’s where I come in. This week’s study examines the relationship between PFF’s cumulative by-team defensive stats[2] and a team’s cumulative by-team defensive fantasy points. In other words, is there anything that a team’s performance in stopping the run, rushing the passer, defending the pass, and avoiding costly penalties can tell us about that team’s future ability to put up solid fantasy numbers? As I did with by-team offensive stats in the previous post, I will test the team defensive stats for both convergent and predictive validity.[3]

Method & Results

Note about PFF’s Premium Stats: Pro Football Focus began their current method of statistical tracking back in 2008, which means we now have four seasons worth of fastidiously collected data at our disposal. As mentioned above, the current work will be looking specifically at cumulative team defensive stats across all four seasons. There are five categories of defensive stats in total: Overall, Run Defense, Pass Rush, Pass Coverage, and Penalty. What the stats intend to capture should be intuitive and self-explanatory, but I’ll refer you here for more precise details. Although the numerical range varies for the different stats, generally, more extreme negative numbers indicate the team performed poorly in that particular facet of the game while more extreme positive numbers indicate they performed well.

The approach I took to totaling a team’s defensive fantasy points was quite similar to my method for totaling offensive fantasy points. First, I divided the defensive points into the following categories: points from Tackles (1 point for solo tackles, 0.5 points for an assist), Sacks (2 points per sack), Air Pass Defense (1 point per pass defended, 2 points per interception), Total Pass Defense (Air Pass Defense + Sacks), and Total Defense (Tackles + Total Pass Defense).[4] [5] [6] After choosing the categories, I simply summed the totals in each category for every defensive player on the team. So, for example, the 2011 St. Louis Rams Tackles total of 784.5 comes from James Laurinaitis’s 122 points + Quintin Mikell’s 83 points + … + Ronald Bartell’s 1 point.

For this first level of analysis, we have 128 cases (32 NFL teams × 4 seasons) of the 10 variables described above (the five PFF stats and the five categorized fantasy totals). To establish the convergent validity of the five PFF measures, I measured the level of correlation between each of the PFF stats and each of the categorical fantasy totals. Results are summarized in the table below.

 

Pro Football Focus Cumulative Team Defense Stats (2008-2011)

Team Fantasy Points

Overall

Run Def.

Pass Rush

Pass Cov.

Penalty

Tackles

-.467**

-.382**

-.240**

-.340**

.096

Sacks

.584**

.466**

.539**

.226*

-.297**

Air Pass Def.

.426**

.320**

.080

.524**

-.036

Tot. Pass Def.

.653**

.509**

.420**

.461**

-.227*

Total Defense

-.167

-.149

-.042

-.128

-.014

 

Note about interpreting correlations: Correlation coefficients can range from -1.000 to 1.000. The closer the coefficient is to either of those values (i.e., the farther it is from zero), the stronger the linear relationship between the 2 variables. Positive coefficients indicate positive linear relationships—as one variable increases, so does the other. Conversely, negative coefficients indicate inverse relationships—as one variable increases, the other decreases. When reading these tables, a single asterisk next to a coefficient denotes a statistically significant relationship between the two variables referenced in the intersecting row and column (p < .05); very significant relationships are indicated by a second asterisk (p < .01)

The first thing to notice here is that none of PFF’s five defensive stats have a meaningful relationship with the aggregate number of fantasy points being scored by a team’s defensive players (i.e., Total Defense). I was initially quite surprised by this, but it becomes apparent why this is the case when we take a closer look at the correlations between the stats and the categorized fantasy totals. Specifically, there are strong negative relationships between all areas of defensive performance (except for Penalty) and the amount of fantasy points from Tackles, but these negative relationships are offset by nearly uniformly positive, significant relationships between the PFF stats and points accumulated through sacks and pass defense.

So we’re seeing two basic relationships here: (1) bad defense begets higher tackling totals, and (2) good defense produces opportunities for pass rushers and defensive backs to make plays in the passing game.[7] Both of these relationships make a lot of intuitive sense—if a defense is bad, that means that team is likely out on the field longer, which means there are simply more tackles to be made. On the other hand, if a defense is really good, it’s likely repeatedly putting the opposing offense in risky and predictable passing situations (e.g., third and long) where the defense is prepared to capitalize on the offense’s disadvantage.

As we did in Part 1, to further investigate this causal relationship between defensive performances and fantasy points in respective defensive categories, we’ll test the predictive power of each of the stats. To put it broadly, we’re now answering the question, “How well do PFF stats from a given season predict fantasy totals the following season?” And, again, as in Part 1, this analysis now uses 96 cases (down from 128 in the previous analysis)—i.e., 32 teams and 3 season-to-season comparisons: 2008 to 2009, 2009 to 2010, and 2010 to 2011. Again, bivariate correlations between the five PFF predictors and the five categorized fantasy totals (across those 96 cases) are shown in the table below.

Pro Football Focus Cumulative Team Defense Stats (2008-2010)

Team Fantasy Points the Following Season (2009-2011)

Overall

Run Def.

Pass Rush

Pass Cov.

Penalty

Tackles

-.281**

-.331**

-.004

-.184

.148

Sacks

.221*

.259*

.181

-.032

-.214*

Air Pass Def.

.244*

.250*

.067

.189

-.179

Tot. Pass Def.

.302**

.332**

.167

.093

-.258*

Total Defense

-.164

-.204*

.075

-.157

.039

What we’re seeing with these numbers really seems to confirm the story the data began telling us in the first analysis. There are some important distinctions, however. First off, whereas Pass Rush and Pass Coverage were significantly associated with a team’s fantasy point output within the same season, we’re not seeing that association transfer over to the following season. As I mentioned in Part 1, this lack of season-to-season stability could be due to any number of reasons (e.g., scheme and/or personnel changes), but allow me to direct your attention to the PFF stat that does seem to have some meaningful predictive power: Run Defense.

Yes, the within-season pattern we found for Run Defense shows nearly the exact (albeit weaker) pattern across seasons. Again, bad run defense predicts higher tackle totals the next year whereas good run defense leads to higher sack, interception, and pass deflection totals. In fact, the relationships are so strong that there’s only a 0.02% chance these patterns are due to randomness in the data. The linear relationships between Run Defense and the following season’s Tackles and Total Pass Defense are shown in the two graphs below.

As in Part 1, the red line through the data points represents the regression line (or the line of “best guess”) where, on average, we would expect a team’s fantasy totals to fall given that team’s previous season Run Defense. In both instances, our r2 is approximately .11, which means about 11% of the variation in points from tackling and total pass defense can be accounted for by our regression line. Remember, in Part 1, we established PRBA to be a potentially useful predictor of rushing performance, and as you may[8] recall, that relationship produced an r2 of .076. Our current findings fall well above that benchmark. Aside from that, these effects on Run Defense tell a pretty clear story: defenses that do a poor job of stopping the run (as quantified by PFF) are also defenses that give their players more opportunities to rack up tackles. At the other end of the spectrum, defenses that effectively stop the run create more openings for their players to make quality defensive plays against the pass. Furthermore, since there seems to be some carryover in this particular area of defense from season to season, these rules of thumb can be used to make inferences about a team’s defensive fantasy performance the following season.

Discussion

Like I said in Part 1, the application of these rules of thumb should come with a few caveats. First, these should be viewed as decision-making tools that inhabit a much larger, more robust, toolbox. Don’t ignore talent or track-record. Just because the Buccaneers finished 2011 with a -51.3 Run Defense doesn’t mean we should automatically think Mason Foster is due for a monster tackling season, and just because the 49ers put up a +111.2 Run Defense in 2011 doesn’t mean we should stay away from Patrick Willis.

What we should do, however, is use Run Defense as a guide for making decisions on the margins. If you’re having a tough time deciding between two similarly-valued players on draft day, one important question to ask yourself is, “Does my league’s scoring system place a greater overall weight on tackles or ‘big plays’ like sacks and interceptions?” For most standard scoring systems, such as the one used in this article’s analyses, the former is true, though there are certainly exceptions.[9] If that is indeed the case, check to see if there’s a large difference in the Run Defense rating of the potential draftees’ teams. If one player comes from a team with particularly bad run defense and the other does not, go with the guy playing for the poor run defense; his team will have more tackles to go around. On the other hand, if your league gives big points for sacks and interceptions and you want to target players who will do well in those categories, don’t do the seemingly logical thing and look for players from teams with a good Pass Rush or Pass Coverage ratings. No, you should instead, again, pay close attention to differences in Run Defense. Of course, only this time you should give preference to the player from the good run defense; his team will force its opponents to pass, upping the chances of him being in position to make a big play.

Summary

As the well-worn coach’s cliché goes, the game of football is won in the trenches. If there’s one thing we’ve learned over these first two studies of PFF’s Premium Stats, it’s this: the game of fantasy football may be won in the trenches as well.[10] In Part 1, we found an offense’s blocking performance was the best (and only) team-level predictor of fantasy rushing performance. Now, in Part 2, we see that a defense’s ability (or lack thereof) to control the line of scrimmage has important implications for where that team will excel in producing IDP fantasy points. In our next installment, we’ll finally dive into individual-level statistics and look at how these predict future performance.

 


[1] In fairness to myself, I did manage to assemble a pretty killer trio of LBs: Derrick Brooks, Sam Cowart, and a budding young star by the name of Brian Urlacher. Go back.

[2] I mentioned this in Part 1, but it’s worth mentioning again: you can get free access to the 2008 Premium Stats simply by registering here. Go back.

[3] If you need a refresher on the definitions of those terms, see the Important Terminology section of Part 1. Go back.

[4] There is a lot of variation in IDP scoring systems, and I arbitrarily chose to use NFL.com’s Standard Scoring Categories as the model. Importantly, recommendations stemming from the analyses conducted in this article should largely be unaffected by the choice of scoring system. Go back.

[5] Points from Forced Fumbles, Fumble Recoveries, Defensive Touchdowns, Blocked Kicks, and Safeties are not represented here because (a) they make up such a small percentage of overall IDP points, and (b) they can’t be reliably predicted. Go back.

[6] Ideally, I would have liked to separate tackles made on running plays from tackles made on passing plays, but the available data don’t distinguish the two. Go back.

[7] We’re also seeing a negative relationship between Penalty and Sacks that I hesitate to interpret. It’s not immediately clear to me why a team that commits more penalties would get more points from sacks. My working hypothesis is that it’s capturing the aggressiveness of pass rushers. That is, rushers who try to jump the snap count may get to the quarterback more often (but also may get penalized more often). I’ll probably need to look at individual-level stats to really test that theory. Go back.

[8] Or, as is much more likely, may not. Go back.

[9] PFF’s preferred scoring system, for instance, gives 1.5 points for solo tackles and passes defensed, .5 points for assisted tackles, 4 points for sacks, 2 points for tackles for loss, 6 points for interceptions, and 4 points for forced fumbles. As a result, pass rushers and playmakers in the secondary have elevated fantasy value. Go back.

[10] Sorry to burst your bubble, “skill” players. Go back.

Subscriptions

Unlock the 2024 Fantasy Draft Kit, with Live Draft Assistant, Fantasy Mock Draft Sim, Rankings & PFF Grades

$24.99/mo
OR
$119.99/yr