I think it’s fair to say that Matt Martin has been a polarising figure in Toronto this season.  Unsurprisingly, the divide mostly seems to be between traditionalists who see Martin as a player who performs a valuable role protecting the Leafs younger stars versus more statistically-inclined fans who see Martin is a low-scoring player whose tangible contributions are not very significant.  But one point of agreement has typically been that Matt Martin is good defensively.

Back when Martin was signed, I said this on Twitter:

When I took a statistical look at Martin a couple weeks later, I said that “the New York Islanders have typically done a good job of limiting shots attempts against their own net while Martin is on the ice.”

But lately I’ve been wondering if it’s actually true that Martin is good defensively.  It’s certainly true that the Islanders allowed fewer shot attempts with Martin on the ice relative to his teammates, and that trend continued in Toronto, where Martin’s Corsi Against relative to his teammates per 60 minutes has been -4.63 (for CA/60 Rel lower is better; it means a player allows fewer shots than his teammates).

Thinking about the issue further, I came up with a theory for why those statistics might be misleading.  There were two parts to the theory:

If that were true, it could be the case that Martin allows less shot attempts not because he is better defensively than his teammates, but because his coaches put him on the ice in low-pressure situations against opponents who are not much of a threat to score.  This would explain why Martin’s overall shot attempt ratio is quite poor despite seemingly having good shot suppression skill.  After all, if you’re playing low event hockey but still getting consistently outshot, that’s not actually good defence, it’s just getting bad results at a slower speed.

In order to see whether that theory holds up, I decided to see what Martin’s results looked like against players who have a strong track record of generating good Corsi results.  Back in March I put together a list of the best centres on each team by Corsi Rel for another article, so I decided to use that list again.  Using Hockey Analysis I took a look at Martin’s results against those forwards over the past three seasons.  Hockey Analysis has a 10 minute ice time minimum in order to display “against you” stats for any given player, and Matt Martin played less than that cut-off against most of the players on my list.  There were 12 players who met the cut-off, and here are their results against Matt Martin over the past three seasons:

CF/60 Dif is whether a player generated more or fewer shot attempts when playing against Martin as compared to everyone else in the league (lower is better for Martin).  CA/60 is the same stat for shot attempts against (higher is better for Martin).  The last one is the overall pace of shot attempts (Corsi for + Corsi against), which I included to see whether Martin seemed to have any skill at slowing the game down, which might be a useful skill even if the other results weren’t ideal.

In this chart, CF/60 Dif is the measure of Martin’s shot suppression (a positive result means a player was on the ice for more shot attempts when playing against Martin vs playing against the rest of the league).  7 out of 12 players shot more frequently when playing against Martin, while the other 5 shot fewer.  There’s a pretty mixed bag in terms of results here in terms of how big the differences are, but on the whole the results do lean towards the league’s top Corsi players generating more offence when playing against Martin, which does back up my theory that his results are influenced by the easy competition he typically plays.

The results in terms of CA/60 Dif (the amount of offence generated by Martin’s team with him on the ice) are far more clear.  Other players do significantly better defensively playing against Martin than against the rest of the league.  Because of this, even if Martin had positive shot suppression abilities (and it’s looking more doubtful that he does), his team still comes out behind because he hampers the offence so much.

However, this might be something that you could live with if Martin was good at limiting the overall pace of play.  There are times, especially late in hockey games, when lowering the pace of play may be advantageous even if your offence is limited because the expected value of preventing a goal against is higher than the expected value of scoring another goal.  However, there’s no real evidence here that Martin is reducing the pace of play.  There’s a 50/50 split between players who had a higher pace of play against Martin than against the rest of the league, and the magnitude of the effect is similar in both directions.

However, 12 players isn’t a great sample size.  I decided to go back to the Hockey Analysis data to increase the amount of information we’re looking at.  I collected 12 more forwards, using a cut-off of at least 20 minutes ice time, picking out the ones Martin played against most frequently who struck me as good examples of solid top 6 forwards.  I limited my selections to one player per team to broaden the results as much as possible.  This is admittedly a much more subjective approach than the way I put together my first chart, but given Martin’s low ice time there’s only so much that can be done to collect a detailed sample against any individual players.  Here’s the second list (like the first list, it’s almost all Eastern Conference players, which is unavoidable given Martin’s low ice time):

The results here are pretty consistent with the earlier chart.  A small majority of these players generate more shots when playing against Martin, while almost all of the players do much better defensively against Martin.  And once again, there’s no clear evidence of Martin reducing the pace of play.  What seems to happen is that most players play at a similar-ish pace against Martin, but they get a bigger share of the shots because Martin and his linemates generate so little offence.

The results here back up my theory about why Martin’s results look good.  He does not show any real shot suppression ability against top 6 players (in fact, he seems to be a bit worse than average), nor is there any evidence that he reduces the overall pace of play.  Indeed, if you look at his results on a player-by-player basis it quickly becomes apparent that most of his “shot suppression” is against lower quality competition, players who get minimal ice time and play at a much slower pace overall.  The evidence just doesn’t support the idea that Martin is good defensively.  He plays low event hockey against bottom line players for most of his ice time, but when faced with the kinds of competition that his more talented teammates typically face, Martin does not appear to have any notable shot suppression ability.

(As an aside, this also supports a theory I outlined in a post about the effects of Quality of Competition on Morgan Rielly, which is that the true gap in Corsi talent league-wide is artificially suppressed because depth players spend so much of their ice time playing against other depth players, raising their results and making them look better than they would if they played better competition more regularly.)