<p><a href="https://theleafsnation.com/2017/06/01/re-approaching-the-methodology-of-nhle/">Last week I wrote about the revisions I&#8217;d made to NHLe</a>, which I think help provide a more accurate reflection of European leagues&#8217; strength relative to each other. Arguably, the most difficult aspect of evaluating draft-eligible prospects is comparing players in North American junior leagues (ie. the OHL) to players in European Leagues (ie. the SuperElit). It&#8217;s so tough that <a href="http://www.nhl.com/ice/draftprospectbrowse.htm?cat=1&amp;sort=finalRank&amp;year=2017">NHL Central Scouting</a> splits their rankings into two lists: North American skaters and European skaters (they also have separate the lists for goalies, but we won&#8217;t be engaging with voodoo today).</p>
<p>With the new NHLe translation factors from last week&#8217;s piece, though, we can make semi-accurate adjustments for league strength, allowing us to compare point production between players in North American and European leagues. Keep in mind that when we look at scoring rates, context is extremely important (TOI/PP usage/QoT/QoC will significantly impact prospects&#8217; production), so we&#8217;re definitely not looking at an all-encompassing measure. Think of it more as a way to get a rough estimate of how impressive a player&#8217;s point production is based on their league difficulty.</p>
<h2 style="text-align: left"><strong>The Methodology</strong></h2>
<p>As a quick reminder, here are the updated NHLe translation factors for European leagues using the Wilson Method.</p>
<blockquote class="twitter-tweet" data-width="550">
<p lang="fi" dir="ltr">NHLe translation factors using Wilson Method:</p>
<p>KHL: 0.73<br />MHL: 0.31</p>
<p>SHL: 0.67<br />Allsvenskan: 0.46<br />SuperElit: 0.25</p>
<p>Liiga: 0.60<br />Jr Liiga: 0.26</p>
<p>&mdash; Ian Tulloch (@regressIan) <a href="https://twitter.com/regressIan/status/869512036337819648">May 30, 2017</a></p></blockquote>
<p><script async src="//platform.twitter.com/widgets.js" charset="utf-8"></script></p>
<p>And here&#8217;s a list of the translation factors for North American leagues based on Rob Vollman&#8217;s latest NHLe update:</p>
<blockquote class="twitter-tweet" data-width="550">
<p lang="fi" dir="ltr">Latest NHLe translation factors from <a href="https://twitter.com/robvollmanNHL">@robvollmanNHL</a> </p>
<p>OHL: 0.31<br />WHL: 0.29<br />QMJHL: 0.25</p>
<p>*USHL: 0.27<br />*AJHL: 0.15<br />*BCHL: 0.13</p>
<p>*small sample</p>
<p>&mdash; Ian Tulloch (@regressIan) <a href="https://twitter.com/regressIan/status/872098136554168325">June 6, 2017</a></p></blockquote>
<p><script async src="//platform.twitter.com/widgets.js" charset="utf-8"></script></p>
<p>Since the OHL is probably the most well-known junior league (and because of my #TorontoBias), we&#8217;re going to use it as our baseline for point production. What this means is that we&#8217;re going to take every prospect&#8217;s point production (Points Per Game), multiply it by the NHLe translation factor for their league (ie. 0.25 in the SuperElit), and divide it by the translation factor for the OHL (0.31). This is going to serve as our league adjustment.</p>
<p>In addition, I felt it was important to make an age adjustment. Before selling his soul to become a Computer Boy™, Rhys Jessop did <a href="http://thats-offside.blogspot.it/2014/06/adjusting-scoring-rate-for-age-in-chl.html">some excellent work</a> on the impact of age on draft eligible prospects&#8217; point production. He found that even a few months can make a huge difference. For example, a player who is 17.9 on September 15th of their draft year is much more physically developed than one who is 17.1, giving the older player an unfair advantage. To account for players at different stages in their development, we&#8217;re going to use Jessop&#8217;s age adjustment. For the mathematically inclined, here&#8217;s his equation:</p>
<h6>Age-Adjusted Pts/GP = (1 &#8211; ([Age as of September of draft year &#8211; 17] * 0.1672)) * Pts/GP</h6>
<h2><strong>The Results</strong></h2>
<p>So without further ado, <a href="https://docs.google.com/spreadsheets/d/1xLbS9kvxqgY7gUFXd99WXvAcegMOaJRHYDyOwgF_T64/htmlview#">here&#8217;s the list of players&#8217; League &amp; Age Adjusted PPG</a> (note that this list is only for players in their draft year &#8211; I&#8217;ll be putting out the list for overagers next week). For transparency, <a href="https://t.co/HT1mtq1Syz?amp=1">here&#8217;s the Excel file</a> I used for the calculations. I also included a column in the table showing where the players ranked in <a href="http://futureconsiderations.ca/top-rankings-2017/">Future Considerations&#8217; final Top 100 rankings</a>. I thought this would help provide some context in regards to how well these prospects are regarded by scouts.</p>
<p>For fun, let&#8217;s dive a bit deeper into these numbers. I don&#8217;t want to put too much data in one image, so we&#8217;ll look at the Top 30 in Adjusted PPG. Let&#8217;s start with the forwards.</p>
<h4><strong>Forwards</strong></h4>
<p><img class="alignnone size-full wp-image-38192" src="https://i0.wp.com/theleafsnation.com/wp-content/uploads/sites/4/2017/06/image8.jpg?resize=1076%2C1429&#038;ssl=1" alt="" width="1076" height="1429" data-recalc-dims="1" /></p>
<p>This list does a great job highlighting some of my favourite high scoring prospects that I believe are undervalued in most public draft rankings (ie. Suzuki, Pettersson, Yamamoto, and Robertson). It&#8217;s also interesting seeing some players that draft nerds like myself are much lower on than the scouting community (Mittlestadt, Rassmussen, and Tolvanen come to mind).</p>
<p>This isn&#8217;t to say that stats are always right and the eye test is always wrong; both are integral components of prospect evaluation. Based on <a href="https://canucksarmy.com/2014/06/18/jake-virtanen-is-good-so-don-t-draft-him/">the latest research</a> though, I think it&#8217;s extremely important to take point production into account when we&#8217;re assessing 17-year-olds. It&#8217;s possible that players like Rassmussen will succeed and players like Suzuki will flame out, but it&#8217;s less likely based on large samples of evidence over the past few decades. Recent history has shown us that prospects with elite point production tend to have a better chance of making it to the NHL and producing at a higher rate once they get there. Based on this information, teams can improve their chances of drafting a quality NHL player by selecting prospects at the top of this list rather than ones lower in the table.</p>
<h4><em>&#8230;but context!</em></h4>
<p>Remember when I said context was extremely important? This couldn&#8217;t be truer in Europe, where 17-year-olds typically get very few opportunities to succeed in professional leagues (the KHL in Russia, the SHL/Allsvenskan in Sweden, and the Finnish Liiga). Draft eligible prospects playing in these leagues will typically get fewer minutes, less PP opportunities, and lower quality linemates than they probably should based on their talent level. Because of this, the league adjustments for these players don&#8217;t do an adequate job of assessing their ability.</p>
<p>To help explain this dilemma, let&#8217;s look at two of my favourite Swedish prospects. After adjusting for league and age, Lias Andersson produced 0.84 Adjusted PPG in the SHL, while Jesper Boqvist produced 0.81 Adjusted PPG in the Allsvenskan, leaving them both outside of the Top 30. Let&#8217;s compare that to their production in junior (SuperElit) last year, where they absolutely tore it up. In their Draft -1 seasons, they put up 1.12 and 1.08 Adjusted PPG respectively, which would rank 8th and 10th among draft-eligible forwards. Try to keep this in mind when you&#8217;re looking at these league adjustments &#8211; it&#8217;s much more difficult for a 17-year-old prospect to succeed in a professional league than in a junior league, even after adjusting for league strength. This may sound like common sense, but it&#8217;s easy to forget about when we simply sort players by Adjusted PPG.</p>
<p>That was fun, let&#8217;s move onto the Top 30 blueliners.</p>
<h3><strong>Defensemen</strong></h3>
<p><img class="alignnone size-full wp-image-38193" src="https://i0.wp.com/theleafsnation.com/wp-content/uploads/sites/4/2017/06/image9.jpg?resize=1069%2C1431&#038;ssl=1" alt="" width="1069" height="1431" data-recalc-dims="1" /></p>
<p>Any time I talk about defensive prospects&#8217; point production, I like to bring up <a href="https://jetsnation.ca/2016/06/19/jets-nation-draft-preview-logan-stanley-could-be-a-good-player-so-don-t-draft-him/">this fantastic piece by Garret Hohl</a>. The biggest takeaway from the article is that point production <em>really</em> matters when forecasting the probability of NHL success, even for defensemen. Hohl breaks down a great study by the aforementioned Computer Boy™, Rhys Jessop, who separated defensemen into two groups: scorers (over 0.6 adj PPG) and non-scorers (less than 0.6 adj PPG). Here&#8217;s a great visual of his findings:</p>
<p><img class="alignnone size-full wp-image-38159" src="https://i2.wp.com/theleafsnation.com/wp-content/uploads/sites/4/2017/06/image2.jpg?resize=600%2C319&#038;ssl=1" alt="" width="600" height="319" data-recalc-dims="1" /></p>
<blockquote><p>This graph is immensely interesting, as it tells you two things:</p>
<p>1. Scouts can legitimately evaluate which players have the non-scoring factors that garners success.</p>
<p>2. Scouts are overvaluing those factors relative to scoring performance.</p>
<p>A top-selected (picks 1-25) who was below Jessop’s arbitrary scoring line of 0.6 points per game were successful picks just as often as the above mid-selected (picks 26-50) 0.6 points per game scoring players. That’s a steep over estimation of talent.</p></blockquote>
<p>To help make explain how we can use this knowledge to our advantage, let&#8217;s use an example from this year&#8217;s draft. I&#8217;m <em>not</em> suggesting that you should take Juho Korhonen (ranked outside the Top 100 by Future Considerations) over Miro Heiskanen (ranked 3rd) simply because he scored at a higher rate. Heiskanen&#8217;s ranked that high for a reason; he has <a href="http://thehockeywriters.com/miro-heiskanen-2017-nhl-draft-prospect-profile/">many impressive traits</a> that don&#8217;t necessarily show up in his point production (which by the way, is very impressive for a 17-year-old playing in a professional league). Scouts clearly don&#8217;t think as highly of Korhonen&#8217;s qualitative attributes, so it would be a massive reach to select him in the first couple rounds. When picking in the later rounds though (after pick 100), it&#8217;s probably a smart bet to select a player like Korhonen ahead of a defenseman with poor point production, since the research indicates he&#8217;ll have a higher chance of becoming a full-time NHLer.</p>
<p>One quick look at the Top 30 D in Adjusted PPG helps explain my unconditional love for Erik Brannstrom, as well as smart 2nd round bets like Connor Timmins, Markus Phillips, and Noel Hoefenmayer. On the flip side, there don&#8217;t appear to be any non-scorers with 1st round grades like <a href="https://jetsnation.ca/2016/06/24/draft-theory-and-thoughts-on-logan-stanley/">Logan Stanley last year</a>. Any team looking for a defenseman in the 1st round (ie. Toronto) appears to have a solid set of scorers to choose from, with no obvious &#8216;player to avoid&#8217; that has a significantly lower likelihood of becoming an NHL player based on their lack of point production (ie. Jared Cowen, Stuart Percy, Samuel Morin, or Logan Stanley).</p>
<p>When it comes to the gap between &#8220;scorers&#8221; and &#8220;non-scorers&#8221; on defense, keep in mind that the 0.6 Adjusted PPG cutoff that we previously discussed is arbitrary (going from 0.61 to 0.59 Adjusted PPG doesn&#8217;t magically turn you into a poor point producer). Scoring is a continuous measure, but Jessop had to choose a cutoff to make two separate groups in his study, so he went with 0.6. Just keep in mind that all of the draft eligible defensemen in the 0.5 range this season are still pretty solid point producers even though they don&#8217;t meet Jessop&#8217;s &#8220;scorer&#8221; criteria. Also, just a quick reminder that 17-year-olds playing in professional leagues (ie. Liiga) are naturally going to have a more difficult time producing points even after adjusting for league strength, like we touched on earlier.</p>
<h2><strong>Concluding Thoughts</strong></h2>
<p>Scoring isn&#8217;t the only thing that matters in prospect evaluation, but it&#8217;s extremely important (and currently very undervalued). There tends to be a divide in hockey these days over the &#8220;analytics vs eye test debate&#8221;, but I try to avoid thinking of it in such a dichotomous fashion. At the end of the day, our goal is to make informed decisions. To accomplish this, we need to take advantage of all the information that&#8217;s available to us, which includes both the qualitative inputs from highly knowledgeable scouts (&#8220;the eye test&#8221;) and the quantitative outputs derived from statistical analysis (#analytics).</p>
<p>Although research has proven that scouts can identify traits that make a prospect more likely to become an NHL player, the evidence indicates that they&#8217;re often overvalued relative to point production. This presents teams with an opportunity to take advantage of this inefficiency, especially with high scoring players in European leagues (ie. Pavel Shen &amp; Juho Korhonen). To make myself clear, I&#8217;m not suggesting that we simply rank players by Adjusted PPG and call it a day. In order to maximize drafting efficiency, we need to rely on both traditional scouting and statistical analysis. Based on the latest draft research, teams would be best served by using scouts&#8217; knowledge to determine an approximate range of where a prospect &#8216;should&#8217; be selected, then select the player in that range with the highest Adjusted PPG (or one of the highest Adjusted PPG in conjunction with elite qualitative traits such as skating or skill).</p>
<p>So should we use &#8220;the eye test&#8221; or &#8220;analytics&#8221; to arrive at decisions? Here&#8217;s a crazy thought: <em>both</em>.</p>

<a href="https://theleafsnation.com/2017/06/01/re-approaching-the-methodology-of-nhle/">Last week I wrote about the revisions I'd made to NHLe</a>, which I think help provide a more accurate reflection of European leagues' strength relative to each other. Arguably, the most difficult aspect of evaluating draft-eligible prospects is comparing players in North American junior leagues (ie. the OHL) to players in European Leagues (ie. the SuperElit). It's so tough that <a href="http://www.nhl.com/ice/draftprospectbrowse.htm?cat=1&amp;sort=finalRank&amp;year=2017">NHL Central Scouting</a> splits their rankings into two lists: North American skaters and European skaters (they also have separate the lists for goalies, but we won't be engaging with voodoo today).

With the new NHLe translation factors from last week's piece, though, we can make semi-accurate adjustments for league strength, allowing us to compare point production between players in North American and European leagues. Keep in mind that when we look at scoring rates, context is extremely important (TOI/PP usage/QoT/QoC will significantly impact prospects' production), so we're definitely not looking at an all-encompassing measure. Think of it more as a way to get a rough estimate of how impressive a player's point production is based on their league difficulty.
<h2 style="text-align: left"><strong>The Methodology</strong></h2>
As a quick reminder, here are the updated NHLe translation factors for European leagues using the Wilson Method.

https://twitter.com/regressIan/status/869512036337819648

And here's a list of the translation factors for North American leagues based on Rob Vollman's latest NHLe update:

https://twitter.com/regressIan/status/872098136554168325

Since the OHL is probably the most well-known junior league (and because of my #TorontoBias), we're going to use it as our baseline for point production. What this means is that we're going to take every prospect's point production (Points Per Game), multiply it by the NHLe translation factor for their league (ie. 0.25 in the SuperElit), and divide it by the translation factor for the OHL (0.31). This is going to serve as our league adjustment.

In addition, I felt it was important to make an age adjustment. Before selling his soul to become a Computer Boy™, Rhys Jessop did <a href="http://thats-offside.blogspot.it/2014/06/adjusting-scoring-rate-for-age-in-chl.html">some excellent work</a> on the impact of age on draft eligible prospects' point production. He found that even a few months can make a huge difference. For example, a player who is 17.9 on September 15th of their draft year is much more physically developed than one who is 17.1, giving the older player an unfair advantage. To account for players at different stages in their development, we're going to use Jessop's age adjustment. For the mathematically inclined, here's his equation:
<h6>Age-Adjusted Pts/GP = (1 - ([Age as of September of draft year - 17] * 0.1672)) * Pts/GP</h6>
<h2><strong>The Results</strong></h2>
So without further ado, <a href="https://docs.google.com/spreadsheets/d/1xLbS9kvxqgY7gUFXd99WXvAcegMOaJRHYDyOwgF_T64/htmlview#">here's the list of players' League &amp; Age Adjusted PPG</a> (note that this list is only for players in their draft year - I'll be putting out the list for overagers next week). For transparency, <a href="https://t.co/HT1mtq1Syz?amp=1">here's the Excel file</a> I used for the calculations. I also included a column in the table showing where the players ranked in <a href="http://futureconsiderations.ca/top-rankings-2017/">Future Considerations' final Top 100 rankings</a>. I thought this would help provide some context in regards to how well these prospects are regarded by scouts.

For fun, let's dive a bit deeper into these numbers. I don't want to put too much data in one image, so we'll look at the Top 30 in Adjusted PPG. Let's start with the forwards.
<h4><strong>Forwards</strong></h4>
<img class="alignnone size-full wp-image-38192" src="https://theleafsnation.com/wp-content/uploads/sites/4/2017/06/image8.jpg" alt="" width="1076" height="1429" />

This list does a great job highlighting some of my favourite high scoring prospects that I believe are undervalued in most public draft rankings (ie. Suzuki, Pettersson, Yamamoto, and Robertson). It's also interesting seeing some players that draft nerds like myself are much lower on than the scouting community (Mittlestadt, Rassmussen, and Tolvanen come to mind).

This isn't to say that stats are always right and the eye test is always wrong; both are integral components of prospect evaluation. Based on <a href="https://canucksarmy.com/2014/06/18/jake-virtanen-is-good-so-don-t-draft-him/">the latest research</a> though, I think it's extremely important to take point production into account when we're assessing 17-year-olds. It's possible that players like Rassmussen will succeed and players like Suzuki will flame out, but it's less likely based on large samples of evidence over the past few decades. Recent history has shown us that prospects with elite point production tend to have a better chance of making it to the NHL and producing at a higher rate once they get there. Based on this information, teams can improve their chances of drafting a quality NHL player by selecting prospects at the top of this list rather than ones lower in the table.
<h4><em>...but context!</em></h4>
Remember when I said context was extremely important? This couldn't be truer in Europe, where 17-year-olds typically get very few opportunities to succeed in professional leagues (the KHL in Russia, the SHL/Allsvenskan in Sweden, and the Finnish Liiga). Draft eligible prospects playing in these leagues will typically get fewer minutes, less PP opportunities, and lower quality linemates than they probably should based on their talent level. Because of this, the league adjustments for these players don't do an adequate job of assessing their ability.

To help explain this dilemma, let's look at two of my favourite Swedish prospects. After adjusting for league and age, Lias Andersson produced 0.84 Adjusted PPG in the SHL, while Jesper Boqvist produced 0.81 Adjusted PPG in the Allsvenskan, leaving them both outside of the Top 30. Let's compare that to their production in junior (SuperElit) last year, where they absolutely tore it up. In their Draft -1 seasons, they put up 1.12 and 1.08 Adjusted PPG respectively, which would rank 8th and 10th among draft-eligible forwards. Try to keep this in mind when you're looking at these league adjustments - it's much more difficult for a 17-year-old prospect to succeed in a professional league than in a junior league, even after adjusting for league strength. This may sound like common sense, but it's easy to forget about when we simply sort players by Adjusted PPG.

That was fun, let's move onto the Top 30 blueliners.
<h3><strong>Defensemen</strong></h3>
<img class="alignnone size-full wp-image-38193" src="https://theleafsnation.com/wp-content/uploads/sites/4/2017/06/image9.jpg" alt="" width="1069" height="1431" />

Any time I talk about defensive prospects' point production, I like to bring up <a href="https://jetsnation.ca/2016/06/19/jets-nation-draft-preview-logan-stanley-could-be-a-good-player-so-don-t-draft-him/">this fantastic piece by Garret Hohl</a>. The biggest takeaway from the article is that point production <em>really</em> matters when forecasting the probability of NHL success, even for defensemen. Hohl breaks down a great study by the aforementioned Computer Boy™, Rhys Jessop, who separated defensemen into two groups: scorers (over 0.6 adj PPG) and non-scorers (less than 0.6 adj PPG). Here's a great visual of his findings:

<img class="alignnone size-full wp-image-38159" src="https://theleafsnation.com/wp-content/uploads/sites/4/2017/06/image2.jpg" alt="" width="600" height="319" />
<blockquote>This graph is immensely interesting, as it tells you two things:

1. Scouts can legitimately evaluate which players have the non-scoring factors that garners success.

2. Scouts are overvaluing those factors relative to scoring performance.

A top-selected (picks 1-25) who was below Jessop’s arbitrary scoring line of 0.6 points per game were successful picks just as often as the above mid-selected (picks 26-50) 0.6 points per game scoring players. That’s a steep over estimation of talent.</blockquote>
To help make explain how we can use this knowledge to our advantage, let's use an example from this year's draft. I'm <em>not</em> suggesting that you should take Juho Korhonen (ranked outside the Top 100 by Future Considerations) over Miro Heiskanen (ranked 3rd) simply because he scored at a higher rate. Heiskanen's ranked that high for a reason; he has <a href="http://thehockeywriters.com/miro-heiskanen-2017-nhl-draft-prospect-profile/">many impressive traits</a> that don't necessarily show up in his point production (which by the way, is very impressive for a 17-year-old playing in a professional league). Scouts clearly don't think as highly of Korhonen's qualitative attributes, so it would be a massive reach to select him in the first couple rounds. When picking in the later rounds though (after pick 100), it's probably a smart bet to select a player like Korhonen ahead of a defenseman with poor point production, since the research indicates he'll have a higher chance of becoming a full-time NHLer.

One quick look at the Top 30 D in Adjusted PPG helps explain my unconditional love for Erik Brannstrom, as well as smart 2nd round bets like Connor Timmins, Markus Phillips, and Noel Hoefenmayer. On the flip side, there don't appear to be any non-scorers with 1st round grades like <a href="https://jetsnation.ca/2016/06/24/draft-theory-and-thoughts-on-logan-stanley/">Logan Stanley last year</a>. Any team looking for a defenseman in the 1st round (ie. Toronto) appears to have a solid set of scorers to choose from, with no obvious 'player to avoid' that has a significantly lower likelihood of becoming an NHL player based on their lack of point production (ie. Jared Cowen, Stuart Percy, Samuel Morin, or Logan Stanley).

When it comes to the gap between "scorers" and "non-scorers" on defense, keep in mind that the 0.6 Adjusted PPG cutoff that we previously discussed is arbitrary (going from 0.61 to 0.59 Adjusted PPG doesn't magically turn you into a poor point producer). Scoring is a continuous measure, but Jessop had to choose a cutoff to make two separate groups in his study, so he went with 0.6. Just keep in mind that all of the draft eligible defensemen in the 0.5 range this season are still pretty solid point producers even though they don't meet Jessop's "scorer" criteria. Also, just a quick reminder that 17-year-olds playing in professional leagues (ie. Liiga) are naturally going to have a more difficult time producing points even after adjusting for league strength, like we touched on earlier.
<h2><strong>Concluding Thoughts</strong></h2>
Scoring isn't the only thing that matters in prospect evaluation, but it's extremely important (and currently very undervalued). There tends to be a divide in hockey these days over the "analytics vs eye test debate", but I try to avoid thinking of it in such a dichotomous fashion. At the end of the day, our goal is to make informed decisions. To accomplish this, we need to take advantage of all the information that's available to us, which includes both the qualitative inputs from highly knowledgeable scouts ("the eye test") and the quantitative outputs derived from statistical analysis (#analytics).

Although research has proven that scouts can identify traits that make a prospect more likely to become an NHL player, the evidence indicates that they're often overvalued relative to point production. This presents teams with an opportunity to take advantage of this inefficiency, especially with high scoring players in European leagues (ie. Pavel Shen &amp; Juho Korhonen). To make myself clear, I'm not suggesting that we simply rank players by Adjusted PPG and call it a day. In order to maximize drafting efficiency, we need to rely on both traditional scouting and statistical analysis. Based on the latest draft research, teams would be best served by using scouts' knowledge to determine an approximate range of where a prospect 'should' be selected, then select the player in that range with the highest Adjusted PPG (or one of the highest Adjusted PPG in conjunction with elite qualitative traits such as skating or skill).

So should we use "the eye test" or "analytics" to arrive at decisions? Here's a crazy thought: <em>both</em>.

Using Adjusted PPG to Evaluate the 2017 NHL Draft Class

Recent articles from Ian Tulloch

Breaking News