Trading Up In The NHL Draft: Is It Worth It?

Hockey Twitter wasted no time getting back to work.

With the first piece to the Leafs 2016 draft puzzle put in place after the team won last night’s lottery, attention quickly turned to Toronto’s later 1st round pick via Pittsburgh as well as the team’s own 2nd round pick which sits firmly at 31st overall.

Specifically, the question was raised about whether or not this was the year it would make sense to trade up from those two spots in order to acquire another higher-end prospect, possibly a defenseman.

My initial instincts were to jump into the argument and tell the people that thought trading up was a good idea that they were wrong.  After all, don’t the numbers tell us that it’s typically a bad idea?

Don’t they?

Rather than get myself involved in the argument, I decided to do some fact-checking to see whether or not my initial instincts were right, and when (if ever) it’s a good idea to trade up (or down) in the draft.

Here’s where my research brought me:

ERIC TULSKY ON TRADING UP

If you’re well-versed in advanced stats you know the name Eric Tulsky quite well.  If you’re not, just know that he’s a former blogger that wrote a lot of great articles that delved deeper into the use of numbers in hockey, and that he now works for the Carolina Hurricanes as a Hockey Analyst.

In this article, Tulsky compiled all 46 of the trades between 2006 and 2012 that involved only draft picks (so, no players) and developed a model to determine the value that GMs were placing on these picks.  Basically, he assigned a numeric value to the perceived value of each pick by the NHL’s various GMs.  Those values looked like this:

Draft_chart_medium

So basically, GMs place a lot of weight on really high picks.

The key finding from his article is summed up nicely here:

By this approximation, three
out of every four trades were roughly fair, meaning that the two teams’
packages were within 20 percent of each other in estimated value.
Moreover, almost all of the ones that were off by more were very minor
moves, where being off by 30 or 40 percent still isn’t very much in
absolute value. Two 6th round picks are probably worth a lot more than a
5th, but I doubt the Flames are losing sleep that they might have given
up too much when they made that trade in 2007.

If we cut our 46-trade sample
in half by focusing just on the bigger trades for a minute, 21 of 23
were fair to within 20 percent, which is pretty reasonable for a model
that doesn’t take into account things like the depth of a given draft.

In other words, most draft trade up/down scenarios end up being fair in the eyes of the GMs.  That means the Leafs could trade up in the draft at fair value, right?

Well, not exactly.  The obvious problem here is that these values are relative to the weight that GMs themselves put on them, which might not accurately align with the actual value of a draft pick.  It’s definitely helpful to know what sort of value GMs themselves place on picks though.

STEPHEN BURTCH ON ACTUAL DRAFT PICK VALUE

Long-time fancy stats writer Stephen Burtch (I know you’ve heard of him) looked at all the draft picks between 1995 and 2007 in a 2015 article for Sportsnet that sought to place an objective value on each and every draft pick.  Basically, using expected games played and points per games played, Burtch ultimately came up with the following graph:

chart4

Not too dissimilar to what we saw from Eric Tulsky: high-end draft picks are more valuable.  That’s a good sign that NHL GMs have at least some clue of what they’re doing.

Here’s what I think is maybe the most important finding though:

Another way to think of this is the comparative worth of picks in
various ranges of the draft. For example the value of a late first-round
pick from a contending team is actually closer in value to any
third-round selection than it is to a top-five pick
. Thinking of this
from a glass-half-full perspective for a team trying to rebuild, this
suggests that adding multiple second- or third-round selections is
likely an easier way to improve the roster of a team than holding out
for that tough-to-obtain first-round choice when the market is far more
thin
.

This, to me, is why it usually makes more sense to trade down.  NHL GMs place a premium on high draft picks, perhaps rightly so, but not all first round picks are created equal.  Here’s a table from the same article that exemplifies this nicely:

chart

Of course, it’s worth mentioning when looking at that table that when we’re talking about the Leafs moving up in the draft, most people aren’t talking about acquiring another top five pick.  But, it’s also worth mentioning that given the value of a 3rd round pick relative to where the Penguins’ pick might ultimately land, trading down from that pick might ultimately end up being more lucrative.

MICHAEL SCHUCKERS’ DRAFT PICK VALUE CHART

A professor at St. Lawrence University and a statistical consultant, Michael Schuckers also crunched some numbers to objectively determine the value of an NHL draft pick.  To do this he looked at all the draft picks between 1988 and 1997 and determined the expected value of a draft pick by taking games played into consideration*.  Maybe not perfect, but nonetheless it gives us another set of data to work with.

Here’s his findings summed up in one glorious table:

Screen Shot 2016-05-01 at 12.13.04 PM

To me this exemplifies why it’s often more efficient to trade down than to trade up.  Let’s say the Penguins win the Stanley Cup (a very real possibility) and the Leafs’ two highest picks after 1st overall (damn that feels good to say) sit 30th and 31st overall.  Let’s say the Leafs are talking with the Arizona Coyotes, who own a pick at 20th overall courtesy of the New York Rangers, and the two teams agree to a trade that would send the 30th and 31st picks in the draft to Arizona for 20th overall.  Seems reasonable, right?

In this scenario, the Leafs would be trading two draft picks with a combined expected value of 520 points for a draft pick with an expected value of 350 points (note: when I say points, I’m not referring to expected NHL production out of that pick).  So, the Leafs come out 170 points in the negative, which, according to the above table, also equates to an extra 3rd-rounder.

Is that worth it?  Objectively, no.  But what if that player is someone the Leafs – and everyone else – really likes?  What if it’s someone that’s fallen past their expected draft position.  Let’s just say it’s Michael McLeod of the Mississauga Steelheads.  Does it make sense then?

I’m a lot more tempted to say yes.  But at the same time, you have to be fully aware that what you’re making is an inefficient decision if you make that trade.  That’s problematic, because it seems to me like the more efficient decisions you make as a management team the greater position you put yourselves in to succeed.  Conversely, the more inefficient decisions you make, the greater position you’re putting yourself in to fail.

Let’s take a look at a couple more examples.  In 2011 the Leafs owned the 30th and 39th picks in the draft and traded them to Anaheim for the 22nd overall pick.  So, the Leafs traded two picks with a combined value of 474 points in exchange for one draft pick worth 324 points – putting them 150 points in the negative.  So that was another inefficient decision on paper, and as most of you well know, it turned up being the wrong one in reality as Toronto drafted Tyler Biggs 22nd and Anaheim took Rickard Rackell and John Gibson 30th and 39th respectively.

Last year though, the Leafs decided to trade down.  They owned the 24th pick in the draft courtesy of Nashville, but ultimately decided to trade down to 29th in exchange for that pick plus 61st overall.  Then the Leafs traded down from 29 with Columbus in exchange for the 34th and 68th picks.  In this scenario the Leafs turned a pick that was originally worth 308 points and turned it into three picks worth a combined 579 points – a massive net gain of 271 points, equal to an additional first round draft pick between 29th and 30th overall.

Now, out of this trade Philadelphia got Travis Konecny and Toronto got Travis Dermott, Jeremy Bracco, and Martins Dzierkals.  Was it worth it?  I’m actually presently leaning no, however, we can’t say with any sort of conviction whether or not it was the right move given it’s been less than one year since those players were taken.  But what’s impressive about that trade is that it was an incredibly efficient decision, and the more of those you make, the better position you’re putting yourselves in going forward.

This gets back to what Burtch said about a late 1st-rounder being closer in value to a 3rd-rounder than a higher 1st-rounder.  For example, the 30th pick in the draft is closer in value to the 61st pick in the draft (a difference of 90 points) than it is to the 19th pick in the draft (a difference of 99 points).

This is where things get tied in rather nicely, because we know from the Tulsky article that we looked at that GMs rightly place a high value on high draft picks, yes, but that they also appear to undervalue lower picks.  Look at the two graphs again: GMs place almost no value whatsoever on mid-to-late third round picks.  But we know from the research done by both Burtch and Schuckers that this isn’t the case: draft picks have at least some value as late as 150th overall, and arguably long past that.

This is exactly why it usually makes more sense to trade down than up: it isn’t so much that GMs overvalue high draft picks, but that they undervalue low ones.  Thus, it may not even be that you’re giving yourself more kicks at the can that makes trading down a smart decision, but that you’re in many cases unknowingly increasing the overall value of your original draft pick the more times you trade down, the more picks you acquire.

For what it’s worth, my understanding is that Kyle Dubas is a big fan of trading down in the draft.  In the OHL you actually can’t trade your first round pick, which was apparently much to his chagrin.  That’s both good news and unsurprising given his interest in analytics.
Of course, sometimes it might make sense to trade up, like in the Leafs-Coyotes scenario I concocted above.  After all, what if the right guy is available, and you’re really sure of yourself?

That’s a tough one.  After all, it sure seems like the Flyers got a good player in Travis Konecny.  Or that the Islanders came away as bandits nabbing Mathew Barzal last year 16th overall (though they only had to give up middling prospect Griffin Reinhart to do so, no draft picks necessary).  But then, the Leafs sure seemed sure of themselves when they took Tyler Biggs back in 2011.  Or Luke Schenn in 2008.

I guess this comes down to having really good scouts and trusting those scouts.  If you’re going to trade up to nab a player, you better be damn sure in what you’re getting.  The difficulty there, as history tells us, is that even the surest of things can be anything but.  Call it a crapshoot, call it a lottery, call it whatever: while there’s unquestionable value in scouts and their ability to determine which young hockey players are good and which ones aren’t, the fact of the matter is that any draft pick, no matter where they’re taken, isn’t a sure thing.  So for me, it usually doesn’t make sense to trade up.  And as the numbers would say, not only that, but it’s often smarter to trade down, because right now a market inefficiency exists between the perceived and actual value of later round draft picks as it relates to NHL GMs.  For this reason, it might make sense to trade up for the right guy, but realistically you should probably be happier if the Leafs elect to trade down.

*: I previously stated that games played, goals, assists, and +/- were taken into consideration, which has since been pointed out as being inaccurate.  My apologies.

  • Mitch92

    Great analysis of the trade up and trade down scenarios. I see the biggest issue in trading up being that top picks in the 5 -15 range are highly overvalued. Having said that, if there is a guy there that you really like and who you think is going to be an impact player for your team are you going to let the notion of inefficiency sway your decision? Take Max Jones for example. If the Leafs thought they could trade up the Pittsburgh pick plus another asset or two to get that player who they might think is a great fit for their team is that price too high? In a year where the fog is clearing and we can see a real NHL roster coming together albeit a young roster is it a bad idea to pay a little extra to get that player? The Leafs are soon going to be crunching numbers to find a way to fit all their young talent into their scheme of 50 contracts. With close to a full complement now and another twelve picks coming into the fold, they have reached a point in the rebuild where packaging quantity assets to make moves for quality players or high picks makes some sense.

  • CMpuck

    Good read.

    So is it easier to trade up with a team with good scouts than not?

    Also, not trying to stir the pot here but could the Leafs get shady and trade Kadri to either move up or get a pick outright? Target say Nashville (if they lose this round) and get a Brown, Keller, Jost coming back?

  • Mitch92

    The fact is the Leafs are becoming in danger of having so many prospects that they cannot sign them all to contracts,
    and run the risk losing future NHL players.

    What the Leafs need more than anything is top end
    defense prospects. If trading up nets us what we have a shortage of, the leafs could easily afford
    to trade picks prospects or roster players to achieve this goal.

    • giproc

      Going by the chart and depending on the actual result of the Pens pick, it looks like the value would put the Pens pick + our 31st at the equivalent of the #10 to #13 range. But in the real world in a strong draft, I’d think the #15 to #20 range is more probable. So many valuables… who’s the partner, who’s sliding, other teams’ needs, etc.

      Personally, I’d prefer to move up by offering a package of only one of those two picks (either the Pens 1st OR our 2nd @ 31) plus a package of decent but not elite prospects.

    • CMpuck

      What last place teams (Leafs, Oilers) is forwards who back check as well as score occasionally. Have you seen Edmonton’s super star forwards check much?. Can’t wait to see who takes Yakapooch and Eberle.

  • FlareKnight

    So basically we can just simplify this whole thing down and say…..it depends :P.

    The numbers work fine in saying that more picks is better and trading down generally works out for more value. But…it’s not just pick value, it’s individual players. If you get a better prospect than what you give up…then pick value be damned, you are better off.

    I don’t think trading down with the Leafs makes sense anyways. 12 picks is a lot and you have to be able to sign the ones you want to keep. I’m not saying make a lot of upward trades, but maybe with the Pens pick it makes sense to look into it. If Hunter can find another diamond in the first round besides our first pick that’s definitely something I’m all for doing.

  • Gary Empey

    For me there is something wrong with the whole premise. By using generalities, you are attempting to put an exact value on something completely unknown.

    This is the very reason GM’s undervalue the later round picks. It is a form of “Blind Man’s Bluff.”

    As CM Puck says it is a good read.

  • Gary Empey

    Word about is the Oilers are taking offers on their 4th overall pick. Now that should be interesting to see what offers they receive.

    How much would the Leaf Nation be willing to trade up to grab a fourth.

    • CMpuck

      You’re really sold on Tkachuk, huh. Good on you to sticking to your guy.

      Best offer I can fathom would be JVR + Gardiner. Edmonton will whine Gardiner is the answer to their blueline, Leafs fan will cry over pay but Tkachuk is a lot younger, it clears cap space (so Stamkos would be a given if he’s willing to sign, we’d have enough left over to bid on Ladd, Eriksson, Okposo or Lucic) and depletes our D to tank for another lottery pick.

      Edmonton could package JVR with someone to land Hamonic, so it’s essentially Gardiner + Hamonic for 4th. I’d pull the trigger on that.

      • Gary Empey

        While it is true that Edmonton is looking for either a two for one deal, or just move down a few spots to get a D plus an NHL player, the Leafs can’t really afford to give up a youngish top six and a top four for one top six prospect.

        If there is a deal to be made (I doubt there is) then the place to look is in the depth of our prospect pool. Up until now Oilers have been unable to pull the trigger on any deals. They always expect to receive a silk purse for a pig’s ear. Oiler fans think the big problem is defencemen. I think what they are really missing is two-way forwards. What the hell was McDavid doing on the penalty kill, when he got injured?

        Sure I really like Tkachuk. I also like Dubois. It is probably time to start going over the 20th to 40th prospects.

  • Gary Empey

    Leaf picks From Draft Site.com – Mock-up

    1 -1st Auston Matthews RW Zurich (NLA) 6′ 2″ 198

    1 -27th Markus Niemeläinen D Saginaw (OHL) 6′ 4″ 190

    2 -31st Pascal Laberge C Victoriaville (QMJHL) 6′ 0″ 159

    2 -57th Vojtěch Budik D Prince Albert (WHL) 6′ 1″ 190

    2 -60th Boris Katchouk LW Sault Ste. Marie (OHL) 6′ 1″ 180

    3 -61st Sean Day D Mississauga (OHL) 6′ 2″ 220

    3 -71st Brett Murray LW Carleton Place (CJHL) 6′ 4.25″ 216

    4 -91st Brandon Hagel LW Red Deer (WHL) 6′ 0″ 165

    4 -100th Jack Kopacka LW Sault Ste. Marie (OHL) 6′ 2″ 188

    5 -141st Wade Allison RW Tri-City (USHL) 6′ 2″ 205

    6 -151st Kasper Björkqvist LW Espoo Blues (SM-liiga) 6′ 1″ 198

    6 -178th Lukas Doudera D Trenin (Slovak) 5′ 11.5″ 167

    7 -181st Jordan Klehr D Shattuck-St. Marys School (HS-MN) 5′ 11.25″ 180

    7 -204th Carter Long D South Kent School (HS-CT) 6′ 2″ 198

    Other than Matthews and Sean Day I haven’t heard of any of those other guys.

    • Mitch92

      Tough to project that far down the list because we don’t know who will be available. I will say that I expect a goaltender or two to be included in their list of draftees. I also will not be surprised to see the Leafs package anywhere from two to six picks to make a bold move or two, whether that means moving up to get another pick in the top ten or trading for an existing contracted player who will help their team immediately, perhaps from a play-off team like the Rangers or Wild who are lacking draft picks.

      • giproc

        If I’m not mistaken, that site recently had the Leafs picking something like 3 or 4 goalies. This time, not even one.

        Laberge is a pretty good centre for the 2nd round who did okay at the WJC U18. He’s rated right around late first, early second.

        Amazing, Mr. Special Status Day slipping all the way to the 3rd. I still think someone will take a chance at turning him around in the 2nd round.

        • CMpuck

          This Sean Day thing is a mystery. How could so many people be so wrong? More to this than meets the eye. Pass until the 4th round or risk losing a valuable 3rd.

  • CMpuck

    the problem arises because the league with 30 teams makes ‘1st round’ a completely subjective term/number. Back when it was a six-team league, ‘1st’ round pick meant something. This year, those 6 would be the World Juniors ‘fab five’ forwards and one defenceman. My impression is that last year and this year, the cut-off is 22 players. then comes another 22 players, 23-44th, then another 22 45-66th. After the 22nd, 3 Swedish forwards are under-‘rated’, not just because they are playing this year in big roles on men professional league, but were standouts in World tournaments. Also, Thompson. At 31, Mascherin skills and Katchouk grinder, and Nielmelainen and Day skill with size, have a chance to be an upgrade on what the Leafs already have, but that would make them ‘steals’, that should have gone higher, not justification for drafting players that are truly the 45th-66th BPA, not counting European skaters and some OA players. Finally, if Rubtsov or Tufte is still there at 20-22, then trade up.

  • Gary Empey

    Umm… you might try reading my paper again. In the version of the pick chart you cite — there is a more up to date version available — I did not “the expected value of a draft pick taking measures like games played, points, and yes, +/- into consideration” but rather only took into account games played.