Showing posts with label Bill James projections. Show all posts
Showing posts with label Bill James projections. Show all posts

25 February 2016

Why the Projection Systems Can't Get Bryce Harper Right

"History will little note, nor long remember, what we say here." --President Abraham Lincoln at Gettysburg battlefield, considered the worst prediction in human history.


The futility of predicting the future in baseball has been amply documented and only weakly lamented. Bless their hearts, the various Sabermetric websites continue to offer the old college try, annually tweaking their systems to finer and finer levels of mediocrity. Fangraphs, Bill James, Baseball Prospectus, Tom Tango and The Hardball Times all provide projections whose mathematical formulas do a 5% better job than you would making educated guesses.

As I've mentioned before, understanding a few simple rules will give you all the tools you need to pull even with, or even out-guess, the projections. The reason is that these systems are prisoners of their calculations, whereas you know something or two about the players.

Take Bryce Harper, who flummoxes PECOTA, ZIPS, Steamer, Marcel, Bill James and all the rest. Harper was a young phenom who flashed wads of unrefined brilliance in his first three seasons but also got himself injured with regularity because of his over-exuberance. Then last year, having learned how to stay on the field and harness his innate power, he blasted 42 homers and got aboard safely at a 46% clip, en route to the MVP.

What the projections systems see is a good player who scuffled along for three seasons batting .270 with 20 home runs before out-performing himself in 2015. Consequently, they are regressing him to the mean. Here is PECOTA's projection of Harper:

2015 (Actual)
22
.386
11.2
2016 (Projected)
23
.313
5.1
2017 (Projected)
24
.322
5.5
(That's age, True Average and WAR listed in the three columns above.)

That's generally the way to treat players, but this is Bryce Freakin' Harper. When it crunches the numbers and spits out its projection, PECOTA doesn't know Bryce Harper from Valerie Harper. It's never seen this prodigy play.  It thinks he's just a guy whose pants were on fire last season.

You know better. You know that's the Harper we've been waiting for, and that putting it all together at 22 makes him a superstar not in spite of three previous seasons of .270 and 20 home runs but because of what we saw during them. 

I'll bet my Pope Francis Fan Club membership that Harper posts a TAv north of .350 this season and, if he stays upright, hands at least another eight wins to the Nationals. It may not work out that way, but that's what PECOTA would say is a reasonable 50% percentile projection if it had the ability to discern the man behind the statistics.

It doesn't, as none of the projections systems do, which is one of the reasons they aren't of much use.

31 December 2012

Another Spin In the Projection Machine

It might be interesting to consider what's in store for players who have changed teams while the hot stove burns. Here are Bill James's projections for the performances of a handful of key players. 

Remember that these projections were assembled prior to the signings and trades that have dotted the off-season, and that projections are not predictions. And that Bill James is not God. In fact, he finished fourth in the holy trinity.

Josh Hamilton
2012 .285/.354/.577 43 HR 148 games
2013 .289/.356/.540 35 HR 147 games

This is an exceedingly generous projection considering:
1. Hamilton has moved from Arlington to Anaheim, which should punish his stats a bit.
2. The number of games Hamilton has stayed healthy for in a season looks like this: 90, 156, 89, 133, 121, 148. The logical next number is not 147.

R.A. Dickey
2012   20-8, 2.73 in 234 innings, 54 BB, 230 K
2013   16-8, 3.58 in 226 innings, 56 BB, 152 K

Projections on pitchers are difficult enough, but with a unique subject like Dickey who really has no comparables, examining other players is not necessarily helpful. Given that, this projection seems eminently reasonable. This suggests he'll still pitch very well but won't dominate. Translated to Toronto, and the AL Beast, these numbers are likely to degrade further.

Kendrys Morales
2012  .273/.320/.467, 22 HR in 134 games
2013  .284/.332/.489, 23 HR in 137 games

Morales broke out in 2009, his first full season, hitting .306 and smacking 34 homers. Off to another estimable campaign in 2010, he broke his leg jumping on the plate during a walk-off celebration. James is suggesting that last year was Kendrys's new normal, which will be normalized lower playing in Seattle's dead-ball zone. Projections also suggest that he'll want to poke his eyeballs out with hot needles after watching the likes of Jason Bay and Raul Ibanez take their hacks. Speaking of which . . .

Jason Bay
2011  .245/.329/.374, 12 HR in 123 games
2012  .165/.237/.299, eight HR in 70 games
2013  .247/.343/.413, 17 HR in 133 games

So James suggests that Bay will deliver the greatest bounceback from irrelevance as a 35-year-old in MLB history. Of course, the projection system didn't know that Bay would become part of a platoon -- with 104-year-old Raul Ibanez, no less -- making 133 games played (and therefore 17 dingers) as likely as good parenting from the platoon of Kim Kardashian and Kanye West.

Melky Cabrera
2011 with Royals - .305/.339/.470 in 155 games
2012 with Giants -- .346/.390/.516 in 113 games before his blood turned him in
2013 with Blue Jays -- .295/.348/.432 in 148 games

In other words, the projection system says that not only was 2012 a steroid-induced fluke, 2011 wasn't to be believed either. The 2013 projection isn't much better than Melky's lifetime averages, which, absent the two years in question, were below average. Good luck with that, Blue Jays.

Shane Victorino
2011 with Phils -- .279/.355/.491, 19 steals, 17 HR
2012 with Phils & Dodgers -- .255/.321/.383, 39 steals, 11 HR
2013 with Red Sox -- .269/.338/.418, 29 steals, 14 HR

Can you say, "split the difference?"

Nick Swisher
Lifetime     .256/.361/.467, 25 HR, 84 RBI, 86 R, 84 BB, 134 K
2013           .256/.362/.458, 25 HR, 86 RBI, 82 R, 86 BB, 143 K

Sheesh, I could have projected that. I guess the Indians know who they signed.

Doubtless, one of these players is headed surprisingly south with his performance (unless it's Bay, who already inhabits baseball's Antarctica, and could therefore neither go south nor disappoint) in a manner beyond the capability of the projection system to foresee. Hey, if the game were predictable, it wouldn't be fun.

02 December 2012

More Fun With the Projector

Do you fantasize about Paul Goldschmidt's 2013 longball contributions to your keeper league team? Is Trevor Plouffe's second-year power surge and position flexibility dancing in your Hot Stove dreams?  Are you dying to see the gauge on Andy Pettite's gas tank?

Then it's time to talk more projections. Bill James is out with the first set and there's plenty to feast on. First, if you haven't read the rules of the road, they're here. Keep in mind that making predictions is easy; getting them right is hard. (Besides, these aren't predictions, they're projections. Stalagmite, stalactite.)

So let's peek ahead at what's in store for a handful of intriguing players for 2013.

Ichiro Suzuki
2010 .315/.359/.394
2011 .272/.310/.335
2012 .283/.307/.390
2013 .294/331/.370

Ichiro is the only 39-year-old on the planet projected for a bounce-back. That's due in large part to his second-half burst with the Yankees last season (.322/.340/.454) and in part to the assumption that he'll be leading off with Murder's Row behind him in the Bronx's Offense Smiley Face Stadium.

Justin Morneau
2010 .345/.437/.618, 18 homers in 81 games
2011 .227/.285/.333, 4 homers in 69 games
2012 .267/.333/.440, 19 homers in 134 games
2013 .271/.348/.459, 21 homers in 137 games

Multiple concussions derailed a near-great career but Morneau quietly rebounded last year with a nearly full season. His on-base and slugging skills have not returned with him though, leaving him a below-average first-baseman. James's projection tools suggest, alas, that Morneau has roughly found his new level.

Carl Crawford
2010 .307/.356/.495, 47 steals
2011 .255/.289/.405, 18 steals
2012 .282/.306/.479, 5 steals (31 games)
2013 .274/.318/.413, 36 steals

Before Dodger fans jump out their windows over this desultory projection, they should remember that this is a repeat of Crawford's 2008 in St. Petersburg when the Rays went to the World Series. In offense-crushing Chavez Ravine, this is more faint praise than damning and if any part of the equation rests on Crawford's rehabbing elbow then better days may lie ahead. That's important to L.A. because he's signed to a king's ransom through his 36th birthday in 2017.

Starlin Castro
2011 .307/.341/.432, 10 homers, nine triples, 35 BB, 96 K, 22/9 in steals
2012 .283/.323/.430, 14 homers, 12 triples, 36 BB, 100 K, 25/13 in steals
2013 .304/.346/.448, 12 homers, 10 triples, 38 BB, 86 K, 24/12 in steals

If this looks familiar it's because it's Alfonso Soriano's early career: a speedy, undisciplined middle infielder with good bat control and occasional pop. The question for the Castro is whether he develops his power or some discipline, or optimally, both. James's system has the arrow pointing towards an uptick in strike zone aptitude, which will be necessary if BABIP ever turns on the Cubs' shortstop. This is a guy with high potential for turning the corner to super-stardom or face-planting on a sub-.300 OBP and an impatient manager.

Paul Goldschmidt
2011 .250/.333/.474, 8 homers in 48 games
2012 .286/.359/.490, 20 homers in 145 games
2013 .283/.375/.501, 27 homers in 153 games


Well, since you asked. While you were busy watching amateurs croon and celebrities prance on your home glow box, this 230-pound first baseman authored an adept first chapter in MLB. With just 177 plate appearances in his rearview, Goldschmidt gave Arizona a batting line 23% above average and 3.7 wins above replacement. The projector suggests that Goldschmidt is on his way to becoming a "Three True Outcomes" player who fans, walks and wallops homers at high rates. (Think Adam Dunn, Mark Reynolds.) When guys like that hit .283 they're major contributors.

We'll take a few more strolls through this meadow over the course of the long baseball-less winter.