Showing posts with label ZiPS. Show all posts
Showing posts with label ZiPS. Show all posts

29 March 2017

Not the 2017 Standings

What will the 2017 standings look like at season's end? Probably not like the chart below. This is Fangraphs' Zips projections for each team, which has every bit as much value as every other projection system, but less than toilet paper, which has at least one other important use.

Still, it's a starting point for understanding the upcoming season.


Some items to note: 
1. None of the projection systems see much in the way of division races. Zips has the Red Sox winning the AL East by 4 games, but after that there's no drama. It's got Cleveland by 8 in the Central and Houston by 10 in the West.  In the NL, it projects the Nats by 8 and Cubs by 17, and the Dodgers over the Giants by 7 in the West.

2. If all goes according to form, which it literally never does, the Wild Cards are a pair of shootouts at the October corral. This chart rates the Angels Mariners, Rangers and Rays as a toss-up for the second Wild Card behind the Blue Jays. In the NL, the Giants, Mets, Cardinals and Pirates will battle for the play-in game.

3. The most volatile projections belong to the Anaheim Angels, Baltimore Orioles and St. Louis Cardinals. Zips puts the Halos at 83 wins and a Wild Card while Baseball Prospectus's PECOTA rankings have them at 77 wins and 85 losses. PECOTA doesn't believe in the Orioles either, tabbing them at 74 wins and the AL East cellar. And PECOTA is unfathomably dubious about St. Louis, forecasting just 77 wins and a finish behind Milwaukee.

So where do all those wins go in PECOTA? To the basement. Its worst team -- the Royals -- still win 71 games, more than four teams in the ZIPS projections

4. No one is much buying the Rangers, who ran away with their division last season. The advanced metrics suggested that was more a matter of serendipity than talent and regressed the Rangers to their natural ability level. A healthy Yu Darvish could mess with that.

5. The Mets' outlook is dampened severely by health concerns on the mound. They are rated as just the fourth best staff in the NL, barely ahead of Washington in fifth. But if the breaks go their way -- or actually, if there are no breaks, and pulls, tears, strains, tweaks, stiffness, contusions and syndromes are kept to a minimum -- they could be scary good at preventing runs. Of course, if the queen had testicles she'd be king.

6. The White Sox will look to deal whoever isn't nailed down mid-season, so their numbers could suffer in the short term in order to improve quickly down the line. The projections already like the path the Braves are on.

Are you ready? Opening Day's just a couple of days away.



25 February 2016

Why the Projection Systems Can't Get Bryce Harper Right

"History will little note, nor long remember, what we say here." --President Abraham Lincoln at Gettysburg battlefield, considered the worst prediction in human history.


The futility of predicting the future in baseball has been amply documented and only weakly lamented. Bless their hearts, the various Sabermetric websites continue to offer the old college try, annually tweaking their systems to finer and finer levels of mediocrity. Fangraphs, Bill James, Baseball Prospectus, Tom Tango and The Hardball Times all provide projections whose mathematical formulas do a 5% better job than you would making educated guesses.

As I've mentioned before, understanding a few simple rules will give you all the tools you need to pull even with, or even out-guess, the projections. The reason is that these systems are prisoners of their calculations, whereas you know something or two about the players.

Take Bryce Harper, who flummoxes PECOTA, ZIPS, Steamer, Marcel, Bill James and all the rest. Harper was a young phenom who flashed wads of unrefined brilliance in his first three seasons but also got himself injured with regularity because of his over-exuberance. Then last year, having learned how to stay on the field and harness his innate power, he blasted 42 homers and got aboard safely at a 46% clip, en route to the MVP.

What the projections systems see is a good player who scuffled along for three seasons batting .270 with 20 home runs before out-performing himself in 2015. Consequently, they are regressing him to the mean. Here is PECOTA's projection of Harper:

2015 (Actual)
22
.386
11.2
2016 (Projected)
23
.313
5.1
2017 (Projected)
24
.322
5.5
(That's age, True Average and WAR listed in the three columns above.)

That's generally the way to treat players, but this is Bryce Freakin' Harper. When it crunches the numbers and spits out its projection, PECOTA doesn't know Bryce Harper from Valerie Harper. It's never seen this prodigy play.  It thinks he's just a guy whose pants were on fire last season.

You know better. You know that's the Harper we've been waiting for, and that putting it all together at 22 makes him a superstar not in spite of three previous seasons of .270 and 20 home runs but because of what we saw during them. 

I'll bet my Pope Francis Fan Club membership that Harper posts a TAv north of .350 this season and, if he stays upright, hands at least another eight wins to the Nationals. It may not work out that way, but that's what PECOTA would say is a reasonable 50% percentile projection if it had the ability to discern the man behind the statistics.

It doesn't, as none of the projections systems do, which is one of the reasons they aren't of much use.

03 January 2016

MLB Demonstrates the Uselessness of Projection Systems

Major League Baseball is touting today the Steamer baseball projections for 2016. Steamer is one of several Sabermetric projection systems -- including Fangraphs' ZIPS, Baseball Prospectus's PECOTA and the Hardball Times' Oliver -- that offer a crystal ball of sorts on future player and team performance.

These systems generally work the same way, projecting the accomplishments of players by comparing their careers to similar players in history, averaging the performances of those similar players in their next season and adjusting that to the player in question.

The MLB.com story is not a particularly interesting read. It projects that Miguel Cabrera will win another batting title, Clayton Kershaw will again top the pitching charts and Giancarlo Stanton will once more outslug the field. 

Shocking.

This is what you get with projection systems, which have no ability to predict the unpredictable. The 2015 accomplishments of Jake Arrieta, Dee Gordon, AJ Pollock, Dallas Keuchel, the Kansas City Royals and New York Mets were no less a mystery to these projection systems than to you.

They also have no ability to predict outlying performances. They will never project any player will slam 58 home runs, bat .360 or accrue 21 pitching wins unless he has done that regularly in the past. 

Moreover, Steamer does not attempt to project playing time, so even though Stanton has missed 40 games a season in his career, the projection assumes he plays 150 games. (Some of these systems do take playing time into account, which means they are wildly wrong slightly less often.)

These systems gave us the Angels, Dodgers and Nationals as baseball's best teams in 2015. They got the AL East and West almost exactly wrong. They offer some mild insights that can be almost completely encapsulated in 13 simple rules.

So don't bother reading the article. (Read this one about Statcast instead.) And let's just enjoy the raging unpredictability of the game that served us so well last year.

24 March 2015

An Un-Evan Projection for Longo

What do the projection systems have against Evan Longoria?

The All-Star third-sacker has manufactured a .298 lifetime True Average (TAv) in a seven-year career, dropped below .300 only by last season's struggles following off-season surgery. That not withstanding, Longo has been automatic 30 homers and a .351 lifetime on base percentage.

The projections systems say that at 29 all of Longoria's best days are behind him. Three prominent systems -- PECOTA, ZIPS and Steamer -- say he is more like a .255-.260 hitter, with OBP in the .330s and low-20s home runs. A seven win player his first six seasons, Longoria is grading out as just a three-win player in 2015, almost all of it because of defense.

This suggests that players with Longoria's profile -- medium-speed power hitters with fancy leather -- don't age well starting in their late 20s. Or it suggests that a new $100 million contract will emotionally short-circuit the ordinarily Evan-keeled Longoria and dampen his skills in 2015.

Neither of these premises rings particularly true. Indeed, the most likely event, barring further injury, is a bounceback from last year's scuffles that sustains itself for a couple of seasons before real decline sets in. The former Rookie of the Year has too much talent, demonstrated too consistently, to suddenly fall off the cliff in his prime.

07 February 2015

Statheads Have To Lighten Up About Their Projections

When a kid gets a shiny new toy he always wanted for Christmas, it's not surprising that he plays with it endlessly. And when it ceases to work, it's not surprising that he puts it away.

The seamheads turned out shiny new projection toys in the 2000s variously called PECOTA, Steamer, ZiPS, Marcel, FANS and Oliver, depending on whose proprietary system you prefer. (For example, Baseball Prospectus created PECOTA, Fangraphs introduced ZiPS and Tom Tango developed Marcel.) They all compare ballplayers of today to their counterparts in history to determine what awaits the current crop in the coming year. All that is then compiled into team projections.

These toys have some value for a couple of reasons: they are objective and they have built into them some simple rules that humans fail to recognize or choose to ignore when analyzing player performance. Beyond that, though, they offer little insight. Most significantly, they don't know anything about the people who play the game. They are blind to who learned a new pitch, is struggling through a wrenching divorce, picked up a hitch in his swing or is finally healthy.

As a result, they can never tell us who will suddenly break out, Jose Bautista style, or who will Dontrelle Willis all over himself. None of them could pinpoint the 2014 demise of the Red Sox or the Orioles' pre-eminence. And yet the sabermetric world talks about these tools as if they're atom splitters.

So, for example, Steamer predicts the top 10 players by WAR next year are Mike Trout, Andrew McCutcheon, Giancarlo Stanton, Troy Tulowitzki, Miguel Cabrera, Josh Donaldson, Evan Longoria, Adrian Beltre, Jose Bautista and Paul Goldschmidt. (Cano, Machado and Puig are right behind.) Well, duh. right? (Clayton Kershaw and Felix Hernandez are its top pitchers. Who knew?)

It says Joey Votto and Bryce Harper are stars with injury risks. You don't say. It projects Chris Davis bouncing about halfway back to 2013 with a .242 batting average and 30 home runs. About what you'd predict. It sees Justin Verlander returning to about league average pitching. And it's not really buying Rookie of the Year Jacob deGrom. Well, who outside of the outer boroughs is?

So the toys have some entertainment value, but the saber community plays with them as if they're iPads.  They quote chapter and verse on players, particularly when analyzing trades and signings. The truth is, exercise a few simple guiding principles, like Warren Buffet investor tips, and you too can lord over the average baseball fan.

And be right 60% of the time.

In subsequent posts, we'll discuss those principles, examine some interesting player projections and the swim among the team projections. (Spoiler alert: the Phillies will suck.)