Thursday, February 10, 2011

Team WAR and team wins

So, the first time I did this, I made a little mistake. But I'm no quitter. I inadvertently only included postional player WAR the first time around, but now I've fixed it. But after fixing it, everything I said previously still pretty much stands. Keep reading:

----
Rob Neyer answered some questions today for Camden Chat. It's all good stuff, and I just happened to file something for the Hardball Times on the Orioles before I read this. But something in particular piqued my interest:
Camden Chat: Newer statistics, particularly Wins Above Replacement, cause a number of disagreements on our site. What are the cracks in the WAR metrics that would allow a team to substantially outperform (in the win column) their total WAR over the course of a season?
Rob Neyer: Do they? I've actually never seen team WAR compared to team wins. Just off the top of my head, WAR doesn't account for baserunning (except for steals). Nor does it account for luck. And that's the big one. The vast majority of fans simply don't understand the degree to which luck impacts wins and losses, even over the course of 162 games.
As luck would have it, I was doing the equivalent of artist doodling a few weeks ago, otherwise known as screwing around with baseball stats and excel. Well, I did something that relates exactly to Camden Chat's question: what are the cracks in the WAR metrics that would allow a team to substantially outperform (in the win column) their total WAR over the course of a season?

You can check out what I did below  for the 2010 season (I'll also add it to my box.net tool on the right hand side, so you can get your hands on the actual spreadsheet). Basically, I looked at win and loss records, run differentials, pythagorean wins and losses and ... WAR. I grabbed each teams WAR from FanGraphs, figured out what replacement was (basically 81 wins minus the average team WAR, which ends up being 45*), then added their team WAR plus replacement to find out how many wins their WAR totals would have predicted. I then calculated the delta between their WAR and actual number of wins -- this is essentially the question Camden Chat was asking.

*Note that the first time I did this a replacement level team would win 60.79 games. That's too many, and I knew this. But I forged on. Now that it's 45, I'm very comfortable I've done this right -- until someone tells me I'm wrong, of course.

If you take a look, you'll find that the Diamondbacks really underperformed in the win column versus their WAR total. That is no shocker to me, as their bullpen was truly atrocious and that will cost you a ton of games. Another team that posted an excellent WAR but turned in a rough season was the Brewers. I'm thinking their additions of Shaun Marcum and Zack Greinke may push them to the top of the pile in 2011. Finally, the Phillies were the team that were the "luckiest." I don't know what the implications are of that, but Rob mentioned base running and they've been excellent each season in that. Davey Lopes was one of the most efficient base runners around, and he's modeled the Phillies after himself. Unfortunately for them, he's gone next season.

Something I noticed after getting it right was the Rays. They are technically the second "luckiest" team. I think this jives with the fact that base running (non-stealing bases gained and lost) isn't accounted into the WAR caclulation. I know for a fact that Carl Crawford is a dream in that particular category, and I do believe the Rays were known for it in general. Oddly, it was this very thing that cost them big time against the Rangers when they were bumped in the first round.

I never really knew what to make of what I created, but here it is for your pleasure. I personally think it might give us some insight into which teams might be closer to contention. Also, I think it certainly shows which teams know there way around the bags. That said, draw your own conclusions.


Sources: FanGraphs for WAR

8 comments:

  1. Hey Rory,

    I did this same exercise during last season, and the first time I went through it, I made the same mistake you made. The WAR you are displaying is only for position players. Here is a link to my post:

    http://knuckleballsblog.wordpress.com/2010/06/13/number34/

    I trie dto do some things with the information, but it never really amounted to anything. Maybe I'll try again soon, or some other inspired sabermetrician will find something in the data.

    Dan

    ReplyDelete
  2. Nothing in this data accounts for games decided by poor umpiring decisions. I guess one could count that as luck, but I look at it as an independent variable.

    ReplyDelete
  3. According to FanGraphs, the G's accumulated a 25.1 position player WAR along w/ a 15.2 starting pitcher WAR, as well as a 6.2 relief pitcher WAR (they actually list the combined results of both starters and relievers as 21.5 WAR as opposed to 21.4) amidst their 2010 season.

    Therefore, 25.1 position player WAR + 21.5 total pitching WAR would equate to 46.6 Gigantes Team WAR.

    Don't know if there's something about your formula that is completely over my head, (I would admit to not being nearly as mathematically inclined as most Sabermetric work would require) but it would seem that if this is in fact an oversight, it could play choas w/ your calculations and/or research.

    By the way, was turned on to your blog about a month ago and have certainly enjoyed your work.

    ReplyDelete
  4. Thanks guys. I screwed up by only using position player scores -- which now makes a lot of sense. No wonder the Brewers are so high... It was their pitching that sucked. I'll fix this today and resubmit. But as Dan points out, I might not see anything useful in it.

    Billiam: thanks for the kind words.

    ReplyDelete
  5. I had wondered about this at some point this off-season too, nice job putting together the table, there are always glitches cropping up at some point, upward and onward!

    Like you, not sure what will come out of it, but given that Bill James always tried to bring his research in line with reality, I'm surprised that nobody had tackled this issue already somewhere, particularly the originators of the idea, as it seems pretty obvious that if you are going to calculate Wins as a metric, you would want to see if it has any bearing on reality or not. Pretty shameful and shoddy research methodology if nobody ever investigated this before.

    ReplyDelete
  6. Maybe the Giants should look into hiring Davy Lopes? With speed coming up our system, we should need someone to guide them in the majors.

    ReplyDelete
  7. Rory-
    noticing another possible factor to add to the equation after you've updated this chart: Managerial Skill.

    Among some of the higher WAR differential outcomes include some highly esteemed Managers. Maddon (+7.4) w/ the Rays, Manuel (9.5)w/ the Phils, Scioscia (5.5) w/ the Halos, and Bud Black (4.9) w/ the Pads; whereas some of the negative WAR differential teams underwent Managerial Rookie Seasons and/or firings.

    If you were looking to classify this "Luck Delta" in opposition of WAR performance, one could probably make a case to add Managerial Skill along w/ the undefined Baserunning aspects, Umpire paradigm, and good old-fashioned Chance.

    ReplyDelete
  8. I love the fact that baseball is evolving, and stat heads are finally getting the credt they deserve. Although not totally main stream, sabremetrics, and more relevant stats are starting to become more engrained in the game. I watch MLB network a ton, and they are starting to use WHIP, WAR, OPS and a bunch of other newer stats in their daily discussions. I hope the Giants have finally started to catch on.

    ReplyDelete