Showing posts with label Clutch. Show all posts
Showing posts with label Clutch. Show all posts

13 April 2016

Why Chris Davis Is Not A Rally-Killer

Chris Davis 
Photo by Keith Allison

During last week’s Camden Highball podcast, I made the following statement (paraphrased):
I love you, Chris Davis. But I don’t want you batting in the bottom of the 9th when the team is down by two and there are two runners on base. One-third of the time you’re going to strike out (not advance the runner). These little moments are going to add up during the year.
Prior to recording the podcast I’d thought a lot about the relationship between swinging strike rate and WPA. My gut told me a high-strikeout player like Davis would hurt the team by failing to advance runners in close games.

It seemed true. It felt true. So I said it out loud.

After I listened to the recording, an embarrassed flush spread to my cheeks. Here I am, writing on a sabermetrics web site, and I just used my gut to make a statement. Ugh! We all say foolish things, but not many of us get the chance to say foolish things that strangers on the Internet hear and that live for eternity on Dropbox. I managed to do both at once.

In order to feel less foolish, I had to atone for my sins. Isn't that what this whole sabermetrics thing is about, backing up your beliefs with evidence? So I said "gut, I'm sorry, but I need to fact check you." My gut responded favorably, but that's probably because I'd just eaten a peanut butter creme Oreo.

I examined the relationship between a player's swinging strike rate and the following metrics:
  • Win Probability Added: Measures how much a player added to their team’s chance to win during the course of a season, taking into account both the leverages (inning, score, runners on base, number of outs) in which they batted and how well they did in the plate appearance.
  • Win Probability Added / Leverage Index (WPA/LI): WPA without the leverage component. Unlike WPA, WPA/LI doesn't punish players for appearing in lots of low-leverage situations, nor does it reward players to bat in a lot of high-leverage situations. Players can't control the leverage of the situations in which they bat.
I sampled non-pitchers from 2010-2015 who averaged at least 50 PA per season. This low threshold avoided survivor bias by looking at not only starters, but also role players and those who were injured.

My hypothesis: players with high swinging-strike rates will have a lower WPA than players with low or average swinging strike rates. For context, Davis’ swinging strike rate of 15.48% ranks 20th-highest out of 1,607 players in this sample.

Unfortunately for my gut, the research shows swinging strike rate doesn't correlate well to either WPA or WPA/LI:


Swinging strike rate explains only 0.07% of the variance in WPA, or about 0.002 wins per year. That's a tiny number of wins.

The relationship isn't much stronger when you remove leverage from the equation. The r^2 between swinging strike rate explains only 0.0198 wins of WPA/LI per year. No one will notice this change in a player's WAR.

But r^2 isn't everything. The regression lines slope upward, indicating that as swinging strike rate increases, WPA and WPA/LI also increase. If you followed this model you'd want a player to swing and miss as much as possible, because the model says their WPA would be very high. But no one wants a batter to swing and miss ever, let alone "as much as possible".

That's why the plots look different if you focus on players with medium-to-high swinging strike rates:


The r^2 values remain weak. More importantly, these trend lines slope downward. Now the model says: if you swing and miss a lot, you're starting from a deeper hole than your peers who make more contact. You can still make a positive contribution, but you'll have a harder time doing so. There's the logical sense we are looking for.

A 2nd-degree polynomial fit of the original data shows this effect better:


While Chris Davis' swinging strike rate doesn't explain his WPA or WPA/LI, he should be careful going forward. If he swings and misses much more than he does now, he'll have a harder time contributing to the team.

Fortunately, Davis is a more complete player than just swinging and missing. He possesses tremendous power and mixes in a pretty good walk rate. These factors boost his wOBA, which correlates much better with WPA and WPA/LI:


The r^2 between wOBA and WPA is 0.64 (2.1 wins), and between wOBA and WPA/LI it's a whopping 0.82 (2.3 wins). Overall offensive prowess, as measured by wOBA, explains variance in WPA and WPA/LI much better than than swinging strike rate does.

These relationships hold up well for hitters in Davis' class:



In both cases, the regression models make logical sense. Have a high wOBA and you'll contribute wins to your team. Chris Davis should have a high wOBA. All is right with the universe.

I'm sorry, Chris Davis. I take back what I said. I won't grimace in frustration anymore when I see you bat in a high-leverage spot. I'll remind myself that you're a very talented baseball player who whacks the ball all over the yard, no matter the game situation.

But please don't swing and miss any more than you already do.

26 August 2015

What WPA Teaches About The 2015 Orioles

Just five games ago, it seemed like the Orioles had finally turned the corner and were set to make a run to at least secure a wild-card spot. The Orioles lost each of those next five games and are now at .500. Orioles’ fans are feeling despondent while Manny Machado apparently boiled over in the locker room after the latest Orioles heartbreaker. Why have the Orioles struggled this year?

In 2014, the Orioles scored 705 runs while hitting 211 home runs and are on pace to score 715 runs and hit 212 home runs this year which means that their offense hasn't gotten worse. The pitching hasn’t performed as well as the Orioles allowed 505 runs through August (3.74 R/G) in 2014 and have so far allowed 498 runs this year (4.01 R/G).  Allowing an extra quarter of a run per game shouldn’t be the difference between winning 96 games and flirting with .500.

Looking at the Orioles’ Win Probability Added (WPA) and Clutch statistics from 2012-2015 can help explain why the Orioles have struggled this year. For those unfamiliar, WPA determines the change in the likelihood that a team will win from one plate appearance to the next and credits or debits the player based on how much their action increased their team’s odds of winning. The Clutch statistic measures how well a player has performed in high leverage situations.

The first chart, which measures the Orioles’ offense from 2012-2015, shows that the Orioles have scored a standard amount of runs. The problem is that they haven’t been in the right situations and is why the Orioles are projected to have a negative clutch score for the first time in the sample. In contrast, the Orioles’ offense was very clutch in 2013 and reasonably clutch in 2012 and 2014. This is also why the Orioles’ offensive WPA is on pace to be worth 2 wins while it was worth over 6 wins in 2013 and 2014.

While the Orioles are on pace to score 715 runs in 2015, the Orioles’ wRC suggests that they should only be scoring 687. This is lower than what the Orioles scored from 2012 through 2014 and could indicate that Orioles’ fans feel like their offense isn’t as good as it has been in past years because they've scored more runs than expected. 


The next chart shows that Orioles’ starters have a better ERA in 2015 than they did in 2012 or 2013 but have a considerably worse win-loss record and have a lower WPA. The data also suggests that the Orioles’ starters have been only average in the clutch as opposed to 2014 where they came up big in crucial situations. Unlike in previous years where the offense was able to offset the starting pitching weaknesses, it appears that the Orioles have been unable to recover from their starting pitching performances.



The third chart shows that the Orioles 2015 bullpen has had the best ERA out of the four bullpens when using either standard ERA or leveraged ERA (a metric that I use which grades relievers based on their innings pitched and game leverage to ensure that a closer is given more credit than a middle reliever for bullpen performance). Unsurprisingly, the solid 2015 bullpen has a high 59% win rate (equivalent to a 96-66 team) which is the best of any Orioles club over that period with the sole exception of the extremely clutch 2012 bullpen that had a 74.4% win rate (equivalent to a 121-41 team). Yet while this bullpen has been extremely effective, it hasn’t resulted in producing wins according to WPA compared to those other bullpens.
 
The reason for this can be explained partly by game leverage and partly by comparing saves, holds and blown saves to previous years. In 2015, the Orioles bullpen average game leverage has been 1.05. Their average game leverage ranged from 1.15 to 1.30 from 2012 to 2014. This means that they haven’t been able to pitch in as crucial of situations as they have in the past. This explains why the Orioles’ bullpen is on pace to have only 42 saves and 48 holds in 2015 despite having mid-50 saves from 2012-2014 and between 67 and 97 holds from 2012 to 2014. It would appear that the Orioles bullpen hasn’t had as many opportunities to pitch with a lead as they have previously and consequently saves, holds and blown saves have all decreased.



It should come as no surprise that the Orioles are 17-22 in one run games and 10-15 in two run games because those are the ones most dependent on luck or clutch performance. If the Orioles were to have won as many one and two run games as they’ve won games decided by three or more runs, then they would have another ten wins and would likely be in a fight with the Blue Jays to determine the AL East winner.  Their problem is that they simply haven’t been clutch.

In previous years, the Orioles have been successful by getting a lead to their bullpen and letting their bullpen save the day. In 2013, the Orioles ultimately fell short because the bullpen couldn’t hold onto enough leads and win enough games. This year the bullpen has done well when given a lead (except for this past week) but it just hasn’t happened often enough. The story that the data seems to be telling is that the bullpen has been placed in a situation where they’re trailing by a small amount instead of leading by a small amount and the offense just can’t quite get that hit that would give the bullpen a lead. There’s only so much a bullpen can do in those situations.


The Orioles are still .500 and have over a month to play. Their team is really built to win in September and if the Os do go on a run and take the second wild card spot then no one will care what happened earlier this year. But if the Orioles don’t end up making the playoffs, then people will look at these close games and wonder what could have been with just one more solid offensive player or slightly better pitching from the starting rotation. 

19 November 2012

Clutchest Hits of 2012

During the magical 2012 season, the Orioles came up with a bunch of clutch hits. After all, you don't outperform you Pythagorean Win totals buy 11 games without coming up big in some close games. The Orioles were no exception.

So I took the 10 biggest hits in terms of Win Probability added and listed them below. Lots of heroes, not all of them obvious.


10. Wilson Betemit - .43 WPA - 4/13/12

The Orioles were in Toronto with two outs in the 8th and the bases were loaded. Betemit singled on a sharp ground ball up the middle scoring Nolan Reimold and Nick Markakis turning a 1-run deficit into a 1-run lead. Reimold would tack on a run with a solo homer in the 9th and the Orioles would win 7-5, breaking a three game losing streak early in the season.




9. Adam Jones - .43 WPA  - 9/19/12

It was the top of the 11th in Seattle and the game had been tied since the 4th inning. Nate McLouth hit a 1 out single and then Adam Jones put the O's on top for good with a long home run to left field. The win put the team 21 games over .500 and kept them a half game back of the Yankees for the division lead.




8. Taylor Teagarden - .44 WPA - 7/14/12

The game versus the World Series bound Detroit Tigers on July 14th is the clutchiest team performance in terms of offense of the 2012 season. Taylor Teagarden's game winning 2-run homer in the bottom of the 13th is not even the biggest hit of the game in terms of WPA and is one of three hits that moved the winning probability more than 40% in the Orioles' favor.




7. Adam Jones - .44 WPA - 7/14/12

There would have been no Teagarden walk-off in the 13th without Adam Jones' big hit in the 11th. Down to their final out with two men on, Jones drove a liner into left scoring Nick Markakis and tying the game at 5 runs apiece.




6. Mark Reynolds - .45 WPA - 7/19/12

With two outs in the top of the 8th, Mark Reynolds singled in Matt Wieters and Wilson Betemit turning a one run deficit into a one run lead. The O's would beat the Twins 4-3.




5. Nick Johnson - .45 WPA - 5/11/12

Remember him? He didn't play much but he did have one of the biggest hits of the year for the Birds. With two outs in the bottom of the 7th, Johnson hit a 2-run homer and turned a 3-2 deficit into a 4-3 lead. (Sound familiar?). The bullpen made it stand up for the one run win over Tampa Bay.




4. Matt Wieters - .46 WPA - 6/24/12

The Nationals had shutout the Orioles for 7 innings but in the bottom of the 8th, Adam Jones singled and then Matt Wieters hit a homer to deep left-center. The blast gave Baltimore the 2-1 lead and, once again, the bullpen made it hold up.




3. Nick Markakis - .46 WPA - 4/22/12

Like many others, Nick Markakis turned a one run deficit into a one run lead with a bases loaded single in the top of the 8th. For good measure, after Angels had tied the game, Nick singled home the go-ahead run yet again in the top of the 10th off of La Troy Hawkins to give the O's their 3-2 victory. With those two big hits, Markakis had .741 WPA for the game, the clutchiest game for an Oriole hitter during the season.




2. J.J. Hardy - .47 WPA - 7/14/12

Back to the July 14th game against the Tigers, the Orioles were down by one run with one out in the bottom of the 13th. Taylor Teagarden was able to give the Birds the win thanks to J.J. Hardy's game tying homer earlier in the inning bringing them back from the brink of defeat.




1. Nate McLouth - .54 WPA - 8/27/12

Pedro Strop gave up three straight singles in the top of the 8th to give the White Sox the 3-2 lead. With one out in the bottom of the inning, Mark Reynolds walked and Nate McLouth hit a 2-run homer to deep right to give the Orioles the 4-3 lead that Jim Johnson would again make stand up.




Looking over this list, you can make the argument that the July 14th game versus Detroit was the turning point of the season. The Orioles were just 4 games over .500 heading into that game and went 48-28 the rest of the way, 20 games over .500. There were lots of great moments in this Oriole season but July 14th may have been the greatest game they played and sparked them to greater things as the rest of the season played out.