Early Skews, Man City Impress And Other Stat Stories: EPL Week 2

Early skews

We've hit the crucial juncture of two (!) games now and already firm story lines are appearing around the media. Simple hooks are readily available to explain any positive or negative deviation, depending on which direction a team appears to be turning.  Take Southampton; last season they conceded four or more shots on target on 14 separate occasions and yet in only five of those games they conceded twice or more.  In all those matches combined, they ran a pretty much bang on league average 70% save percentage.

This year they've played two matches, conceded four shots on target in each and conceded five goals. Over double the previous rate.  Now what we can't do is make a hard conclusion about where Southampton are as a team after two games, but what we can say is that in the games played they have conceded goals at an extremely high and unsustainable rate; this kind of thing happens regularly in a tiny sample.   Already though i'm seeing the loss of Schneiderlin being called key and analysis homing in on perceived areas of weakness within the team.  The two matches have also featured 15 and 17 shots from Southampton's attack- a very good 25 of which have been inside the box and shows it hasn't been a raft of potshots. It also means the true alarm bells are only humming gently in the far, far distance, almost imperceptible to anyone but the very few people prepared to shrug, make a plea for calm, look at the numbers and say:  "it's early days and it could just be one of those things".

Man City v Chelsea

After the tiresome and miserable events and after-effects around the "doctors" issue, it was refreshing to get back to the football; the two top teams in the land, of course, and for 90 minutes we found a treat of a game that seemed quickly forgotten- at least by the Sky Sports pundits- and replaced by yet another dull narrative surrounding John Terry.

Terry's withdrawal was more interesting when held against the new found defensive generosity that has beset Chelsea so far   Over the last two seasons, Chelsea have conceded eight or more shots on target on only five occasions, it's extremely rare.  Now they've already done just that in both of their games this season.  For all that Aguero remains the most impressive forward in the league, to repeatedly allow him to arrive ball at feet in the centre of the penalty box was not part of the Mourinho plan and we're into the realm of theories: are they worn out? Are they too old? Is it just one of those things?

Now whilst I'm happily giving Southampton a free pass for now, Chelsea's mediocre underlying numbers stretch back over much of 2015.  Rarely convincing, but regularly winning, they put in a string of under-par away performances as last season wound down.  They visited West Ham, Hull and QPR consecutively and contrived to be thoroughly out-shot in each match yet scored five goals from seven shots on target and picked up nine points.  That two of those teams were subsequently relegated and the other showed relegation form throughout the second half of the season makes turning up at Man City and being comprehensively beaten seem a more logical extension than you might otherwise think.

In contrast, Man City who, lest we forget, are a team who many pundits predicted were in decline and would finish fourth or even fifth, have contrived to make a mockery of such half-baked predictions rather quickly.  Stronger in defence than they are often credited, they have now won eight straight games in the league scoring 24 goals, conceding just four and regularly take double the amount of shots of their opponents.  Criticism of the Sterling signing seemed to be more about the nature of the transfer than the talents of Sterling himself and having pruned their attackers by letting Jovetic and Dzeko move on, they now have the extremely attractive options of Nasri and Bony as first change attackers.  With the possible promise of further strengthening to add to what is already the most intelligent attack in the league, there is a distinct possibility that they just may be able to sneak a few more wins.

Bonus content

 

barnes

 

Having spent a deal of time really trying not to make snap judgements based on two games it's time to take a small diversion. Over the summer I finally put down on paper a little starter on some research i'd done on footedness in shooting and as a further hors d'oeuvre to a meal that admittedly may never be served, we have this:

foot head used

The sample is sized as such as it represents an average of six players per team, or realistically a starting midfield and forward line and there was a requirement of a certain volume of shots to ascertain which foot preference a player had.  In this instance I used a 60% cut-off as a definition: a player that took 60% or more of their footed shots with a certain foot was deemed to favour that foot, and in between were deemed two-footed.  This gave 70% of players as right footed, 8% as two footed and 22% as left footed.

What can we take away here?

Well, it seems that left footed shooters are more predominantly left footed than their right footed counterparts are right footed.  They take 77% of all shots with their left foot compared to 68% for right footers.  Left footers also make fewer headers than both two footed players and right footers.  In fact, two footed players appear to show greater versatility with regard headed attempts too.

That left footers may favour their dominant foot to a greater degree seems to chime with recollections of significantly one-footed players.  Erik Lamela's rabona is just one extreme example.  Historically, fans have regularly eulogised about the qualities of left footers- "he's got a wand of a left foot"- to a degree that seems to exceed that of the far more common right footer.  Maybe that's a partial comment on scarcity but to think of special dribblers such as Barnes, Giggs, Maradona and Messi is to evoke a thrilling aspect of the game.

Another type of left footer can also find favour: the "Hammer" left foot of Branco, Stuart Pearce, Roberto Carlos or Christian Ziege through to more modern players like Riise, Kolorov, Podolski or Bale.  All players extremely and vividly biased towards their stronger foot.  Maybe this is a function of position? The left footer is more obviously sent to his wing as a balance- although less so in the era of inverse wingers- and again do we recall due to uniqueness?

Anyway, that's just a few thoughts, i'm sure people have many more and I'll return to this in future.

Obligatory Tottenham bit

I noted last week that the seemingly improved defensive performance against Man Utd was likely to be as much about how Man Utd structure their game as to a genuine example of problem solving and in a fairly grim fashion, Tottenham proceeded to concede 16 shots at home to Stoke in the course of snatching a draw from the clutches of victory.  An hour of the game was good: solid play and a couple of goals but much like this fixture last year, Stoke came on stronger as the game wore on and Tottenham visibly shrank.  By the finish Tottenham were so devoid of control and nous that you'd have found fresher ideas in a new episode of the Simpsons and the lack of a Schweinsteiger figure to come on and steady the ship, much like er... Schweinsteiger had done for Utd the previous evening, was telling.

This is an inexperienced side, and it really showed here.  The exciting but also young Clinton N'Jie has arrived and will at least provide some sorely needed forward options and further deals may need to be made.   A visit to the Mahrez inspired Leicester beckons.

Thanks for reading!

______________

Follow me on Twitter:  @jair1970

Tim Sherwood: The Secrets Of Success And This Week's Other EPL Stat Stories

I had been champing at the bit to write about Tim Sherwood but after this last weekend, it feels a little more like a necessary procedure akin to having root canal treatment. Damn it though I'm an analyst, to some at least, and come hell or high water one must continue. Sherwood, despite widespread unpopularity amongst Tottenham fans dismissive of his win percentage, showed humility and decency in his special one-on-one Match of the Day interview.  With a glint in his eye joined merrily by the tiniest yet most obvious smirk he may well have provoked a little ire but he brings a certain appeal that if not quite box office is certainly worthy of soap opera. He has returned to our lives in the guise of Aston Villa manager and has quickly posted a 37% win percentage- an instant improvement on the 20% Paul Lambert accrued thanks to an aversion to creativity and goalscoring. He's back, he's got his striker scoring again and as such Goal of the Month competitions have resumed at Villa Park, but what's under the hood for our Tim? villa sherwood Firstly, Lambert presided over one of the most miserable Premier League seasons in recent memory. A sub-five percent conversion rate meant that a proverbial grandmother could have come in and improved the situation.  An ideal gig for a confident and confidence-orientated manager?  For sure. The most relevant thing about Villa under Sherwood to me is that their shooting numbers are solidly par.  They are a roughly 50% team under his tutelage and it holds across a variety of other numbers including possession (49%), Finishing/PDO (1.02), total conversion (+0.01) and even goals for / against (1.5:1.4).  How he is generating these numbers is interesting given that as a Tottenham fan, I have some insight as to how Tim Sherwood sets up his teams and how he attempts to generate results.  And in this early analysis, there are some notable similarities to his Tottenham tenure.  Samples are small, twenty-two games and eight but already we can pull specific likenesses: villa sherwood 2 A few choice numbers there but revealing, in particular when held up against league averages as shown.  Each of these statistics I feel are a reasonable proxy for how Tim Sherwood sets up his teams and the way he approaches football matches.  We can see that in both his jobs the conversion rates for and against have been high, the rate of shots created and allowed that are on target is extremely high and the goal totals in games have clearly exceeded league averages.  To those of us who watched the back end of Tottenham's 2013-14 season, none of these points will come as a surprise. Sherwood regularly entrusted 19 year old Nabil Bentaleb to a nominal defensive midfield role.  Alone.  Meanwhile five more attack minded players endeavoured to wreak havoc ahead.  Some of these set-ups appeared naïve, or even ill conceived, and they provided mixed results.  So much so that when combined with an over willingness to share in the media, his departure was not mourned widely.  Sherwood's methods appeared to sacrifice control at the altar of chance and his gung ho attitude was too nerve-wracking for supporters more recently acquainted with the prescriptive stylings of Villas Boas.  He has found a similar scenario at Villa and seemingly approached it the same way. Paul Lambert's latter period was characterised by some extremely cautious, even negative, ball retention and Villa often played as if they feared losing.  This is no longer the case.  The reality of a 3-3 draw at home to QPR as Redknapp protégés slug things out shows where the football has headed for Villa. And weirdly, this might not be a bad thing.  Whereas Sherwood's methods ultimately fell short of requirements at Tottenham, they could well be exactly what is needed for a club battling relegation.  “You win some, you lose some” is a hell of a strong maxim for a team that hasn't been winning many at all and deserved to win fewer.  His current early record of 3-1-4 will do them just fine if maintained and suggests that “having a go” is at least, a short term fix.   It isn't particularly technical, it might end in tears but Sherwood's magic is simple: pump up your chest, glue your heart to your sleeve and get out there and play like you're worth it. So welcome back, Tim. Stat Shorts 1. Chelsea are limping but what does it matter? Since trouncing Swansea 5-0, Chelsea's form has been decidedly less impressive.  It will likely mean nothing as Arsenal and Man Utd have taken too long to flourish but with little impact from score effects, to have been outshot by a combined 52(17) to 29(7) in their last three away games against West Ham, Hull and QPR is head-scratchingly non-creditworthy.  Taking all nine points from those fixtures means “who cares?” and the trophy engraving has likely been scheduled. 2. Newcastle are phoning it in It happened last year, it's happening again: Christmas lasts four or five months in Newcastle as regular donations of three points are handed out to all and sundry. I mean, they lost to Sunderland last week and that's a team i'm sorely tempted to bestow with a “least deserving” award, so bad they've been. Competition winner John Carver has had a tough run of fixtures and has been scalded by a horrible opposition conversion rate: Newcastle are conceding 16% of shots faced compared to scoring 8% of their own.  This can't last forever but we saw the same utterly banal form the same time last year and a repeat was foretold by one of our sage analysts back at the end of January: https://twitter.com/colinttrainor/status/561450632557891584 @Objectivefooty has also come up with a novel solution: https://twitter.com/ObjectiveFooty/status/587749219710193664 Maybe I'm being harsh? In isolation I'd agree but Newcastle are coasting once more and the blueprint does not include this kind of form early season, a potential situation which will surely require remedy over the summer. Won't it? 3. Pulisball wobbles We know Pulis puts up sub-par numbers.  We know Pulis has defined inflexible methods that tend towards overachieving against them.  What we don't know is what's going wrong at West Brom that has led his team to concede seven goals in two games against Leicester and QPR.  He's still picked up points at the same rate as Sherwood (1.25 a game) but what he hasn't got coming any time soon is fixtures as nominally winnable as those last two. They may be able to beat Newcastle, but beyond that none of their remaining fixtures look winnable and one wonders just how much psychological damage was inflicted by a frenzied Man City that day.  That's not stats, I hear you cry, and I know so here's a chart: pulis rubbish Sure, the City game ruined this, but it was heading for the rubbish tip anyway.  Tough times at the Hawthorns. Obligatory Tottenham Exhaustion “You see, them lads down at Tottenham are young. And they've played a lot of games and worked hard all season. Lots of training, lots of games and now they're knackered. And it shows. Danny Rose is their best player at the moment, Danny Rose!  Their attack has given up and even the fans are questioning Pochettino.  Is he up to the job?  Well?  Is he?  We just don't know.  He keeps picking the wrong players.  Week by week players disappear then return magically for a game or two then get dropped.  Fazio rose from the ashes this week and got blamed for the goal.  But he's barely played in weeks.  Paulinho gets slated every time he gets near the pitch but he's not match fit.  It's a nightmare.  Half the team are gonna get shipped on in the summer and a few of the rest probably aren't up to it.  You could drive a train through our defence at times, so easy is it for the opposition! At least we've got Villa at home this weekend though, be good to turn over Sherwood.  Last thing we need to see is his grinning mug...”   ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~   Thanks for reading!   Find me on twitter here: @jair1970

What Is Wrong With Daniel Sturridge?

I buy the Times on occasion (not for political reasons, or an endorsement of Rupert Murdoch's empire: I like some of the puzzles) and this Thursday there was an interesting small analysis piece on Daniel Sturridge written by Rory Smith.  What drew my attention was the general intention of the article to depict Sturridge as being “short of confidence”.  It went on to criticise Sturridge's efforts against Blackburn citing amongst other things “poor choices”, being “unsure of his instincts” (?) and that his “energy [was] wayward and incoherent.”(??).   Nope, me neither.

He also “looked a shadow of the prolific goalscorer who terrorised defenses last season.” Okay, maybe he didn't have his best game?  What else? “The less confidence Sturridge has, the more he seems to retreat into cockiness” and “[he] takes too many touches, slipping the ball under his feet, throwing dummies and feints, a desperate dance designed, perhaps [!], to convince him[self] of his own qualities.” This latter section is a knowingly counter-intuitive argument and one which surely doesn't hold firm.  Even without getting into the stats (we will) Sturridge has never seemed a man needing a shot of confidence to effect positive endeavour.

What does Daniel Sturridge do?

I'm pretty happy to declare that Daniel Sturridge is two things:

1. An elite level striker

2. Injury prone

The elite level striker angle is easy to prove: his entire career he's consistently averaged four or five shots a game and mapping back even through his “kid learning the ropes” stages he averages over 0.6 goals per game.  He's a pure striker, a darn good one and has always been so.  More fool Chelsea for selling him when they did.  But... His injury record stinks.  He's been involved in professional football since a young age and has participated in seven seasons. He was back-up or a rotational player in the early years but still, the guy is 25 years old and has never played more than 2/3 of a season.

2014-15

So, a familiar storyline of injury and absence and he reaches mid-April with only 750 league minutes to his name.  He “struggles to recapture top form” and has “only scored four goals since returning from several injuries.” This seems like a fair argument if you blindly consider four to be a small number but if we pull up some shot and goal numbers, we can see that perceived problems may well be smaller than is being suggested: sturridge2 I've highlighted two sections particularly to make the point. With data stretching over nearly 8000 minutes from 2009 to 2015 we have as near as we can get to career rates and despite it being a small sample in 2015 (he has only played 480 league minutes since returning from many months injured) we can also take a look at what he's doing since coming back into the team.  I have also put in this season's cumulative rate and his entire Liverpool career by way of contrast.

What can we see?

  • His career shot rate is 4.38, his Liverpool rate is similar and he's recently above that level.
  • Whilst he is lacking in recent six yard box activity (“poaching”) his rate of penalty area shots to out of box shots has increased over time, and is currently high.
  • His on target rate is incredibly consistent across his whole career.
  • He has always and continues to takes all kinds of shot at similar rates (left foot, right, header).
  • His Key Pass rate is consistent throughout.
  • His Liverpool conversion rate is very high overall but has dropped back this season. Multiple studies have shown that conversion rates have poor levels of repeatability so change here cannot be solely attributed to anything apart from random variation.  He had been running extremely hot in this measure over the season and a half he'd been at Liverpool, much like Giroud, Costa or Kane are this season and a cooling off is not significant in itself.
  • His goal rate is a fraction beneath his career rate and 0.20 goals per 90 below his very high overall Liverpool rate.

Alright so; shots wise, he's just dandy, goal-wise he's a little off.  Well, again I can point to the small sample and suggest there is little cause for concern. Given the time he has been on the pitch, one or two more goals would have covered the conversion and goal per 90 deficits shown.  That's it.  If you are to posit that Daniel Sturridge is out of form or “short of confidence” then effectively you are suggesting that he has reached this negative mindset via the method of missing one or two goal scoring chances. And if I want to give Sturridge a break I really could.  I can identify three simple factors which could have impacted on his production in 2015:

1. He is playing in an unfamiliar formation (3-4-3), adaptation could take time.

2. He has just returned from a series of injuries and so may need time to gain full match sharpness.

3. He is no longer playing alongside one of the most devastating attacking players in the world, the dervish-like Luis Suarez.

Despite these factors, his personal contribution to Liverpool when in the team is solid in relation to his career and once more consistent.  I don't see self-concern in Daniel Sturridge's performances and I suspect that over time it will be seen that it was an extremely strange deduction to make.  The answer to the question posed in the title is simple: if fit, not a lot.   ~~~~~~~~~~~~~~~~~~~~~~~~~~~~

Thanks for reading!

Find me on Twitter: @jair1970

The Story Of Nil, Shot Dominance And A Premier League Weekend Review

When you attempt to write a statistical and analytics-based Premier League round-up column every week of the season, it can be somewhat dispiriting to see parts of the league meander towards an almost inevitable status quoNothing wrong with that per se, but finding interesting hooks to write about can become a tricky task.  As such, this week we're going on a bit of a holiday  and we have more of a quirky investigation than a news report.   It's more a diet of "Louis Theroux" than "The One Show" and we should all feel better for it.  Maybe.  Hopefully. The Story of Nil As a plentiful supply of goals flew in, there wasn't a lot of “nil” around in the Premier League this weekend, at least until Sunday, and only four teams contributed: Southampton, Burnley, Tottenham and Newcastle. Of these four teams, the away teams offered particularly little in the way of healthy shot counts and as such widely deserved their “nil”: nil club The international break, whilst generally dismal from a fan perspective, does at least offer time to ponder questions and explore data. This being so, I've been able to explore a few mini-topics that have intrigued me, one of which is the superficially nonsensical question: “How many shots does it take to score nil?” So using data I lovingly collected over many, many hours then ignored for a couple of months I can tell you that in the Premier League between 2009-10 and 2013-14, there were 1050 instances of a team scoring nil.  And I can produce this table of averages: scored nil Well, well! Our table of averages matches very well with this weekend's nil scorers!  Pure chance, I assure you.  Over the duration of the sample, goals are scored from around ten percent of all shots and 30 percent of all shots on target. As we're looking at nil, the shot on target figure correlates nicely, on average somewhere between every third and fourth recorded shot on target becomes a goal and average nil scorers do not exceed this range.  In fact, the “nil” scorer has a problem with its shot on target rate, it averages out at around 25 percent, five percent shy of the average for all. Another aspect we can see here is a difference in the location of the “nil” between home and away.  A bias towards home advantage is clear in frequency (408 to 642) and in the volume of shots recorded. Despite achieving the same final outcome, “nil”, home teams recorded an average of 2.74 more shots and 0.62 shots on target than the away team.  This is something we can also see in this next section. So: how many shots does it take to score nil? About 12, with three on target. Shot Dominance I'm defining "shot dominance" as the difference in the volume of shots a team has in contrast to its opposition.  A simple frequency chart using the same data as before, produces a familiar shaped graph: shot dom bellThis shows a huge majority of Premier League matches involve a shot differential of under ten, which is logical when tallying with a long-term average of around twenty eight shots per game (although a trend for this season would bring it lower).  I've had ideas around this on the back burner for a little while now but was spurred into trying to make coherent sense of the data by a tweet highlighting some of @JamesWGrayson's work from @WillTGM and an observation Statsbomb's Colin Trainor made in the replies: willtgmcolitrainorYep. I concur.  It took a bit of wrangling to create charts that I was broadly content with but I can show the impact that shot dominance has on both goals and points, from the perspective of the home and away teams, and it indicates a familiar bias towards the home team.  I should add that each data point is bucketed and incorporates the two nearest values either side of the given number, that the higher figures are excluded and that small samples still persist towards the edge of the charts.  Regardless, here's what we see with goals: shot dominance g2Without any bias, we would expect the value lines to cross at zero.  In fact, they cross somewhere between minus one and minus three shots, to the cost of the away team.  What this suggests is that before a ball is even kicked, an away team can probably expect to have to generate around two shots extra per game to create a par outcome.  Home field advantage has been shown to have clear significance in previous studies, and it is borne out here. We can also see the same effect on points: shot dominance points This time the effect is arguably larger, with a clear crossing point at a shade over minus three shots.  Indeed, here the away team only seems to gain a particularly significant potential advantage when it exceeds a ten shot dominance.  Compare with the perceived points expectation a home advantage of ten shots confers. [A curio in the sample is that the rate of goals (2.79 per game) is closely matched to the rate of points (2.74 per game).  If you refer back to the graphs, they track quite nicely.] There are clear implications here for work with shots.  We already intuit that all shots are not born equal and there is significant discourse in the analytics community as to whether methods of separating and defining them are sufficiently meritorious so as to favour complex modelling over straightforward counting metrics.  In many cases a preference is linked to whichever method one has devoted time and work towards or even whether or not a purposeful endgame is being visualised.  There are still many simple elements that can be examined with basic counted data and with some of the modelling understandably shrouded, it can be hard to be definitive as to which the most effective and predictive metrics truly are.   Okay, okay, enough with the graphs and analytics, how about some weekend review? Personal highlights this weekend were the two Gomis finishes.  I challenge anyone not to enjoy his first volleyed attempt and the marvellous composure to languidly lob in his second was Berbatov-esque.  Swansea continue to defy my, and maybe the shot watchers, expectations.   In their last ten matches, they have exceeded 11 shots only once yet have amassed 16 points.  Five of those matches were against members of the current top seven so they can feel well pleased to be maximising their returns, at least for now. In a similar vein, Everton have started to pick up results despite being beaten down recently on the shot count.  This was a trick they performed a few times at a similar stage last season before eventually their challenge for the top four (!) petered out.  Though this time it is more about securing comfort in mid-table, it is hard to know whether they have just managed to stabilise after some inequitable results prior or if they're just finally getting a share of good fortune. Elsewhere, many things remain similar.  Chelsea eked out another narrow win to remain adequately ahead and Arsenal and Man Utd again put forward solid claims to be the strongest teams in the land, at least based on recent form.   Arsenal have become adept at preventing shots on target (last 11 games only once over 4 shots on target conceded, 8 against Tottenham) and swept past a faltering Liverpool. I have suggested more than once in this column that I felt Liverpool's challenge would end up in the top four but the combination of Utd's sudden improvement  and again poor form in a crunch game has apparently killed them off.   Five games ago Utd recorded 30 shots including 10 on target against Sunderland.  In that game and the four subsequent games, they have only conceded 30 shots and nine on target in total.  Their success is built largely on restriction of the opposition and with Herrera, Carrick, Mata and Fellaini now surrounding Rooney, they appear to have chanced upon an attacking potency they formerly lacked. Obligatory Tottenham bit A bravura performance from Paulinho led Tottenham to another comfortable victory against a battling but ultimately limited Burnley side.   Recently maligned by fans, he responded magnificently by rounding the keeper to open the scoring then contributed fully as Harry Kane ran riot scoring five, Eriksen chipped in with a couple more and Tottenham ran out 9-1 winners. At least that's a version of reality that would sit a little better than a grindy 0-0 against a well organised Burnley team, who on recent showings look reasonably well set to climb away from the relegation zone.  But, no!  Their point, whilst deservedly earned, paled in comparision to QPR, Sunderland and Leicester's three, each of which was backed up by solid attacking numbers.  Hey, if Gus Poyet could rescue Sunderland last season, given the fixture list they overcame, then it's impossible to state that any team in this league will be pulling their rip-cord any time soon.   Thanks for reading!   ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~   Find me here on Twitter:  @jair1970     

Is Manuel Pellegrini Getting A Raw Deal At Man City? + Premier League Round Up

Repeatability of metrics and genuine insight are the primary drivers for football analytics and the best work in the field is rigorously tested after the collation of long series of data. What we see happening in front of us week by week are just fragments of the greater storyline but it is always fascinating to go through the individual game data and this weekend's Premier League games have been a marvellous reminder of why one-game hard statistical analysis isn't really a thing.  The ultimate small sample, one game, can throw up many a quirk, as this weekend amply showed.

Saving Manuel

Huge excitement amongst us number watchers as the shot totals came in at half time in the Man City vs West Brom game.  Ten men for West Brom, 26 shots for Man City and it looked like they could possibly emulate and exceed their title winning match against QPR and shoot past 40 shots, beat the 44 recorded in that game and maybe even hit 50?  Such shot volumes are incredibly rare and even beyond the obvious skew caused by the sending off, that they recorded 43 shots is verging on the ridiculous.  They went super-hard for an hour and recorded 38 shots only to bring out the cigars and coast through the last half hour.  The easy dampening of City here just notes the sending off and gives them little credit for their dominant performance, (and in one of many ideas lifted from ice hockey there is a valid argument that only 11 v 11 statistics should be examined in analysis; the excellent Football in the clouds site records player data in such scenarios) but I'm more inclined to celebrate the statistic as it is and look at how Man City are now performing in comparison to the rest of the league:

city 201415

 

Plenty of media commentary appears to be suggesting that Manuel Pellegrini's job is under threat. Take this from er... Robbie Savage:

Manchester City boss Manuel Pellegrini could be sacked in the summer after their Champions League exit, says BBC football expert Robbie Savage. "I think Pellegrini's time will be up," says Savage. "Would Diego Simeone leave Atletico Madrid or Carlo Ancelotti leave Real Madrid? That's the kind of manager I would look at for City.”

Why not Guardiola, Robbie? Or maybe Alex Ferguson? But I digress.

Plenty more media commentary has had a quick look at the table and spotted how close Arsenal and Man Utd are to the top two and in particular City. They have then presumed that City's position in the top two is under threat and they are vulnerable to challengers.  The numbers just don't support this analysis.  The trouble for City is mainly in perception, which is of course functionally irrelevant.  Their season last year was so fluid and goal laden that any normal regression would look underwhelming.  That they have regressed yet still maintained huge shot dominance is actually impressive. Their shot ratios over this year and last are now almost identical and it has been their raw conversion that has fallen off.  No other team in the league approaches 8 shots and 3 shots on target over and above their opposition.  Their current record of 18-7-5 is only six points behind their comparative record from last year of 21-4-5 and whilst I could easily be wrong I will be surprised if the owners rescind Pellegrini's contract.  Certainly they shouldn't.  There is no Champions League heritage to protect, disappointment there has no prior measure of success and the team remains very talented and strong.

If I have any concern regarding Man City moving forward it is more centred around the playing squad and the long comfortable contracts that have been generated by FFP compliance.  There are two ways of looking at this: 1) that long term they are potentially demotivating and too comfortable for aging players or 2) there is a degree of loyalty in the higher echelons at City.  One suspects the former, but any shred of the latter could extend Pellegrini's stay.  Regardless, NYCFC may well have a hell of a side in a couple of years.  Mancini only went due to disagreements with key personnel both on pitch and off and the last coach to get sacked from one of the Premier League's mega-clubs after following up a hugely successful season with something less dominant was Carlo Ancelotti at Chelsea.  I hope and think City won't make the same error.

Sunday away day

Three away wins on Sunday recorded by Chelsea, Man Utd and Everton and three more cracking examples of one game skew. Between them, the three teams scored seven goals from ten shots on target, which when compared to an realistic expectation of about three goals shows how pleasant a trip each team had.

The Hull v Chelsea game was particularly interesting as after a quick start the half ended at two a-piece and the shots stat were 14-3 in Hull's favour, something which bore no resemblance to anything we've seen from Hull all season.  The Courtois triple save upped the Hull on target shot count to eight, equal to Chelsea's total shot count and us number watchers were left scratching our heads as to how Chelsea managed to limp over the line. You couldn't even blame score effects, as little happened between 2-0 and 2-2 and once again we wonder if Chelsea are tiring.  Their cushion is significant and necessary but it is worth noting that they suffered a similar dip at this point last year and it cost them any chance of the title.  They should have enough to repel challengers but many more moderate efforts such as this could see dropped points and raised eyebrows.

Man Utd v Liverpool

Juan Mata has once more set about his annual task of winning over a manager and made a decent fist of it in this match with two quality finishes.  The stat angle on this one was once more that it was a shot freak; this time tying the season low of 13 shots in a game (with Chelsea v Man City).  And what we can quickly notice here is that both games involve top four challengers.  A quick calculation shows that matches involving top four contenders average around 11.6 shots per team per game, which is low compared to a league average of 12.8.  All that makes a deal of sense, shot counts are likely to get bloated against worse teams and the top seven includes teams managed by Koeman, Van Gaal and Mourinho, each of whom appears to value pragmatism over shooting affluence.

So, for Man Utd: six shots, four on target, including the penalty and two goals.  As we saw last week, Van Gaal appears to do a good line in efficiency in shooting and they shut down Liverpool almost entirely even before the disparity in player numbers, much as they had Tottenham last week.  There was always the possibility that Utd could gel at some point and impress and these two recent wins certainly indicate that they may well have arrived.

For Liverpool, I will always object to the use of Raheem Sterling on the right flank and as expected, his influence was negligible from that position.

Obligatory Tottenham bit

There may well be pragmatism in other teams near the top of the table but it's been in precious supply at Tottenham as witnessed by their thrilling, rollercoaster display against Leicester.  I say “thrilling and rollercoaster” when I could quite easily go for “bewildering and chancy” as the easy concession of multiple goals now means Tottenham have conceded more than Sunderland, Villa, Hull, West Brom, Everton, Palace and every other team outside the relegation zone bar Newcastle and are one short of matching Southampton's full year total of 46 from last season.

So that is a concern.

In an attempt to mask and ignore these issues, I shall once more celebrate Harry Kane who co-leads the traditional goal charts with Diego Costa.  His Non-Penalty Goal rate is still excellent but only ranks 4th in comparison to the other sharp shooters (minimum 10 NPG):

npg201415

Those boys at the top are running especially hot and Olivier Giroud is the most lethal striker in the league.

Oh my days.

~~~~~~~~~~~~~~~~~~~~~~~~~~~~~

Thanks for reading! Find me on twitter here: @jair1970

Man Utd's Defence Under Van Gaal: Lucky, Good Or Neither? + Premier League Round Up

The desire to write properly about Tim Sherwood runs strong but will have to wait for a sufficient sample.  For now, we can note that the 4 goal first half salvo against Sunderland has single-handedly lifted their seasonal raw conversion rate (goals to shots) above 6%, a rate which is no longer cut adrift as historically terrible and is merely very bad.  I can speculate that a little attacking intent can go a long way at the bottom of this league, and that may well be enough to garnish enough points, but I suspect that an in-form good team may be able to exploit Tim's functional 4-4-2.  These three points so kindly donated by Gus Poyet were clearly vital given that Villa look as though they will struggle to get another away point this season: trips to Utd, Tottenham, City and Southampton await and their survival will likely be determined at Villa Park.

Man Utd's defence
It's interesting to note that in the nascent world of football analytics, we often see counter-narratives growing alongside traditional reactive media or in-game views in relation to the successes or performances of any given team.  This season has seen the marvellous dichotomy between Villa's early successes, subsequent contractual beano and the underlying structural statistical truths that pointed out, quite vividly, that retained success was something of an unlikely longshot.  We can also point to one game, a huge outlier amongst Man Utd's season, their 3-5 defeat to Leicester as a game pivotal to both teams' wider perception.

It seemed feasible at the time to presume that Leicester were coping well with life in the top division, but just as with Villa, the stats told a different story: they were conceding heroically large quantities of shots and had scored nine of 16 shots on target, an unsustainable figure that sure enough did not sustain. Subsequently, they have plodded, rarely been destroyed, yet picked up two wins in 23 games.  Leicester are simply not very good, they never were very good and sadly for them the Championship beckons.

What that game did for Man Utd was reinforce a wide view that they were suspect defensively.  After shipping out a trio of veteran club legends in the summer and making interesting but not entirely convincing replacement signings, they were handicapped by a slew of injuries and Van Gaal's desire to tweak formations. And this game showed a clear storyline: they were vulnerable.  Never mind that they were down a man or that for a team to score from all five of its recorded shots on target was an extremely rare feat, Man Utd were dodgy at the back.

As autumn drew on, a new narrative emerged from the number watchers. Utd, by now having strung a series of decent results together could primarily thank the efforts of one man, their goalkeeper, David De Gea.  His Save Percentage was extremely high, and indeed has remained extremely high, as we can see here:

man utd save percentage

De Gea's year long save rate is around seven percent above league average which loosely translates to about eight goals.  Liberally sprinkle an extra eight goals conceded around their fixtures and their season might look all a bit Moyes. (Last season the rate was 71%, lesser but indicating other issues at play).

So here we are: they have rarely looked convincing, there's sufficient reason to think that their current position is flattering yet they continue to post largely good results and are bizarrely two points behind Man City.

Obviously the eight extra goals never arrived and because of that Man Utd's defense has some pretty impressive numbers aligned to it. Here's a thing: based on a sample of 1200 Premier League games in which either team conceded two goals, the average expected points from a team conceding two goals is about half a point per game.  Half a point a game will get you relegated pretty quickly so conceding two goals or more in any given game is an extremely bad idea. Man Utd tie the league lead with only four matches in which they've conceded two or more goals: the five against Leicester, two against West Brom in a 2-2 draw at the Hawthorns and both 1-2 defeats against Swansea:

2plus frequency

Against the better teams in the league, their record is quite remarkable, they have not once conceded two goals:

utd v rivals

They're just lucky? Hmm... Not so sure.  Overall they've conceded less than a goal a game; a feat that Van Gaal has achieved in the vast majority of his seasons in management.  Sure, he's been in charge of clubs that were powerful within their leagues, but it implies that limiting the opposition is a key tenet to his work.  In fact, as a bit of a curio, there are interesting parallels with the last time he took control of a giant club: his tenure at Bayern Munich that started in 2009-10.

Both in that season and this, his team started quite slowly, Bayern were 5-6-2 compared with Man Utd's 6-4-3, then followed it up with a strong run: Bayern 12-2-2, Man Utd 10-4-2. Other similarities are here: bayern utd And that year, Bayern only conceded two or more goals on five occasions... We're down the rabbit hole here!

It has been well reported that Van Gaal's methods are extremely prescriptive and team-orientated, so it should come as no surprise that aspects of his statistical map are replicated. What i'm trying to show is that beyond the unsustainable high save percentage, there seems to be a strong system that is designed to effect defensive solidity, and it's working.  Chelsea and Southampton have been the obviously strong defenses throughout this season, but Van Gaal has managed to install a formidable defensive base.  If only he could get his attack functioning too.

Obligatory Tottenham Capitulation

And he did! Tottenham's kind efforts to rehabilitate the unwanted stars of rivals teams continued apace, as weeks after giving Mario Balotelli a shining moment, Marouane Fellaini surprised the world by sprinting clear of the Spurs defense and finishing handsomely with his wrong foot.  A Michael Carrick header and a Gascoigne-esque bundling run from Rooney added to the one-in-a-million nature of the game's goals and Tottenham left with barely a whimper from their inexperienced line-up.

Esteemed fellow Statsbomb stalwart Colin Trainor had earlier in the week flagged this match up as an intriguing battle of the hard press:

What actually occurred was somewhat typical when compared with other teams that have been unwilling to let Tottenham play their own game.  Man Utd's hard press was extremely effective and once more the central midfield position looked most vulnerable, as horribly exemplified by the Rooney goal.  I'm still happy to forgive Bentaleb for reasons of age and general competence but dearly desire an upgrade on Mason, especially when factored against Morgan Schneiderlin's continued quality in the heart of Southampton's team.  Certainly Man Utd clicked, and whilst he may never be a Van Gaal 'type' player, it was disheartening to see Juan Mata line up; he's had many a good game against Tottenham over the years. Meanwhile, concerns about rotation and tiredness were probably valid.  Sadly, but inevitably, this appears to the the end of the road for this season and the team is actually three points behind the Villas Boas/Sherwood train wreck from last year.

Progress?  I would say so, but more in terms of the distant future.  The usual blend of tricky sales and hopefully choice recruitment is once again required this summer and whilst i'm generally positive, there is the nagging feeling that Tottenham look more like Southampton these days than Southampton themselves.

Thanks for reading!

No Kane, No Gain? How valuable are Kane and Eriksen?

Mauricio Pochettino has had a tricky start to his Tottenham tenure but in his attack, two players have come to the fore: Christian Eriksen and Harry Kane.  Both are now seen as pivotal to Tottenham's attacking schemes but their routes to becoming regular starters at Tottenham have been very different and each has overcome apparent indifference from certain coaches to secure their spots in the team.  But how effective are they?  Does their hype match their achievement?  Let's find out.

Neither player featured heavily under Villas Boas, a coach who favoured physicality and experience over guile and youth but it was Eriksen's performance in a 0-1 defeat against Newcastle last season that stood out on the numbers and made him a player to watch; a performance so noteworthy that it was dissected by Ted here on Statsbomb.  Both Kane and Eriksen featured far more often under Tim Sherwood, Eriksen to such an extent that he won the club's Player of the Season award despite hardly featuring during the early months.  Kane featured later on.  Beyond the point  Sherwood had been told he would be leaving he seemingly ignored status and picked teams featuring players he liked.  500 minutes of Premier League game-time was valuable experience for Kane and he showed good form, notable for two encouraging aspects: shot volume and goals.

Another head coach offered new challenges and Pochettino seemingly took to Eriksen quicker than he did Kane; he's the only outfielder to start every league match this season.  Kane's route to the first team this season has been more unorthodox. Initially deployed in Europe & seemingly behind Adebayor and maybe Soldado in the league squad, two obvious factors have fast-tracked his step up: the annual disappearance of Adebayor and yet again, goals. We reach 2015 with Kane & Eriksen firmly established as Tottenham's most effective attackers (a quick check over at the contributions at 'Football in the Clouds' confirms this) but how are their games represented within the statistics? Let's see.

Kane comes out shooting

Those 500 minutes at the back-end of 2013-14 were the first chance Kane had to play Premier League football on a regular basis and within them he showed great promise.  An ability to find shooting positions was matched by a willingness to shoot and he averaged 5 shots per 90 minutes.  This was enough for numbers watchers to raise an eyebrow in his direction as 5 shot a game guys are scarce, but it came with a caveat: 500 minutes is a small sample.  We can see exactly how a high shot average is appealing by looking at this chart that covers the last 4 years of the Premier League:

 

shotsper90avg

 

A list of the great, good and Mario Balotelli. (As an aside, this chart shows exactly how good Aguero has been this current season. He's splitting Messi and Ronaldo with a rate this high.)  So Kane piqued interest but there were easy criticisms that could be made, criticisms that are also often laid at Balotelli.  He was taking a lot of shots but his decision making wasn't always good: a high proportion of his shots were being blocked and there were occasions where shots on target were tame and easy for the keeper to pick up.  The willingness was encouraging and three goals (two headers and a right foot shot) was a very fair return for a still young player new to the league.  It was also enough for the club and its support to accept that he'd be an option as part of the 2014-15 striking corps, a status many fans had been sceptical he would ever achieve.

Kane: from the Europa League to Premier League

(We can be justifiably wary when discussing Kane in that he is still a young player and any analysis is shadowed by small samples, however, trends are perceptible.)

It's easy to forget that Kane started the season down the pecking order at Tottenham. Coach Pochettino, an advocate of a versatile forward in his 4-2-3-1, saw Adebayor as his best option, an understandable decision based on ability, reputation and team ethic. Yeah I know, team ethic? I contend that Adebayor's languid style conceals an intelligent, team-orientated on pitch persona, it's just his ability to be difficult off-pitch has often caused problems and absences.  Aptly, his semi-mysterious omission from the team in early November was the catalyst to elevate Kane to league starter, a position he hasn't looked like relinquishing.

Having scored regularly when used in European and cup fixtures, Kane had an opportunity to show that his late 2013-14 flourish was no one-off.  Two months and 8 goals later fans now fear having to cope without him; his transformation from peripheral squad striker to starter is complete. But how has he improved? Which parts of his game have evolved over time and what can we see in his raw numbers?

 

kane

 

The first issue to look at is a reduction in his shot totals.  Pitching in at a shade over 3.6 per 90 is still pretty decent but it's noticeably down on his prior total.  So where have the extra shots gone? The simple answer implies better decision making:

 

kane2

 

My earlier criticism was that in 2013-14 a high percentage of his shots were either blocked or weakly on target.  A reduction in both these totals suggests the possibility that these may well be areas that he's been working to improve.  Indeed, despite the reduction in shot totals, his goal rate has continued at a similar and impressive level.

The other noticeable difference is an increase in dribbling.  Whilst the textbook example is his first goal against Chelsea, in which he picked up the ball on the left flank, headed infield and fired home, my personal favourite 'Kane dribbling moment' is this, from the home game against Man Utd:

 

 

It also reflects an aspect of Kane's game that didn't register at all last season: creative passing.  I have no idea how he sees this pass to Mason (he got a shout?), let alone executes it with such precision.  Backing this piece of play up, we now have evidence of crossing and through balls, neither of which figured when he was playing in Tim Sherwood's more orthodox 2 striker system.   Pochettino has required him to become more versatile and it shows.  Alongside this, but harder to represent statistically, his ability to hold the ball up and position himself effectively to shield the ball has visibly strengthened over time.  Kane is a consistently smart player.

The Lambert Blueprint

During a season and a half under Pochettino, Rickie Lambert scored 15 non-penalty goals but more than that expressed appreciation towards his coach for the way he had educated him:

“(...) each manager that came in improved me massively and especially Mauricio. He taught me how to be a different kind of player and I think that’s helping now.

“(...) He taught me how to be the lone striker and the thing that I was doing wrong most was the fact I thought I had to show for everyone on the pitch.

“Whoever had the ball, I felt I had to run over and show for the ball, get on the ball. He was saying ‘take your time’ and ‘wait until the right people have got on to the ball’ like Adam Lallana and others further up the pitch. After that, I had an understanding of how to play that position a lot better.” Harry Kane is known to be an enthusiastic trainer and seems committed to improvement and similarities with Lambert are clear: neither is blessed with pace but both have good footballing intelligence and have now thrived in Pochettino teams.  During his tenure at Tottenham, Pochettino has been demonstrably patient.  None of the summer signings became regular starters immediately and players that returned back late from World Cup duty were slowly reintroduced to the team.  Similarly, one could posit that the sporadic use of Kane in the early months was a deliberate attempt to give him time to learn a role he would be required to play; the lone front man in a 4-2-3-1.  In starting initially with Adebayor, Pochettino not only deferred to seniority and known ability but experience in the role.  It bought Kane some time, he gained experience of the role in Europe, and enabled him to hit the ground running when he finally made the league team.

So are there similarities between what Lambert and Kane have brought to each team?

 

kane 3

 

Anyone would think they've been coached to play the same role!  Beyond the similarities amongst these shooting numbers (a rough 'n ready correlation puts the similarity here at 96%), Kane has a higher rate of dribbles and is scoring at twice the rate (0.64 per 90 to 0.32 per 90) whereas Lambert was more active in the air and in creative passing.  Still, it appears that Pochettino may have found his 'Lambert'.

Versatility

Kane has also played around a third of his minutes in a more withdrawn attacking midfield role, primarily to accommodate Roberto Soldado, but has generally looked most effective in a forward role.  Whilst his default move may be to drift from the left to create a shot on his right foot, it's notable that he takes all types of shots and scores all types of goals.  This season he has taken 55% of his shots with his right foot and split the rest evenly between his head and his left.  Having turned these efforts into 4 right footed goals, 2 left and 2 headers shows confidence and adaptability.  In this regard he resembles Edin Dzeko, a more pure striker, but also one who year after year consistently finds and takes all types of chances.

Alongside his successful integration into the Tottenham first team, it should be noted that Harry Kane is a highly effective 'pro'.  Some players lack the ability to absorb the nuances within the game that might gain advantages for their team; Kane has no such worries.  This trait was highlighted initially with his famed legal time-wasting up at Old Trafford last year, only technically offside when touching the ball he launched it high into the stands, the implication here was clear: the kid knows the rules.  More recent examples include an ability to draw fouls, an ability to draw penalties convincingly and excellent 'lastminutebythecornerflag' work.  And I've not even touched on the statistically hard to quantify quality of his movement and ability to find gaps and spaces; the pros and pundits always pick up on that!  Oh, and he's the size of a house now, which is a new thing too.

Harry Kane's early promise has morphed into some realisation of potential and with a game not reliant on athletic speed, his immediate and long-term future should be rewarding.

Eriksen: metronome

How a player is affected by the tactical variations of their coach cannot be underestimated when looking at performance. In a little over 18 months at Tottenham, Christian Eriksen has had 3 coaches and been required to perform a number of roles based on a single theme: 'attacking midfielder'. That he has come to the fore and stayed relevant is testament to his natural ability and willingness to work for his place. Anyone with any doubts of the Dane's ability need look no further than the 'Crossbar Challenge' recorded some months back as a curio for the official Tottenham site.  It's really well worth seeing:

 

Spurs Crossbar Challenge - Christian Eriksen Masterclass!

 

Under Villas Boas, Eriksen on completed 90 minutes in the league once, the aforementioned game against Newcastle. He was then injured and left out of Villas Boas final game, so was never given an early opportunity to settle.  What promise he'd shown was seized upon by Tim Sherwood, who'd reportedly lobbied for his signing, and he spent much of the rest of the season drifting in from the left to good effect in Sherwood's lopsided 4-4-2.  Cue 2014-15, he's started every game and played often but not exclusively in the centre of the 3 in Pochettino's 4-2-3-1.  So: plenty of variation, his relative twofootedness allowing him to be moved around the team, and no small amount of success.  He spent the entirety of 2014 averaging around 0.4 non-penalty goals per 90, an enviable total for an attacking midfielder.  But how else does he contribute?

 

eriksen

 

The most obvious thing to take from this is his consistency. Despite different roles, little in his game has varied over 18 months and he repeatedly hits a shot contribution of over 5 per 90:

 

eriksen2

This makes him a fixture in the top 20 in the league in this metric, Tottenham's chief contributor and one of the higher rated creative types. In fact, he's managing to maintain his rate despite the fact that Tottenham are recording an average of 2 shots fewer per game this season compared to last.  His influence is increasing and he deserves to be mentioned in a similar breath to other feted creators such as Silva, Di Maria, Fabregas, Nasri, Hazard and Ozil.

He also possesses a refreshingly small on-pitch ego.  Close attention to his game shows a true team man who contrarily appears uncomfortable with the nature of football stardom: he has no patented goal celebration and often looks bewildered when scoring.  He generally makes very good decisions and this can sometimes make it appear that he isn't attempting to dominate.  This lack of obvious externalised tenacity can frustrate but it misses his intelligence, he continually hits his marks and has this season found himself a repeated match winner.

This year and beyond...

In yet another season of rebuilding and transition, Tottenham have found themselves with two reliable and young attacking talents.  With other players such as Chadli enjoying their on-pitch roles in the Pochettino regime and the tantalising promise held by Lamela, Tottenham's creative core has high potential.  Issues remain in central midfield, an overpopulated but under-par position and striking depth is a work in progress with aging, huge earners under-performing (Soldado) or disappearing (Adebayor).  The defence is also proving more porous than is ideal but has suffered from an inability to get a regular line-up in front of the often busy Lloris.

Most reassuring for the longer term is the age of a large portion of the squad:

Bentaleb (20)

Kane, Dier, Davies (21)

Lamela, Eriksen (22)

Mason, Townsend (23)

Walker, Rose (24)

Chadli (25)

All these players are entering their best years and are well established squad members.  The centre back duo of Fazio (27) and Vertonghen (27) also have some time left and Lloris (28) despite the repeated fears of fans, appears well settled.

Long term, whether this base will be strong enough to challenge for the top 4 is likely to depend on how many of the creative talents are retained and progress as hoped.  The league gets no easier but in an era of Financial Fair Play, Tottenham appear to have a solid foundation on which to build upon. It is to be hoped that Harry Kane and Christian Eriksen will be key in this process.

----------------------------------------------------------------------------------

Thanks for reading!

Is Sizzling Southampton's Start to the Season Sustainable?

I've been monitoring Southampton's underlying numbers this year and I was disappointed that they failed to annihilate Villa as any boost from that game would have sugar-coated their already historically impressive totals.  As it is, it's possible to show that they have had a start to the season that ranks very high in the pantheon of 'Great Starts to the Season' as recorded in the 'Enlightened Stat Era' (2009-now).  This era is defined as such because it covers the public availability of shooting numbers that can be built into metrics that are highly insightful & which can also be toyed with to create weird mini-stats that show that what Southampton have done is indeed extraordinary.

Factor in the pre-season predictions of demise (guilty!), the wholesale personnel changes & the size of the club when compared against other teams that have made outstanding & blistering starts and their achievement gathers even more credence.

But what achievement? Good point.  Starting a season well has little meaning unless it can translate into a tangible return at the end of a season so what chance they retain their position in the upper echelon of the league & usurp a more established visitor to the top 4?

Of course the key point against what they have achieved so far is their schedule which has meant they have avoided all but Liverpool & Tottenham of last season's top 7.  They lost to both.

For this article the seasons referenced above have been used (09-14) and that denotes 120 team starts of 12 games.

Total Shot Ratio (TSR)

  • Southampton rank 9th/120 with 63%
  • 7 of the top 9 went on to finish in the top 4 that season

Shot on Target Ratio (SoTR), SoT+/- and Goal Ratio

  • 2nd/120 SoTR with 72%
  • Of all these extra metrics, this (and the related 'Shots on Target +/-') are most predictive towards final points & position.  After 12 games it is comparative in predictive power to 'Goals For' and only behind 'Wins' & 'Goal Difference'

We can see how this impressive SoTR has translated into an equally impressive goal % & that historically, it stands very highly:

 

 

Similarly the shots on target +/- figure is historically high:

 

 

Of the teams on this chart, only Liverpool 09/10 did not finish top 4.  We can also see here that despite varying media perceptions of Man City & Chelsea this year, they rate identically on this metric.

Shots, goals against & saves

Whilst Southampton's goals total is impressive, to some degree it has been enhanced the the 8-0 romp against Sunderland.  There is some mileage here though; teams averaging 2.0 goals per game or better at this point have qualified for the top 4 on  the last 15/18 occasions.  Their shots for totals are no better than average; indeed they rate only 8th in the league here.  Where they really impress is at the other end of the pitch.  Defensively they are putting up extraordinary numbers, something that can be highlighted by this little nugget; they have conceded 4 shots on target in their last 5 games.

  • Shots against: 1st/120 (Arsenal 2014/15 also score extremely well here)
  • Shots on target against: 1st/120

And these figures are powering this:

  • Goals against: 2nd/120
  • Saves (low): 2nd/120

Save %

Not only are they effective at minimising opposition efforts, they've also been good at repelling those that do get through.  Their save percentage is not historically significant, but nonetheless leads the league this year.

Shooting Accuracy

Or, the percentage of shots on target in relation to shots.

  • For: 9th/120 (Swansea & Chelsea are also historically high)
  • Against: 6th/120 (Stoke are 1st/120 here)

Both solid numbers, but the key component here is the relationship between the two and is arguably Southampton's most impressive/least sustainable stat.  This cake can be cut a few ways, but I've just represented the difference between the raw percentages:

 

 

To score 13% where the previous high is about 10% is a noticable outlier & whilst the stat isn't particularly predictive, it can reasonably be assumed that the ability of Southampton to restrict their opposition's shooting accuracy in relation to their own will reduce as the season progresses.  Indeed, a seasonal high for this figure is only 8%.  Somewhere along the line 5 points will most likely disappear.

As we can also see, Swansea, Chelsea & Everton are all scoring above seasonal expected levels here.

Conversion rates

Simple shots to goals percentages:

  • For: 8th/120 (Swansea, Palace (!) & Chelsea also riding high)
  • Against: 2nd/120
  • +/-: 2nd/120

There are 8 percentage points difference between the for and against totals (14% & 6%).  In the course of the sample, the only teams to break 6 percentage points over an entire season are three Alex Ferguson teams & Man Utd & Man City occupy 8/9 slots above 5 percentage points.  The other team is Brendan Rodgers' Suarez fuelled 2013-14 squad.  Overall, these numbers appear to lack league-wide predictive quality but seem to represent the very good and the very bad at their extremities. Could this Southampton team join this list of good & great teams?

The near future

...is tricky, but there is some hope that Southampton can retain their high position in the short to medium term:

 

 

They have been particularly good at home, winning 5/6 and conceding only one goal & five of their 'tough' matches are at home. Throw in winnable matches at Burnley and Palace & there's can be a genuine expectation that whilst their impressive numbers will almost certainly regress somewhat, there is clear scope to continue to pick up a good points return.   There are some precedents that suggest that what they have already done stands them in excellent stead towards the top 4:

  • The last 25 teams with +10 goal difference after 12 games finished the season in the Top 4. Portsmouth failed in '07-08. Southampton are currently +18.
  • The last time a team in Top 3 after 12 games finished out of the top 4 was 2007/8.
  • The top 16/17 Goal Ratio teams after 12 games finished 4th or above.  Southampton rank 2nd here & the only team not to finish top 4 was... Southampton 2013-14. 
  • 8 wins after 12 games? 9/9 top 4.

Problems & Top 4?

Southampton lack a deep squad and have been relatively fortunate with injuries thus far.  A series of quick games against tough opposition may well test their player resources and with key contributors throughout the first team, any succession of injuries will noticeably weaken them.

A significant proportion of their current success has centred around their defensive abilities & the Villa match was the first in which they committed a defensive error that led to a goal; and a loss of two points.  We can praise Koeman for instilling an effective defensive strategy & mindset thus far but having spent very little time in a losing position, their tenacity when under pressure has rarely been tested.  This will surely change as we go through December.

They have twice scored as a result of instantly returning terrible goalkeeper clearances.  This kind of goal is scarce & that they've benefited twice is a subtle indicator of how their season has progressed with a degree of charm.  Similarly, the generosity shown by Sunderland's defence has provided a notable massage to their attacking figures, some of which are not historically impressive.  Removed from analysis, their goals for is a much less impressive 1.3 per game and you lose 4 points from conversion.  Suddenly: not so impressive.

Despite these issues, I personally feel that it's worth taking a positive view of what has been achieved.  The betting markets give them around a 2/1 chance of qualifying for the top 4 and that, as I think I've shown, is not ungenerous.  Indeed anyone who has availed themselves of higher odds can be well pleased with their current position.

EPL Season Preview 2014-15: Manchester United

I first started reading about and closely following football analytics at the start of the 2012-13 season. Throughout that season, the main narrative in the mainstream media was how much better Manchester United were than every other team in the league and how they ran away with the title. In analytics circles, the story was almost completely flipped - How is a team with only the eighth best shot ratio in the league so far ahead of everyone else?

Looking back on that season we see that United’s shot locations tended to be significantly better than their opponents and they relied an an unsustainable, high conversion rate. So even if 2013-14 had been a regular season, the analytics crowd would have been apprehensive as to whether United could repeat their results from the previous season. Of course the following season was not a regular season, it was the first in twenty-six years where Manchester United were not managed by Sir Alex Ferguson.

2013-14 League Finish: 7th (64 points)

Goal Difference Rank: 6th (+21)

TSR Rank: 8th (0.538)

PDO Rank: 4th (1059)

Not unlike the final season under Sir Alex Ferguson in 2013-14 by all of the basic metrics United looked like a mid table team. The only difference was this time they actually finished mid table.

Even the shot position charts look very average, with United only slightly above league average in both attack and defence, which corresponds to what we’d expect from a seventh place team.

MUFC

Looking ahead to this upcoming season under another new manager in Louis Van Gaal, it is important to compare these past two seasons in order to predict what kind of United team we will see in 2014-15.

Manager Effect It is really hard to isolate the effect a manager has on a team. We can say pretty conclusively Sir Alex Ferguson is a better manager than David Moyes, and that Moyes had a negative influence on the team in 2013-14. The question is how do we separate the underlying capabilities of the team versus their poor performance under an inferior manager?

In 2012-13, some pointed to the influence of Sir Alex Ferguson in how the team managed to win the title despite not dominating their opponents as we’d expect a title winning team to do. This hypothesis stands up pretty well when we compare whatever Sir Alex’s magic touch was with Moyes whose team had similar shot numbers in the following season but very different results.

The problem is we obviously can’t run the counterfactual to see how Sir Alex does with Moyes’s team in 2013-14. We cannot see how much of the drop from 89 to 64 points is attributable to the manager. Some of it might just be simple regression to the mean, some might be attributable to an aging squad with several holes in both midfield and defence. It is probably a mixture of all of these things, which brings us back to Louis Van Gaal and the current squad.

Louis Van Gaal is undoubtedly a very good manager. Almost everyone in the game speaks highly of him and he has achieved success at every club he’s been at. Despite not being able to fully isolate for a manager’s influence, I think it is safe to say that Van Gaal is a better manager than David Moyes and will produce better results.

Essentially the results of Manchester United under Sir Alex Ferguson and David Moyes with similar squads and similar underlying performances suggest that the change of manager had a significant effect and another change of manager to one vastly more qualified than Moyes should also have an effect.

Squad Changes With the transfer window still open and new rumours popping up daily (it really would be easier for all of us if the transfer window ended before the season begins) it’s hard to say conclusively what Manchester United’s squad will look like on September 1st. That said, the club has already been very active this summer making moves in three key areas: central midfield, left back and centre back.

United’s midfield has been much maligned since around the 2008-09 season when Darren Fletcher was at the top of his game and Anderson was still considered a promising option. To few people’s surprise (maybe other than David Moyes himself), the 28 million pound signing of Marouane Fellaini did little to address these issues.

Ander Herrera is a very different player to Fellaini, one whose natural position is a box-to-box central midfielder as opposed to the more attacking midfield role that Fellaini was operating in at Everton. At Athletic Bilbao, Herrara posted high key pass, through ball and tackle numbers - all areas in which the United midfield has been sorely lacking. As of the writing of this piece, Herrara is the one true clear and immediate upgrade in terms of United acquisitions this summer.

The second area United has made a big move is at left back with the signing of Luke Shaw from Southampton and the sale of Patrice Evra to Juventus.

Patrice_Evra_2013-14Luke Shaw Southampton 2014

Looking at these two radars, Shaw and Evra actually look like pretty similar players with the one exception of dribbling where Shaw is much more forward thinking, but accordingly gets dispossessed more often. The dribbling aspect may actually be more suited to Van Gaal’s new system in which Shaw will most likely be playing as a wing-back in a 3-5-2. Comparing these numbers, it seems that Shaw is less of an upgrade over Evra today, as opposed to someone who United believe will develop into a more talented fullback in the future whereas Evra is a player in decline. However, Evra's numbers are probably boosted a bit by the fact that Moyes used a system heavily reliant on left back attacks.

The final area where United have made significant moves this summer has been at centre back with the exits of both Rio Ferdinand and Nemanja Vidic. These are two players who have gone through a fair share of struggles at the back over the past few years, but were still important pieces in United’s back line. The club is now down to only three natural centre backs who played any minutes last year: Phil Jones, Chris Smalling, and Jonny Evans. All of these players have had injury concerns over the past few seasons as well. Given that Van Gaal will be playing with a system that requires three centre backs, it looks like acquiring another centre back before the transfer window closes will be crucial to the team’s success this year.

Youth Team Prospects Van Gaal has a history of bringing through successful youth team players at every other club he’s been at. Luckily for him, the current crop at United looks promising.

With the aforementioned depth issues at centre back Van Gaal will have to be willing to give a couple youth team players a shot, the most significant of them being twenty-year-old Tyler Blackett. Blackett played a significant role on the team’s pre-season tour and slotted in nicely at the back. Expect Blackett to get a decent amount of playing time this season if United aren’t able to add any more centre backs in the mean time.

Another big name who already made a splash on loan scoring 10 goals in the Championship last season is attacking midfielder Jesse Lingard. Lingard was part of the pre-season tour squad under Moyes and again under Van Gaal this season, and has looked to be a real threat going forward. Whether or not Lingard is sent out on loan again this season probably comes down to whether or not United sign another central midfield.

The prospect United fans seem most excited about is James Wilson. Wilson scored two goals last season in his only Premier League appearance coming in a dead rubber against Hull City. He has also impressed at every level in the United youth teams, scoring last season for each of the U-18s, U-21s and reserves. Recently in the Manchester Senior Cup Final, he scored four goals against Manchester City on route to a 4-1 win. With Rooney, Van Persie, Welbeck and Chicharito all fighting for roles up top in Van Gaal’s team, it may be the young James Wilson who forces the sale of the out of favour Chicharito as he moves up in the pecking order.

Conclusion Comparing United of 2013-14 to the current United team, there are a few major differences: they have a significantly better coach, they are stronger in central midfield, they have less depth at centre back, and they have several prospects who look ready to make the jump to the first team.

This piece has only really looked at what is different going into the upcoming season, but there are a lot of questions about the players already at the club. For example:

  • Can Wayne Rooney continue producing at the same level? (Some of his chance creation numbers have proven to be very repeatable over the years so the evidence would suggest he can.)
  • Will Robin Van Persie stay fit?
  • Will Michael Carrick return to his 2011-13 form?
  • Will Ashley Young thrive in a 3-5-2 as he has done in preseason?

There are a lot more unknowns about this team than just the changes outlined above, but it is these changes that will attract the most scrutiny and will probably have the biggest impact on the season.

I think looking at these changes, it’s hard not to see United as an improved team. Not one ready to challenge the best teams at the top in Manchester City and Chelsea, but certainly in with a shout at competing for a Champions League spot with Liverpool, Arsenal and Tottenham.

Publicly the club may boast about jumping right back into a title race, but privately I’m sure the club would be very happy with returning to the Champions League next year and I think that is probably around where they will finish.

What Matters in Football? A Deeper Look at Chances Created

One of the goals of sport analytics is to convey rich information about a player or team in a single number or statistic. In football one of the main areas of interest is how much a player contributes to scoring goals, something which can be difficult to quantify given the rarity and stochastic nature of goals. I decided to look into developing a single statistic that can be used to compare relative contributions to chance or goal creation. Taking a cue from sabermetrics and baseball analytics, I’ve developed a series of comparative statistics for attacking contributions in soccer called “Chances Created”.

Baseball Model

One of the most influential statistics developed by Bill James, the father of sabermetrics, is called “Runs Created” (RC). RC was a response to baseball’s obsession with the RBI or run-batted-in which is very context and team specific often giving a skewed view of how much a player actually contributes to his team’s offence. RC in its most basic form looks at a players contribution by multiplying the player’s on-base-percentage by their total bases. The simplest test for RC was to see if a team’s RC total roughly added up to their total runs scored and the results were encouraging with a margin of error of approximately 5%.

Since the inception of RC there have been two major advancements. The first which was given the name “Runs Created Plus” (RC+) normalizes the average player’s value to 100, so a RC+ of 115 means that the player contributes 15% more runs than the average player. The second major change was weighting the statistic for several other quantifiable factors, hence “Weighted Runs Created Plus” (wRC+).

In developing a Chances Created statistic I took this approach so there are three separate statistics: Chances Created (CC), Chances Created Plus (CC+), and Weighted Chances Created Plus (wCC+). The goal of a statistic like this is the same as in baseball, find a metric that gives a better indication of a players contribution to the attack than just goals and assists which are clouded by lots of noise.

Chances Created

A chance in football corresponds to a shot, whether on target or not. There are two actions which directly create a chance, a shot and a pass that leads directly to a shot (a key pass). So at its core CC is just an accumulation of shots and key passes, but adjusted for playing time to shots and key passes per 90 minutes.

CC

The next step is to create a statistic that is normalized so that the average is 100. The problem with this is determining what the average player is in terms of chance creation. In baseball, every player has the same opportunity to bat whereas in soccer different players in different positions are expected to contribute different outputs offensively. So instead of normalizing for a non-existent, completely average player I divided players into four positions: goalkeeper, defender, midfielder and forward. Obviously there are a lot of debates about what these positions actually mean and there are players that play in different positions throughout the season. In order to keep as much objectivity as possible I’ve just used the players' positions that they are assigned by the Premier League’s official fantasy league. Not a perfect solution, but as good a benchmark as I could think of.

In creating the average player I also think it is important to only include players who played a significant role in the season, not those who only play bit-part roles. Thus I’ve only included players who have played at least half of their teams games in the season (which in the Premier League is 19).

CCplus

Finally, I wanted to weight the chances created statistic to account for shot quality. We know that not all shots and not all chances are created equally, so the chances created statistic should also reflect the quality of these chances created. I decide to weight the statistic by assist rate and scoring rate which are essentially the percentage of key passes that lead to goals and the percentage of shots that lead to goals. Since I’m using an entire season’s worth of data the sample size is large enough that these percentages should align relatively closely with the percentages if I had used expected goals, or in other words the sample size should be large enough to drown out any significant noise that exists in the weights. For example if a player takes a lot of shots from poor positions their CC+ will be high, but their scoring rate will be low so their wCC+ will be lower accordingly.

SR    AR

wCCplus

Testing the Statistic

I think there are three key features that a statistic should have in order to be relevant and useful, it should have some explanatory capability, it should be repeatable and it should be simple to understand.

Explanatory: If the teams that have players with the highest CC, CC+ and wCC+ don’t create the highest number of goals then the statistic is useless since it is not connected to anything tangible that teams are trying to accomplish.

There are high r^2 values between the number of goals a team scores in a year and the average of their players’ CC+ and wCC+. The table below summarizes the r^2 values in the 2012-13 and 2013-14 Premier League seasons between the statistics and team goals scored. As the tables show wCC+ has more explanatory power than CC+ as we would expect.

r2 table

Interestingly if we look at defenders, midfielders and forwards on each team individually as well as the total average and run a regression on the total number of goals the team scored the individual position specific values are not statistically significant, so everything is captured by the total team average. In simpler terms, if a team’s forwards have a higher wCC+ than their midfielders it doesn’t mean they will score more goals, it is the team average of all positions that matter.

Repeatability: The statistic must have some predictive value. Therefore there must be some trend in the statistic from season to season so that a player’s CC, CC+ or wCC+ has some predictive power for their output in the following season.

Looking at the 2012-13 and 2013-14 Premier League season the r^2 value between wCC+ from one season to the next is 0.78. The scatter plot below shows the tight season to season trend in wCC+.

wCC+SeasonGraph

Simplicity: CC+ and wCC+ are designed to be as simple as possible in compare players. The benchmark of 100 for the average player at each position makes it instantly clear whether a player is above or below average in terms of offensive contribution. This is a statistic that is easy to read and even without the background on the methodology is easy to understand conceptually.

wCC+ Premier League Leaderboards

2012-13 Premier League Defenders

Defenders1213

2012-13 Premier League Midfielders

Midfielders1213

2012-13 Premier League Forwards

Forwards1213

2013-14 Premier League Defenders

Defenders1314

2013-14 Premier League Midfielders

Midfielders1314

2013-14 Premier League Forwards

Forwards1314

Some of the outliers like Kolarov and Schürrle come down to their classification as a defender and midfielder respectively when in reality they often play in more attacking positions. However, the lists in general seem to provide leaderboards that pass the “eye-test” when it comes to chance creation in the Premier League.

These leaderboards also demonstrate one of the limitations of the statistic. It can only really be used to compare players in the same position. As expected there is a much greater range for defenders than midfielders and forwards, because the denominator becomes steadily higher as we move further up the pitch. This also reflects common sense, there is a bigger range among defenders’ chance creation, who all have different roles in terms of attacking intent, than there is amongst those of forwards whose primary goal is to create chances. For example Kolarov doesn’t create more chances than Suarez despite having a higher wCC+, he just creates more relative to the average defender than Suarez does relative to the average forward.

That being said these leaderboards show how much better Luis Suarez has been than every other forward in the Premier League over the last two years. It is also nice to see this statistic reflect how vital Coutinho was to Liverpool’s 2013-14 season. The other stand out to me was Wayne Rooney’s consistency and impressive numbers over the past two years with wCC+ of 147 and 148. These production numbers fall in line with some of the other work on Statsbomb looking at Wayne Rooney’s career.

Overall I’m pretty pleased with the picture these wCC+ leaderboards give of chance creation over the last two seasons.

Next Steps

I’ve only used the data that I’ve complied to date which is 2012-13 and 2013-14 Premier League data. In order to really understand how widely applicable CC+ and wCC+ is we need to see how it works when applied to other leagues around the world.

The other area where changes could be made is in how the weights are applied. Assist rate and scoring rate are simplistic measures compared to potentially more indicative metrics like expected goals per key pass and expected goals per shot which would require a much richer data set. In the future these weights might give a statistic that better isolates an individual player’s contribution.

This is the first time I’ve ever tried something like this before so I’m open to critiques, suggestions and other tests people think would be applicable to further examine CC+ and wCC+.

 

What Does It Take To Get Out of a World Cup Group?

There has been very little work done in international football analytics compared to the club game . The general consensus is that working with these statistics is much more difficult for a variety of reasons, the most often citied are a small sample size, high turnover of squad composition and varying strengths of schedule.

Looking at the World Cup in isolation the problem of squad turnover is handled as countries are not allowed to change their squad composition once the tournament has begun. Further restricting analysis to the group stage also deals with the strength of schedule problem. Looking solely at the World Cup group stage the only problem becomes the question of sample size.

Leading up to every World Cup journalists may not explicitly use the term sample size, but they all discuss this idea of “getting unlucky” or not “getting the bounces” in the short time frame. This line of inquiry brings up the question, do the best teams really get through the group stage? Or at the very least do the teams that play the best in the opening three matches make it through?

The first question is very difficult to answer for many of the reasons stated above. Going into the World Cup we really don't know who the best teams are. Club form doesn't always translate into national team form and it's difficult to compare underlying talent between teams that have faced very different competition leading up to the tournament. The second question is much easier to deal with, do the teams that play the best in the opening three matches make it through their group?

In order to take a more in-depth look at this question I've chosen simple proxies for playing well and for getting lucky. FIFA does not provide any shot location data, at least none that I've been able to find, so the best available alternative to use for dominance is total shot ratio or TSR. The idea is that over three matches the extent to which a team outshoots their opponents indicates how well they have played. On the flip side I've used PDO as a proxy for luck. These two proxies have often been used elsewhere on Statsbomb.

The data I'm using for this analysis are from the 2010 World Cup. If anyone needs a refresher as to where teams finished in the group stage the final results are all here.

Most teams go into the group stage with the goal of qualifying for the round of sixteen, and the question of getting unlucky only comes up if a team doesn't make it past the group stage, so instead of looking at final position I just look at whether or not the team qualified for the next round.

I use a probit model, which assigns a probability to each team getting out of the group stage given their TSR and PDO throughout the three group stage matches. Each team assigned a probability greater than 0.5 is expected to qualify and each team with a probability less than 0.5 is expected to be eliminated.

The first thing we want to understand is how many of these teams the model accurately assigned a probability of greater than 0.5. Or in other words how many of the teams fates can be described purely using these two statistics.

The complete model accurately anticipates fourteen of the sixteen teams that made the second round. The only two teams that the model did not accurately assign to the round of sixteen were South Korea and Slovakia.

Table1

Essentially this means that neither the proxy for skill nor the proxy for luck can explain why these two teams qualified for the round of sixteen. Examining these two teams in context gives a bit more insight. South Korea's below average TSR seems to be down to the curse of the small sample size in which they are disproportionately punished for a 4-1 pummelling by Argentina. As for Slovakia they seem to just have been even luckier to escape a group with Paraguay and Italy than their 1115 PDO indicates.

Now we use two restricted models one which only uses PDO and one which only uses TSR. The model only taking into account PDO correctly predicts eleven of the teams that qualified, whereas the model only taking TSR into account correctly predicts thirteen of the teams that qualified. This suggests that despite the small sample size the quality of performance has a bigger impact on whether or not a team qualifies than luck does.

This becomes more interesting when comparing the teams that the PDO and TSR models differ on. The PDO model correctly predicted two teams to qualify that the TSR model didn't: Slovakia and Mexico. As mentioned above Slovakia is a bit of an outlier since even the combined model didn't anticipate their PDO to be high enough to make up for their poor TSR.

The TSR model correctly predicted four teams to qualify that the PDO model didn't, including the tournament champions Spain.

Table2

It is interesting that all of these four teams which made up for their relative “unluckiness” did so with TSRs greater than 0.6. The most telling number here might be Chile's who appear to have been very unlucky with a PDO of 854, but were able to overcome it by significantly outshooting their opponents.

The evidence from the 2010 World Cup suggests that if a team outshoots their opponents throughout the group stage by at least 6 to 4 they should be able to get past so called “unlucky bounces”. The data also show that getting lucky in the group stage and making it to the round of sixteen is not impossible, but it doesn't appear to be quite as prominent as many TV commentators will inevitably claim during this summer's World Cup.