Eurovision 2013: The Split Results

On Tuesday the EBU provided the split between the jury and televote average rankings for this year’s contest, with winners Denmark topping both. However, unlike in previous years, these split results don’t actually show us what the scoreboard would have looked like if only juries or televoters had voted and points been awarded accordingly.

To see how widely the conventional points system might differ from the average ranking system, consider a hypothetical country which 20 juries in the final ranked 1st and 19 juries ranked 26th. If the split results showed us what the points situation would have been had only juries voted, as they did in previous years, we’d see this country scoring 240 jury points. Now, all we’d see is an average jury rank of 13.17.

Compare another hypothetical country which finished 13th with every jury. Jury points: 0. Average jury rank: 13. An extreme case, but Armenia’s semi-final performance provides a more practical example of how the average rankings might be misleading.

Armenia had an average jury rank 7.15 (7th best) and average televote rank 9.44 (11th best). But it’s likely that Armenia ranked first or very highly in quite a few televotes, which means they must have ranked very low in quite a few others to reach that 9.44 figure. If the split results had shown us what the points allocation would have been had only juries or televoters voted, it’s very probable that we would have seen Armenia scoring more televote points than jury points.

So one has to be very careful not to read too much into statements like “Armenia did better with the juries”. If the EBU had chosen to release the split figures using the points system instead of the average rankings – as they could easily have done – we might instead be saying “Armenia did better with the televoters”.

Nonetheless, we can tentatively look for lessons in big discrepancies between jury and televote rankings. In the semis, this happened with juries tending to favour middle-of-the-road stuff – Austria (+10), Moldova (+8) and Georgia (+8) – and punish the more leftfield, such as Romania (-12), Bulgaria (-11) and Montenegro (-10). Switzerland’s dated, amateurish schlager was the other act to suffer most (-11).

The smaller the discrepancies in rankings, the more carefully we have to tread. It’s surprising, though, that Iceland did worse with juries than with televoters in the final (-5); Croatia likewise in the semi (-3). Just when is old-fashioned but well-performed significantly better liked by juries – for example, Estonia (+5 in semi, +8 in final) – and when isn’t it? It remains hard to tell.

Sweden’s jury love in the final (+15) suggests that if something sounds vaguely contemporary and radio-friendly, it’s likely to do well with this constituency. Unless it’s sung by a Hungarian hipster (-13). You see – for every case there’s an exception. Perhaps jurors didn’t take to ByeAlex’s quirky vocals, as they didn’t to Can Bonomo’s in 2012.

The bottom line: second-guessing the juries has been a tricky proposition since their reintroduction in 2009, and this year was no exception. We make assumptions about what juries will like; only sometimes are we proved correct.

Moving on to televoters, I will try never to underestimate again how viewers can respond to a favourable draw and memorable act in the semi-final. Cezar topped the televote average rankings with the second semi-final pimp slot, despite the lack of many of Romania’s allies. That’s two better than Lithuania’s Donny Montell managed in 2012 from the same place. Meanwhile, Switzerland managed a televote fifth from the penultimate position.

Otherwise, there were not so many televote suprises. It’s interesting to note that the televote rankings are, in general, still more closely correlated to an act’s final position than the jury rankings are. I had wondered if the new system would do more to negate this. Greece provides a good example with a classic Greek result: 4th in the televote, 14th with juries, 6th overall. I think this is due to televoters being more decisive; juries spread their points around a little more.

Again, we need to be tentative here, and remember we’re comparing apples with oranges – it’s frustrating that the EBU are not prepared to release the points system splits as well as the average rankings, which would give us a fuller understanding of how well each song did with each constituency and what difference the new voting system has made.

Indeed, as we have argued, we think every country’s televote and jury rankings should be in the public domain (as Italy’s televote and Sweden and Denmark’s jury vote already are). With such a cloud of suspicion hanging over this year’s vote, transparency is the best policy.

The EBU have yet to come round to this point of view. Their statement on release of the split rankings says:

To protect the fairness of the voting, the EBU does not release the split ranking of televoting and jury per country. Publishing these numbers would explicitly highlight if countries don’t meet the televoting threshold – the minimum number of televotes needed to become a statistically valid result – is and where thus only the jury voting was regarded valid. Explicitly highlighting these countries could lead to unwanted disproportionate influence on the televoting in these countries in future years to come.

If this is the EBU’s only reason, then it has a significant flaw – from the average rankings they have published, it’s possible to reverse-engineer how many countries didn’t make the threshhold. Thanks to some sterling mathematical work from escxtra’s Ervin, it’s apparent that one country in the first semi-final used jury-only scores and two countries voting in the second semi-final did so.

We don’t know which countries these were, but I’d put good money on Ervin’s guesses of San Marino and Albania being correct. Given Albania’s six points to Spain in the final, which doomed Ryan Dolan to last place, I’d bet this was a jury-only result too.

What do you feel about how the new system of allocating points has worked and been represented? What are your views on the split results? Let us know below.

4 comments to Eurovision 2013: The Split Results

  • Ben Gray

    I think the only reason the EBU could take a justified decision to show us average rankings instead of a raw points-based overall European ranking is because they don’t want us to extrapolate that data and compare it to the old system.

    What else could they have to hide behind these vague numbers other than the possibility (or fact?) that Denmark would not have won under the old system? A few countries shifting around in the middle was acceptable for them to release in previous winners, as long as they could show that we all agreed on the winner, which 3 times out of 4, we did, and on the one occasion we didn’t, it was only 2nd with the juries so no big deal.

    This year, they have showed us a ranking that says Denmark was the winner on both sides. That’s what’s so important to them I think. They’re trying to save face. They probably don’t want a mob of Azeris coming over the hill with flamed torches yelling that this complex new voting system robbed their country of a second victory. It’s entirely possible that even Norway could’ve won under the old system, and maybe Germany could’ve scraped into the top 10.

    This is a shambles, they’ve got to bring the old system back.

  • Thank you for this article Daniel. Please, correct me if I am wrong, but had the normal points-based split been released, the countries that would jump up/down a lot on either the jury or the televote ranks compared to the split we have now would be the ones achieving their average positions by getting a big % of their points through 8’s/10’s/12’s? In other words, being voted very high by a few countries and not being voted almost at all by many countries?

    I have done a mock jury vote for Italy, a country which quite possibly had very high jury marks from a few western/Mediterranean/neighbouring juries. I have allocated the potential jury points from the 38 juries in such a way as to get the 9.46 average jury rank Italy got. I got around 140 jury points. Looking at the jury splits from 2009-2012, this could be a 5th/6th jury position, whereas now Italy is ranked 8th in the jury split. Not such a huge difference.

    I suppose the change would be bigger if I would try this on the televoting split of a country with big diaspora/local support, as a big % of their televote points could have been again through 8’s/10’s/12’s.

    • Daniel

      Hi Panos, I agree with what you are saying here, and good work on the possible Italian total. Ultimately, all of this can only be guesswork, which makes it all the more frustrating and speculative.

  • Alen

    The only reason imo not to release the usual split points result is to hide something. Easy as this. They are surely aware of all the talking about the released data so I wonder why they still don’t release it under so much presure?

    I tell you what: It just stinks and it’s annoying. All we want is to know which place and how many points every song got by jury and televote.

    I think maybe Denmark wasn’t No. 1 in televote but Azerbaijan for example and they don’t want any problems. Everyone knows that the jury is voting 50% but we (yet) didn’t have a general winner that wasn’t the televotes winner too. And I would be furious too if a song won that wasn’t No. 1 in televoting cause I still think 5 people against 1000’s voting isn’t really fair.

    I doubt we will get the split results though. Ebu likes the “let’s settle some dust on it and everyone will forget about it” – attitude.

 Leave a reply...