Tuesday, 7 April 2009

Andy Cooke on the poll averaging debate


(This is a comment that Andy Cooke posted on the main PB site on the debate that often flares up here on poll averaging between Mike Smithson and Rod Crosby)

On poll averaging: Rod Crosby would be absolutely correct - if the only variability of the polling were random error (imprecision). If systematic error (inaccuracy) creeps in, then the averaging technique would fail. We can, in fact, use Rod's correct statistical assertion to test the assumption that variations between all the polls from the polling companies is purely random error - if averaging tends to work over a specified technique of selecting a single poll (which we don't have to come up with - Mike has long subscribed to the technique "Whichever one is worst for Labour"), the assumption holds. If the specified technique tends to win, the assumption fails.

Quick test: Looking at the final 3 days polling data from the last 4 elections (information readily available; timescale chosen to provide sufficient polls to actually average (number of 4-7 over the 4 elections), data from most polling companies at each election, yet minimise the possibility of a late swing), we can take the average (Crosby's Rule, or "CR") and worst-for-Labour (Smithson's Rule, or "SR")

1992: (Lead in GB; Con score-Lab score; error)
Actual: Con 7.6%; 42.8-35.2
CR: Lab 1.4%; 38.1-39.5; 9.0% to Lab
SR: Con 0.5%; 38.5-38.0; 7.1% to Lab
SR wins

1997: (Lead in GB; Con score-Lab score; error)
Actual: Lab 13.0; 31.4-44.4
CR: Lab 18.0%; 30.0-48.0; 5.0% to Lab
SR: Lab 10.0%; 33.0-43.0; 3.0% to Con
SR wins

2001: (Lead in GB; Con score-Lab score; error)
Actual: Lab 9.3%; 32.7-42.0
CR: Lab 12.8%; 31.6-44.4; 3.5% to Lab
SR: Lab 10.0%; 33.0-43.0; 0.7% to Lab
SR wins

2005: (Lead in GB; Con score-Lab score; error)
Actual: Lab 3.0%; 33.2-36.2
CR: Lab 4.9%; 32.4-37.3; 1.9% to Lab
SR: Lab 3.0%; 33.0-36.0; 0.0% to Lab/Con
SR wins

SR wins in 4 out of 4 cases. If the assumption that error is purely random were to hold, then in each case, SR would be heavily odds against to win. A 4-horse accumulator all at odds against on the order of 4/1 to 6/1 would seem extremely unlikely (if all were 4/1, for example, we'd be looking at a 624/1 accumulator, which beats Mike's Obama bet totally hollow).

Ergo the assumption that all polling error is purely random fails. Polling averaging (across companies, at least) is contraindicated.

Should Labour follow Ireland's example on MPs' pay?

Harry Hayfield on what's happened across the Irish Sea

Taken from the Irish Finance Minister's speech in Dublin this afternoon:
The Government has decided to introduce a number of additional changes to
the remuneration of Deputies and Senators.
* There will be a 10% reduction in all expenses other than mileage
rates where a 25% reduction has already taken place.
* Deputies will no longer receive long service payments or increments.
* The arrangement whereby former Ministers are paid Ministerial
pensions while they are still members of the Oireachtas will be
discontinued.
* Oireachtas members who are on paid leave of absence as teachers may
no longer avail of the arrangement whereby they can keep the difference
between their teachersâEUR(tm) salary and the cost of employing a
replacement.
* The allowances paid to Oireachtas Committee chairs will be halved
and the payments to whips and vice-chairs are to be abolished.
* The Oireachtas Commission has put forward its own proposals for a
reduction in the number of Committees and I am happy to leave that matter to
these Houses.
Some of these changes will require legislation which will be introduced
shortly. The members of this Government reduced their salaries by 10% last
October. Ministers of State made a similar reduction. The public service
pension levy was applied to members of the Government and Ministers of
State. As a result, Ministers have seen a reduction of one fifth in their
incomes.

Harry Hayfield is a regular PB contributor

Mr Smithson - the horse


This is Mr Smithson - the race-horse that is owned by a syndicate of PB followers. It's pictured here in the parade ring just before its first outing last week at Musselburgh - a race that saw it coming in second at 14/1. Those who backed it each way did very nicely.

We'll keep you up to date here on PB2 about its progress and where it is running next.

Hung Parliament Revisited

A PB2 guest slot by Rod Crosby

Discussions of the prospect of a hung parliament have probably caused more disagreements here than any other topic. The preponderance of opinion seems to be that the Tories are very likely to win a majority. All things are possible, but before one commits to a position an objective analysis is called for.

What is the Electoral System saying?
The capacity of FPTP to deliver an overall majority is entirely dependent on two factors – its exaggeration when translating votes into seats, and the number of third party MPs.

The first has been in long-term decline since the demise of the “cube-law” in the 1950s, although it has recovered slightly since 1992 and has now stabilised at around a “square-law.” This change, due to the decline in the number of marginals, means that fewer seats now change hands between Labour and Conservative for a given shift in votes, or swing.

The second has seen the number of MPs not aligned with Labour or Conservative grow from just 8 in 1955 to no fewer than 92 in 2005. This change, due to the rise in the LibDems and Nationalists, and the de-coupling of Northern Ireland from the mainland party system, means that to gain an overall majority Labour or Conservative now need a far larger lead in seats over each other than they did in the past.



Combined, these two factors have dramatically altered the British FPTP system from one where hung parliaments were extremely unlikely to one where they are now increasingly likely.

The rôle of Electoral Bias
The preceding analysis takes no account of electoral bias – the tendency of the system to favour one party over another, other things being equal. In the 1950s there was a modest pro-Tory bias, but by 1966 this had disappeared, and for the next 25 years the system treated the two big parties roughly equally. In 1992 that changed dramatically. Despite obtaining a thumping lead in votes, John Major was rewarded with a majority insufficient to last a full parliament. Tactical voting, and to a lesser degree regional effects, had swung the system significantly towards Labour. And rather than this being an aberration - on the contrary - the anti-Tory bias increased in 1997, 2001 and 2005. It is notable that, but for electoral bias, there would have been a hung parliament in 2005. Boundary changes and a likely small fall in the total number of third-party MPs may reduce this bias fractionally in 2010, but as the following graph shows, the Tories will probably need about 57% of the two-party vote to achieve a majority – a huge handicap only narrowly exceeded in 2005. However, continuing demographic shifts may also improve Labour’s position slightly, relative to the 2005 notional figures, meaning that in practice the Tories could be no better off than in 2005.



In a nutshell, the hung parliament zone has widened from a crack to a chasm, while the power of the system to propel a party across it has simultaneously weakened. Worryingly for the Tories, electoral bias has now shifted the chasm almost entirely into what would otherwise be their winning territory.

Cycles and Volatility
A complicating factor, in arriving at an estimate of the chance of a hung parliament is that the political pendulum does not move in a clockwork fashion. Parties have their great triumphs and abject disasters, and often remain in power for more than one term.


The black line represents an idealised electoral system, with no electoral bias and assumes a swing to the opposition at each election, adjusted for increasing volatility over time. The yellow line is more realistic, incorporating electoral bias and memory of the previous election result.

The first big leap in the chance of a hung parliament came at the February 1974 election, which did in fact produce one, although the objective chance, given a small pro-Labour bias and the closeness of the previous result, was somewhat smaller. It was the unexpectedly minuscule swing to Labour that in reality delivered that inconclusive result. For different reasons, two subsequent elections - October 1974 and 1992 - also came extremely close to producing hung parliaments.

Of course, politics often confounds even the best statistical estimates. In 1983, had there been a swing to Labour, a hung parliament was quite likely - instead there was a swing to the government, resulting in a Tory landslide. Again, in 1997, the system was primed to deliver a hung parliament, but the unprecedented, massive swing to Labour rendered the estimate moot. On the other hand, the graph shows that in 1987 and 2001 the Opposition were simply starting from too far behind to make a hung parliament at all likely, which turned out to be an accurate prediction. But we can see that in 2010 we are once again facing a “peak probability” of a hung parliament. The numbers say about a 67% chance, and we can be pretty confident there will be no swing to Labour to upset that estimate.

What are the Polls saying?
Since, in the final analysis, a hung parliament turns on a single seat we should not be surprised that individual polls give a Yes/No answer, rather than a Maybe. That may be misleading. Of the 335 polls since 2005 exactly 50% of them have indicated a hung parliament, while only 28% have indicated a Tory majority and 22% a Labour majority. That is an unprecedented number of polls indicating a hung parliament.

The following graph visualises the polls. About half the time, we see “islands” of majority government emerging from the Stygian waters of a hung parliament, only to be submerged again. The Tory archipelago seemingly peaked in 2008, and one could be forgiven for thinking they look poised to slip beneath the waves again sometime soon…




The median forecast of the polls in this parliament is Con 288, Lab 277, LD 47, which if reflected in the result could see Labour remain in office with the LibDems as Kingmakers.

Conclusion
In 1951, just a 1% swing saw a Labour majority government replaced by a Tory majority government. Electoral bias, increased third party MPs, and the changing nature of the system mean that to obtain a majority at the next election the Tories require at least a 6% swing, possibly more. Only one of the last sixteen elections has seen such a swing. The polls are narrowing - another fractional shift and the Tories fall back into the NOM zone. Whether you examine the electoral system or the polls, a hung parliament still appears to this poster to be the odds-on favourite.

Rod Crosby is a regular contributor to the main site - Politicalbetting.com

Friday, 3 April 2009

We are having very serious problems on the main site

We do not know what is happening but it has not been possible for large parts of the day for people to get onto the main site.

This is not the normal server pressure that happens from time to time.

I have no idea what the cause is - but please check here for the latest information.

..and please use the thread here for our ongoing discussion.

Monday, 30 March 2009

Temporary Shelter

It seems the main site has gone down briefly

Double Carpet is contacting Mike and Robert Smithson, and I expect we'll see everything back to normal shortly.

Keep talking here in the meantime.

Morus

Thursday, 26 February 2009

Sorry - the main site is down



Marf's cartoon is about the big political story of the day - the RBS's record losses and the £650,000 a year pension that is being paid to the 50 year olf former Chief Executive - Sir Fred Goodwin.