A Communicate Research poll in today’s Independent gives the Conservatives an 6 point lead over Labour. The full topline figures are CON 38%, LAB 32%, LDEM 14%, Others 16%.

It is Communicate’s first voting intention poll since back in 2005, so there no changes from the last poll and it is impossible to say if there are any trends in voting intentions, although it goes without saying that the poll doesn’t appear to support MORI’s figures yesterday.

Communicate’s methodology has in the past produced figures slightly more favourable to Labour, in theory at least – in practice there wasn’t much difference between them and the other pollsters. ICM and Populus both weight by past vote, which tends to make samples “more Conservative”; Communicate don’t. In the distant past Communicate also didn’t prompt by party name, which used to favour Labour at the expence of the Lib Dems. That changed prior to the last election, so there is now no obvious methodological explanation for the low level of Liberal Democrat support.

The most obvious difference in Communicate methodology is that they use a very harsh squeeze question. Those who say they don’t know how they will vote are asked how they would vote if it was a legal requirement to do so. There has also been a slight change in the way they deal with turnout – Communicate now just filter by likelihood of voting, including those who rate themselves as 5/10 likely to vote or higher. In the past they also used to weight by likelihood, so people who said they were 5/10 likely to vote counted only half as much as someone 10/10. The likelihood weighting has been abandoned, the result of which is to slightly reduce Conservative leads.

Communicate also asked about attitudes to Iraq. 72% of people now think that the war in Iraq is unwinnable. 62% of people think the UK should withdraw as soon as possible from Iraq, regardless of whether it is completely stable. Only 28% favour staying until Iaq is stable. An ICM poll in the Guardian produced alsmost identical findings – 61% wanted troops withdrawn this year, with only 30% wanting them to stay for as long as necessary.

Still to come this week, there should be ICM voting intention figures tomorrow, and YouGov voting intention figures on Friday.

Deaths in Iraq

Given its potential to attract hordes of nutcases to my comments section, I have been steadfastly ignoring the Lancet’s report on the increased mortality rate in Iraq since the invasion. Since Peter Cairns has asked me about it in the comments section below and I have been tagged by Matthew Turner I suppose I must reluctantly enter the fray. Thanks Peter & Matthew ;)

The study in Iraq was, for all intents and purposes, an opinion poll. The researchers from Johns Hopkins University sent interviewers to a sample of houses in Iraq and asked them how many people had died in that house since the invasion (they also asked how many people had died for a prior before the invasion, to act as a baseline of “normal” mortality). This allowed them to say that x% of people had died in Iraq over the period, therefore given Iraq’s total population the “excess” deaths amounted to about 655,000 people.

Obviously such a suggestion is politically charged, especially since it conflicts strongly with the Iraqi government’s official figures and the figures from third parties like Iraq Body Count. In my own view this doesn’t matter – the Iraq government has good reason to downplay casualties and is governing a country in a state approaching civil war where much of the government infrastructure has broken down. Why Iraq Body Count was ever viewed as anything other than a minimum number of casulties is beyond me – I have not the slightest reason to think that there are not vast numbers of deaths in Iraq that are not reported in two separate English language media sources (something I’ve often pondered doing is taking the UK murder statistics, and seeing if I can track down newspaper reports for every single murder in a given year. My guess is that every single killing in a media-heavy, highly developed state like the UK is reported in the local press at the very least, but it would be interesting to actually check). I wouldn’t regard official figures from a country in a state of chaos, or a count of deaths mentioned in the media as being in any sense reliable enough to use to gauge the accuracy of a study that at least attempts to be a rigorous scientific inquiry.

So, to the study itself. I am not going to explain the basic logic of extrapolating findings based on a small sample to a larger population here, though some of the dismissals have been based on the fallacy that you cannot extrapolate 629 deaths up to 655,000. The method of cluster sampling used is well established, has been successfully used in the past. In short, in the same way that we can accurately predict an election result to within a few percentage points based on interviewing just 1,000 people, we can estimate how many people have died in the whole country by seeing how many people died in a smaller group of residences and factoring up. If polls work, and they do, then so should this, despite it being a relatively small number. Unless something has gone wrong with the methodology of the survey the chances of the researchers just happening to have knocked on doors with a disproportionate number of deaths that do not reflect the country as a whole, and of there actually being fewer than 392,979 excess deaths is only 2.5% (the same chance that there have been more than 942,636 excess deaths).

So, what could have gone wrong? The more excitable fringes of the US blogosphere have come out with some interesting stuff. Let’s look at criticisms that don’t hold water first.

Firstly, the turnout is unbelievably high. The report suggests that over 98% of people contacted agreed to be interviewed. For anyone involved in market research in this country the figure just sounds stupid. Phone polls here tend to get a response rate of something like 1 in 6. However, the truth is that – incredibly – response rates this high are the norm in Iraq. Earlier this year Johnny Heald of ORB gave a paper at the ESOMAR conference about his company’s experience of polling in Iraq – they’ve done over 150 polls since the invasion, and get response rates in the region of 95%. In November 2003 they did a poll that got a response rate of 100%. That isn’t rounding up. They contacted 1067 people, and 1067 agreed to be interviewed.

Secondly, people have been understandably confused by the mention of death certificates. Whenever possible interviewers asked if they could see the death certificate of people reported dead during the study. In 92% of cases those asked produced the certificate. This presents an apparant discrepancy – if over 80% of the deaths had been officially recorded, how come official Iraqi estimates of the dead were so low? The explanation given by the report – which seems perfectly reasonable – is that hospitals have continued to issue death certificates, but the system of collating the figures centrally has broken down to a large extent. In other words, a doctor in Iraq may still be giving out the paper certificates, but the figures are not necessarily passed on or registered with any higher authority.

Thirdly, some people have pondered whether Iraq’s mortality rate from before the invasion as determined by the study seems unfeasibly low at 5.5 per 1000. This compares to mortality figures of 10.1 for the European Union, a group of far more developed countries with better nutrition and health care. If Iraq’s pre-invasion mortality figure is artifically low, then it would wrongly inflate the number of excess deaths. However, the difference is actually because Iraq has a far younger population than the EU. Apart from countries in Southern Africa where AIDS is endemic, developed countries tend to have a higher mortality rate because they have more elderly people in proportion to young people, and an old person in a “safe” country is still more likely to die than a young fit person in an “unsafe” country. It seems that 5.3 is a perfectly reasonable figure when compared to mortality rates for similar countries like Egypt (5.2), Iran (5.6), Tunisia (5.1), Syria (4.8), Qatar (4.7), Bahrain (4.1).

Moving on, some people have raised more substantial concerns. Firstly, two of Iraq’s governates were not sampled because of errors, these areas were in the extreme North and South of the country, away from the Sunni dominated centre where the violence has been worst. It seems reasonable to assume that these two areas are likely to have reported a low casualty rate, and therefore the remaining figures are artificially high. That may be so, but they contain only 5% of the population so even if they had a very low casualty rate indeed the effect would be very small. The headline figure of 655,000 extra deaths was based on the population excluding those areas, so is still sturdy.

Secondly, the populations of the governates were estimated using 2004 figures, if there has been substantial population movements since then it could skew the figures. Again, this is a legitimate concern, but population movements would have to be very large to make a truly significant difference.

Thirdly, several people have pondered the “word of mouth” effect. The researches state in their report that having explained to the first house in a cluster their good intentions, word of mouth travelled ahead of them and made it easier to presuade the rest of the cluster of their good intentions. Some people have, quite reasonably, asked whether this could skew the result – could people with deaths in the family have become more or less likely to take part in the survey? In theory yes, they could, but given the response rate of 98% there is very little space for it to have made a difference. If it made people with deaths more likely to take part, they are 98% likely to have done so anyway. If if made them less likely to take part, it obviously didn’t have much effect.

Fourthly, interviewers had some leeway to change the area they were interviewing if the designated area was too dangerous. This could result in bias, but it seems more likely that it would lead to an underestimate in the number of deaths, as interviewers avoided the sort of area where lots of people get killed. Of course, interviewers could avoid a safer area because they had to travel through a dangerous area to get to it, but it still seems unlikely that a systemic bias of this sort could overall lead to a upwards bias in the number of deaths.

Finally, there have been questions over whether the sampling technique was biased towards urban areas. This is the most substantial problem in my view. The way the location of clusters was determined was thus – first the governate was determined, then a main road in the province was randomly selected, then a road leading off of that main road was randomly selected, and then a house on that road. It seems to be that this approach should skew the location of clusters towards urban areas, and make it less likely that rural areas and areas with informal housing like refugee camps would be selected. If violence is concentrated in urban areas this could skew the sample and give an artifically high number of casualties.

Overall, the study seems sound. There are some legitimate questions about the effect of the two missing provinces and any large population movements, but at the end of the day they would have quite minor effects on the total: they are not suddenly going to bring the figures into line with the Iraqi government figures or the Iraq Body Count figures. The possible effect of an urban bias is more worrying, potentially this could skew the figures upwards. That said, 77% of Iraq’s population live in urban areas, so even if there is a systemic bias here, in a worst case scenario of non-urban areas being entirely missed out and 23% of the country actually having a much lower mortality rate, it is not going to be a drastic change. For example – the report found the post-election death rate to be 13.2, if that actually applied only to urban areas, and the mortality rate in non-urban areas was still 5.5 (the pre-invasion figure), the overall rate would still be 11.4, which still equates to hundreds of thousands of extra deaths.

The study is based on a survey in a country in a state of near civil war and without accurate population estimates, it is not a perfect situation to be working in and obviously there are going to be question marks here and there. Surveys in developed countries aren’t perfect, let alone in war zones. The bottom line though is that the study suggests that the increase in deaths since the invasion is indeed far higher than estimates from other sources suggest.


Following Communicate Research’s poll at the weekend, ICM’s latest figures also show public disapproval of Tony Blair’s close relationship with President Bush. 63% of respondents thought that Blair had tied Britain too closely to the US. This included 54% of Labour supporters and 68% of Conservative voters (though this is likely to be largely a politically partisan answer – generally speaking Conservative voters are more pro-American than those of other parties). 83% of Liberal Democrat voters, who tend to be most anti-American, thought the present relationship between Britain and the USA was too close.

There is little support for Israel’s present actions – only 22% of people think that Israel’s bombing of Lebanon is proportional, while 61% think she has overreacted.

The poll also showed support for the war in Iraq dropping to a new post-war low – 36% of people now say the war was justified, compared to 51% who say it was unjustified (the wording of ICM’s question, which specificially mentions the removal of Saddam Hussein as a war objective, means that their figures show much higher support for the war than other pollsters. The downwards trend in support though is the same for all companies figures). 36% of people think that Britain’s contining presence in Iraq is making the situation worse, compared to only 19% who think the progress is being made. The comparable figures in Afghanistan are 29% and 23%.

Overall 69% of people think that Britain’s armed forces are now overstretched.

YouGov’s latest poll in the Telegraph also asked about the war in Iraq. The proportion of people thinking the US and Britain were right to take military action against Iraq has now fallen to 33% with 57% thinking it was wrong, for a net approval figure of -24. This is the lowest so far recorded in a YouGov poll (Populus have recorded lower levels of support – as low as -40 in their last poll – but the wording of their question specifically asks people to think about both the war and what has happened in Iraq since then, which given the situation in Iraq leads to a lower approval rating).

Asked when Britain should withdraw her troops from Iraq, 24% of people supported immediate withdrawal while 31% supported a withdrawal of British troops within 12 months, regardless of the situation on the ground. 39% supported keeping British troops in Iraq on a more opened ended footing until the Iraqi security forces were ready to take over.

Finally 36% of people thought that is would be a victory for terrorists and extremists if the US and Britain were forced to leave Iraq before it was ready compared to 42% of people who thought that US and British troops were a major reason for the instability in Iraq, and that their withdrawal was a prerequist for Iraqi stability.

Ipsos-MORI have released a new poll for the Associated Press on the trial of Saddam Hussein, conducted across 9 different countries.

While other polls have consistently shown support for the war in Iraq declining in the UK, people continue to believe that Iraq is better off that it would have been under Saddam – 52% think the people of Iraq are now better off, while only 29% think they are worse off. These views seems to be somewhat unusual in the rest of Europe though. While opinion in Canada is almost identical to the UK, and in the USA 68% of people think Iraq is better off without Saddam, across the rest of Europe people tend to think that Iraq was better off with Saddam: in France 32% think Iraq is now better off, 41% worse off; in Germany 38% think Iraq is better off, 42% worse off; in Spain only 18% think Iraq is better off, with 47% thinking it is worse off. Italy is the is other exception, where 43% think Iraq is better off and 25% think it is worse off.

Britons, Americans, Canadians and Italians are also the most confident that Saddam Hussein is receiving a fair trial – 62% of British people think Saddam is being fairly tried, compared to 24% who think he is not. People are less confident in France and Germany (44% and 51% respectively think the trial is fair) and the Spanish are the least confident of the European countries – only 27% think Saddam is receiving a fair trial compared to 36% who think he is receiving an unfair trial. Respondents in South Korea and Mexico, the other two countries polled, were also more likely to think that Saddam was receiving an unfair trial.

Finally Ipsos asked whether Saddam should receive the death penalty or life imprisonment if found guilty. America was the only country where a majority (57%) supported the death penalty, in Britain, Canada and France 38% supported the death penalty for Saddam, 34% in Germany, 26% in Mexico, 25% in South Korea, 20% in Italy and 14% in Spain.