Friday, February 6, 2015

Breaking down the Sudbury results

The provincial by-election in Sudbury culminated in a somewhat anti-climactic fashion, with Glenn Thibeault (the NDP MP turned Ontario Liberal) prevailing by a little more than six points over the NDP's Suzanne Shawbonquit. The wildcard in the race, Andrew Olivier (the Ontario Liberal turned independent), took less of the vote than expected. But was he really a spoiler?

Let's first take a look at the shift in vote share since the 2014 provincial election.

Thibeault captured 41.2% of the vote, increasing his party's share by 1.9 points. Shawbonquit finished with 34.9%, a drop of 7.3 points over the NDP's victorious performance in 2014.

Olivier took 12.3%, not a bad performance by an independent candidate, but well below expectations.

The Progressive Conservatives' Paula Peroni saw her vote share (she ran last time as well) fall 6.3 points to 7.5%, while the Greens' David Robinson was down 0.4 points to 3.2%.

On the face of it, it would seem that Olivier drew votes from the NDP and the PCs, suggesting he could have been a spoiler for the NDP. But the New Democrats would have had to hold virtually all of their vote to beat Thibeault, a tough assignment considering that many Sudburians used to voting for Thibeault the New Democrat might have been willing to vote for Thibeault the Liberal.

In terms of actual votes, no party made any gains. The total number of voters dropped by some 8,000, as turnout fell to around 34%.

Of the three major parties, Thibeault saw the smallest drop, of 2,670 votes. Peroni fell 2,730 votes while Shawbonquit saw the largest slide, from 14,274 votes to 8,985 (a drop of 5,289).

Overall, turnout had dropped to about 76% of what it was in 2014. That means Thibeault outperformed that baseline, retaining 80% of the votes that the Liberals took in 2014.

Robinson retained 68% of 2014 Green voters, while Peroni retained just 41%. The problem for the NDP was that Shawbonquit retained 63% of her voters, when she needed at least 74%. In other words, the NDP just needed to tread water in order to hold off Thibeault, but they disproportionately lost voters, and so the by-election.

Was Olivier the cause? Quite possibly. If the number of votes cast had dropped uniformly across the board due to falling turnout, Shawbonquit would have won with about 10,900 votes and a lead of 700 or so over Thibeault. Instead, she under-performed that mark by about 1,860 votes. Peroni also under-performed, by about 1,610 votes. In total, these two parties took about 3,470 fewer votes than they should have, all else being equal. Perhaps not coincidentally, Olivier captured 3,177.

Just looking at the math, it doesn't seem like many Liberals went over to Olivier's camp. Undoubtedly some did, but they were more than made up for by New Democrats and PCs who voted for Thibeault. It seems more likely that Olivier drew support from the NDP, reducing their chances of victory. Or, at the very least, he did not draw enough Liberals to make up for the number of New Democrats who followed Thibeault across the metaphorical aisle.

Mixed results for the by-election polls

Polling in by-elections is risky business. It becomes even riskier when word that the OPP believes the Liberals did something under-handed to try to get Olivier out of the race drops on election day.

It is impossible to know the effect that news might have had on the outcome. Many voters may not have heard the news when they cast a ballot - certainly those who voted in the advanced polls, and potentially most of the voters who cast a ballot on election day itself (not everyone checks the news as frequently as you or I may). And maybe even the news wouldn't have had much of an effect, merely confirming what people were already thinking. In the end, the OPP appears to be looking at some individuals within the Liberal Party, not Glenn Thibeault. Voters may have compartmentalized the two - something they probably would not have been able to do if Thibeault wasn't already a known quantity.

So that is one thing to keep in mind when looking at how the polls performed. Another thing to keep in mind is the effect of the polls themselves. All of the polls over-estimated Olivier's support. Might voters who were aware of the polls have decided to cast a ballot for one of the two front runners, rather than the all-but-guaranteed third place finisher? Lastly, even the most recent polls were out of the field on Monday, three days before election day in a topsy-turvy campaign. So, some mitigating factors.

Nevertheless, none of the three final polls published in the last stages of the campaign did particularly well. But two of the three did correctly identify the winner.

Mainstreet Technologies had the smallest amount of error, totaling 14.1 points for the five major candidates (or 2.8 per party). Mainstreet had the gap at five points, close to the 6.3-point gap that actually occurred. But the results for Thibeault, Olivier, and Peroni were all outside the margin of error for the sample of decided voters (and taking into account the estimated support of the each candidate). However, the story Mainstreet's poll told was closest to the truth.

Forum Research's poll had only a little more absolute error, but the story it told was false. Two of Forum's three polls throughout the campaign had Shawbonquit ahead of Thibeault, including the last one.

Total error for Forum was 17.3 points, or 3.5 points per party. Again, though, Thibeault's result was outside the margin of error, as was Peroni's and Robinson's. Forum was the only pollster to get Olivier's support within the margin of error.

Oraclepoll Research had the largest degree of total error at 20.1 points (or four points per party). But it has to be rated ahead of Forum for not having pushed the narrative of a very, very close race that the NDP had better than even odds to win. Oraclepoll always had Thibeault ahead, and he ended up winning.

Oraclepoll was the only firm to get Thibeault's score within the margin of error, as well as Peroni's. But the results for Shawbonquit were well off the mark, as were Olivier's. Note, however, that Oraclepoll was out of the field the earliest of the three. It finished polling on Saturday.

So, not exactly a terrific performance by any pollster. At the same time, however, the polls were far better than what we have seen in some other by-elections. Mainstreet and Oraclepoll both said Thibeault would win, and he did. Forum said the race would be close, and it wasn't a landslide. I think, considering the drama of the campaign and the amount of time between the final polls and the results, we can give the polls a passing grade.

Wednesday, February 4, 2015

Conservatives and Liberals effectively tied

Two new polls, both showing the Conservatives and Liberals only one point apart (and to the advantage of the Tories), have nudged the vote projection into a virtual tie. That means the Conservative seat lead, which stood at 10 on Jan. 13, has now increased to 17. Nevertheless, the Conservatives are no closer to majority territory, and in fact still overlap a great deal with the Liberals.

The Liberals are still narrowly ahead in the aggregate, with 33.4% support to 33.2% for the Conservatives. That is a small drop of 0.3 points for the Liberals since the last update, and a gain of 0.8 for the Conservatives. The New Democrats are up 0.7 points to 21.3%.

In terms of seats, the Conservatives still lead with 139 (up three), or a range of between 122 and 155. Interestingly, the high range for the Tories has not moved at all. Instead, only the lower range has increased, from 117. It means the odds that the Conservatives would win fewer seats than the Liberals on current polling levels have lessened, but the Tories are no closer to the magic number of 170.

The Liberals have dropped four seats and their high range has fallen from 144 to 138. Their low range of 107 seats, however, is steady.

The NDP is up two seats to 74, but its low and high ranges have narrowed from 54 to 87 seats on Jan. 13 to 60 to 84 seats now.

The Bloc's high range has slipped from nine to four seats.

Let's take a look at the two new polls added to the model.

The poll by Forum, published in the Toronto Star on the weekend, put the Conservatives up two points (since Forum's last poll of Jan. 5-6) to 35% and the Liberals down three points to 34%.

The NDP was unchanged at 20%, while the Greens and Bloc were each up one point to 6% and 5%, respectively.

None of these shifts were outside the margin of error.

Abacus showed similar stability, with the Conservatives and Liberals each down one point to 33% and 32%, respectively, since Abacus's last poll of Dec. 18-20. The NDP was up two points to 24%, while the Greens were down one to 5% and the Bloc was unchanged at 4%.

All of these shifts were also within the margin of error (of a probabilistic sample of similar size), but it is clear from both Forum's and Abacus's trend lines that the Liberals are drooping to the benefit of the Conservatives (if not in absolute terms, at least in relative terms).

This is also the first time since Justin Trudeau became Liberal leader that two consecutive polls by two different pollsters have shown a Conservative edge.

Forum does have a regional oddity in its numbers, though. In Quebec, Forum gave the Conservatives 26% support, putting them in second place ahead of the NDP (25%) and behind the Liberals (27%). That is absurdly high for the Conservatives (you need to go back to before the 2008 election to find the Conservatives routinely polling at that level), but Forum has often had higher numbers than usual for the Conservatives in Quebec. And broadly speaking, the Tories have been experiencing an uptick in the province, so perhaps this is a product of that.

Both Forum and Abacus showed a close race in Ontario, the Conservatives ahead in B.C., Alberta, and the Prairies, and the Liberals in front in Atlantic Canada. Quebec was the bone of contention.

The projection model is showing some interesting regional fluctuations as well. In British Columbia, the Liberals have now fallen to second place, though they are unchanged at 31%. The Conservatives are up 3.1 points to 31% as well, and are narrowly ahead of the Liberals. Their seat range has improved from 13-18 to 15-22. The NDP has dropped by 2.2 points to 24%, and their range from 10-13 to 6-11.

The Liberals are sliding in the Prairies. They are now at 29%, and have been consistently dropping since mid-December, when they were at 34%. The NDP has benefited, improving from 17% in mid-December to 23% now.

Vote projection in Quebec
In Quebec, the Liberals dropped 1.2 points (and from 20-30 seats to 19-26 seats) to 28%, putting them narrowly behind the NDP, which was up 1.6 points to 28% (and from 29-47 seats to 34-46). The Liberals have been sliding here as well, having had 34% support in mid-October.

But it is the Conservatives who have taken advantage, up from 13% in early November to 20% now. They have pushed the Bloc into fourth place, and are now estimated to be in play in 11-16 seats.

A couple regions to keep an eye on, then. Overall, things remain quite close. The Conservatives are inching up in the national tally, but have actually dropped a little in Ontario. That is what is keeping them from pulling ahead more decisively in the seat projection.