The wisdom of crowds design for sensitive survey questions

Survey research on sensitive questions is challenging because respondents often answer untruthfully or completely refuse to answer. Existing indirect questioning techniques address the problem of social desirability bias at the expense of decreasing estimates' efficiency. We suggest the Wisdom of Crowds survey design that does not pose a tradeoff between anonymity and efficiency as an alternative. We outline the conditions necessary for the technique to work and test them empirically. Moreover, we compare the Wisdom of Crowd estimate of a right-wing populist party's vote share to alternative indirect questioning techniques' estimates as well as to the official election result in the 2017 German federal election. Provided its conditions are met, the Wisdom of Crowds design performs best in terms of both bias and efficiency. We conclude that the Wisdom of Crowds design is an important addition to social scientists' survey methodology toolbox.     

Comparing and Combining List and Endorsement Experiments: Evidence from Afghanistan

List and endorsement experiments are becoming increasingly popular among social scientists as indirect survey techniques for sensitive questions. When studying issues such as racial prejudice and support for militant groups, these survey methodologies may improve the validity of measurements by reducing nonresponse and social desirability biases. We develop a statistical test and multivariate regression models for comparing and combining the results from list and endorsement experiments. We demonstrate that when carefully designed and analyzed, the two survey experiments can produce substantively similar empirical findings. Such agreement is shown to be possible even when these experiments are applied to one of the most challenging research environments: contemporary Afghanistan. We find that both experiments uncover similar patterns of support for the International Security Assistance Force (ISAF) among Pashtun respondents. Our findings suggest that multiple measurement strategies can enhance the credibility of empirical conclusions. Open‐source software is available for implementing the proposed methods.     

President Obama on the ballot: Referendum voting and racial spillover in the 2014 midterm elections

The 2014 elections were widely viewed as a referendum on the presidency of Barack Obama. Republicans ran against the incumbent president, and many view the Republican Party's victories in 2014 as a mass rejection of President Obama's policies. We argue that this account of the 2014 elections is incomplete. We advance the theory of racial spillover—that associating an attitude object with President Obama causes public opinion to polarize on the basis of racial attitudes—to explain both vote choice and referendum voting in the 2014 elections. In an analysis of the CCES and an original survey, we show that congressional vote choice was strongly racialized in 2014. We go on to show that perceptions of the election as a referendum on President Obama were also racialized, and that these perceptions mediated the link between racial animus and 2014 congressional vote choice. This represents the first study to show that racialized congressional evaluations continued into 2014 and we provide direct evidence that attitudes about President Obama mediated the effect of racial animus on congressional vote choice. We conclude by discussing the implications for referendum voting, racial spillover, and the 2014 midterm elections.     

Do referendum results change norm perceptions and personal opinions?

Referendums are often seen as a means to legitimize the outcome as the new norm and increase acceptance of the outcome. Do referendums actually have these effects? More precisely, do voters recognize the referendum result as the new norm? And do voters go as far as to change their own minds in accord with the referendum result? We explore these questions using a panel survey that we conducted in Ireland before and after the abortion referendum that was held on May 25, 2018. We find that, after the referendum, voters updated their norm perceptions in the direction of the referendum result. However, we find inconsistent evidence that the referendum convinced voters to change their personal opinions about abortion. The findings provide insights on the power and the limit of referendums in increasing policy agreement among voters.     

Public Attitudes Toward Social Spending in the United States: The Differences Between Direct Spending and Tax Expenditures

This paper uses a survey experiment to examine differences in public attitudes toward ‘direct’ and ‘indirect’ government spending. Federal social welfare spending in the USA has two components: the federal government spends money to directly provide social benefits to citizens, and also indirectly subsidizes the private provision of social benefits through tax expenditures. Though benefits provided through tax expenditures are considered spending for budgetary purposes, they differ from direct spending in several ways: in the mechanisms through which benefits are delivered to citizens, in how they distribute wealth across the income spectrum, and in the visibility of their policy consequences to the mass public. We develop and test a model explaining how these differences will affect public attitudes toward spending conducted through direct and indirect means. We find that support for otherwise identical social programs is generally higher when such programs are portrayed as being delivered through tax expenditures than when they are portrayed as being delivered by direct spending. In addition, support for tax expenditure programs which redistribute wealth upward drops when citizens are provided information about the redistributive effects. Both of these results are conditioned by partisanship, with the opinions of Republicans more sensitive to the mechanism through which benefits are delivered, and the opinions of Democrats more sensitive to information about their redistributive effects.     

Testing the Mill hypothesis of fiscal illusion

According to the “Mill hypothesis”, the tax burden from indirect taxation is underestimated because indirect taxes are less “visible” than direct taxes. We experimentally test the Mill hypothesis and identify tax framing as a cause of fiscal illusion. We find that the tax burden associated with an indirect tax is underestimated, whereas this is not the case with an equivalent direct tax. In a referendum to tax and redistribute tax revenue, fiscal illusion is found to distort democratic decisions and to result in “excessive” redistribution. Yet, voters eventually learn to overcome fiscal illusion.     

Beyond for or against? Multi-option alternatives to a corrective referendum

Referendums commonly offer a binary choice between supporting and rejecting proposed legislation. Binary designs benefit from simplicity and guarantee a majority result, but also provoke voting biases and interpretation challenges. Referendum designs offering multiple policy alternatives provide a different approach which could alleviate binary referendum challenges whilst maintaining the aggregative benefits. Offering more than two options, however, raises new challenges in designing the referendum process and obtaining majority results. This article uses survey data collected on a corrective referendum held in the Netherlands in 2018 to compare the challenges faced by binary and multi-option referendum designs respectively. The analysis demonstrates how the multi-option design empowers voters in expressing their preferences and delivers more detailed and constructive referendum results. Building on the survey data, the article subsequently discusses the challenges of extending choice and concludes that alternative voting methods can mitigate some of these challenges.     

Electoral and structural losers and support for a national referendum in the U.S.

The U.S. is one of only a few democracies in the world never to hold a national referendum. Recent national surveys reveal that a majority of respondents approve of a national referendum both cross-nationally and in America is relatively stable. Building on previous work (Bowler and Donovan, 2007), we find public opinion on a reform proposal is fluid and responsive to electoral politics, rather than stable as reported in earlier work. In this paper, we argue that contemporary support for a national referendum in the U.S. is contingent on whether a citizen is a short- or long-term “winner” or a “loser” when it comes to electoral politics. We expect that public support for a national referendum in the U.S., where legislation referred by Congress would be subject to a popular vote, may vary at the individual level because of short-term electoral fortunes as well as long-term structural conditions. Strategic voting as well as losing in candidate races and policy issues may be important, but so might be partisanship, with non-partisans the most likely to benefit from citizen law-making at the national level. Support for a national referendum might also be contingent upon state context, that is, upon use of direct democracy in the state where a person lives, as well as the population of a state. The results based on a natural experiment and 2008 panel survey data provide an important window into understanding public opinion on institutional change more broadly.     

Die „Sonntagsfrage“, soziale Erwünschtheit und die AfD: Wie alternative Messmethoden der Politikwissenschaft weiterhelfen können

In Germany, the standard vote intention survey item has come under attack because it failed to correctly measure the vote share of the German party “Alternative für Deutschland” (AfD). We argue that alternative measurement techniques that aim to reduce social desirability bias are better suited for this task. We test three measurement techniques to forecast AfD vote share—a double list experiment, the crosswise-model randomized response technique, and the wisdom of crowds design—and compare their performance to the standard vote intention item. Our results indicate that the wisdom of crowds design is an easily implementable and promising addition to political scientists’ toolbox of survey items.     

Risk Attitudes and Independence Vote Choice

In this article, we examine the impact of risk attitudes on vote choice in the context of a salient referendum with high levels of uncertainty about the consequences of the ballot proposal. Using data from a pre- and post-referendum panel survey conducted in the context of the 2014 independence referendum in Scotland, and a specific battery to measure attitudes to risk, we determine how these attitudes operate in such political contexts. We reach two main conclusions. First, risk attitudes have a direct effect on vote choice, even after controlling for alternative explanations of vote choice such as party identification and leaders’ evaluations. In the aggregate, the effect of risk attitudes on the vote choice contributes to the status quo bias found in referendums. Second, we find that information moderates the effect of risk attitudes on vote choice. Voters who are politically knowledgeable have a greater capacity to predict the consequences of political outcomes and, therefore, they are less affected by their risk attitudes when making their ballot choices.

     

The Effect of Information on Voter Turnout: Evidence from a Natural Experiment

Do better‐informed people vote more? Recent formal theories of voter turnout emphasize a positive effect of being informed on the propensity to vote, but the possibility of endogenous information acquisition makes estimation of causal effects difficult. I estimate the causal effects of being informed on voter turnout using unique data from a natural experiment Copenhagen referendum on decentralization. Four of fifteen districts carried out a pilot project, exogenously making pilot city district voters more informed about the effects of decentralization. Empirical estimates based on survey data confirm a sizeable and statistically significant causal effect of being informed on the propensity to vote.     

Public Support for Referendums: The Role of the Media

Previous research is unclear about which citizens support the use of referendums and how a referendum campaign can affect support for direct democracy. This study investigates, first, the factors that determine support for referendums and, second, the role of the campaign in changing support. This is done in the context of the 2005 Dutch EU Constitution referendum. A media content analysis of national media (N = 6,370) is combined with panel survey data (N = 1,008). The results suggest that those who felt more politically disaffected were more supportive of referendums. Furthermore, higher levels of exposure to tabloid style campaign news led to increased approval of referendums. In a second step, the mechanism behind this effect was tested using an experiment (N = 580). When exposed to negative tabloid style news about a referendum proposal, opponents perceive the assumed consequences as more of a threat. This threat perception increased their support for a referendum on the issue at stake as a means to prevent the proposal. The article concludes with a discussion about the conditions under which a dynamic like this is likely to unfold and when alternative explanations for referendum support apply.     

Violence,voting & peace: Explaining public support for the peace referendum in Colombia

How does political violence affect popular support for peace? We answer this question by examining Colombia, where in 2016 the people narrowly and unexpectedly voted against a peace agreement designed to end a half century of civil war. Building on research on the impact of political violence on elections as well as research on referendum/initiative voting in the United States, we argue that local experiences with violence and the political context will lead to heightened support for peace. We test these expectations using spatial modeling and a municipal-level data on voting in the 2016 Colombian peace referendum, and find that municipal-level support for the referendum increases with greater exposure to violence and increasing support for President Santos. These results are spatially distributed, so that exposure to violence in one municipality is associated with greater support for the peace referendum in that municipality and also in surrounding areas. Our findings have implications not only for Colombia, but for all post-war votes and other contexts in which referenda and elections have major and/or unexpected results.     

Areal interpolation and the UK's referendum on EU membership

I show how results from the United Kingdom's referendum on membership of the European Union can be remapped from local authority level to parliamentary constituency level through the use of a scaled Poisson regression model which incorporates demographic information from lower level geographies. I use these estimates to show how the geographic distribution of signatures to a petition for a second referendum was strongly associated with how constituencies voted in the actual referendum.     

‘You Can't Always Get What You Want’: The effects of winning and losing in a referendum on citizens' referendum support

In Western democracies, many citizens support the use of referendums. However, as referendums create satisfying outcomes for citizens with majority views, they could generate ambivalent feelings among voters for the minority option. Little is known about the effects of winning or losing a referendum for citizens' referendum support. This article analyses multiple-wave survey data from five referendums in Bavaria (Germany), Finland and the Netherlands. The findings show that losers' referendum support decreases in nearly all cases, but there is very limited evidence for an increase of winners' referendum support. Nevertheless, the results clearly indicate a winner-loser gap, suggesting that referendums have relatively more positive effects for winners' than for losers' referendum support. As such, this article extends previous findings of the non-stability of referendum support. As the legitimacy of democratic institutions depends upon losers' consent, these findings have important implications for the democratic potential of referendums.     

Testing the power of arguments in referendums: A Bradley–Terry approach

How can we determine which arguments in a referendum are most persuasive? We show that the Bradley–Terry model has several features that make it well-suited to this task, and thus preferable to other, more conventional approaches. Using a survey experiment conducted during an electoral reform referendum in Ontario, Canada in October 2007, we demonstrate how unstructured and structured Bradley–Terry models can be straightforwardly fitted and interpreted. In doing so, we gain insight into the factors which determine support for electoral reform. We identify a status quo bias and find that power varies with mention of fairness, local control over candidate selection, and the role of political parties. We conclude by discussing the limits, extensions and further applications of such models in electoral studies and political science more broadly.     

Do populist values or civic values drive support for referendums in Europe?

Representative democracy gives voters the right to influence who governs but its influence on policy making is only indirect. Free and fair referendums give voters the right to decide a policy directly. Elected representatives usually oppose referendums as redundant at best and as undermining their authority at worst. Democratic theorists tend to take electing representatives as normal and as normatively superior. The nominal association of popular decision making and populism has strengthened this negative view. Public opinion surveys show substantial support for holding referendums on important issues. Two major theories offer contrasting explanations for popular support for referendums; they reflect populist values or a commitment to the civic value of participation. This innovative paper tests an integrated model of both theories by the empirical analysis of a 17-country European survey. There is substantial support for all three civic hypotheses: referendum endorsement is positively influenced by attitudes towards participation, democratic ideals and whether elected representatives are perceived as responsive. By contrast, there is no support for populist hypotheses that the socioeconomically weak and excluded favour referendums and minimal support for the effect of extreme ideologies. The conclusion shows that most criticisms of referendums also apply to policy making by elected representatives. While referendums have limits on their use, there is a democratic argument for holding such ballots on major issues to see whether or not a majority of voters endorse the choice of their nominal representatives.     

Exploiting a Rare Communication Shift to Document the Persuasive Power of the News Media

Using panel data and matching techniques, we exploit a rare change in communication flows—the endorsement switch to the Labour Party by several prominent British newspapers before the 1997 United Kingdom general election—to study the persuasive power of the news media. These unusual endorsement switches provide an opportunity to test for news media persuasion while avoiding methodological pitfalls that have plagued previous studies. By comparing readers of newspapers that switched endorsements to similar individuals who did not read these newspapers, we estimate that these papers persuaded a considerable share of their readers to vote for Labour. Depending on the statistical approach, the point estimates vary from about 10% to as high as 25% of readers. These findings provide rare evidence that the news media exert a powerful influence on mass political behavior.     

Politicians,voters and democracy: The 2011 UK referendum on the Alternative Vote

At the 2010 UK election, Labour proposed a referendum on changing the House of Commons electoral system from single member plurality to the Alternative Vote. Subsequently, a coalition was formed between the Conservatives and the Liberal Democrats, yet it was Labour's policy on electoral reform that was implemented. The paper explains why this proved to be politically convenient for Labour's opponents. At the same time, however, holding the referendum reflected an emergent de facto convention that significant constitutional change should only be introduced after it has secured popular endorsement. The paper assesses whether the dynamics of public opinion during the AV referendum suggests that voters' eventual decisions about constitutional questions reflect their views about the merits of the relevant arguments.     

Culture,Institutions and Campaign Effects: Explaining the Outcome of Malta's EU Accession Referendum

This survey examines the background to and the campaign preceding Malta's EU accession referendum. The result of the referendum, which was held on 8 March 2003, and which was the first of the EU accession referendums of 2003, was a 53.65% vote in support of membership, on a turnout of close to 91%. Explaining both the relatively low support for EU accession and the high turnout on referendum day involves weighing up the relative impact of distinctive features of Malta's political culture and institutional framework against more immediate campaign effects. While the conclusion is that the high turnout in the Maltese EU accession referendum can be traced to Malta's political culture, the relatively low but positive vote in favour of membership can only be fully understood by focusing on a range of factors, including campaign-related factors, such as the credibility of the arguments presented by the ‘yes’ and ‘no’ camps and the balance of resources available. The most important factor explaining the result of the Maltese referendum are, however, the cues provided by the political parties prior to and over the course of the referendum campaign.