The Benefits of Experimental Methods for the Study of Campaign Effects

Researchers rely heavily on observational designs to study the effects of political campaigns. In doing so, scholars often overlook serious threats to causal inference that bedevil their research designs. The strategic nature of campaigns leads to serious selection biases in voter exposure to campaign stimuli and, ultimately, generates biased estimates of campaign effects. Standard approaches to establishing causal effects in observational research, such as the collection of panel data and the inclusion of covariates, are often inadequate. In contrast, experimental approaches offer researchers a more promising way to estimate accurately the causal effects of campaigns. In this essay, I discuss the recent renaissance of experimental research in the study of campaigns and illustrate how scholars can use lab, field, and survey experiments to good effect. When experimental methods are not feasible, studies of campaign effects would benefit from paying better attention to the causal identification strategy. In closing, I discuss how the logic of experimentation can be applied to some observational settings.     

Psychophysiology in the Study of Political Communication: An Expository Study of Individual-Level Variation in Negativity Biases

The use of psychophysiological measures has been relatively common in the study of communication; there has been a recent increase in interest among political behavioralists as well. There has nevertheless been a limited body of work that uses psychophysiological measures to better understand the impact of political mass media content. This article presents the case for using psychophysiological measures to study political communication. Focusing on skin conductance, it outlines the advantages of this measure for capturing subconscious responses to media over time, second-to-second. It then presents results from recent experimental work in the United States that highlights individual-level variation in responsiveness to negative versus positive news content—variation that is correlated with measures of psychophysiological reactions to non-news content, suggesting the relevance of deep-seated predispositions in psychophysiological research on media effects.     

Assessing the Influence of Political Parties on Public Opinion: The Challenge from Pretreatment Effects

Despite generations of research, political scientists have trouble pinpointing the influence of political parties on public opinion. Recently, scholars have made headway in exploring whether parties in fact shape policy preferences by relying on experimental designs. Yet, the evidence from this work is mixed. I argue that the typical experiment faces a design problem that likely minimizes the extent to which parties apparently matter. Because parties have policy reputations, experimental participants may already know from real-world exposure to political debate where the parties stand before they are told in the experiment—they are “pretreated.” This study investigates how real-world political context interferes with party cue stimulus in experiments. In two experiments I show that two types of “pretreatment” from outside the experiment—exposure-based and reputation-based—dramatically moderate the effects of party cues in experiments. Moreover, the politically aware participants—who are most likely to have been pretreated before entering the experiment—are the most sensitive to this interference from real-world context. Paradoxically, experimenters are most likely to find no effect of parties at the very time that their influence is strongest outside the experiment. These findings emphasize the importance of keeping real-world context in mind when designing and analyzing experiments on political communication effects and might help reconcile disparate results of previous party cue experiments.     

Steven Chaffee and the Future of Political Communication Research

This article discusses four basic characteristics of Steven Chaffee's research: going beyond the "common research wisdom," careful explication of concepts, avoiding unsubstantiated charges against the media, and investigation of the social aspects of communication. The evolution of political socialization research is used as an example of how these characteristics have strengthened Chaffee's contribution to that area and to the larger field of political communication. It is argued that the future of this field would benefit from emulation of these characteristics. Continuing problems of political communication research are noted, and various emerging problems are discussed.     

Grabbing attention: An experimental investigation of headlines during campaigns

In this article, we review two research programs that could benefit from a more extensive dialogue: media and policy studies of agenda setting. We focus on three key distinctions that divide these two robust research programs: the agenda(s) under investigation (public versus policymaking), the typical level of analysis (individual versus systemic), and framing effects (individual versus macro level). We map out these differences and their impacts on understanding the policy process. There is often a policy disconnect in the agenda-setting studies that emanate from the media tradition. Though interested in the effects of political communication, scholars from this tradition often fail to link the media to policy outcomes, policy change, or agenda change. Policy process scholars have increasingly rejected simple linear models in favor of models emphasizing complex feedback effects. This suggests a different role for the media—one of highlighting attributes in a multifaceted political reality and involvement in positive feedback cycles. Yet, political communication scholars have for the most part been insensitive to these potentials. We advocate a shared agenda centering on the role of the media in the political system from an information processing framework, emphasizing the reciprocal effects of each on the other.     

A Matter of Context: A Comparative Study of Media Environments and News Consumption Gaps in Europe

Research has shown that individual-level characteristics such as socioeconomic status and political interest are becoming more important as predictors of news consumption in a rapidly changing media environment. Despite this general trend, this article argues that the importance of individual-level predictors of news consumption varies between national media environments. We use extensive survey data from 16 European countries and multilevel modeling in order to investigate both contextual-level and cross-level effects on news consumption. The results show that media environment characteristics have additional effects on news consumption beyond the effects of individual-level characteristics such as education and political interest, but also moderating impacts on these individual-level predictors of news consumption. More specifically, national media environments characterized by higher levels of newspaper-centrism are related to smaller gaps in newspaper reading between those with high and low levels of education and political interest. Lower degrees of newspaper-centrism are, on the other hand, related to a weaker “lower-class bias” of television news and larger gaps in news consumption between those with and without high political interest. These findings are discussed in light of previous research on news consumption, knowledge, and participation gaps as well as cross-national comparative research.     

A Pragmatic Guide to Qualitative Historical Analysis in the Study of International Relations

Researchers using qualitative methods, including case studies and comparative case studies, are becoming more self–conscious in enhancing the rigor of their research designs so as to maximize their explanatory leverage with a small number of cases. One aspect of qualitative research that has not received as much attention is the use of primary and secondary source material as data or evidence. This essay explores the potential problems encountered by political scientists as they conduct archival research or rely on secondary source material produced by historians. The essay also suggests guidelines for researchers to minimize the main problems associated with qualitative historical research, namely, investigator bias and unwarranted selectivity in the use of historical source materials. These guidelines should enable advanced undergraduates and graduate students to enhance the quality of their historically minded political science scholarship.     

Intramedia Mediation: The Cumulative and Complementary Effects of News Media Use

This study focuses on one often overlooked political communication-based media effect, intramedia mediation, and the indirect effects that stem from relationships that exist among various forms of media use. Data from a 2000 national Annenberg election panel survey are used to assess a series of relationships between television and newspaper public affairs use and how these forms of media consumption affect citizens' knowledge of presidential campaign endorsements. The indirect effects that stem from the relationships that exist among these two forms of media use reflect the cumulative and complementary functions of mass communication consumption across time. An analysis of intramedia mediation in coordination with the study of the direct effects of public affairs media use on this study's outcome variable produces substantially larger overall effects for both forms of news use. Thus, the study of intramedia mediation contributes to a better understanding of the full range of media influences on a given outcome variable over the course of a political campaign. Ramifications of these findings are outlined and future lines of research summarized.     

Communication for development: alive and kicking!

ABSTRACT

Communication has been a key element in the West's project of developing the Third World. In the one-and-a-half decades after Lerner's influential 1958 study of communication and development in the Middle East, communication researchers assumed that the introduction of media and certain types of educational, political, and economic information into a social system could transform individuals and societies from traditional to modern. Conceived as having fairly direct and powerful effects on Third World audiences, the media were seen as magic multipliers, able to accelerate and magnify the benefits of development.     

A survey of research foci and paradigms in media and communication Master's dissertations and doctoral theses in South Africa

This study set out to evaluate the foci and paradigms of research in media and communication at Master's and doctoral levels in South Africa. A sample of 241 dissertations and theses in the communication, journalism and media studies programmes of nine universities, from 2004 to 2013, categorised into historically black, historically white Afrikaans-medium and English-medium, were obtained from the databases of the National Research Foundation and some of the universities. The findings show that the production of PhD theses is far lower than that of Master's dissertations. Qualitative design tended to be the dominant approach adopted, followed by a mixed methods approach, and the quantitative approach. The focus of most of the theses is journalism, followed by general media studies. The findings further show that historically black universities bottom the table in the production of related theses and dissertations, while white English-speaking universities top the list. Also, there is evidence of a relationship between the historical origin/language of the universities and the research designs adopted, as well as the research focus of the theses. The article recommends, among others, the need for a clear-cut statement of research methodologies and designs in such theses and dissertations, greater motivation for enrolment in PhD programmes, a strengthening of historically black universities for better performance in postgraduate research, and the incorporation of the experimental method in media research in South Africa.     

Bringing the Sociology of Media Back In

In political communication research, news media tend to be studied more as a dependent than independent variable. That is, few studies link structural characteristics of media systems to the production of journalistic discourse about politics. One reason for this relative silence is the inadequacy of prevalent theories. Influential scholars in sociology and political communication such as Jürgen Habermas, Manuel Castells, and William Gamson provide only sketchy, institutionally underspecified accounts of media systems. Likewise, models in the sociology of news have tended to either aggregate societal level influences (chiefly political and economic) that are analytically and often empirically quite distinct or overemphasize micro-level influences (news routines, bureaucratic pressures). In between such micro- and macro-influences, the mezzo-level "journalistic field" represents an important shaping factor heretofore largely ignored. As path-dependent institutional logics, fields help ground cultural analysis; as interorganizational spatial environments varying in their level of concentration, they explain heretofore undertheorized aspects of news production. Drawing on the sociology of news and field theory (Bourdieu and American new institutionalism), this essay offers a series of hypotheses about how variable characteristics of media systems shape news discourse. Since variation at the system level is most clearly seen via cross-national comparative studies, international research is best positioned to build more generalizable theory about the production of journalistically mediated political discourse.     

How can PhD research contribute to the global health research agenda?

We suggest that PhD and post-doctoral researchers are a strong, untapped resource with the potential to make a real contribution to global health research (GHR). However, we raise some ethical, institutional, and funding issues that either discourage new researchers from entering the field or diminish their capacity to contribute. We offer a number of recommendations to Canadian academic and non-academic institutions and funders, aiming to generate discussion among them about how to overcome these constraints. We need changes in the way graduate research is organised and funded, to create opportunities to work collaboratively within established low- and middle-income countries (LMIC)/Canadian research partnerships. We urge changes in the way that institutions fund, recognise, value, and support GHR, so that established researchers are encouraged to develop long-term LMIC relationships and mentor new Canadian/LMIC researchers. We ask funders to reconsider additional GHR activities for support, including strategic training initiatives and dissemination of research results. We also encourage the development of alternative institutions that can provide training and mentoring opportunities. GHR faces many challenges. If we address those that reduce our potential to contribute, we can become real partners in GHR, working towards equitable global health and solutions to priority health issues.     

(Re)Claiming Our Expertise: Parsing Large Text Corpora With Manually Validated and Organic Dictionaries

Content analysis of large-scale textual data sets poses myriad problems, particularly when researchers seek to analyze content that is both theoretically derived and context dependent. In this piece, we detail the approach we developed to tackle the analysis of the context-dependent content of political incivility. After describing our manually validated organic dictionaries approach, we compare the method to others we could have used and then replicate the method in a different—but still context-dependent—project examining political issue content on social media. We conclude by summarizing the strengths and weaknesses of the approach and offering suggestions for future research that can refine and expand the method.     

Diversionary War and Argentina's Invasion of the Falkland Islands

The idea of “least likely” (or “hard”) and “most likely” cases with which to test theories has been addressed in many prominent works on qualitative methodology. Such research designs are especially common among those working in the field of security studies. Nevertheless, there exists considerable confusion regarding how these cases should be defined and how authors can draw sound inferences from them. At worst, such confusion leads to the impression that researchers apply the labels of least and most likely cases in an arbitrary fashion. This article advances two related rationales for categorizing cases as least or most likely, describing the necessary steps researchers should follow to employ them correctly. It incorporates literature from security studies to demonstrate the pitfalls that researchers may be vulnerable to without a precise idea of how least and most likely cases should be used.     

Blogwars,by David D. Perlmutter

Little is known about how elected representatives attempt to manipulate public opinion and news media through their participation on regional open line radio or media straw polls. This article examines the systematic attempts by political actors to engage these media in the small polity of Newfoundland, Canada, where politics is characterized by the hyper-local nature of 590-VOCM radio programming. Our mixed-method study draws from talk radio call-in logs, online straw poll vote results, observation of the production of open line programming, and insights from local media personnel. We draw attention to two clandestine media management techniques. First, we analyze call-ins by elected legislators to talk radio that were timed to coincide with the known field dates of a public opinion polling company. Second, we report that handheld communication devices were used by senior members of the governing party to mobilize legislators and party personnel to repeatedly vote on straw polls on regional media Web sites. Our findings show that there is a substantial and statistically significant increase in the probability that legislators will call talk radio when pollsters are in the field. Furthermore, we document and explore the manner in which political elites mobilize to engage online media straw polls, and discover that straw poll questions which address political topics attract a disproportionately higher number of “votes” than nonpolitical questions. This micro-level study offers perspective for interpreting macro-level knowledge about political talk radio, horse race/game and strategic media frames, and about political elites’ mobilization and media management tactics.     

Survey Research in International Political Economy: Motivations,Designs, Methods

The use of surveys and survey experiments by international political economy scholars is increasing, adding to the ability to study a broad array of topics. In doing so, many scholars in international political economy draw on—and are contributing to—insights and arguments from American politics and comparative politics (Milner 1998), substantive fields with a history of using surveys and survey experiments. In this article, I review motivations for using surveys and survey experiments, the research designs, and analysis strategies in light of this issue’s contributions. I contrast these motivations and their accompanying designs and discuss the pros and cons of ways to approach the data generated by these research designs. The goal of this commentary is to situate surveys and survey experiments—especially those within the special issue—within a larger discussion about research motivations, design, and analysis techniques.     

Partisan Media and Engagement: A Field Experiment in a Newly Liberalized System

How does media exposure affect political engagement in newly liberalized systems? Some celebrate newly vibrant and diverse media, believing that they mobilize citizens. Others worry that these outlets, which are often partisan, dampen engagement. We theorize that exposure to political programming engenders interest in politics irrespective of program bias, but that interest does not necessarily beget action. Partisan media affect participation only when altering attitude strength, and thus motivations. To evaluate media effects on interest and participation, we conducted a field experiment in Ghana, in which subjects in tro-tros (commuter vans) were randomly exposed to different types of live talk radio. We find that partisan and nonpartisan media increased political interest, but not participation. Instead, exposure to alternate perspectives on cross-cutting media (i.e., those biased against subjects’ partisan preferences) heightened ambivalence and dampened participation, measured as signing a petition to parties. Partisan media simultaneously increased interest and decreased participation.     

Escape from the Laboratory: Ethnographic Methods in the Study of Elder and Family Court Mediation

The randomized control trial and pre/post research designs are commonly used in applied research and provide common standards for mediation evaluation research. These approaches have many benefits, particularly for evaluating whether mediation as an experimental intervention works or not. Scholars and practitioners, however, want to know not only whether mediation can work as expected but also how it works in a range of real‐world contexts over time. In these contexts, ideal experimental conditions are less likely to occur. Challenges include such circumstances as the following: the number of cases suitable for statistical comparison is insufficient; researchers lack control over how mediation is implemented; researchers lack clear, objective variables to measure; and the variability of mediation outcomes when studied over time makes it difficult to draw conclusions about them. My research has involved each of these challenges, and I have used ethnographic research as a way to evaluate mediation in these contexts. In this article, I explain ethnographic methods and present two studies as examples of mediation evaluation research that began with a standard program evaluation design, and then incorporated ethnography to allow more complete data collection and analysis. My purpose here is not to argue that experimental methods in mediation evaluation research should be displaced but rather to demonstrate how ethnographic methods can be used when the conditions necessary for standard evaluation cannot be met. The two studies used as examples are from an elder mediation study in Ghana and a family court mediation study in the United States.     

How Political Elites Process Information From the News: The Cognitive Mechanisms Behind Behavioral Political Agenda-Setting Effects

Political agenda-setting studies have shown that political agendas are influenced by the media agenda. Researchers in the field of media and politics are now focusing on the mechanisms underlying this pattern. This article contributes to the literature by focusing not on aggregate, behavioral political attention for issues (e.g., parliamentary questions or legislation), but on Members of Parliament’s (MP) individual, cognitive attention for specific news stories. Drawing upon a survey of Belgian MPs administered shortly after exposure to news stories, the study shows that MPs are highly selective in exploiting media cues. They pay more attention to both prominent and useful news stories, but a story’s usefulness is more important for cognitive processes that are closely linked to MPs’ real behavior in parliament. In other words, aggregate political agenda-setting effects are a consequence of the way in which individual MPs process media information that matches their task-related needs.