THE INTERNAL AND EXTERNAL VALIDITY OF THE REGRESSION DISCONTINUITY DESIGN: A META‐ANALYSIS OF 15 WITHIN‐STUDY COMPARISONS

Theory predicts that regression discontinuity (RD) provides valid causal inference at the cutoff score that determines treatment assignment. One purpose of this paper is to test RD's internal validity across 15 studies. Each of them assesses the correspondence between causal estimates from an RD study and a randomized control trial (RCT) when the estimates are made at the same cutoff point where they should not differ asymptotically. However, statistical error, imperfect design implementation, and a plethora of different possible analysis options, mean that they might nonetheless differ. We test whether they do, assuming that the bias potential is greater with RDs than RCTs. A second purpose of this paper is to investigate the external validity of RD by exploring how the size of the bias estimates varies across the 15 studies, for they differ in their settings, interventions, analyses, and implementation details. Both Bayesian and frequentist meta‐analysis methods show that the RD bias is below 0.01 standard deviations on average, indicating RD's high internal validity. When the study‐specific estimates are shrunken to capitalize on the information the other studies provide, all the RD causal estimates fall within 0.07 standard deviations of their RCT counterparts, now indicating high external validity. With unshrunken estimates, the mean RD bias is still essentially zero, but the distribution of RD bias estimates is less tight, especially with smaller samples and when parametric RD analyses are used.     

“An Inherited Money Dude from Queens County”: How Unseen Candidate Characteristics Affect Voter Perceptions

Political Behavior - We examine the effect of biographical knowledge on voters’ assessments of leaders. Prior research has shown that voters infer traits from candidate characteristics such...     

Domestic violence and dependency courts: the Greenbook demonstration experience

This field study reports on a cross-site evaluation of dependency courts in communities receiving federal funding to implement the Greenbook initiative, a multisite demonstration for community improvement of coordinated responses to families victimized by domestic violence and child maltreatment. This article focuses on the dependency court, where child maltreatment cases are heard, specifically court participation in collaborative activities and court practice improvements. Findings indicate that perceptions of judicial leadership varied considerably by site. Cross-training appeared to increase over time, particularly with court staff. Collaborative efforts emerged across the Greenbook initiative with regard to the courts, and some innovative practices appeared within Greenbook sites, such as separate case plans for perpetrators and victims of violence in families, reducing the likelihood of controversial failure to protect charges. Results also highlight challenges inherent in changing court practices. Research and practice implications are discussed, focusing on relevance to other communities attempting to work collaboratively with the court system.     

Generating a Corpus of Mobile Forensic Images for Masquerading user Experimentation

The Periodic Mobile Forensics (PMF) system investigates user behavior on mobile devices. It applies forensic techniques to an enterprise mobile infrastructure, utilizing an on‐device agent named TractorBeam. The agent collects changed storage locations for later acquisition, reconstruction, and analysis. TractorBeam provides its data to an enterprise infrastructure that consists of a cloud‐based queuing service, relational database, and analytical framework for running forensic processes. During a 3‐month experiment with Purdue University, TractorBeam was utilized in a simulated operational setting across 34 users to evaluate techniques to identify masquerading users (i.e., users other than the intended device user). The research team surmises that all masqueraders are undesirable to an enterprise, even when a masquerader lacks malicious intent. The PMF system reconstructed 821 forensic images, extracted one million audit events, and accurately detected masqueraders. Evaluation revealed that developed methods reduced storage requirements 50‐fold. This paper describes the PMF architecture, performance of TractorBeam throughout the protocol, and results of the masquerading user analysis.     

Learning through foreign market participation: the relative benefits of exporting,importing, and foreign direct investment

A growing literature explores the degree to which firms learn from exporting. Although this literature finds that firms that export subsequently enjoy enhanced innovative performance, there has been little research that compares the effect of exporting to that of alternative internationalization activities. In this paper, we extend the literature to explore theoretically the differential effects of a firm’s exporting, foreign direct investment, and importing activity on its innovative outcomes. We test the resulting hypotheses using a sample of Spanish manufacturing firms from 2000 to 2008. We find that (1) learning associated with exporting is more pronounced than that associated with a firm’s FDI activities, (2) exporting and FDI operate as substitutes in their effect on a firm’s learning, and (3) although importing is positively associated with learning as manifested in new product introductions, it is not associated with learning as manifested in patenting activity.