An Empirical Validation Study of Popular Survey Methodologies for Sensitive Questions

When studying sensitive issues, including corruption, prejudice, and sexual behavior, researchers have increasingly relied upon indirect questioning techniques to mitigate such known problems of direct survey questions as underreporting and nonresponse. However, there have been surprisingly few empirical validation studies of these indirect techniques because the information required to verify the resulting estimates is often difficult to access. This article reports findings from the first comprehensive validation study of indirect methods. We estimate whether people voted for an anti‐abortion referendum held during the 2011 Mississippi General Election using direct questioning and three popular indirect methods: list experiment, endorsement experiment, and randomized response. We then validate these estimates against the official election outcome. While direct questioning leads to significant underestimation of sensitive votes against the referendum, indirect survey techniques yield estimates much closer to the actual vote count, with endorsement experiment and randomized response yielding the least bias.     

Integrated Administrative Data & Criminal Justice Research

Using integrated administrative data from criminal justice and social service systems can harness information in meaningful ways that transcend traditional “silos” and allow communities to focus collective attention on important social issues that cross systemic boundaries. Despite recent advances in use of integrated administrative data, practical information to promote adoption by new users is lacking. Here we provide an introduction to potential uses of integrated administrative data for criminal justice researchers, including general benefits of using integrated data as well as implications for innovative research design. We describe a case example of data integration through a state data warehouse for a federally funded project on impact of incarceration on families. The project utilizes data from eight agencies (corrections, juvenile justice, mental health, substance use, social services, health, education, and environmental control) and includes development of an Online Analytical Processing cube. We draw from lessons learned to provide specific recommendations for developing researcher-practitioner partnerships that use integrated administrative data to improve translational criminal justice research and evidence-based practice and policy.     

Developing and Validating a New Classroom Climate Observation Assessment Tool

The climate of school classrooms, shaped by a combination of teacher practices and peer processes, is an important determinant for children's psychosocial functioning and is a primary factor affecting bullying and victimization. Given that there are relatively few theoretically-grounded and validated assessment tools designed to measure the social climate of classrooms, our research team developed an observation tool through participatory action research (PAR). This article details how the assessment tool was designed and preliminarily validated in 18 third-, fourth-, and fifth-grade classrooms in a large urban public school district. The goals of this study are to illustrate the feasibility of a PAR paradigm in measurement development, ascertain the psychometric properties of the assessment tool, and determine associations with different indices of classroom levels of relational and physical aggression.     

Does the amount of participation matter? Public comments,agency responses and the time to finalize a regulation

The notice and comment rulemaking process is a fundamental part of how agencies write regulations. While this process is starting to receive more empirical attention, the question of how the number of comments that an agency receives affects its decision-making process has received little examination. This paper uses Boolean analysis to examine nine rules from two agencies at the Department of Health and Human Services and evaluates the impact of a high volume of comments on agency changes to proposed rules and the time an agency takes to finalize a proposed rule. These nine cases suggest that agencies are most likely to change their proposals when they receive a high volume of comments on highly complex rules that are not very politically salient. Highly complex rules are also likely to take a long time to finalize when there are many public comments however it is often other factors that cause a long delay between proposed and final rules.