Testing What Matters (If You Must Test at All): A Context‐Driven Approach to Substantive and Statistical Significance

For over a half century, various fields in the behavioral and social sciences have debated the appropriateness of null hypothesis significance testing (NHST) in the presentation and assessment of research results. A long list of criticisms has fueled the so‐called significance testing controversy. The conventional NHST framework encourages researchers to devote excessive attention to statistical significance while underemphasizing practical (e.g., scientific, substantive, social, political) significance. I introduce a simple, intuitive approach that grounds testing in subject‐area expertise, balancing the dual concerns of detectability and importance. The proposed practical and statistical significance test allows the social scientist to test for real‐world significance, taking into account both sampling error and an assessment of what parameter values should be deemed interesting, given theory. The matter of what constitutes practical significance is left in the hands of the researchers themselves, to be debated as a natural component of inference and interpretation.     

States of Environmental Justice: Redistributive Politics across the United States, 1993–2004

In the 20 years since a president committed federal government agencies to achieving environmental justice (EJ), states have been at the forefront of policy development. But states have varied in the nature and extent of their EJ efforts. We use Guttman Scaling to measure state EJ effort and test hypotheses regarding the relative importance of problem severity, politics, and administrative variables to variation in state policy development. Our analysis offers a novel characterization of state policy intensity and demonstrates its scalability. Income‐based problem severity, environmental group membership, and nonwhite populations were important predictors of state EJ policy intensity during our study period. The political geography of EJ policy also displayed a distinctive southern pattern and the EJ policy intensity model contrasted significantly with a model of environmental policy innovation. The findings suggest that state EJ politics are more indicative of redistributive policy than regulatory.