Pretend It Doesn'T Work: The ‘Anti-Social’ Bias In The Maryland Scientific Methods Scale

The social constructs and methodological principles embodied in the Maryland Scientific Methods Scale (SMS), comprising part of the Campbell Collaboration in Crime and Justice assessment protocol, induce a series of biases in the evaluation of evidence of crime prevention policy interventions that focus on collective social phenomena, such as communities. Applying these principles leads to negative conclusions about effectiveness; yet their inherent ‘anti-social’ bias may induce Type II error with regard to the desirability of ‘social’ interventions to reduce crime. Policy-making is poorly served as a result. This point is illustrated, first, through a scrutiny of the social constructs used, including those that typify treatments, institutional settings and units of analysis. These are seen as being constructed in a way that is congenial to the underlying methodological issue of ‘control’ but that constitute nevertheless a distorted definition of the governance issues involved in crime reduction in community settings. A model more appropriate for evaluating voluntaristic action in civil society is needed. Second, it is suggested that this methodological bias arises particularly in policy interventions and change programmes that address issues concerning the ‘collective efficacy’ of local communities in reducing crime. An empirical exemplification of these arguments is presented with reference to a completed evaluation research study (Foster and Hope, 1993).