Procedural justice and police legitimacy: a systematic review of the research evidence

Objectives

We undertook a systematic review and meta-analysis to synthesize the published and unpublished empirical evidence on the impact of police-led interventions that use procedurally just dialogue focused on improving citizen perceptions of police legitimacy.

Methods

The systematic search included any public police intervention where there was a statement that the intervention involved police dialogue with citizens that either was aimed explicitly at improving police legitimacy, or used at least one core ingredient of procedural justice dialogue: police encouraging citizen participation, remaining neutral in their decision making, conveying trustworthy motives, or demonstrating dignity and respect throughout interactions. The studies included in our meta-analyses also had to include at least one direct outcome that measured legitimacy or procedural justice, or one outcome that is common in the legitimacy extant literature: citizen compliance, cooperation, confidence or satisfaction with police. We conducted separate meta-analyses, using random effects models, for each outcome.

Results

For every single one of our outcome measures, the effect of legitimacy policing was in a positive direction, and, for all but the legitimacy outcome, statistically significant. Notwithstanding the variability in the mode in which legitimacy policing is delivered (i.e., the study intervention) and the complexities around measurement of legitimacy outcomes, our review shows that the dialogue component of front-line police-led interventions is an important vehicle for promoting citizen satisfaction, confidence, compliance and cooperation with the police, and for enhancing perceptions of procedural justice.

Conclusions

In practical terms, our research shows the benefits of police using dialogue that adopts at least one of the principles of procedural justice as a component part of any type of police intervention, whether as part of routine police activity or as part of a defined police crime control program. Our review provides evidence that legitimacy policing is an important precursor for improving the capacity of policing to prevent and control crime.     

Is the Effect of Procedural Justice on Police Legitimacy Invariant? Testing the Generality of Procedural Justice and Competing Antecedents of Legitimacy

Objectives

This study tests the generality of Tyler’s process-based model of policing by examining whether the effect of procedural justice and competing variables (i.e., distributive justice and police effectiveness) on police legitimacy evaluations operate in the same manner across individual and situational differences.

Methods

Data from a random sample of mail survey respondents are used to test the “invariance thesis” (N = 1681). Multiplicative interaction effects between the key antecedents of legitimacy (measured separately for obligation to obey and trust in the police) and various demographic categories, prior experiences, and perceived neighborhood conditions are estimated in a series of multivariate regression equations.

Results

The effect of procedural justice on police legitimacy is largely invariant. However, regression and marginal results show that procedural justice has a larger effect on trust in law enforcement among people with prior victimization experience compared to their counterparts. Additionally, the distributive justice effect on trust in the police is more pronounced for people who have greater fear of crime and perceive higher levels of disorder in their neighborhood.

Conclusion

The results suggest that Tyler’s process-based model is a “general” theory of individual police legitimacy evaluations. The police can enhance their legitimacy by ensuring procedural fairness during citizen interactions. The role of procedural justice also appears to be particularly important when the police interact with crime victims.

     

Promoting a culture of fairness: police training,procedural justice,and compliance

Objectives

Academics and practitioners alike are concerned about the potential “double-edged sword” of procedural justice. In the organizational context, procedural justice is expected to increase compliance with supervisors. However, blind, unthinking, or “hard” compliance with supervisors, may lead to anti-organizational behavior and misconduct. The present study examines the moderating effect of a police recruit cultural training program on the relationship between procedural justice and compliance with police supervisors. We expect that providing cultural training will moderate the relationship between procedural justice and “hard” compliance.

Methods

Participants were police recruits at the Queensland Police Academy who were randomly assigned to an experimental (Voice 4 Values) or control condition (business-as-usual training) upon entry into the academy. Recruits in both groups were surveyed pre- and post- training to capture perceptions of procedural justice and compliance with supervisors.

Results

Results suggest that procedural justice mattered less for predicting “hard” or unthinking compliance among the recruits who received the Voice 4 Values cultural training package, compared to those who did not receive the training.

Conclusions

We conclude that while procedural justice may be of interest to policing organizations, it is important that it is not used as a tool to encourage unthinking compliance. We find cultural training reduces the effect of procedural justice on unthinking or “hard” compliance.

     

The Effect of Incarceration on Re-Offending: Evidence from a Natural Experiment in Pennsylvania

Objectives

This paper uses a sample of convicted offenders from Pennsylvania to estimate the effect of incarceration on post-release criminality.

Methods

To do so, we capitalize on a feature of the criminal justice system in Pennsylvania—the county-level randomization of cases to judges. We begin by identifying five counties in which there is substantial variation across judges in the uses of incarceration, but no evidence indicating that the randomization process had failed. The estimated effect of incarceration on rearrest is based on comparison of the rearrest rates of the caseloads of judges with different proclivities for the use of incarceration.

Results

Using judge as an instrumental variable, we estimate a series of confidence intervals for the effect of incarceration on one year, two year, five year, and ten year rearrest rates.

Conclusions

On the whole, there is little evidence in our data that incarceration impacts rearrest.     

Defending and managing the pipeline: lessons for running a randomized experiment in a correctional institution

Objectives

To discuss the challenges faced in an experimental prisoner reentry evaluation with regard to managing the pipeline of eligible cases.

Methods

This paper uses a case study approach, coupled with a review of the relevant literature on issues of case flow in experimental studies in criminal justice settings. Included are recommendations for researchers on the management of case flow, reflections on the major research design issues encountered, and a listing of dilemmas that are likely to plague experimental evaluations of prisoner reentry programs.

Results

Particularly in a jail setting, anticipating the timing of release of a prisoner to the community is probably impossible given the large number of issues that impact release, many of which will be unanticipated. A detailed pipeline study is critical to the success of an experimental study targeting returning prisoners. Pipeline studies should be conducted under what will be the true conditions and context for enrollment, given all eligibility criteria.

Conclusions

With continued and systematic documentation of enrollment challenges in future experimental evaluations of reentry programs, as well as other experimental evaluations that involve individuals, academics can build a deep literature that would help facilitate future successful randomized experiments in the criminal justice field.     

Challenging the ‘invariance’ thesis: procedural justice policing and the moderating influence of trust on citizens’ obligation to obey police

Objectives

This paper examines the effects of a procedural justice policing intervention on citizens’ feelings of obligation to obey police. It examines whether the efficacy of procedural justice on citizens’ obligation to obey police may be contingent on citizens’ level of trust in police during a police–citizen encounter.

Methods

This research draws on survey data from the Queensland Community Engagement Trial (QCET). QCET was a randomized controlled field trial implemented by the Queensland Police Service. The trial exposed citizens to either a procedural justice experience (experimental condition) or standard police practice (control condition) during a random roadside stop. Survey responses were received from 1107 drivers in the experimental condition and 1655 drivers in the control condition.

Results

Compared to the control condition, the procedural justice condition yielded higher levels of trust in the police officer conducting the roadside stop. No differences in obligation to obey police were observed between the two conditions. Importantly, citizens’ level of trust in the officer moderated the effect of the intervention on obligation to obey police. Specifically, the procedural justice condition had a negative effect on obligation to obey for those reporting low trust in police. For those high in trust, the procedural justice intervention had a slight but insignificant positive effect on obligation to obey.

Conclusions

The findings suggest that procedural justice effects can vary between individuals; specifically, the findings reveal that procedural justice interventions can sometimes be counter-productive, depending on the level of trust a citizen exhibits toward police during an encounter. Police agencies should therefore be aware of potential counter-productive effects when implementing procedural justice in the field.

     

Procedural justice, routine encounters and citizen perceptions of police: main findings from the Queensland Community Engagement Trial (QCET)

Objectives

To test, under randomized field trial conditions, the impact of police using the principles of procedural justice during routine encounters with citizens on attitudes towards drink-driving, perceptions of compliance, and their satisfaction with the police.

Methods

We conducted the first randomized field trial??the ??Queensland Community Engagement Trial?? (QCET)??to test the impact of police engaging with citizens by operationalizing the key ingredients of procedural justice (neutrality, citizen participation, respect, and trustworthy motives) in a short, high-volume police?Ccitizen encounter. We randomly allocated 60 roadside Random Breath Testing (RBT) operations to control (business-as-usual) and experimental (procedural justice) conditions. Driver surveys were used to measure the key outcomes: attitudes towards drinking and driving, satisfaction with police and perceptions of compliance.

Results

Citizen perceptions of the encounter revealed that the experimental treatment was delivered as planned. We also found significant differences between the experimental and control groups on all key outcome measures: drivers who received the experimental RBT encounter were 1.24 times more likely to report that their views on drinking and driving had changed than the control group; experimental respondents reported small but higher levels of compliance (d?=?.07) and satisfaction (d?=?.18) with police during the encounter than did their control group counterparts.

Conclusions

Our results show that the way citizens perceive the police can be influenced by the way in which police interact with citizens during routine encounters, and demonstrate the positive benefits of police using the principles of procedural justice. Our study was limited by the use of paper-only surveys and low response rate. We also recognize that the experiment setting (RBT road blocks) is limiting and non-reflective of the wider set of routine police?Ccitizen encounters. Future research should be undertaken, using experimental methods, to replicate our field operationalization of procedural justice in different types of police?Ccitizen encounters.     

An experimental evaluation of a nationally recognized employment-focused offender reentry program

Objectives

The need for re-entry assistance is widely acknowledged, but specifics about what services actually lead to reduced recidivism are hard to find—at least among rigorous studies. This is a critical issue: at a time when there appears to be unprecedented support for expanding rehabilitative programs for offenders, there is a dearth of rigorously vetted program options from which to choose.

Methods

Collaborating with a nationally known employment-focused reentry program in Southern California, the authors compared employment, housing, and recidivism outcomes of reentering offenders (n?=?217) who were either randomized into the program or simply provided with a list of community resources. This approach was possible because the number of applicants at the time exceeded program capacity. Outcomes were based on self-report interviews conducted 1-year post-randomization and arrest records reflecting a 2-year follow-up period. The follow-up rate for interviews was 87 %.

Results

No significant differences were found for any of the between-group comparisons on any of the major intervention outcomes.

Conclusions

Findings from the study suggest a greater need to apply randomized designs to more carefully evaluate current reentry efforts. Methodological challenges of field experiments are also discussed.     

Examining macro-level impacts on procedural justice and police legitimacy

Purpose

Many studies have lent empirical support to the procedural justice model of police legitimacy; however, there has, as yet, not been widespread consideration of the potential impact of neighborhood- and community-level factors on people's perceptions of procedural justice or police legitimacy. The present study integrates the macro-level policing literature with the psychological-based procedural justice framework to uncover what effects, if any, the sociostructural environment has on procedural justice and police legitimacy.

Methods

Hierarchical linear modeling integrates census and survey data within a single, mid-sized city.

Results

Concentrated disadvantage exerted a marginally-significant impact on procedural justice, and on police legitimacy while controlling for procedural justice. Procedural justice remained the strongest predictor of legitimacy, even when accounting for macro-level characteristics.

Conclusions

The effect of procedural justice on police legitimacy appears to be robust against the deleterious impacts of concentrated disadvantage. This has implications for procedural justice research, theory, and policing.     

Evaluating the relative impact of positive and negative encounters with police: a randomized experiment

Objectives

Examines the influence of positive, negative, and neutral police behavior during traffic stops on citizen perceptions of police.

Methods

Participants were randomly assigned to view a video clip of a simulated traffic stop in which the officer communicates with the driver in a positive (procedurally just), negative (procedurally unjust), or neutral manner. After viewing the video, participants completed a survey about their perceptions of police, including their level of trust in police, obligation to obey police orders, and willingness to cooperate with police.

Results

Observing positive interactions with police enhanced people’s self-reported willingness to cooperate with police, obligation to obey police and the law, and trust and confidence in police, whereas observing negative interactions undermined these outcomes. The effects of these interactions were much stronger for encounter-specific outcomes than for more general outcomes.

Conclusions

The results from this randomized experiment confirm that procedural justice can enhance people’s prosocial attitudes toward police, whereas procedural injustice can undermine these attitudes. While positive (procedurally just) interactions tend to have weaker effects than negative (procedurally unjust) interactions, this study finds little support for the notion that only negative experiences shape people’s views about the police.

     

Teaching procedural justice and communication skills during police–community encounters: Results of a randomized control trial with police recruits

Objectives

To describe and evaluate Chicago’s Quality Interaction Program (QIP) for police recruits. The training focused on procedural justice, interpersonal communication, decision-making, cultural awareness, and stress management during encounters with the public. Attention was given to emotions, empathy, and communication skills.

Methods

The QIP is an underutilized approach to police training that involves engaging recruits through applied case studies, role-playing scenarios, repetitive opportunities for practice, and individualized feedback. The impact of QIP training on 142 officers’ attitudes and behaviors was evaluated in a randomized control trial. Treatment and control groups were assessed through responses to self-reported questionnaires as well as research-coded videos that recorded officers during role-playing scenarios.

Results

The QIP did not change recruits’ attitudes toward procedural justice, nor did it impact their self-reported interpersonal communication skills. However, the program was effective at creating more respectful and reassuring behaviors during role-playing scenarios that were videotaped. The program also improved recruits’ decision-making during a scenario with rebellious youths and reduced officers’ reliance on force and arrest relative to controls.

Conclusion

The QIP initiative was instrumental in moving police training beyond “talking heads” to interactive adult education, while promoting a more sophisticated understanding of human dynamics during police–public encounters. The results, however, were mixed, due in part to a training academy environment that emphasized aggressive policing and officer safety. Thus, reform-minded agencies may need to rethink the totality of the training experience to achieve strong results.

     

Translating research into evidence-based practice in juvenile justice: brand-name programs,meta-analysis,and key issues

Objectives

To investigate the utility of two main approaches for translating research into evidence-based practice in juvenile justice: (a) brand-name programs that are identified by lists of various expert groups and come with implementation and quality assurance packages offered by program developers; and (b) results of large-scale meta-analyses that offer a number of generalized strategies (or generics) for improving existing programs.

Methods

Informed by prospect theory, a first-stage analytic decision-tree model was developed that included three comparable evidence-based programs (two brand names and one generic). Implementation success was a key factor, and analyses were conducted under two conditions.

Results

Under the first condition, where brand-name programs have a large advantage in implementation success over generic programs, it was found that the brand-name programs had the highest expected values. Under the second condition, which considered the role of Lipsey et al.’s (2010) Standardized Program Evaluation Protocol, it was found that all three programs produced highly favorable expected values.

Conclusions

Brand-name programs and meta-analyses represent two rigorous and transparent approaches for advancing evidence-based practice in juvenile justice. State governments should consider the merits of both approaches through a decision-tree model, paying particular attention to implementation success as well as financial costs and benefits derived from rigorous cost–benefit analysis.     

The next generation of court-mandated domestic violence treatment: a comparison study of batterer intervention and restorative justice programs

Objectives

The most common approach to treatment of domestic violence crimes in the United States is the mandated group-based Batterer Intervention Program (BIP). Several alternative treatment approaches have been developed over the years, including a restorative justice-based treatment program for domestic violence offenders called Circles of Peace (CP). This study compared a CP program administered in Arizona with a local BIP program, in controlled settings.

Methods

This study involved a randomized controlled trial with 152 domestic violence cases randomly assigned to either BIP or CP between September 2005 and March 2007. Independent sample t tests were used to measure treatment outcomes post-random assignment, in terms of both domestic violence and non-domestic violence re-arrest rates during four follow-up periods (6, 12, 18, and 24 months).

Results

CP participants experienced less recidivism than BIP during all follow-up comparisons. However, statistically significant differences were detected only for the 6-month (p?<?.1) and the 12-month (p?<?.05) follow-up comparisons for non-domestic violence re-arrests, and no statistically significant differences were detected for the domestic violence re-arrests.

Conclusions

The findings are generally statistically non-significant at .05. While these results do not suggest a change in policy from BIP to CP for domestic violence crimes, it does dispel the popular belief that restorative justice cannot be used to treat domestic violence criminal activity, in that CP does no worse than the traditional batterer intervention program. Given the low statistical power and high attrition rates, more research is necessary to test CP and restorative justice treatment generally in court-mandated domestic violence cases in order to understand the treatment impact on both domestic violence and non-domestic violence offenders.     

Block Randomized Trials at Places: Rethinking the Limitations of Small N Experiments

Objectives

Place-based policing experiments have led to encouraging findings regarding the ability of the police to prevent crime, but sample sizes in many of the key studies in this area are small. Farrington and colleagues argue that experiments with fewer than 50 cases per group are not likely to achieve realistic pre-test balance and have excluded such studies from their influential systematic reviews of experimental research. A related criticism of such studies is that their statistical power under traditional assumptions is also likely to be low. In this paper, we show that block randomization can overcome these design limitations.

Methods

Using data from the Jersey City Drug Market Analysis Experiment (N = 28 per group) we conduct simulations on three key outcome measures. Simulations of simple randomization with 28 and 50 cases per group are compared to simulations of block randomization with 28 cases. We illustrate the statistical modeling benefits of the block randomization approach through examination of sums of squares in GLM models and by estimating minimum detectable effects in a power analysis.

Results

The block randomization simulation is found to produce many fewer significantly unbalanced samples than the naïve randomization approaches both with 28 and 50 cases per group. Block randomization also produced similar or smaller absolute mean differences across the simulations. Illustrations using sums of squares show that error variance in the block randomization model is reduced for each of the three outcomes. Power estimates are comparable or higher using block randomization with 28 cases per group as opposed to naïve randomization with 50 cases per group.

Conclusions

Block randomization provides a solution to the small N problem in place-based experiments that addresses concerns about both equivalence and statistical power. The authors also argue that a 50 case rule should not be applied to block randomized place-based trials for inclusion in key reviews.     

Supervision mode effects in computerized delinquency surveys at school: Finnish replication of a Swiss experiment

Objectives

This study provides a Finnish replication of a recent Swiss experiment (Walser and Killias: J Exp Criminol 8:17–28, 2012) on the supervision mode effects in computerized delinquency surveys in schools. This study supplements the Swiss study by using individual level randomization and two additional outcome variables: meta-questions of response integrity and incidence-counting heuristics.

Methods

A total of 924 ninth grade students (15–16 years old) in southern Finland were randomly assigned (at the level of individuals) to supervision either by their teachers or by an external research assistant. Students then responded to an online self-report delinquency survey. Chi-square and t tests were used to compare prevalence levels and means.

Results

In both last year and lifetime recall periods, only one offence type (unspecified theft) showed significantly different outcomes, with external supervision yielding a higher prevalence figure. For other offences, no supervision effects were found. When females and males were separately examined, limited evidence of gender-specific supervision effects emerged. Thus, females appear to report more thefts in external supervision while males report more violence in teacher supervision. No statistically significant supervision effects were found in questions probing response integrity and counting heuristics.

Conclusion

Using teacher supervision in online self-report delinquency surveys does not appear to compromise the validity of the survey results. The findings thus largely corroborate the results of the earlier Swiss test. How supervision condition interacts with respondent characteristics apart from gender calls for further scrutiny.     

Short-term effects of restorative justice conferences on post-traumatic stress symptoms among robbery and burglary victims: a randomized controlled trial

Objectives

To examine the impact of face-to-face restorative justice conference (RJC) meetings led by police officers between crime victims and their offenders on victims’ post-traumatic stress symptoms.

Methods

Two trials conducted in London randomly assigned burglary or robbery cases with consenting victims and offenders to either a face-to-face restorative justice conference (RJC) in addition to conventional justice treatment or conventional treatment without a RJC. Post-traumatic stress symptoms (PTSS) were measured with the Impact of Event Scale-Revised (IES-R) within 1 month of treatment for 192 victims. We assessed the prevalence and severity of PTSS scores following treatment, using independent sample t tests and chi square statistics. We further measured the magnitude of the differences between the groups, using effect size analyses.

Results

Analyses show that PTSS scores are significantly lower among victims assigned to RJC in addition to criminal justice processing through the courts than to customary criminal justice processing alone. There are overall 49 % fewer victims with clinical levels of PTSS, and possible PTSD (IES-R?≥?25). Main treatment effects are significant (t?=?2.069; p?Conclusions Findings suggest that restorative justice conferences reduce clinical levels of PTSS and possibly PTSD in a short-term follow-up assessment. Future research should include longer follow-up, larger and more stratified samples, and financial data to account for the cost benefit implications of RJ conferences compared to ordinary PTSS treatments.     

Retrieving administrative data to assess long-term outcomes: a case study of the 23-year follow-up of the Milwaukee domestic violence experiment

Objectives

To describe how social scientists, criminal justice practitioners, and administrative agencies collected administrative data to follow-up a criminological experiment after two decades. To make recommendations that will guide similar long-term follow-ups.

Methods

A case study approach describes the processes of and sociological benefits to collecting administrative data to assess criminal justice and life-course outcomes.

Results

While maintaining experimental integrity, we developed, executed, and verified processes to retrieve arrest, mortality, and residential data for the experimental subjects, which enabled us to complete the longest ever follow-up of a criminal justice experiment.

Conclusions

When experiments have policy implications, administrative data may be preferable to survey data for assessing primary effects. Successful social science research can be conducted in conjunction with multiple administrative agencies.

     

A long-term follow-up evaluation of the Minnesota High Risk Revocation Reduction reentry program

Objectives

This study examines the effectiveness of the High Risk Revocation Reduction (HRRR) program, a reentry program designed to reduce recidivism among offenders released from Minnesota state prisons.

Methods

Adult male release violators were randomly assigned to a treatment group that received supplemental case planning and access to community service and programs, or to a control group that received standard case management. Survival analysis was used to examine rearrest, reconviction, reincarceration for a new offense, and supervised release revocation.

Results

The results of Cox regression models showed that participation in HRRR significantly reduced the risk of rearrest but had no effect on the other measures of recidivism.

Conclusion

The results provide limited support for the program, although its effectiveness appeared to decline during the second phase of implementation. HRRR also reduced costs; however, the estimated benefits were not robust across all sensitivity analyses.