Predictive validity of the dynamic risk assessment and management system in individuals with intellectual disability residing in the community

Background. The Dynamic Risk Assessment and Management System (DRAMS) was created to measure dynamic risk in individuals with intellectual disabilities (ID). Steptoe, Lindsay, Murphy, and Young, (2008) examined the construct validity, reliability and predictive validity of the dynamic risk assessment and management system (DRAMS) in offenders with intellectual disability and found that the total DRAMS score and sections on mood, antisocial behaviour and intolerance/agreeableness predicted incidents with a medium effect size for offenders with ID residing in high secure settings.     

Challenges for the theory and application of dynamic risk factors

ABSTRACT

The inclusion of dynamic factors in risk assessment measures used with forensic populations has largely been considered an improvement in both the accuracy and utility of these assessments in informing treatment and sentencing. However, there are important challenges associated with the current approach to the conceptualisation, identification, and use of dynamic factors in risk assessment. Whereas some of these challenges relate to applied settings (such as the use of measures with different offender populations), there are also deeper questions regarding the construct validity of dynamic risk measures and the methodological strategies used to identify them. More emphasis on theoretically driven research is needed, to identify causal and explanatory relationships between dynamic risk factors and recidivism. We hope that highlighting these challenges can help to build a consensus on a future research agenda for dynamic risk factors.     

Assessing reliability, validity, and clinical utility of the BEST-Index in measuring living skills among forensic inpatients

The assessment of behavioral change as a result of inpatient treatment in forensic psychiatry is an important precondition for violence risk prediction in forensic psychiatry. In relation to a multitude of diagnostically based risk assessment instruments, there is a shortage of appropriate instruments with which to carry out valid and reliable therapeutic assessments that are behaviorally based and therefore appropriate for use within varied psychiatric contexts. There is also a need for instruments which will offer assessors the opportunity to examine possible relationships between criteria of social risk and criteria of more general aspects of social functioning. Tapping the issues pointed out above, the authors present an overview of a normatively based social profiling instrument (the BEST-Index), and discuss evidence for its validity, reliability, and aspects of clinical utility.     

Incremental validity of ambulatory assessment of acute dynamic risk in predicting time to recidivism among prisoners on parole

ABSTRACT

This study investigates the incremental validity of changes in ten stress-related acute dynamic risk factors, collected through automated telephony over 30 consecutive days following parole, for predicting time to recidivism during the following year. Before release, the participants completed self-report assessment of some stable risk factors – impulsiveness and history of problematic substance use – as well as an assessment of symptoms of anxiety experienced during the weeks prior to release. Analysis of the baseline assessments showed that impulsiveness and a history of problematic substance use, but not pre-release symptoms of anxiety, were associated with recidivism during the parole year. Growth modelling using a linear mixed model was used to assess whether inmates on parole showed changes in acute dynamic risk factors during the first month following release. Individual growth model slopes and intercept were then extracted and used as covariates in a series of Cox regression analyses to test whether changes in acute dynamic risk factors could provide incremental predictive validity beyond baseline stable risk factors. Changes in five dynamic risk factors were associated with an increased risk of recidivism, of which daily drug use and daily summary score showed incremental predictive improvement beyond impulsiveness and history of problematic drug use.     

Beyond static and dynamic risk factors: the incremental validity of release planning for predicting sex offender recidivism

Both desistance research and strengths-based approaches to offender rehabilitation suggest that attempts to reduce sex offender recidivism should attend to an offender's release environment. Recent research has demonstrated that better quality release planning is associated with reduced recidivism; however, whether release planning contributes significant incremental validity in predicting recidivism over and above static and dynamic risk factors is unclear. In the present study, release planning was retrospectively assessed for a sample of child molesters (n = 196) who had been released into the community following completion of a prison-based treatment program and its relative contribution to recidivism risk prediction was investigated. The average follow-up period was 11.08 years, during which 13.3% of the sample were convicted of a new sexual offence. Hierarchical Cox regression analyses showed that release planning contributed additional predictive validity for sexual recidivism after controlling for static and dynamic risk factors. Findings suggest that assessment of release planning might improve accuracy of sex offender risk assessments and that improved release planning should contribute to reductions in recidivism.     

Construct validity and internal reliability of the Finnish risk and needs assessment form

Validation of risk and needs assessment instruments used to predict, and reduce, recidivism and misconduct is of ethical, practical and scientific importance. We argue for a focus on variable (i.e. changeable over time) risk factors, and that validation begins with establishing construct validity. The Finnish Risk and Needs Assessment Form, in Finnish Riski- ja tarvearvio (RITA), is a semi-structured interview form adapted from the Offender Assessment System used in England and Wales and consists primarily of variable risk factors. In this study, we examined the construct validity and internal reliability of RITA. The results suggest that the original RITA sections do not provide an adequate statistical model for describing the relationship between scored questions, and we, therefore, offer an improved model. In our proposed model, several scores are influenced by more than one dimension of risk and the dimensions correlate with each other considerably. We suggest that the dimensions that can be measured with RITA are Problems managing economy, Alcohol problems, Resistance to change, Drug abuse and associated behaviour, Aggressiveness and Employment problems. All factors except Drug abuse and associated behaviour had very good internal reliability. We propose this new model to be used in future research with, and in development of, RITA.     

Predictive validity of the Structured Assessment of Violence Risk in Youth (SAVRY) during residential treatment

This prospective study examines the predictive validity of the Dutch version of the Structured Assessment of Violence Risk in Youth (SAVRY) by examining relationships between SAVRY scores and various types of disruptive behavior during residential treatment. The SAVRY, a risk assessment instrument, was coded for 66 male adolescents on the basis of file information and interviews. The adolescents were referred to Rentray, a juvenile correctional and treatment facility, by the Dutch juvenile courts because of severe behavioral problems or serious offenses. Institutional infractions were retrieved from incident registration files, which included acts of physical violence, verbal threat, verbal abuse, and violation of institutional rules. The interrater reliability of the SAVRY scores was good. The predictive validity of the SAVRY for physical violence against persons was excellent (Risk Total: AUC=.80, r =.33; Summery Risk Rating: AUC =.86, r =.48). The SAVRY also had good predictive validity for violence against objects, verbal threats and violations of rules, but not for verbal abuse. Implications for assessment and management of violent behavior among adolescents in residential treatment are discussed.     

Socially desirable responding and psychometric assessment of dynamic risk in sexual offenders against children

Does socially desirable responding (SDR) represent a threat to the validity of dynamic risk assessment in sex offenders’ self-reports? We studied a sample of men (N?=?218) who completed a psychometric assessment battery while enrolled at Kia Marama, a prison-based treatment program for sexual offenders against children. SDR, as measured by the Marlowe-Crowne scale, was elevated compared to non-offender samples, increased from pre- to post-treatment, and was negatively correlated with dynamic risk (rs?=??.30 to ?.40), consistent with previous research. Measures of dynamic risk factors derived from the psychometric battery were correlated with sexual recidivism, but correlations were little changed when variance associated with SDR was removed using a regression procedure [Mills, J. F., &; Kroner, D. G. (2006). Impression management and self-report among violent offenders. Journal of Interpersonal Violence, 21(2), 178–192.]. These results suggest that there is a substantial component of the variance in psychometric self-reports of sexual offenders that is associated with SDR (approximately 10%), but that it does not compromise the predictive or construct validity of dynamic risk measures derived from these reports.     

Exploring the validity of the Level of Service Inventory-Revised with Native American offenders

The use of actuarial risk/need assessment tools is an increasingly important part of the correctional landscape. Actuarial tools ideally will provide a valid, dynamic assessment of an offender's overall risk/need level, and will identify their most prevalent criminogenic needs. What results is typically a number or score that can be used to assign an offender to a risk level that is associated with an assumed likelihood of recidivism. Testing the predictive validity of actuarial risk/need assessment tools is of paramount concern, particularly when they are utilized with new (and under-researched) populations. The current study assessed the predictive validity of the Level of Service Inventory-Revised using a sample of Native American and White offenders in a northern midwestern state. Results showed the instrument to have modest predictive validity utilizing the entire sample of offenders, with varying results for subsequent subgroups.     

The differential predictive validity of the Youth Level of Service/Case Management Inventory: the role of gender

Most criminogenic risk assessments are developed and empirically validated on samples of boys or samples comprised of mostly boys, and subsequently applied to girls. Using a sample of male (n = 1,267) and female (n = 453) probationers, the purpose of the current study was to examine the potentially differential performance of the Youth Level of Service/Case Management Inventory (YLS/CMI) and the instrument’s eight domains for female juvenile offenders. Findings revealed gender differences in the predictive validity of the YLS/CMI in which girls scored significantly higher on the risk assessment, but recidivated at significantly lower rates than boys two years following the administration of the assessment. The predictive validity of the instrument was impacted by these gender differences in which the YLS/CMI total score was a better predictor of recidivism for boys (area under the curve (AUC) = .623) than girls (AUC = .565). The only subscales that significantly predicted recidivism for girls were the family (AUC = .607) and personality (AUC = .572) domains, whereas all of the subscales significantly predicted recidivism for boys. Directions for future research as well as gender-responsive assessment, programming, and policy implications are discussed.     

Dynamic risk and violence in individuals with an intellectual disability: tool development and initial validation

Without a violence risk assessment designed for people with an intellectual disability (ID), assessors are reliant upon tools developed for mainstream offenders or develop their own tools. This study describes the early stages of development of the Current Risk of Violence (CuRV), an informant-reported measure of dynamic risk for aggression in adults with an ID. The pool of items was generated from a multitude of sources. Predictive accuracy for aggression was tested prospectively among 64 adults with an ID and history of aggression. The 34-item CuRV was found to be a brief, uncomplicated risk assessment. Initial findings revealed good predictive validity over a five-month period: area under the curve (AUC) range from .72, 95% CI [.59, .85] to .77, 95% CI [.66, .89]. These preliminary findings suggest that the CuRV may assist staff to perform assessments of risk in busy clinical settings. Future research effort is needed to fully explore the psychometric properties of the CuRV.     

The development of the comprehensive health assessment tool for young offenders within the secure estate

Health inequalities are high among offending groups. The comprehensive health assessment tool (CHAT) is a semi-structured assessment developed to provide a standardised approach to health screening for all young offenders admitted to the secure estate. The four sections of the CHAT (physical health, mental health, substance misuse and neurodisability) were evaluated within a two-phased study of male adolescents (aged 15–18?years) within a young offenders institution in the north-west of England. Within Phase 1, a consecutive sample of 127 new receptions was assessed using the physical health, mental health and substance misuse sections of the CHAT against a range of reference standard assessments. Phase 2 of the study evaluated the neurodisability section on 93 male adolescents against reference standard tools. The four sections of the CHAT demonstrated fair to good convergent validity when compared against reference standard tools in male offenders. The diagnostic accuracy rate was 76% for mental health, 63% for physical health, 83% for substance misuse and 53% for neurodisability when compared against reference standard assessment tools. The introduction of the CHAT offers the opportunity to enhance existing reception screening practices and create an integrated approach to the assessment of health needs across the secure estate.     

Assessment and management of risk for intimate partner violence by police officers using the Spousal Assault Risk Assessment Guide

Intimate partner violence (IPV) is a crime that is present in all countries, seriously impacts victims, and demands a great deal of time and resources from the criminal justice system. The current study examined the use of the Spousal Assault Risk Assessment Guide, 2nd ed. (SARA; Kropp, Hart, Webster, & Eaves, 1995), a structured professional judgment risk assessment and management tool for IPV, by police officers in Sweden over a follow-up of 18 months. SARA risk assessments had significant predictive validity with respect to risk management recommendations made by police, as well as with recidivism as indexed by subsequent contacts with police. Risk management mediated the association between risk assessment and recidivism: High levels of intervention were associated with decreased recidivism in high risk cases, but with increased recidivism in low risk cases. The findings support the potential utility of police-based risk assessment and management of IPV, and in particular the belief that appropriately structured risk assessment and management decisions can prevent violence.     

Assessing dynamic risk and protective factors in the community: examining the validity of the Dynamic Risk Assessment for Offender Re-entry

Recently, there has been a growing interest in advancing the state of offender risk assessment: particularly through the development of risk instruments to assist with parole management and the incorporation of protective factors specific to re-entry. The current study's aim was to validate a measure of stable and acute dynamic risk factors and protective factors used by probation officers managing offenders in the community: the Dynamic Risk Assessment for Offender Re-Entry (DRAOR). Empirical examination of the structure of DRAOR scores soon after release from prison suggested four components, rather than the theoretically proposed three-subscale structure. Both the original three subscales and the four new subscales showed good convergent validity with other dynamic risk instruments, and reliably predicted new convictions; however, only the new stable component added significant incremental predictive power over existing static and dynamic risk instruments. These findings provide initial support for the validity of the DRAOR; suggestions for future research are discussed.     

The self-regulation model of sexual offending: Relationship to risk and need

In the present study, we evaluated the validity and utility of the self-regulation model in a sample of 275 adult male sexual offenders treated within the Correctional Service of Canada (CSC). Individuals following different self-regulation pathways, as delineated in the SRM, were compared on offence characteristics, static and dynamic risk measures, and various treatment targets. Multivariate analyses revealed that, in general, offenders guided by approach-motivated goals exhibited more problematic offence characteristics as well as greater risk and treatment need than individuals guided by inhibitory goals. However, several other important distinctions were noted across offenders with different goals and strategies toward offending. These findings highlight the main importance of utilizing a comprehensive and multidimensional offence process model that emphasizes multiple routes to offending in sexual offender treatment. Implications of these findings for the effective assessment and rehabilitation of sexual offenders are discussed.     

Design,development and validity testing of the gang affiliation risk measure (GARM)

This study aimed to create a measure of risk for gang affiliation, for use in the UK. A pilot stage invited gang affiliated and non-gang affiliated participants between the ages of 16–25 years to retrospectively self-report on 58 items of risk exposure at the age of 11 years. Based on performance of these items, a 26-item measure was developed and administered to a main study sample (n = 185) of gang affiliated and non-gang affiliated participants. Categorical Principal Component Analysis was applied to data, yielding a single-factor solution (historic lack of safety and current perception of threat). A 15-item gang affiliation risk measure (GARM) was subsequently created. The GARM demonstrated good internal consistency, construct validity and discriminative ability. Items from the GARM were then transformed to read prospectively, resulting in a test measure for predictive purposes (T-GARM). The T-GARM requires further validation regarding its predictive utility and generalisability. However, this study has resulted in the first measure of gang affiliation, with promising results.     

Supervisory experience and data points: implementation barriers,risk assessment and correctional professionals

Drawing on interviews with 24 correctional practitioners who use risk assessment instruments daily, we examine barriers to the use and implementation of these instruments. Findings reveal that practitioners have confidence in the state of risk assessment generally, but are skeptical about risk assessment on the job due to limited resources. They also point to barriers that inhibit their effectiveness including recognition of population heterogeneity, predictive misspecification due to data lags and overemphasis on stable predictors, and lacking guidance on appropriate use of vast available data. Instruments for measuring risk serve purposes beyond those intended by the social scientists who developed measures. We conclude with lessons for increasing the utility and legitimacy of risk assessments and with a call for incorporating latent uses of assessments into design.     

How well do dynamic needs predict recidivism? Implications for risk assessment and risk reduction

Purpose

The current study assessed the predictive validity of nine dynamic risk factors in two samples of justice-involved individuals (n = 24,972) to identify promising targets for correctional programming. The study also tested the incremental predictive validity of dynamic risk relative to static indicators of recidivism risk (i.e., criminal history, age and sex).

Methods

The study relied on bivariate correlations and stepwise multivariate logistic regression analyses to test the predictive and incremental validity of dynamic risk constructs measured by the Level of Service Inventory-Revised (LSI-R).

Results

Study findings revealed that while several dynamic risk constructs were significantly related to recidivism (antisocial attitudes, antisocial peers, education/employment, and substance abuse) over a 36-month follow-up period, the inclusion of dynamic risk items on the LSI-R did little to improve the overall predictive validity of the instrument. Across both study samples, static criminal history risk emerged as the most robust predictor of recidivism.

Conclusions

The advantages of third and fourth generation risk-need assessment tools are noted for classification purposes, but the study findings imply that risk prediction is better served by static risk factors. Implications for risk assessment and offender case management are discussed.     

Measuring grievance thinking in sexual offenders: The revised Dissipation–Rumination Scale

Abstract

Rumination is an important part of “grievance thinking”, which has been linked to recidivism in sexual offenders. Grievance thinking is a dynamic risk factor that can be targeted in treatment, and is characterized by a perception of being wronged accompanied by angry, hostile rumination about revenge, and has similarities to the “dangerous world” implicit theory . A revised version of the Dissipation–Rumination Scale is used currently to measure grievance thinking in sexual offenders incarcerated in England and Wales. The study aimed to establish whether this revised measure is valid to use with this population. The scale demonstrated adequate reliability and good convergent validity. However, analyses revealed problems with both construct and predictive validity. Further, it is suggested that the scale may not be sufficient to measure the whole of the “grievance thinking” concept. The results do not provide overwhelming support for the use of this tool with sexual offenders; further research is required before firm conclusions can be drawn regarding the scale's utility. Directions for future research are discussed.     

The predictive validity of youth violence risk assessment tools: a systematic review

ABSTRACT

This paper reports the findings of a systematic search of published literature which reports the predictive validity of violence risk assessment tools specifically designed for use with youth. A total of 38 studies, involving 9,307 participants, reported data for six different tools; the most common of which were the SAVRY and the YLS/CMI. Each of the tools demonstrated at least moderate levels of predictive validity, with the predictive validity of several newer assessment tools yet to be established. The results provide an up-to-date overview of the state of knowledge in an area in which practitioners make choices about which tools to use on an almost daily basis. It is important that practitioners are aware of the strength of evidence that is available to support the choice of violence risk assessment tools and the interpretation of results.