Development of the Observation Scale for Aggressive Behavior (OSAB) for Dutch forensic psychiatric inpatients with an antisocial personality disorder

The Observation Scale for Aggressive Behavior (OSAB) has been developed to evaluate inpatient treatment programs designed to reduce aggressive behavior in Dutch forensic psychiatric patients with an antisocial personality disorder, who are "placed at the disposal of the government". The scale should have the sensitivity to measure changes in the possible determinants of aggressive behavior, such as limited control of displayed negative emotions (irritation, anger or rage) and a general deficiency of social skills. In developing the OSAB 40 items were selected from a pool of 82 and distributed among the following a priori scales: Irritation/anger, Anxiety/gloominess, Aggressive behavior, Antecedent (to aggressive behavior), Sanction (for aggressive behavior) and Social behavior. The internal consistency of these subscales was good, the inter-rater reliability was moderate to good, and the test-retest reliability over a two to three week period was moderate to good. The correlation between the subscales Irritation/anger, Anxiety/gloominess, Aggressive behavior, Antecedent, Sanction was substantial and significant, but the anticipated negative correlation between these subscales and the Social behavior subscale could not be shown. Relationships between the corresponding subscales of the OSAB and the FIOS, used to calculate concurrent validity, yielded relatively high correlations. The validity of the various OSAB subscales could be further supported by significant correlations with the PCL-R and by significant but weak correlations with corresponding subscales of the self-report questionnaires. The Observation Scale for Aggressive Behavior (OSAB) seems to measure aggressive behavior in Dutch forensic psychiatric inpatients with an antisocial personality disorder reliably and validly. Contrary to expectations, a negative relationship was not found between aggressive and social behavior in either the OSAB or FIOS, which were used for calculating concurrent validity.     

科学证据可采性标准的认识论反思与重构

科学证据的可采性是指是采纳某一科学证据作为证明某一事实的标准或条件。目前我国还没有建立明确的科学证据可采性标准,而在科学证据研究最发达的英美国家,科学证据可采性标准中的一些基本要素也是纠缠不清的。通过对科学证据可采性标准的历史考察和认识论反思,并根据科学证据在真相发现中的功能,可以尝试从内在属性和外在属性两个方面来审视科学证据可采性的结构。科学证据可采性的标准主要包括：科学证据本身的科学有效性、可靠性、科学相关性以及科学专家的可信性等。     

The referral decision scale with mentally disordered inmates

Correctional facilities are increasingly burdened with mentally disordered offenders and are faced with the formidable task of effectively screening inmates for major mental disorders and suicide potential. Teplin and Swartz (1989) developed the Referral Decision Scale (RDS) as a rapid screen for schizophrenia and major mood disorders in jail populations. However, more recent research by Hart, Roesch, Corrado, and Cox (1993) has called into question the effectiveness of the RDS. In this study, we examined the convergent and discriminant validity of the RDS with the Schedule of Affective Disorders and Schizophrenia—Change Version (SADS-C) and the Personality Assessment Inventory (PAI) on a sample of 108 mentally disordered inmates. The RDS provided moderate evidence of convergent validity but failed to demonstrate acceptable discriminant validity, because of high intercorrelations on RDS subscales (heterotrait-monomethod coefficients). In comparison, the SADS-C yielded similar evidence of convergent validity and excellent discriminant validity.The authors would like to thank the Research Opportunities Program, University of North Texas for its grant support and Captain James Moore for his active cooperation.Tarrant County Mental Health and Mental Retardation Services.     

Cross-validation of the Self-Appraisal Questionnaire (SAQ): an offender risk and need assessment measure on Australian, British, Canadian, Singaporean, and American offenders

The Self-Appraisal Questionnaire (SAQ) is a 72-item self-report measure designed to predict violent and nonviolent recidivism among adult criminal offenders. The results from using samples from Australia, Canada, England, Singapore, and two samples from the United States (North Carolina and Pennsylvania) indicated that (a) the SAQ has sound psychometric properties, with acceptable reliability and concurrent validity for assessing recidivism and institutional adjustment; (b) there were no significant differences among the scores of the White, African American, Hispanic, and Aboriginal Australian offenders on the SAQ; (c) there were no significant differences among offenders who completed the SAQ for research purposes versus offenders who completed it as part of a decision-making process. Results provided support for the validity of the SAQ to be used with the culturally diverse offenders involved in this research and provided further evidence that contradicts concerns that the SAQ as a self-report measure may be susceptible to lying, and self-presentation biases.     

Reliability and validity of the original and revised legal attitudes questionnaire

The Legal Attitudes Questionnaire (LAQ) predicts juror bias, but there is little evidence concerning its reliability and construct validity. Two studies provide such evidence for two versions of the LAQ. In Study 1 a questionnaire containing both versions of the LAQ, measures of related and unrelated constructs, and demographic questions was completed by 294 undergraduates. In Study 2 a shortened questionnaire was completed by 102 jury-eligible adults. In both studies, the revised version of the LAQ was superior to the original LAQ in terms of missing data, internal reliability, and construct validity. A refined version of the revised scale is presented, evaluated, and recommended for future use.This article is an expanded version of a poster presented at the meeting of the American Psychology and Law Society in March, 1992. We are grateful to Barbara Martin and Ray Wolfe for their comments on a previous version of this article. We would like to thank Sean Henriques, Tracy Chavez, Jennifer Devenport, Alex Milov, and Cathy Mucha for their assistance in data acquisition, entry, and verification. Finally, we thank the Miami Beach Kiwanis for participating in this study.     

The Spousal Assault Risk Assessment (SARA) Guide: Reliability and Validity in Adult Male Offenders

We evaluated the reliability and validity of judgments concerning risk for violence made using the Spousal Assault Risk Assessment Guide (SARA; Kropp, Hart, Webster, & Eaves, 1994, 1995, 1998). We analyzed SARA ratings in six samples of adult male offenders (total N = 2681). The distribution of ratings indicated that offenders were quite heterogeneous with respect to the presence of individual risk factors and to overall perceived risk. Structural analyses of the risk factors indicated moderate levels of internal consistency and item homogeneity. Interrater reliability was high for judgments concerning the presence of individual risk factors and for overall perceived risk. SARA ratings significantly discriminated between offenders with and without a history of spousal violence in one sample, and between recidivistic and nonrecidivistic spousal assaulters in another. Finally, SARA ratings showed good convergent and discriminant validity with respect to other measures related to risk for general and violent criminality.     

Predictive Validity of the SVR-20 and Static-99 in a Dutch Sample of Treated Sex Offenders

In this retrospective study, the interrater reliability and predictive validity of 2 risk assessment instruments for sexual violence are presented. The SVR-20, an instrument for structured professional judgment, and the Static-99, an actuarial risk assessment instrument, were coded from file information of 122 sex offenders who were admitted to a Dutch forensic psychiatric hospital between 1974 and 1996 (average follow-up period 140 months). Recidivism data (reconvictions) from the Ministry of Justice were related to the risk assessments. The base rate for sexual recidivism was 39%, for nonsexual violent offenses 46%, and for general offenses 74%. Predictive validity of the SVR-20 was good (total score: r = .50, AUC = .80; final risk judgment: r = .60, AUC = .83), of the Static-99 moderate (total score: r = .38, AUC =.71; risk category: r = .30, AUC = .66). The SVR-20 final risk judgment was a significantly better predictor of sexual recidivism than the Static-99 risk category.     

Screening for risk: A revised salient factor score (SFS 81)

Since 1972, the United States Parole Commission has used an actuarial device as an aid in assessing parole prognosis in conjunction with explicit decision guildelines. This article describes the most recent revision of the actuarial device used by the commission. This device (SFS 81) is examined and compared with the device previously used (SFS 76) on five dimensions: validity, stability, reliability, simplicity, and ethical concerns.     

Validation of the technology acceptance model for police

The Technology Acceptance Model (TAM) developed by Davis (1989) was used to develop a basic theoretical model that would explain why patrol officers embraced or rejected new computer technology. Davis identified two factors of technology acceptance: ease of use and usefulness. Items representing each factor were generated in focus groups with patrol officers, and subject matter experts (SMEs) provided evidence of content validity. Exploratory (EFA) and confirmatory factor analyses (CFA) were conducted to assess the construct factorial validity of the factor structure. The two-factor model hypothesized by Davis (1989) was not supported. The EFA, however, identified a four-factor model that indicated a good fit to the data. The four factors were labeled as ease of use, usefulness, information quality, and timeliness. The findings suggested that the new factors of information quality and timeliness were the most important components of technology acceptance by patrol officers. Policy implications and future research directions are discussed.     

Validation of the Sexual Assault Symptom Scale II (SASS II) using a panel research design

To examine the utility of a self-report scale of sexual assault trauma, 223 female victims were interviewed with the 43-item Sexual Assault Symptom Scale II (SASS II) at 1, 3, 7, 11, and 15 months postassault. Factor analyses using principal-components extraction with an oblimin rotation yielded 7 common factors with 31 items. The internal consistency was high for 4 factors and moderate for 2 factors. The multitrait-multimethod matrix, correlating the factor subscale scores of self-reported trauma and clinical assessment ratings, demonstrated both convergent and discriminant validity, indicating that the SASS II has construct validity. Correlations between the SASS II subscales and the intrusion subscale of the Impact of Events Scale also indicated the convergent and discriminant validity of the SASS II. Significant positive correlations between current and prior trauma levels further evidence the validity of the SASS.     

Comparison of the MMPI-2 and Niederhoffer Cynicism Scales for a Sample of police academy trainees

This study compared the Niederhoffer Cynicism Scale, as a less costly alternative, to the MMPI-2 measure of cynicism. Data were collected on both scales from a sample of male and female police academy trainees to compare reliability and construct validity. Subgroup analyses by race and sex yielded comparable Cronbach alpha estimates for minority (.71) and majority (.83) males to MMPI-2 norms. The Niederhoffer reliability values were marginally smaller (.73 to .77) but within the acceptable range. Construct validity correlations between both scales were significant for minority and majority males. However, sample size was too small for both minority and majority females groups to use appropriate statistical techniques to determine reliability or validity. Continued use of the Niederhoffer is recommended for minority and majority males. Author's Note: This paper was presented at the 44^th Annual Meeting of the Western Social Science Association in Albuquerque, NM, in April of 2002.     

The use of the Psychological Inventory of Criminal Thinking Styles with English young offenders

Objectives. This study examines the psychometric properties of the Psychological Inventory of Criminal Thinking Styles (PICTS) with a sample of imprisoned English young offenders. Method. The reliability and validity of the PICTS scales were investigated, and changes in scores on the PICTS scales over a 6‐month period were analysed. Results. The findings suggested that from a psychometric perspective the PICTS scales were not performing as well with young offenders as with adult prisoner samples. The indices of reliability and validity were of a moderate level. Test‐retest scores calculated over the 6 months showed little change on the PICTS scores. Conclusion. The use of the PICTS scales with young offenders is discussed with reference to previous research with adult offenders in England and North America.     

Reliability and validity of cross-national homicide data: a comparison of UN and WHO data

Data reliability and validity are methodological concerns in cross-national analyses of crime, but there is little agreement on which source of data provides the most reliable estimates. Moreover, few studies have examined the potential threat to validity posed by unclassified deaths. The current study aims to (1) assess the reliability of cross-national homicide data from the United Nations (UN) and the World Health Organization (WHO); and (2) investigate the impact of unclassified deaths on the validity of WHO data. Findings indicate that UN and WHO homicide rates (n=56) differ in magnitude, but produce similar outcomes. The UN data produce more robust results and statistical models with less error. The WHO data are more stable and reliable over time, and better suited for longitudinal analyses. Analyses drawing on WHO data should not disregard unclassified deaths because their inclusion provides a more accurate estimate of the true number of homicides.     

Assessing civil competence in the elderly.

This study was designed to establish reliability of the Community Competence Scale-Revised (CCS-R) and provide evidence for its validity in making discriminations relevant to civil competence in the elderly. The CCS-R is an individually administered structured interview of 17 subscales. Criterion groups were formed by drawing a sample of research participants from a retirement complex with various levels of care and with nurses having extensive knowledge of the residents' level of functioning. The study demonstrated high reliability and found converging evidence for the effectiveness of the CCS-R in making discrimination about competence in the elderly. The study had added to the growing evidence that it is possible to standardize the assessment of civil competence, thereby making the adjudication process a more accurate one.     

Skeletal estimation and identification in American and East European populations

Forensic science is a fundamental transitional justice issue as it is imperative for providing physical evidence of crimes committed and a framework for interpreting evidence and prosecuting violations to International Humanitarian Law (IHL). The evaluation of evidence presented in IHL trials and the outcomes various rulings by such courts have in regard to the accuracy or validity of methods applied in future investigations is necessary to ensure scientific quality. Accounting for biological and statistical variation in the methods applied across populations and the ways in which such evidence is used in varying judicial systems is important because of the increasing amount of international forensic casework being done globally. Population variation or the perceived effect of such variation on the accuracy and reliability of methods is important as it may alter trial outcomes, and debates about the scientific basis for human variation are now making their way into international courtrooms. Anthropological data on population size (i.e., the minimum number of individuals in a grave), demographic structure (i.e., the age and sex distribution of victims), individual methods applied for identification, and general methods of excavation and trauma analysis have provided key evidence in cases of IHL. More generally, the question of population variation and the applicability of demographic methods for estimating individual and population variables is important for American and International casework in the face of regional population variation, immigrant populations, ethnic diversity, and secular changes. The reliability of various skeletal aging methods has been questioned in trials prosecuted by the International Criminal Tribunal for the Former Yugoslavia (ICTY) in The Prosecutor of the Tribunal against Radislav Krstic (Case No. IT-98-33, Trial Judgment) and again in the currently ongoing trial of The Prosecutor of the Tribunal against Zdravko Tolimir, Radivolje Miletic, Milan Gvero, Vinko Pandurevic, Ljubisa Beara, Vujadin Popovic, Drago Nikolic, Milorad Trbic, Ljubomir Borovcanin (IT-05-88-PT, Second Amended Indictment). Following the trial of General Krstic, a collaborative research project was developed between the Forensic Anthropology Center at The University of Tennessee (UT) and the United Nations, International Criminal Tribunal for the Former Yugoslavia, Office of the Prosecutor (ICTY). The purpose of that collaboration was to investigate methods used for the demographic analysis of forensic evidence and where appropriate to recalibrate methods for individual estimation of age, sex, and stature for specific use in the regions of the former Yugoslavia. The question of "local standards" and challenges to the reliability of current anthropological methods for biological profiling in international trials of IHL, as well as the performance of such methods to meet the evidentiary standards used by international tribunals is investigated. Anthropological methods for estimating demographic parameters are reviewed. An overview of the ICTY-UT collaboration for research aimed at addressing specific legal issues is discussed and sample reliability for Balkan aging research is tested. The methods currently used throughout the Balkans are discussed and estimated demographic parameters obtained through medico-legal death investigations are compared with identified cases. Based on this investigation, recommendations for improving international protocols for evidence collection, presentation, and research are outlined.     

Measuring Neoliberalism: Development and Initial Validation of a Scale of Anti-Neoliberal Attitudes

Critics of neoliberalism argue that so-called meritocratic and identity-neutral social policies and political positions actually reinforce and exacerbate intersecting inequalities, namely racism, sexism, heterosexism, classism, and ethnocentrism/xenophobia. The purpose of these studies was to develop and initially validate a scale of neoliberal attitudes from a wide range of existing instruments that reflect anti-neoliberal theory. A series of three studies resulted in a 25-item instrument—the Anti-Neoliberal Attitudes Scale (ANAS)—that exhibits initial evidence of construct validity, internal consistency, and test–retest reliability. Exploratory factor analysis with students from two universities revealed a four-factor structure of Racism and Sexism Awareness, Communitarian Values, Multicultural Ideology, and Inequality Consciousness. However, a confirmatory factor analysis with an independent sample of undergraduate students suggests a bifactor model in which the general factor explains most of the variance and that the instrument should be treated as a single scale, rather than independent subscales. Significant correlations with measures of right-wing authoritarianism and social dominance orientation suggest convergent validity. Temporal stability was established via a test–retest analysis in an independent sample of undergraduate students. Finally, responses from a sample of MTurk workers provided evidence of the ANAS’s incremental validity when compared to an existing measure of neoliberal beliefs. Implications for future empirical work on the psychological dimensions of neoliberalism are discussed.

     

Problems of reliability and validity in criminal justice research

Reliability and validity are critical standards of scientific inquiry. This analysis directs attention to problems of reliability in data collection and to problems of validity in measuring two key criminal justice variables: the offense and the sentence. The discussion and empirical analysis indicate that reliability of official information sources in criminal justice cannot be assumed. Furthermore, there is evidence to suggest that the criterion of validity is even more elusive. This elusiveness is demonstrated in the operational definition of criminal offense, an important predictor variable, and in attemps to operationally define the criminal sanction, i.e., the disposition of charges against convicted defendants. These considerations suggest that research in the sentencing area may not be directed to the subject at hand and that research results should be interpreted with “scientific” caution.     

Internal reliability and construct validity of the Novaco Anger Scale-1998-S in a sample of violent prison inmates in Sweden

Abstract

In this study, the internal reliability and construct validity of the recently adapted Swedish version of the Novaco Anger Scale (NAS-1998-S; Lindqvist, Dåderman, & Hellström, Social Behavior and Personality, 8, 773–788, 2003), as well as its scale correlations with demographic and criminality variables, were investigated. Construct validity was established by assessing the correlation pattern of the scales of NAS-1998-S with concurrent scales of similar and distinct constructs. Ninety-five male violent prisoners, ranging in age from 18 to 67 years, participated. The results demonstrated good internal reliability, consistent intrascale relationships, and appropriate construct validity of NAS-1998-S. The number of previous convictions had a moderate negative relationship with the capacity of control. Age and education correlated negatively with the NAS-1998-S scales, except Regulation. In addition to psychometric issues, the results were discussed from a clinical perspective on the offender population.     

The development and pilot testing of a family treatment court best practices assessment: The model standards implementation scale

In 2019, the family treatment court (FTC) best practice standards (the Standards) were published to clarify attributes of FTC programs associated with superior child, parent, and family outcomes. The Standards cover the breadth of FTC operations including program structure and leadership, substance use treatment and complementary services, and behavioral responses to participants. This study aimed to develop an instrument (the Model Standards Implementation Scale; “MSIS”) that stakeholders can use to assess implementation of the Standards by individual FTCs. The MSIS balances usability with scientific validity. Interrater reliability (IRR), internal consistency, and several types of validity were assessed. Results indicated moderate to strong IRR, high internal consistency, mixed known groups validity depending on Standard, and high convergent and divergent validity. Initial findings suggest good validity and usability of the MSIS for evaluating FTC Standards' implementation. Notably, the process of using the tool functioned to educate FTC team members on the Standards. Although implementation of the MSIS is a resource-intensive process, the opportunity to receive constructive feedback proved to be an effective incentive for initial and subsequent participation in the evaluation among FTCs. Future research is needed to examine predictive validity, including association between Standards' implementation and family outcomes in FTCs.     

The predictive validity of youth violence risk assessment tools: a systematic review

ABSTRACT

This paper reports the findings of a systematic search of published literature which reports the predictive validity of violence risk assessment tools specifically designed for use with youth. A total of 38 studies, involving 9,307 participants, reported data for six different tools; the most common of which were the SAVRY and the YLS/CMI. Each of the tools demonstrated at least moderate levels of predictive validity, with the predictive validity of several newer assessment tools yet to be established. The results provide an up-to-date overview of the state of knowledge in an area in which practitioners make choices about which tools to use on an almost daily basis. It is important that practitioners are aware of the strength of evidence that is available to support the choice of violence risk assessment tools and the interpretation of results.