Strength in Numbers or Quality over Quantity? Examining the Importance of Criterion Measure Selection to Define Validity Groups in Performance Validity Test (PVT) Research

Mirroring clinical guidelines, recent Performance Validity Test (PVT) research emphasizes using ≥ 2 criterion PVTs to optimally identify validity groups when validating/cross-validating PVTs; however, even with multiple measures, the effect of which specific PVTs are used as criterion measures remains incompletely explored. This study investigated the accuracy of varying two-PVT combinations for establishing validity status and how adding a third PVT or applying more liberal failure cut-scores affects overall false-positive (FP)/-negative (FN) rates. Clinically referred veterans (N = 114; 30% clinically identified as invalid) completing a six-PVT protocol as during their evaluation were included. Concordance rates were calculated across all possible two-and three-PVT combinations at conservative and liberal cutoffs. Two-PVT combinations classified 72–91% of valid (0–4% FPs) and 17–74% of invalid (0–40% FNs) cases, and three-PVT combinations classified 67–86% of valid (0–6% FPs) and 57–97% of invalid (0–24% FNs) at conservative cutoffs. Liberal cutoffs classified 53–86% of valid (0–15% FPs) and 39–82% of invalid (0–30% FNs) cases for two-PVT combinations and 46–75% of valid (3–27% FPs) and 60–97% of invalid (0–17% FNs) cases for three-PVT combinations. Irrespective of whether a two-or three-PVT combination or conservative/liberal cutoffs were used, many valid and invalid cases failed only one PVT (3–68%).Two-PVT combinations produced high FNs and were less accurate than three-PVTs for detecting invalid cases, though variable accuracy was found within both types of combinations based on the specific PVTs in the combination. Thus, both PVT quantity and quality are important for accurate validity classification in research studies to ensure reliability and replicability of findings. Applying more liberal cutoffs yielded increased sensitivity, but with generally higher FPs yielding problematic specificity, particularly for three-PVT combinations.     

Testing a Financial Incentive to Promote Re‐employment among Displaced Workers: The Canadian Earnings Supplement Project (ESP)

This article presents findings from a randomized experiment conducted in four Canadian provinces to measure the effects of a generous financial incentive that was designed to promote rapid re‐employment among workers who were displaced from their jobs by changing economic conditions. The incentive tested was an earnings supplement which, for as long as 2 years and as much as $250 weekly, would replace 75 percent of the earnings loss incurred by displaced workers who took a new lower‐paying full‐time job within six months of receiving a supplement offer. Findings from the experiment indicate that although persons offered the supplement understood its terms and conditions, only 2 out of 10 actually received supplement payments. Furthermore, the supplement offer had little effect on job‐search behavior, employment prospects, or receipt of unemployment insurance. Nevertheless, persons who received supplement payments benefited from them substantially. On average, they received payments for 64 weeks, totaling $8,705. © 2001 by the Association for Public Policy Analysis and Management.     

The 2018 California Wildfires: Integration of Rapid DNA to Dramatically Accelerate Victim Identification

In November 2018, Butte County, California, was decimated by the Camp Fire, the deadliest wildfire in state history. Over 150,000 acres were destroyed, and at its peak, the fire consumed eighty acres per minute. The speed and intensity of the oncoming flames killed scores of people, and weeks before the fire was contained, first responders began searching through the rubble of 18,804 residences and commercial buildings. As with most mass disasters, conventional identification modalities (e.g., fingerprints, odontology, hardware) were utilized to identify victims. The intensity and duration of the fire severely degraded most of the remains, and these approaches were useful in only 22 of 84 cases. In the past, the remaining cases would have been subjected to conventional DNA analysis, which may have required months to years. Instead, Rapid DNA technology was utilized (in a rented recreational vehicle outside the Sacramento morgue) in the victim identification effort. Sixty-nine sets of remains were subjected to Rapid DNA Identification and, of these, 62 (89.9%) generated short tandem repeat profiles that were subjected to familial searching; essentially all these profiles were produced within hours of sample receipt. Samples successfully utilized for DNA identification included blood, bone, liver, muscle, soft tissue of unknown origin, and brain. In tandem with processing of 255 family reference samples, 58 victims were identified. This work represents the first use of Rapid DNA Identification in a mass casualty event, and the results support the use of Rapid DNA as an integrated tool with conventional disaster victim identification modalities.     

Factor Structure and Reliability of the Revised Conflict Tactics Scales for Incarcerated Female Substance Abusers

Incarcerated women with a history of substance abuse often experience intimate partner violence (IPV), both as victims and as perpetrators. The issues surrounding partner violence and substance abuse are complex, and accurate assessment of this population's experience is critical to ensure proper treatment planning and program development. One of the most common instruments with which to measure IPV is the Conflict Tactics Scales (CTS). Unfortunately, very little published data exist on the revised version of the Conflict Tactics Scales (CTS2), and no data could be located in the literature using this scale with incarcerated women. The purpose of this investigation was to examine the underlying factor structure and reliability of the CTS2 for 359 incarcerated women who had voluntarily participated in a 1–year long substance abuse treatment program. Item analysis revealed a high level of reliability for the overall scale as well as for the individual subscales. Additionally, results from the confirmatory multiple group factor analysis support the 5 underlying subscales, and taken together indicate that the scale is acceptable to use with this population.     

Population drug use in Australia: a wastewater analysis

Accurate information on drug use in communities is essential if health, social and economic harms associated with illicit drug use are to be addressed efficiently. In most countries population drug use is estimated indirectly via surveys, medical presentations and police and custom seizures. All of these methods have at least some problems due to bias, small samples and/or long time delays between collecting the information and analysing the results. Recently the direct quantification of drug residues in wastewater has shown promise as a means of monitoring drug use in defined geographical areas. In this study we measured 3,4-methylenedioxymethamphetamine (MDMA), methamphetamine and benzoylecgonine in sewage inflows in metropolitan and regional areas of Australia and compared these data with published European data. Cocaine use was small compared to European cities (p<0.001) but was compensated for by much greater consumption of methamphetamine (p<0.001) and MDMA (p<0.05). MDMA was more popular in regional areas (p<0.05) whereas methamphetamine and cocaine were mainly consumed in the city (p<0.05). Greater than 5-fold increases in MDMA use were detected on weekends (p<0.001). This approach has the potential to improve our understanding of drug use in populations and should be further developed to improve prevention and treatment programs.     

Expertise in Fingerprint Identification

Although fingerprint experts have presented evidence in criminal courts for more than a century, there have been few scientific investigations of the human capacity to discriminate these patterns. A recent latent print matching experiment shows that qualified, court‐practicing fingerprint experts are exceedingly accurate (and more conservative) compared with novices, but they do make errors. Here, a rationale for the design of this experiment is provided. We argue that fidelity, generalizability, and control must be balanced to answer important research questions; that the proficiency and competence of fingerprint examiners are best determined when experiments include highly similar print pairs, in a signal detection paradigm, where the ground truth is known; and that inferring from this experiment the statement “The error rate of fingerprint identification is 0.68%” would be unjustified. In closing, the ramifications of these findings for the future psychological study of forensic expertise and the implications for expert testimony and public policy are considered.