Objective Analysis of Impressed Chisel Toolmarks

Historical and recent challenges to the practice of comparative forensic examination have created a driving force for the formation of objective methods for toolmark identification. In this study , fifty sequentially manufactured chisels were used to create impression toolmarks in lead (500 toolmarks total). An algorithm previously used to statistically separate known matching and nonmatching striated screwdriver marks and quasi-striated plier marks was used to evaluate the chisel marks. Impression toolmarks, a more complex form of toolmark, pose a more difficult test for the algorithm that was originally designed for striated toolmarks. Results show in this instance that the algorithm can separate matching and nonmatching impression marks, providing further validation of the assumption that toolmarks are identifiably unique.     

Validation of Toolmark Comparisons Made At Different Vertical and Horizontal Angles

Numerous studies have focused on determining whether objective statistical methods can be used to discriminate between known matches and nonmatches when comparing laboratory prepared toolmarks. This study involved an analysis of striated toolmarks made as a function of varying vertical and horizontal angles of attack. Comparisons based on experimental data show that replicate toolmarks from the same tool show high correlation values at identical vertical and horizontal angles, with the correlation decreasing as the angular difference increases, especially for horizontal angular changes. Comparisons between nonmatching samples produce low correlation values that remain unchanged as horizontal angular differences increase. While complete statistical separation was not achieved between matching and nonmatching samples, there is evidence demonstrating that toolmarks can be identified if the variation in horizontal angle is within 10°. The experiment shows that computer‐aided comparison techniques could be viable for identification with the proper statistical algorithm.     

Confocal microscopy analysis of breech face marks on fired cartridge cases from 10 consecutively manufactured pistol slides

Recent publications from the National Academy of Sciences have called for additional foundational research in the field of firearm and toolmark analysis. We examined test fires from 10 pistol slides with consecutively manufactured breech faces. A total of nine test fires from each pistol slide, for a total of 90 test fired cartridge cases, were compared using confocal microscopy combined with three-dimensional cross-correlation analysis algorithms. A total of 8010 comparisons were performed (720 matches and 7290 nonmatches). The average score for matches was 0.82 with a standard deviation of 0.06. The average score for nonmatches was 0.20 with a standard deviation of 0.03. Additionally, subclass toolmarks were observed on the breech faces, but the presence of subclass was not detected in the correlation analysis. There was no overlap of scores between matching and nonmatching test fires. This provides objective data that support the AFTE (Association of Firearms and Tool Mark Examiners) theory of identification.     

Development of a Mobile Toolmark Characterization/Comparison System

Since the development of the striagraph, various attempts have been made to enhance forensic investigation through the use of measuring and imaging equipment. This study describes the development of a prototype system employing an easy‐to‐use software interface designed to provide forensic examiners with the ability to measure topography of a toolmarked surface and then conduct various comparisons using a statistical algorithm. Acquisition of the data is carried out using a portable 3D optical profilometer, and comparison of the resulting data files is made using software named “MANTIS” (Mark and Tool Inspection Suite). The system has been tested on laboratory‐produced markings that include fully striated marks (e.g., screwdriver markings), quasistriated markings produced by shear‐cut pliers, impression marks left by chisels, rifling marks on bullets, and cut marks produced by knives. Using the system, an examiner has the potential to (i) visually compare two toolmarked surfaces in a manner similar to a comparison microscope and (ii) use the quantitative information embedded within the acquired data to obtain an objective statistical comparison of the data files. This study shows that, based on the results from laboratory samples, the system has great potential for aiding examiners in conducting comparisons of toolmarks.     

Angular Determination of Toolmarks Using a Computer‐Generated Virtual Tool

A blind study to determine whether virtual toolmarks created using a computer could be used to identify and characterize angle of incidence of physical toolmarks was conducted. Six sequentially manufactured screwdriver tips and one random screwdriver were used to create toolmarks at various angles. An apparatus controlled tool angle. Resultant toolmarks were randomly coded and sent to the researchers, who scanned both tips and toolmarks using an optical profilometer to obtain 3D topography data. Developed software was used to create virtual marks based on the tool topography data. Virtual marks generated at angles from 30 to 85° (5° increments) were compared to physical toolmarks using a statistical algorithm. Twenty of twenty toolmarks were correctly identified by the algorithm. On average, the algorithm misidentified the correct angle of incidence by ?6.12°. This study presents the results, their significance, and offers reasons for the average angular misidentification.     

The Development and Application of Random Match Probabilities to Firearm and Toolmark Identification

The field of firearms and toolmark analysis has encountered deep scrutiny of late, stemming from a handful of voices, primarily in the law and statistical communities. While strong scrutiny is a healthy and necessary part of any scientific endeavor, much of the current criticism leveled at firearm and toolmark analysis is, at best, misinformed and, at worst, punditry. One of the most persistent criticisms stems from the view that as the field lacks quantified random match probability data (or at least a firm statistical model) with which to calculate the probability of a false match, all expert testimony concerning firearm and toolmark identification or source attribution is unreliable and should be ruled inadmissible. However, this critique does not stem from the hard work of actually obtaining data and performing the scientific research required to support or reject current findings in the literature. Although there are sound reasons (described herein) why there is currently no unifying probabilistic model for the comparison of striated and impressed toolmarks as there is in the field of forensic DNA profiling, much statistical research has been, and continues to be, done to aid the criminal justice system. This research has thus far shown that error rate estimates for the field are very low, especially when compared to other forms of judicial error. The first purpose of this paper is to point out the logical fallacies in the arguments of a small group of pundits, who advocate a particular viewpoint but cloak it as fact and research. The second purpose is to give a balanced review of the literature regarding random match probability models and statistical applications that have been carried out in forensic firearm and toolmark analysis.     

An ideal material for the preparation of known toolmark test impressions

Traditionally, toolmark test exemplars are produced by applying a tool's working surface to a piece of soft metal such as lead. Soft, pliable metals are primarily used for this purpose because they will replicate the microscopic grooves present on a tool's working surface without damaging the tool. In this paper the authors present an alternative material for the preparation of test toolmarks. Jewelry modeling or carving waxes are utilized in this study. These waxes are designed for the jewelry modeling industry to create very fine, highly detailed wax models of jewelry pieces that will be cast in various metals utilizing the lost wax casting method. Jeweler's waxes have been found to be ideal for preparing test toolmarks from exemplar tools. The test tool's working surface is applied to a piece of the appropriate wax in a manner consistent with the tool's design. The replicas obtained are exact, highly detailed, 1:1, negative impressions of the exemplar tools working surface, have a long shelf-life, and are suitable for use in toolmark examination and comparison cases.     

A Statistical Validation of the Individuality and Repeatability of Striated Tool Marks: Screwdrivers and Tongue and Groove Pliers*

Abstract: Tool mark identification relies on the premise that microscopic imperfections on a tool’s working surface are sufficiently unique and faithfully transferred to enable a one‐to‐one association between a tool and the tool marks it creates. This paper presents a study undertaken to assess the validity of this premise. As part of this study sets of striated tool marks were created under different conditions and on different media. The topography of these tool marks was acquired and the degree of similarity between them was quantified using well‐defined metrics. An analysis of the resulting matching and nonmatching similarity distributions shows nearly error‐free identification under most conditions. These results provide substantial support for the validity of the premise of tool mark identification. Because the approach taken in this study relies on a quantifiable similarity metric, the results have greater repeatability and objectivity than those obtained using less precise measures of similarity.     

A Historical,Detailed Toolmark Examination from 1916

Marc Bischoff received his PhD from the University of Lausanne, Institute of Police Science and Criminology, and later became the head of the Institute. His final examination paper for his doctorate degree constitutes a toolmark analysis and comparison between a suspected axe and questioned cuttings of wood trunks. Bischoff uses the scientific method to test the hypothesis he formulated. Dated 1916, this report includes his notes, measurements, photomicrographs of the questioned toolmarks and the test impressions, detailed sketches, technical discussion, results, and conclusions. Recognizing the historical value of Bischoff's work, it seemed important to get it translated. Photocopies of Bischoff's original work were obtained. The case report, translated from French, is presented here along with a brief history of the Firearm and Toolmark Identification field and Bischoff's role in the beginning of this field. Bischoff's work stands as testimony to the long tradition of the field of forensic toolmark analysis.     

Bolt Cutter Blade's Imprint in Toolmarks Examination

Bolt cutters are known as cutting tools which are used for cutting hard objects and materials, such as padlocks and bars. Bolt cutter blades leave their imprint on the cut objects. When receiving a cut object from a crime scene, forensic toolmarks examiners can determine whether the suspected cutting tool was used in a specific crime or not based on class characteristic marks and individual marks that the bolt cutter blades leave on the cut object. The paper presents preliminary results of a study on ten bolt cutters and suggests a quick preliminary examination—the comparison between the blade thickness and the width of the imprint left by the tool on the cut object. Based on the comparison result, if there is not a match, the examiner can eliminate the feasibility of the use of the suspected cutting tool in a specific crime. This examination simplifies and accelerates the comparison procedure.     

A calculation of the theoretical significance of matched bullets

Abstract:  The comparison and identification of bullets from the striations that appear on their surfaces, after they have been fired from a gun, have been practiced since the 1920s. Although the significance of the correspondences of these impression marks has been empirically justified, there is a conspicuous absence of any theoretical foundation for the likelihood. What is presented here is the derivation of the formulae for calculating the probability for the correspondence of the impression marks on a subject bullet to a random distribution of a similar number of impression marks on a suspect bullet of the same type. The approach to the calculation entails subdividing the impression marks into a series of individual lines having widths equal to the separation distance at which a misalignment of striations between the two bullets cannot be distinguished. This distance depends upon the resolution limit imposed by the microscope as well as by the visual acuity of the examiner. A calculation of the probabilities for finding pairs and triplets of consecutively matching lines on nonmatching bullets, by an examiner with normal perception using a microscope at 40× magnification, produces values that agree well with the empirical probabilities determined by Biasotti in the 1950s and when determined for larger consecutive sequences suggest that they are extremely unlikely to occur. The formulae can be used to determine the probabilities for the random occurrence of any sequence of striae and provide a straightforward way to quantitatively justify the significance of a specific match between any two bullets.     

Adapting the Chumbley Score to Match Striae on Land Engraved Areas (LEAs) of Bullets,

The same‐source problem remains a major challenge in forensic toolmark and firearm examination. Here, we investigate the applicability of the Chumbley method (J Forensic Sci, 2018, 63, 849; J Forensic Sci, 2010, 55, 953) (10,12), developed for screwdriver markings, for same‐source identification of striations on bullet LEAs. The Hamby datasets 44 and 252 measured by NIST and CSAFE (high‐resolution scans) are used here. We provide methods to identify parameters that minimize error rates for matching of LEAs, and a remedial algorithm to alleviate the problem of failed tests, while increasing the power of the test and reducing error rates. For 85,491 land‐to‐land comparisons (84,235 known nonmatches and 1256 known matches), the adapted test does not provide a result in 176 situations (originally more than 500). The Type I and Type II error rates are 7.2% (6105 out of 84,235) and 21.4% (271 out of 1256), respectively. This puts the proposed method on similar footing as other single‐feature matching approaches in the literature.     

Firearm and toolmark identification criteria: a review of the literature,part II

An update to a previously published review of articles pertaining to firearm and toolmark identification criteria is presented. In this update, 22 additional articles were reviewed, including works of a general nature, studies critically assessing the theory of consecutive matching striations, empirical studies involving various firearm components, toolmark studies, as well as articles discussing the utility of statistics in the firearms and toolmark identification discipline. These articles have been reviewed in a format to permit others to learn what has been published in the field in an effort to educate interested parties. Further, a discussion of the importance of articulation and communication within the discipline is presented.     

An Improved Version of a Tool Mark Comparison Algorithm

Chumbley et al. (2010) described a statistically based algorithm for comparing pairs of tool marks. They presented empirical evidence that the algorithm produces well‐separated similarity score values for “matching” and “non‐matching” pairs of tool marks. However, the algorithm has two substantial weaknesses. First, it is “uncalibrated” in the sense that error rates can be determined only through empirical investigation. Second, it relies on a randomized test and can lead to different similarity scores when the algorithm is repeatedly applied to the same pair of tool marks. We present an improved version of the procedure, which eliminates the randomized scores and yields more consistent and predictable error rate control. This is accomplished by replacement of a random sampling step from the original algorithm with a deterministic process. We demonstrate the improved algorithm and compare its performance to the original by applying to known “matching” and “non‐matching” pairs of tool marks.     

Consecutive matching striation criteria: a general critique

In the forensic science of firearms and toolmark identification, examiners traditionally have drawn conclusions of identity from subjective criteria. This paper critically explores the general validity of one proposed objective-criteria regime--that of counting consecutive matching striations on fired bullets. Practical considerations are discussed, as well as theoretical ones, with both discussions viewed from the perspective of Bayesian logic. It is concluded that drawbacks exist for this particular objective-criteria regime, but that research and logical analysis should continue.     

Quantitative analysis of sharp-force trauma: an application of scanning electron microscopy in forensic anthropology.

Scanning electron microscopy (SEM) has occasionally been used by anthropologists and forensic scientists to look at morphological characteristics that certain implements leave on bone. However, few studies have addressed techniques or protocols for assessing quantitative differences between tool marks on bone made by different bladed implements. In this study, the statistical variation in cut mark width was examined between control and test samples on bone using a scalpel blade, paring knife, and kitchen utility knife. Statistically significant differences (p < .0005) were found between cut marks made by the same knife under control and test conditions for all three knife types used in the study. When the control sample and test samples were examined individually for differences in mean variation between knife types, significant differences were also found (p < .0005). While significant differences in cut mark width were found, caution should be used in trying to classify individual cut marks as being inflicted by a particular implement, due to the overlap in cut mark width that exists between different knife types. When combined, both quantitative and qualitative analyses of cut marks should prove to be more useful in trying to identify a suspect weapon. Furthermore, the application of SEM can be particularly useful for assessing many of these features.     

Improve Toolmarks' Impressions in Soft Wax

When the forensic toolmarks laboratory receives for examination and comparison a tool that is suspected of having been involved in a crime, the expert performs tests designed to determine whether or not the specific tool generates the same toolmarks as those found at the crime scene. This is performed by testing tool striation on a piece of soft metal, such as lead, and examining the marks left by the tool. Studies have shown that wax may be an optimal material for this purpose. This study examines the use of wax at different temperatures and shows that quality of results is better when the wax is cooled (recommended temperature is ?18°C). At this temperature, the wax is flexible enough but does not smear and is not sticky. This makes the obtained marks clearer and of better quality.     

Neural networks in forensic science.

Neural networks were developed to study and mimic the functioning of the human brain. Humans are good at pattern recognition; the question is how good neural networks are at it, particularly with problems of forensic science interest. Simulation experiments with a type of neural network known as a Hopfield net indicate that it may have value for the storage of toolmark patterns (including bullet striation patterns) and for the subsequent retrieval of the matching pattern using another mark by the same tool for input. Another type of neural network, the back-propagation network (BPN), is useful for applications similar to those for which standard statistical methods of pattern classification can be used. This would be an appropriate approach to the matching of general component patterns, such as gas chromatograms of gasoline, or pyrolysis patterns from materials of forensic science interest, such as paint. The BPN may provide better results than statistical methods, but it is currently necessary to try both to determine which would be best for any given situation.     

Reporting likelihood ratio for casework in firearm evidence identification

Likelihood ratio (LR) plays an important role in estimating the weight of evidence in firearm evidence identifications. LR is computed from a statistical model including the distribution of the known-matching (KM or within) and known-nonmatching (KNM or between) comparison scores. Current LR procedures rely on KM/KNM scores from existing reference firearm toolmark data sets or alternatively from generating a set of test fires using multiple firearms. Both procedures may contain theoretical or practical issues which may hinder the LR procedures from reporting an unbiased LR estimation in casework. In this paper, a reference data set was established from a set of firearms, each test-fired two cartridge cases, resulting in a basic data set and a control data set. The congruent matching cells (CMC) method was used to generate CMC scores that are used to fit in the KM/KNM statistical distributions for LR estimation. In the initial test, 130 firearms from eight manufacturers were used for generating a reference data set consisting of 260 cartridge cases representing 130 KM and 8385 KNM pairwise breech face images. Test results showed that the KM and KNM distribution intersect at CMC = 2, which is equivalent to LR = 1 (equally to support both the prosecutor and the defense propositions). When the CMC threshold is increased to 6 or more, the LR values are higher than a million, which can provide extremely strong support to the conclusion of the same firearm (or the prosecutor's proposition) in the casework of firearm evidence identification.     

The Class Characteristic Mark of the H&M Mul‐T‐Lock Picking Tool in Toolmarks Examination

Mul‐T‐Lock is a high security lock cylinder distinguished by the use of a telescoping “pin‐in‐pin”—tumbler design. Picking the Mul‐T‐Lock cylinder with a traditional picking tool is highly complicated because it can get stuck between the inner and outer pins. The H&M Mul‐T‐Lock picking tool was designed to overcome this problem and facilitate the picking of the “pin‐in‐pin” cylinder. The purpose of this research is to determine whether H&M Mul‐T‐Lock picking tool leaves class characteristic mark and whether it can be distinguished from traditional picking tools marks and from regular key marks. It also describes and determines the class characteristic mark left on telescopic pins, its origin, recurrence, and its benefit to the toolmarks examiner. When receiving a Mul‐T‐Lock from a crime scene, a toolmarks examiner can quickly determine whether or not it was picked by an H&M Mul‐T‐Lock picking tool by noticing the class characteristic mark which this typical tool leaves.