The reliability of digitized radiographs for dental identification: a Web-based study

In the era of Daubert and other judicial rulings pertaining to the acceptability of forensic evidence, it is increasingly important that experts are able to testify that their methods have been scientifically tested and that error rates and other factors relating to reliability have been published. The purpose of this study was to determine the reliability of digitized radiographic comparisons for the purposes of dental identification. Participants with various forensic backgrounds and experience levels were passively recruited to the website. Ten forensic identification cases composed of antemortem and postmortem dental radiographs were supplied to examiners using a bespoke website. Participants responded to the cases on two occasions after a one-month washout interval using the ABFO conclusion levels for forensic identifications. A total of 115 first attempts and 87 matched second attempts were received. Of the total responses, 72% were dentally trained respondents who had completed at least one forensic identification case; of these, 38% were experienced forensic dentists who had completed more than 25 identifications. Data relating to accuracy, intra- and inter-examiner agreement, and the effect of case difficulty are presented. Mean accuracy was 85.5% for all cases, with the experienced forensic dentists obtaining a 91% success rate. The inter-examiner agreement on the negative identification cases was classified as poor. The data suggest that dental identifications resulting from the comparison of postmortem and antemortem radiographs are valid, accurate, and reliable when undertaken by experienced odontologists.     

Dentists' qualifications affect the accuracy of radiographic identification

This study assessed the effects of forensic odontologists' training and experience upon the accuracy of their dental radiographic identifications. Forty participating odontologists with various levels of training and experience completed a Web-based survey of their qualifications and then completed nine Web-based radiographic identification cases. They made their identifications using the American Board of Forensic Odontology Categories and Terminology for Body Identification. The results indicate that odontologists with high levels of training and experience performed significantly more accurately than those with lower levels. We conclude that high levels of training and experience in forensic odontology should be developed, maintained, and required of dentists who participate in a forensic team dealing with challenging identification cases.     

Dental hygiene students' matching accuracy when comparing antemortem dental radiographs and oral photographs to simulated postmortem WinID3® odontograms

Matching dental antemortem (AM) and postmortem (PM) data for human identification is especially challenging when the workforce is limited. Dental hygienists have served mass fatality incidents (MFIs) due to dental-related expertise. However, forensics within dental hygiene education and research on transferable skills is limited. This qualitative balance design study assessed senior dental hygiene students' match accuracy of simulated cases varying in dental identifiers based on AM full mouth series (FMS) radiographs and oral photographs to PM WinID3^® odontograms to demonstrate possible disaster victim identification (DVI) transferable skills gained during formal education. A convenience sample of senior dental hygiene students (n = 31) was presented information on WinID3^® interpretation, then presented with 5 mismatched cases and asked to visually interpret each to make 10 total matches; five based on AM FMS with simulated PM WinID3^® odontograms and five based on AM photographs with PM WinID3^® odontograms. Match accuracy scores ranged from 41.9% to 58.1% for cases with 1–10 identifiers, and 77.4% to 93.5% for cases with 11–40 identifiers. Accuracy when matching AM radiographs to PM odontograms versus AM photographs to PM odontograms was compared and revealed no statistical differences in match accuracy depending on image type (p = 0.388 to 1.000). Results of this pilot study suggests transferable match accuracy skills resulted from the participants' dental hygiene formal education. These baseline skills with additional specialized training support the rationale for dental hygienists serving on DVI teams. More research is needed in education and practice when preparing dental hygienists for forensic-based service.     

Dental identification by comparison of antemortem and postmortem dental radiographs: influence of operator qualifications and cognitive bias

Dental forensic identifications based on comparison of antemortem and postmortem radiographs provide effective and reliable evidence. There are no standardized procedures for assessing similarities between different types of dental radiographs (e.g. orthopantomograms, bitewings, and periapical radiographs), and the operator's subjective judgment can considerably affect identification. The purpose of this study is to evaluate the potential influence of experts' qualifications, training, and cognitive bias on the accuracy of identification. Seventy-eight differently qualified and experienced experts underwent an identification test. The expert sample was composed of 10 specialists in emergency care (ER), 10 specialists in legal medicine (ML), 20 pregraduate dental students (STU), 12 dentists (DENT), 20 dentists educated in forensic odontology (DENT-TRA), and 6 experienced forensic odontologists (FOR). The simulated cases required participants to assess the possible matching of 42 postmortem intraoral radiographs with 16 antemortem panoramic radiographs. Accuracy and specificity for the different operator groups were as follows: ER, 0.76-0.70; ML, 0.76-0.88; STU, 0.89-0.82; DENT, 0.87-0.97; DENT-TRA, 0.88-0.92; and FOR, 0.97-1. As evidenced by high rates of accuracy and repeatability, the most experienced forensic odontologist consistently outperformed operators less or differently educated and trained, especially for difficult cases. In our sample, the dentists who received additional education in forensic odontology did not necessarily perform better than dentists who had not received this additional education. Some cognitive bias, mainly the so-called observer effect, emerged as a possible source of outcome variability among the operator groups.     

Root Morphology and Anatomical Patterns in Forensic Dental Identification: A Comparison of Computer‐Aided Identification with Traditional Forensic Dental Identification*

Abstract: An online forensic dental identification exercise was conducted involving 24 antemortem–postmortem (AM–PM) dental radiograph pairs from actual forensic identification cases. Images had been digitally cropped to remove coronal tooth structure and dental restorations. Volunteer forensic odontologists were passively recruited to compare the AM–PM dental radiographs online and conclude identification status using the guidelines for identification from the American Board of Forensic Odontology. The mean accuracy rate for identification was 86.0% (standard deviation 9.2%). The same radiograph pairs were compared using a digital imaging software algorithm, which generated a normalized coefficient of similarity for each pair. Twenty of the radiograph pairs generated a mean accuracy of 85.0%. Four of the pairs could not be used to generate a coefficient of similarity. Receiver operator curve and area under the curve statistical analysis confirmed good discrimination abilities of both methods (online exercise = 0.978; UT‐ID index = 0.923) and Spearman’s rank correlation coefficient analysis (0.683) indicated good correlation between the results of both methods. Computer‐aided dental identification allows for an objective comparison of AM–PM radiographs and can be a useful tool to support a forensic dental identification conclusion.     

Modified intraoral film holders for postmortem identification.

To date there have not been any commercial dental X-ray film holders marketed to accommodate the special needs of forensic odontologists. Modification of standard Rinn XCP film holders by the investigators produced self-supporting film holders that do not require the active participation from the examinee. The modified film holders greatly simplify the operator's technique of exposing dental radiographs on cadavers.     

Collection of post mortem data: DVI protocols and quality assurance

In many countries forensic odontologists are members of the Disaster Victim Identification (DVI) team. As part of their post mortem (PM) tasks work on the incident site may include securing and preserving the dental material and evidence before transport to the mortuary. In the autopsy room the main aim is to register the PM dental status. Photographs and radiographs are essential documentations in addition to a conventional registration of the dental status. Abbreviations in the registration may be used if agreed with the ante mortem (AM) team. Dental age estimation may be an aid in the sorting process and especially in victims without previous dental treatment. Interpol has a form set as part of their DVI manual. Forensic odontologists working in pairs and checking each other will act as quality assurance (QA) as suggested by International Organization for Forensic Odonto-Stomatology (IOFOS). Direct entry into the computer program as part of the registration in the autopsy room may save time and manpower.     

The Odontology Victim Identification Skill Assessment System*,†

Abstract: Mass fatality identification efforts involving forensic odontology can involve hundreds of dental volunteers. A literature review was conducted and forensic odontologists and dental educators consulted to identify lessons learned from past mass fatality identification efforts. As a result, the authors propose a skill assessment system, the Odontology Victim Identification Skill Assessment System (OVID‐SAS), which details qualifications required to participate on the Antemortem, Postmortem, Ante/Postmortem Comparison, Field, and Shift Leader/Initial Response Teams. For each qualification, specific skills have been identified along with suggested educational pedagogy and skill assessment methods. Courses and assessments can be developed by dental schools, professional associations, or forensic organizations to teach and test for the skills required for dental volunteers to participate on each team. By implementing a system, such as OVID‐SAS, forensic odontologists responsible for organizing and managing a forensic odontology mass fatality identification effort will be able to optimally utilize individuals presenting with proven skills.     

Lessons learned from large-scale comparative dental analysis following the South Asian tsunami of 2004

The aim of this study was to examine the quality of the ante-(AM) and postmortem (PM) dental data that were submitted for entry into the PLASS data system in Phuket, Thailand, following the Boxing Day (December 26) Tsunami, 2004. The investigators were two forensic odontologists who were part of the New Zealand Disaster Victim Identification team that worked at Wat Yang Yao morgue and at the Information Management Center in Phuket. Our findings underline the usefulness of dental data in human identification, but point to a number of significant sources of error. Of the 78 PM records received, only 68% of radiographs and 49% of photos confirmed the accompanying dental charting. This underlines the value, particularly of photographs of the dental arches, in quality control. It also points to a large error component, which may have been due to inexperience of the operators, fatigue, poor conditions in the temporary morgue, or the problem of tooth-colored fillings. Of the 106 AM records received, 62% were of unacceptable quality and 64% were either not accompanied by radiographs or had poor quality radiographs. These results indicate that AM data collection ideally needs to be collated and checked by a forensically trained dentist(s) in the country of origin.     

数字全口牙位曲面体层片的法医学同一认定指标

目的采用颌面全口牙位曲面体层片,针对牙齿无病变者筛选简洁实用的法医学同一认定识别指标并进行编码、统计分析及评估。方法随机选取170例牙齿无病变者的颌面数字全口牙位曲面体层片进行观测．根据牙齿的生理变异特征和牙齿的排列特征分别筛选全口牙型和牙列型识别指标。按设计的编码标准对全口牙型、牙列型逐一编码,统计分析编码的多样性,以评估两类识别指标的应用价值。结果170例中共有74种全口牙型编码,多样性为43．53％：170例中共有129种牙列型编码,多样性为75．88％;170例同时进行全口牙型和牙列型编码．则共有150种全口牙型／牙列型编码,多样性为88．24％。结论全口牙型编码多样性较低,单独使用尚不能满足法医学同一认定的要求。牙列型编码的多样性比较高,具有一定的法医学同一认定价值。如果同时进行全口牙型和牙列型编码,多样性明显提高,有较高的法医学同一认定价值。     

Establishing personal identification based on specific patterns of missing,filled, and unrestored teeth

The primary goal of this research is to examine the overall utility of nonradiographic dental records for the establishment of individual identifications. It was found that even without radiographic lines of comparison, charts and notes that accurately detail a missing individual's antemortem dental condition can be essential for establishing an identification. Based on an analysis of two large datasets, individual dental patterns were determined to be generally unique, or at least very uncommon. Through this type of empirical comparison, it is possible to establish a strong, quantifiable association with a missing individual. The results of this research indicate that a definitive number of points of concordance do not need to be established in dental identification cases. Each case must be assessed individually. The critical factor is to remove subjective judgment calls from dental comparisons. This research has proposed a new method of empirical comparison that allows forensic odontologists to derive objective frequency information regarding the occurrence of specific dental patterns in the general population. The method is similar to that used for mtDNA casework, and a computer program (OdontoSearch) has been developed to make the technique accessible. It was found that even a small number of common dental characteristics may produce a very rare dental pattern, a point that may be counterintuitive to many forensic odontologists.     

Dental identification using digital images via computer network

Dental identification is a useful scientific method. In Japan, however, there are only a few forensic odontologists; moreover, until now, forensic dental services have only been offered by general dentists. These dentists may not be able to offer such forensic services during office time. For a quick comparison, the authors tried sending digital photos, taken with a 2-million-pixel digital camera, to dental offices via the Internet. If a dental office has Internet access, it is possible for dental charting to be sent directly to the autopsy room. Of course, digital images only provide the first outline. However, when antemortem dental records of the person in question are available at autopsy, a quick comparison can be made.     

Radiographic Recognition of Dental Implants as an Aid to Identifying the Deceased

Abstract:  This study was undertaken to determine if dental implants can be radiographically differentiated by company type to aid forensic identification of the deceased. Recognition of dental implants on intraoral radiographic images was assessed in a blind study using a radiographic examination guide to highlight differences between dental implants. Inter- and intra-examiner comparisons were conducted and a computer program (Implant Recognition System^®) was evaluated to see whether it improved the accuracy of implant recognition. The study found that dental implants could be radiographically differentiated by company type. The Implant Recognition System^® in its current form was of little benefit for radiographic assessment of dental implants for forensic odontologists. Prior knowledge of implant types, with a McNemar's statistical value of 92.9, proved to be most significant in identification.     

The efficiency of an X-ray screening system at a mass disaster

This is a study to determine the efficiency and efficacy of using an X-ray security screening system to locate both dental fragments and other foreign objects that might be commingled with fragmented remains in a mass disaster. A controlled study by the Pennsylvania Dental Identification Team (PADIT) revealed that a manual examination of simulated body bags containing commingled dental parts and foreign objects by a team of trained forensic odontologists was very effective in locating dental fragments and in finding foreign objects. Although this was effective, it was not efficient, because it was very time consuming. With the use of an X-ray security screening system, the time factor could be reduced. This study also revealed that even though this sophisticated equipment could reduce the time factor in locating commingled dental and foreign objects, a forensic odontologist should be utilized to be most effective.     

Results of the 4th ABFO Bitemark Workshop--1999.

Thirty-two certified diplomates of the American Board of Forensic odontology (ABFO) participated in a study of the accuracy of bitemark analysis. Examiner experience as board-certified odontologists ranged from 2 to 22 years.Examiners were given sets of photographs (a cast in 1 case) of 4 bitemark cases and asked to report their certainty that each case was truly a bitemark and the apparent value of the case as forensic evidence. Participants also received 7 occluding sets of dental casts, 1 correct dentition for each case and three unrelated to any of the cases, and asked to rate how certain they were that each set of teeth had made each bitemark. Receiver operating characteristic (ROC) analysis resulted in an accuracy score of 0.86 (95% CI=0.82-0.91). Youden's index was used to determine a cutoff point for determining an accuracy score for each case. Accuracy scores were significantly correlated with bitemark certainty and forensic value (P<0.001 in both cases) but not with examiner experience (P=0.958). The use of individual ROC analysis with weighted Youden's index to calibrate individual accuracy was also demonstrated.     

Reality bites--A ten-year retrospective analysis of bitemark casework in Australia

Criticism of forensic science, particularly that of bitemark analysis, has become increasingly common in the last decade. Much of the criticism directed at forensic odontology cites cases where miscarriages of justice have occurred when erroneous, over-confident or even false bitemark evidence has been tendered by odontologists. Despite Australia's own experience with such cases in the past, it is postulated that this does not represent the true nature of bitemark analysis as practiced by odontologists today-at least in this country. A review of 119 cases from the last 10 years confirms that 'identification' of a suspect is rarely, if ever, offered, and that conclusions reached by odontologists with respect to bitemark analysis are generally conservative. However, the results of this study also indicate that in a small but significant proportion of cases, there is still some tendency to reach conclusions that could be considered over-confident when considering the overall quality of the physical evidence offered. It is suggested that odontologists should avoid making conclusive remarks regarding the origin of the mark, or the identification of a perpetrator, when such comments are realistically precluded, given the low evidentiary value of the mark itself.     

Dental participants in mass disasters--a retrospective study with future implications

Mass casualty incidents continue to require the services of forensic dentists to determine the identity of victims. Across North America and Europe. teams of forensic dentists train, using mock disaster exercises, to prepare for such duties. It is vital that these mock exercises simulate the features of real disaster situations as far as possible. In order to inform those responsible for the design and implementation of mock exercises, a study was undertaken to determine the features of actual disasters that dental personnel had attended. Using a questionnaire, data were solicited from 38 odontologists. The average number of disasters attended by the respondents was eight, with an average casualty number of 94. Aircraft crashes were the most frequent cause of disasters that were attended by the odontologists. The authors conclude that future mock disaster exercises should replicate features of aircraft crashes as closely as possible by using commingled, fragmented, and burned remains. In addition, mock disasters should require the identification of a realistic number of individuals to ensure authenticity and the maximum logistical preparedness of participants.     

“Identified”, “probable”, “possible” or “exclude”: The influence of task-irrelevant information on forensic odontology identification opinion

In a mass disaster situation, identification of the deceased utilising comparison of dental features is frequently heavily relied upon to facilitate rapid and accurate outcomes. The method consists of the comparison of clinical and radiographic records depicting oral structures and dentition to allow an opinion to be produced on a presumed identity. Current forensic odontology identification opinions are expressed as categories of levels of identification. Categories such as “Identified”, “Probable”, “Possible” and “Exclude” are used in various forensic odontology identification scales. The boundaries between the levels of the scales are not fixed; hence, category selection is highly subjective. It is uncertain how extrinsic factors such as exposure to contextual task-irrelevant information or operator experience influence category selection. In this study, forensic odontologist and dentist participants read task-irrelevant context case information containing either strong or weak identification or non-identification suggestions before evaluating and comparing pairs of true matching and non-matching dental radiographs. They were then asked to form an opinion regarding identification using one of four categories from the INTERPOL scale. Context information was found to influence categorical decisions. The magnitude and direction of influence depended on the type of participant, the true match status of the radiographs, and the strength and direction of bias of the context. The results of this study demonstrate the contextual effect and fluidity of the boundaries between the categories on the identification scale and highlight the need for stringent protocols to be developed regarding the use of these categorical scales to enable decision making to be more objective.     

Antemortem records of forensic significance among edentulous individuals

The identification of edentulous individuals is problematic due to poor provision of labelled dental prostheses. Dental records may still provide useful information for odontologists in the comparative identification process. The purpose of this study was to determine the level of forensically significant information contained within the dental records of a population of denture wearers attending the University of Manchester School of Dentistry. Two hundred and two dental records were examined and a proforma completed. The mean age of the patients was 72 years. Medical history were absent in 4% of all records and only 67.8% of the written records were rated as good. Thirty-two percent of the records contained one or more panoramic radiographs but 30% of these were over 3 years old rendering their usefulness in identification procedures questionable. In total only 18% of the examined records contained antemortem information that would enable identification. These data suggest that the process of denture marking is an essential in order to ensure that the identification of this population can be undertaken expediently by dental means.