Non-Response Bias with a Web-Based Survey of College Students: Differences from a Classroom Survey About Carrying Concealed Handguns

Internet-based and e-mail surveys represent viable administrative methods for efficiently collecting data. These methods appear to be particularly well-suited for studying college student populations, a group that has gained attention from criminologists interested in testing theories. An important concern with administering surveys with the Internet and via e-mail is that of non-response bias. Despite the appeal of online surveys, nonresponse bias associated with these methods has not been sufficiently investigated. The study described here estimates nonresponse bias associated with a web-administered survey that measured opinions about changing concealed handgun carrying laws on college campuses, items likely to elicit polarizing opinions. Results show important substantive differences between web-administered and in-class versions of the survey. Students who responded to the web survey expressed more extreme opinions and behavioral responses to a proposed policy that would allow concealed handgun carrying on campus. Survey researchers who utilize web-based administrative methods should consider using multiple sources of leverage when soliciting participation and must carefully evaluate sample representativeness.     

Methodological review of ‘the incidence and prevalence of woman abuse in Canadian university and college dating relationships: Preliminary results from a national survey,’ by Walter S. DeKeseredy and Katharine Kelly

This essay reviews and assesses the methods used to conduct the National Study of Woman Abuse in University and College Dating Relationship. Funded by Health and Welfare Canada, Walter S. DeKeseredy and Katharine Kelly surveyed 1,835 females and 1,307 males in a stratified multi-stage cluster sample enrolled in University and College courses across the country in 1992. This essay examines the sampling design, reported response rates, data collection methods and frequency estimates of the study carried out by these two researchers in conjunction with the Institute for Social Research at York University. It is noted that while there are certain methodological difficulties associated with the study, these are problems that any survey of this type might encounter. The review of the methods suggests that while perfect surveys are not possible, good surveys are. The essay concludes with the observation that this survey should be qualified as the latter.     

Measuring Civilian Defensive Firearm Use: A Methodological Experiment

Estimates of the incidence of victim gun use from the National CrimeVictimization Survey (NCVS) are consistently lower than are those fromother studies. To examine the divergence, we conducted a survey that gaugedthe impact of methodological differences between the NCVS and the otherstudies. For half of the sample, we asked questions from the NCVS, followedby questions from the other surveys. For the other half of the sample, wepresented the questions in the reverse order. We examined two hypotheses:(1) survey methods account for the divergent results, and (2) the questionscover unrelated activities. The results provided some support for the firsthypothesis, but respondents also reported many more defenses to thequestions from the other surveys than to the NCVS questions. Consistent withthe second hypothesis, this suggests that the NCVS and the other surveysmeasure responses to largely different provocations.     

Medicare program; granting and withdrawal of deeming authority to national accreditation organizations--HCFA. Final rule

This rule implements section 1865(a) of the Social Security Act, as amended by sections 2345 and 2346 of the Deficit Reduction Act of 1984 and section 6019 of the Omnibus Budget Reconciliation Act of 1989. The amendments expand the types of providers and suppliers of services that we may consider to meet conditions of participation or certification, nursing home requirements, or conditions for coverage by virtue of their accreditation by a national accreditation program; these providers and suppliers are also subject to validation surveys. The rule also extends confidentiality to accreditation surveys, other than home health agency surveys, done by accreditation programs in addition to the Joint Commission on Accreditation of Healthcare Organizations, except that we may disclose survey and related information to the extent that such information relates to an enforcement action we take on the basis of accreditation survey findings. The rule also provides for: the release to, and use by, HCFA of all accreditation surveys and other relevant information even if a provider or supplier is not subject to a validation survey; the removing of deemed status of a facility based on a validation survey, an accreditation survey, or other information related to either; and appeal procedures for denied or withdrawn approval.     

Mail vs. telephone surveys of criminal justice attitudes: A comparative analysis

This study compares results from surveys using two modes of administration. A subset of questions from the 1992Texas Crime Poll, a statewide poll conducted annually by mail, was replicated in telephone interviews using the Computer Assisted Telephone Interviewing System. The phone survey yielded better participation rates but less complete responses to individual attitude questions than did the mail poll. As expected, the mail survey was less expensive but less efficient than the automated phone survey. The central finding was that all but one of the responses to five attitude questions difered significantly across the surveys. The samples differed in their demographic composition, but this did not explain differences in the substantive findings from the mail and phone surveys. The discussion considers alternative explanations for differences in the findings from the two surveys and suggests direction for further comparative research.     

Health law and mental health law courses in US medical schools

Results of a recent survey of all 127 medical schools in the United States indicate that about two fifths of medical schools offer a separate course that focuses on topics in medicine and law and a number of medical schools integrate health law topics into other courses. Presumably reflecting concern over temporary medical malpractice litigation, most health law courses include informed consent, medical malpractice, privileged/confidential information, and patients' rights. In contrast, schools that offer a course on psychiatry and law are clearly in a minority. It is elective at all but two of the 13 schools with such a course. Although the hours allotted and the format of these courses vary greatly, courses typically cover most of the topics listed on the questionnaire. Most of the courses are led or co-led by a member of the American Academy of Psychiatry and the Law. Information from two additional surveys suggests two related factors that may influence a medical school to present a separate course on health law. Medical licensing boards were surveyed to determine which states require physicians to be examined on health law. In two states that require physicians to pass a separate medical jurisprudence examination for licensure, all four-year medical schools offer a course on health law for medical students. Medical malpractice companies providing coverage in all 50 states and the District of Columbia were surveyed to determine which states have the highest claim rates. The claim rate per 1,000 physicians insured per year was significantly greater in states with health law courses than was the rate in states without such courses.     

Interview mode effects on estimates of need for alcohol and drug treatment among welfare recipients: evidence from a quasi-experiment

Employing a quasi-experimental design, this study compared responses from face-to-face and telephone surveys of welfare recipients to assess the effects of survey modality on prevalence estimates of alcohol and drug abuse and need for treatment. Samples were drawn from adult welfare recipients in Oklahoma in 2001. We generated 1-year and 30-day prevalence estimates of alcohol and drug use, employed several common measures of substance-related behavioral and physical problems to estimate treatment need, and used odds ratios to compare prevalence estimates. Results indicated that telephone surveys provided estimates that were (1) statistically no different from those of face-to-face administration in the categories used to estimate treatment need and (2) significantly higher than those of face-to-face surveys for admission of ever having a substance problem and driving after consuming alcohol or drugs. We conclude that, for welfare recipients, telephone surveys provide similar data quality about treatment need as do more costly face-to-face interviews, a finding that is important and of practical concern to both practitioners and methodologists. More broadly, we argue that further survey methodology research is required for specific populations and subgroups that are often the focus of criminal justice and public health research and response.     

Trademark parody and the mass media: Going beyond survey evidence in the determination of “a likelihood of confusion”

This article examines trademark parody in statutory and mass media case law by, in part, analyzing several key cases which illustrate the use of quantitative social science research in the determination of trademark parody infringement. Although the definition and nature of trademark parody has not been settled definitively, courts’ attitudes toward survey evidence, particularly its probative value and materiality in the determination of copyright and trademark infringement litigation, have evolved over time. Courts now admit survey evidence if it meets certain methodological conditions. In trademark parody litigation, survey evidence pointing to a “likelihood of confusion” has evolved as the standard test of trademark infringement. However, there are questions whether vague, subjective concepts like “a likelihood of confusion” and “perception of substantial similarity” between trademarks can be adequately measured by consumer surveys. It is argued that multi‐method research which has both quantitative and qualitative aspects would provide more reliable data than the “one‐shot” surveys or case studies that are widely used in settling trademark infringement cases.     

Perceptions of Neighbourhood Safety and Policy Response: A Qualitative Approach

Safety perceptions of residents are often analysed through surveys and compared with factual crime developments. Using the Dutch city of Rotterdam as an urban context of improved crime levels, this article provides a critique on standardised surveys in the research of safety perceptions and its presupposed connection to factual crime. Contrasting survey results from the Rotterdam Safety Index with qualitative data from 64 in-depth interviews in four districts, the qualitative narrative contradicts findings from the survey and implies more nuanced and diversified policy responses to safety issues. Because of the tendency of surveys to connect safety perceptions to factual crime, their unsuitability to catch subtle perceptions and their inability to expose new viewpoints, we argue for de-quantification: a lesser dependency on—but not a repeal of—survey data in this area, supplemented by a periodic qualitative approach in the research of crime and safety information (qualitative monitoring).     

Psychologists as consultants for changes of venue the use of public opinion surveys

This study reports the use of public opinion surveys to support motions to change venue. Step-bystep procedures of venue surveys are outlined, and results of their use in five capital murder trials are presented. Employing a quasi-experimental approach to the surveys allows inferences, about the likelihood of obtaining between-county differences of certain magnitudes. In addition, the use of a survey instrument with standardized subparts permits a second, novel type of contrast: comparisons previous cases. The responsiveness of this approach to the typical criticisms of venue surveys is discussed.     

Using network sampling in crime victimization surveys

Since crime victimizations are statistically rare events, surveys to estimate rates of victimization are difficult and expensive. In this paper, we examine the advantages of network sampling over traditional methods for conducting crime victimization surveys. Network sampling links population households in specified ways, for reporting purposes, in order to increase the probabilities of locating households with particular characteristics. We conducted a reverse record check field experiment to test whether a telephone survey using network sampling is feasible to collect crime victimization data. Three types of crimes-burglary, robbery, and assault-were tested along with two types of networks-relatives and co-workers/close friends. This paper examines the extent to which victims report their victimization experiences in a general crime and victimization interview and the extent to which a randomly selected relative or close friend will report the same victimization incident in an identical interview. A number of multiplicity counting rules are compared in terms of reporting errors and a mean square error analysis.     

The legality of employee attitude surveys in union environments

Employee attitude surveys are becoming an increasingly popular tool for employers. A host of legal implications, such as the circumstances under which they can be used, what they can ask, and whether or not they are a subject of mandatory bargaining, arise when surveys are conducted by companies that have an incumbent union or by companies that are involved in union-organizing campaigns. The following article describes the survey process, outlines some of the inherent advantages and pitfalls, and examines the legal questions raised when surveys are used by nonunion employers, by employers with incumbent unions, and by employers who are involved in union-organizing-campaigns. It concludes with recommendations for employers that undertake attitude surveys.     

Living in the demos: qualitative approaches to demographic questions

Contributors to this special issue use qualitative methodologies to explore questions traditionally posed by demographers. The introduction summarizes each article and surveys the wider potential significance of qualitative research for historical demography. The authors suggest that this research can disrupt traditional scholarly categories and methods pertaining to reproduction and other demographic phenomena. Qualitative sources may serve as wild cards suggesting new paths of investigation based on individuals' idiosyncratic viewpoints; but they may also offer ways to collapse and integrate wide bodies of knowledge by contextualizing and reframing the blurred cross-categorical world views associated with individuals' actionable ideas and ideals. Studying such views more systematically will become easier as the digitization of human culture, past and present, proceeds apace. Moreover, as digital tools for accessing and interpreting text become more sophisticated, individual- and aggregate-level studies may be increasingly understood as a single scholarly corpus, rather than two parallel approaches with scattered mutual intelligibility and intermittent cross-fertilization. As explanations for fertility decline continue to center on modernization – often without speaking its name – the authors suggest that individual narratives offer a way to subjectivize modernization while avoiding the mystical incoherence of extreme subjectivization.     

Time-lapse resistivity surveys over simulated clandestine graves

The aim of this study was to develop a better understanding of how electrical resistivity surveys can be used to locate clandestine graves. Resistivity surveys were conducted regularly over three simulated clandestine graves containing a pig cadaver, no cadaver and a pig cadaver wrapped in tarpaulin, respectively. Additionally, soil and groundwater samples were collected from two more simulated graves outside the survey area. The grave containing a pig cadaver was detectable from a low resistivity anomaly in the survey data. Groundwater data suggest that the resistivity anomaly associated with the surveyed pig grave was caused by a localised increase in groundwater conductivity. Wrapping a cadaver was found to initially change the resistivity response of a grave to a high resistivity anomaly. Resistivity surveys did not detect the disturbed soil in the grave that did not contain a cadaver. Although soil samples showed grave soil to be more porous than undisturbed soil, the lack of response from the grave that did not contain a cadaver suggests that disturbed soil was not responsible for the resistivity anomalies observed in this study. Resistivity surveys successfully detected all graves containing cadavers throughout the study, whilst also showing the potential to eliminate the need for mass excavation in a genuine search.     

Women's fear of violent crime: An exploratory test of a feminist hypothesis

Government-sponsored national victimization surveys in several countries have found consistently that women's fear of violent crime is much greater than their actual chances of being violently victimized. Not suprisingly, most attempts to account for this discrepancy begin with the assumption that women's fear is subjectively based. A few feminist theorists, however, have challenged this view. They argue that women's fear of violent crime is much more objective than the crime surveys indicate. Women's fear results in part, they suggest, from being physically abused by a husband, boyfriend, or other male intimate; an experience largely untouched in the crime surveys. Such abuse creates a generalized fear of male violence, which has shown up in the victimization surveys as fear of violent crime in public places. This study tested, and found some support for, the feminist hypothesis, using data from a telephone survey of a representative sample of 315 Toronto women.     

Evidence for the crime drop: survey findings from two Finnish cities between 1992 and 2013

In this article, results from self-report studies in two Finnish cities, Helsinki and Turku, are presented. The aims are to compare the prevalence of youth crime between these cities and changes in delinquency during the observation period. In Helsinki, the surveys took place in 1992, 2006 and 2013, and in Turku, the surveys took place in 1992, 2001, and 2013. With the exception of the Turku 2001 survey, all datasets have been collected under the auspices of the International Self-Report Delinquency Study (ISRD). The most recent survey, ISRD3, targeted comprehensive school pupils from grades 7–9 (ages 13–16), while some of the former studies excluded 7th and/or 8th grades. The results show that (1) the delinquency rates are generally higher in Helsinki than in Turku and (2) the prevalence of both property- and violence-related crimes has decreased, while drug use manifested fluctuating or increasing trends. Overall, the findings are consistent with the observation that there has been a relatively general crime drop in the Western world since the 1990s.     

Crime victims and attitudes towards the police: the Israeli case

Crime victims are a critical component of the criminal justice system. Their evaluations of the police have been studied through victimization and public attitude surveys mainly in the US and the UK. This study, which utilizes data from a large scale community survey conducted in Israel in 2008, finds that victims’ attitudes towards the police are significantly more negative than those of non-victims regarding police treatment, performance, and trust in the police. This study is the first to compare the views of victims and non-victims in Israel, while focusing on a wider array of attitudes than previously examined.     

Measurement problems in official and survey crime rates

This paper analyzes sources of error in the two major methods we use to measure crime in America—official police statistics and victimization surveys. The two produce quite different pictures of the volume and distribution of crime, but it is not clear that this is because victim-based statistics are “accurate.” Each measurement procedure has its characteristic errors, some of which it shares with the other. Comparisons of official and survey data on crime are helpful in revealing the dimensions of these error terms, and they point out the analyses which must be conducted if we are to specify their exact proportions.     

Defensive Gun Uses: New Evidence from a National Survey

The number of civilian defensive gun uses (DGUs) against criminal attackers is regularly invoked in public policy debates as a benefit of widespread private ownership of firearms. Yet there is considerable uncertainty for the prevalence of civilian DGUs, with estimates ranging from 108,000 (using the National Crime Victimization Survey) to 2.5 million (using smaller telephone surveys) per year. In this paper we analyze the results of a new national random-digit-dial telephone survey to estimate the prevalence of DGU and then discuss the plausibility of the results in light of other well-known facts and possible sources of bias in survey data for sensitive behaviors. Because DGU is a relatively rare event by any measure, a small proportion of respondents who falsely report a gun use can produce substantial overestimates of the prevalence of DGU, even if every true defensive gun user conceals his or her use. We find that estimates from this new survey are apparently subject to a large positive bias, which calls into question the accuracy of DGU estimates based on data from general-population surveys. Our analysis also suggests that available survey data are not able to determine whether reported DGU incidents, even if true, add to or detract from public health and safety.     

A consideration of telescoping and memory decay biases in victimization surveys

The relationship between memory biases and characteristics of incidents and respondents in victimization surveys were studied using National Crime Survey victimization data. Comparisons between the monthly distribution of victimizations appearing in police offense reports and the monthly distribution of victimizations reported to survey interviewers revealed evidence of substantial memory effects in victimization survey results. However, no substantial biases were found in the victimization data according to the seriosness of the event, whether or not the event was reported to the police, or respondent characteristics. That is, regardless of the characteristics of the event or characteristic of the respondent studied, the temporal distribution of victimizations reported to survey interviewers was similar. These results suggested that, whereas memory effects of the kind studied here are in evidence in reports of victimization experiences, there is no evidence that these effects are substantially related to respondent and incident characteristics, and, hence, they are much less problematic for the use of victimization survey results than would otherwise be the case.