FIELD NETWORK RESEARCH IN POLICY EVALUATION

The field-network evaluation studies (FNES) approach to policy evaluation research seeks to overcome deficiencies of small-sample case study method and of the large-sample survey research approach. Methodologically, FNES uses many of the familiar techniques of both these approaches interviews, data collection and analysis, limited sampling, field observation, and document analysis. The crucial difference is sample size. The FNES approach using a middle-range sample of 50 to 60 research sites has the advantages of the case study method in being able to provide an in depth account of a program and how it operates, and is sufficiently flexible to permit a shift in the analytical framework as the research proceeds thus overcoming the inflexibility of the instruments of survey research.
Seven major studies employing the FNES approach have been carried out or are underway in the United States of America. The principal components of the methodology are a network of university-based field associates and a central management group. The field associates collect the information and the data using a uniform analytical framework and reporting form. The central staff aggregates these analyses into a single report that cuts across the sample. This approach and the use of a middle-range sample make it possible to draw generalizable conclusions based on the national experience, and also provide sufficient detail to differentiate policy impacts among the sample jurisdictions.     

South Africa's unintended experiment in school choice: how the National Education Policy Act,the South Africa Schools Act and the Employment of Educators Act create the enabling conditions for quasi-markets in schools

School choice is often identified with right-leaning, voucher-happy, market-oriented public school systems like those found in the United States. Thus, the proposition that a social democratic state such as South Africa will offer many primary and secondary school learners far greater choice strikes many as counter-intuitive and implausible. The authors demonstrate that the three major pieces of education framework legislation—National Education Policy Act (NEPA), South Africa Schools Act (SASA) and Employment of Educators Act (EEA)—conspire with recent historical events and deep political and constitutional commitments to create South Africa's unintended experiment in school choice.

The authors emphasize that the legal framework created by legislation and regulation are necessary but not sufficient conditions—they prefer to call them enabling conditions—for the creation of quasi-markets in schools. The generation of quasi-markets in schools depends on several other factors required for all markets. The absence of many of these features in much of South Africa explains why the majority of South African learners do not have access to quasi-markets in schools. The absence of such features is largely a function of apartheid's legacy of deeply entrenched patterns of inequality in primary and secondary schooling.

Having demonstrated that historical, political, legal and economic conditions had the unintended consequence of producing school choice—and that school choice was not the result of the state's adoption of a conscious and deliberate policy—the authors examine the state's response to this de facto policy. The authors remain agnostic as to the desirability of the de facto policy and conclude with an exploration of some of the primary critiques of choice in South Africa. While they dismiss the ‘political’ critiques as largely facile, the available empirical evidence suggests the limited systemic benefits and the potentially deleterious consequences for the poorest of the poor who reside in areas where quasi-markets exist. The state's current ‘conscious’ attempts to re-engineer a modest mixed model, that emphasizes access to existing quasi-markets—and thus exploits superior existing school stock for the benefit of learners from historically disadvantaged communities—and that shifts public resources to those schools in the greatest need, accords with what little we know about the advantages and disadvantages of choice.     

Advertising and promotion of medical devices

Dr. Portnoy, a former senior clinical reviewer and manager for the FDA's Center for Devices and Radiological Health, provides guidance for determining acceptable practices for the claims, content, and appearance of advertising and promotional materials for medical devices. In the course of doing so, he discusses important regulatory and legal precedents, and provides examples of successful and problematic advertising and promotion strategies including those that resulted in FDA Warning Letters, enforcement activities, and in some cases, monetary and criminal penalties.     

Are effective drug courts an urban phenomenon?: considering their impact on recidivism among a nonmetropolitan adult sample in Washington State

Drug courts represent a significant development in criminal justice during the past 15 years, and a small but growing literature suggests they are effective in reducing drug use and criminal behavior. Most of these studies evaluate the effects of drug courts in urban areas, however. This study adds to this literature by considering the effects of this intermediate sanction among adult offenders in a small, nonmetropolitan county of northwest Washington. Using a retrospective comparison group of matched control participants, these results show that the prevalence and incidence of rearrest is significantly lower among drug court graduates than probationers. These differences in recidivism persist even when the age, race, gender, and number of days at risk in the community are statistically controlled. Among those who did recidivate, drug court graduates did not significantly differ from controls in duration to first arrest and arrest incidence. Policy implications are discussed.     

Changing patterns of addiction and public aid receipt: tracking the unintended consequences of welfare reform

Sharp declines in welfare rolls since the passage of welfare reform legislation have led many to label it a social policy success. Using data from prereform and postreform samples of welfare applicants and recipients, as well as ethnographic data on welfare reform implementation, we examine three hypotheses based on concerns raised during the welfare reform debate about the possible effects of new policies on substance abusers and addicts: First, they would be "scared off," or discouraged from applying to aid by welfare's new requirements surrounding work and treatment. Second, they might be "weeded out," or face discrimination in the application process because of concerns about the difficulty of moving them successfully from welfare to work. Third, they might be "bumped down," or shifted to local aid programs rather than moving from welfare to self-sufficiency. Our empirical analysis finds no evidence of scaring off or weeding out, and some evidence of bumping down. Using ethnographic data, we offer some possible explanations for these findings by placing them in the context of policy change and implementation in the years following welfare reform.     

RATIONALISM VERSUS INCREMENTALISM IN CRIMINAL SENTENCING

Rationalism in management science tends to mean attempting to determine the benefits and costs of the alternative decisions under consideration, and then picking the one that is best on benefits minus costs. Incrementalism tends to mean determining the decisions that actually get made under various circumstances, and then working with those existing decision rules as the basis for making adjustments to consider special or changing circumstances. Those two approaches can be well illustrated with the problem of attempting to determine what criminal sentences should be legislated to cover given crimes and prior records. The analysis tends to show that a rationalist approach is more effective in achieving societal goals when (1) alternative policies can be meaningfully related to those goals, and (2) existing decisions reflect individual goals which are generally in conflict with societal goals. An incrementalist approach is more effective when either of those criteria is absent, which is so when seeking to arrive at legislatively determined nondiscretionary criminal sentencing.     

Citizen sampling simulations: A method for involving the public in social planning

The growth of the planning function of government raises the question of how planning can be accomplished by democratic means. A new technological device—the teaching computer—seems to be ideally suited for disscussions between experts and the public on issues of medium and long-range planning. The teaching computer can be thought of as a mass communications system with feedback.The author wishes to acknowledge research support from the Program on the Social Implications of Science and Technology at the University of Illinois under National Science Foundation grant GR-60. The research described is being carried out through the Institute of Communications Research. The facility being used is located at the Computer-based Education Research Laboratory of the University of Illinois which is supported in part by the National Science Foundation under grant GF-81 and the Advanced Research Projects Agency under grant ONR-Nonr 3985 (08). This paper was presented at the second International Future Research Conference held in Kyoto, Japan, April 10–16, 1970.