POLICY EVALUATION AND PROGRAM TERMINATION

One example of treating the policy process as an integrated process is the relationship between policy evaluation and policy termination.
Policy and program terminations are seen as having three rationales: cost reductions, programmatic inefficiencies, and political ideology. The third appears to be the most important. Even so, formal program evaluation is increasingly critical to the termination exercise. This has important policy implications for both the professional evaluation community and those who have program termination responsibilities.     

PROGRAM EVALUATION AND ADMINISTRATIVE CONTROL

What is the role of program evaluation research in making and implementing social policy and how do program evaluators view the social programs they evaluate? This article discusses the findings of two closely related studies that examine these questions from the perspective of organization theory. These studies found that program evaluations rely on methods of research that do not correspond to the extent of uncertainty in social programs over goals and causal knowledge, and that most evaluations define organizational effectiveness solely in terms of goal achievement. In addition, of the various groups with a stake in the evaluation process, only federal and top program administrators influenced the implementation and interpretation of the studies. These findings, when taken together, suggest that program evaluation research acts more to augment administrative control than to increase our understanding of the effects of social policy.     

AN IMPACT IDENTIFICATION METHOD FOR DEVELOPMENT PROGRAM EVALUATION

Evaluation is essential to planning and implementing effective develop- ment programs. The resource limitations, multidimensionality of develop- ment program impacts, cultural barriers between evaluators and those impacted, and the diversity of settings in which evaluations must be con- ducted arc serious constraints on the use of traditional research methods to evaluate development programs. Similar constraints are faced in con- ducting most social impact assessments. We suggest that a method of impact identification that makes use of experts, including the people ef- fected by a project, can be used in development project evaluation. The method, which is based on the noniinal group technique, is described, as are some of its applications in Latin America and the Caribbean. We conclude iiy considering directions for future development and the relationship be- tween planning, evaluation, and impact assessment.     

IMPROVING THE QUALITY OF RESEARCH SYNTHESIS IN PROGRAM EVALUATION

Because research synthesis enables one to determine either the overall effectiveness of different types of treatments, it is becoming increasingly popular as a tool in program evaluation. Numerous methodological problems arise, however, when research synthesis is applied to studies conducted in field settings. The present paper categorlzes and discusses these problems as being threats to either the (1) internal validity (whether one can draw conclusions about cause and effect), (2) statistical conclusion validity (whether one's inferential statistics are capable of detecting cause-and effect relationships, (3) construct validity (whether one's treatments and outcome measures are valid operationalizations of the independent and dependent variables of interest), or (4) external validity (whether one can generalize results to particular populations, settings, or time periods) of research synthesis (see Cook & Campbell, 1979). Specific recommendations are made for minimizing these threats to validity, In order to improve the quality of research synthesis in program evaluation. Finally, the validit framework is applied to an actual synthesis to identify strengths, weaknesses, and potential means of enhancing research quality.     

AN ADAPTIVE-LEARNING APPROACH TO ENVIRONMENTAL REGULATION

This conceptual piece reviews the muddle in reform thinking in environmental regulation. It suggests that rhetoric and relief posturing will not lead to an improvement in regulatory performance, and various market mechanisms, while promising, are ill-suited to current organizational processes. Authentic reform efforts, it contends, should place greater reliance upon an adaptive learning approach to environmental policy development and implementation. Conceptual elements of such an approach are sketched out.     

AN INTEGRATED APPROACH TO POLICY TRANSER AND DIFFUSION

This article reviews the existing literature on policy transfer and diffusion and offers a more integrated theory for examining the spreading of policy. Typical studies have treated each as separate, yet they are similar in many respects. For example, both involve many of the same agents and processes involved in the spreading of policy. This article integrates the two literatures by developing a theoretical continuum upon which varying degrees of policy diffusion occur.