On evaluating evaluations

The act of evaluation requires an expenditure of resources. In Part I of this paper, we present a simple decision tree model borrowed from operations research to provide a conceptual framework for considering whether or not to commit such resources. In Part II, once the evaluation is carried out, we address the problem of evaluating the evaluation as a vehicle for producing useful information to decisionmakers. Evaluation inputs, processes, and outcomes are defined and discussed within the context of comprehensive evaluation of evaluations.     

Sunlight or Window Dressing? Local Government Compliance with South Africa's Promotion of Access to Information Act

Institutional reforms often face challenges of poor compliance and implementation at the local level. I analyze these in a context where weak state capacity and limited enforcement make widespread compliance unlikely. South Africa's 2000 Promotion of Access to Information Act tasked the South African Human Rights Commission with monitoring and promoting compliance, but with limited resources and no authority to sanction. I argue that local political competition can generate endogenous incentives for compliance, even under conditions of weak capacity and limited external enforcement. Using data on 234 South African municipalities over 10 years, I find higher levels of compliance among more politically competitive municipalities. The results are not simply a function of differences between African National Congress–governed municipalities and others, and are robust to numerous controls for different forms of local state capacity.     

From norms to programs: The United Nations Global Compact and global governance

Norms shape policy when they get translated into concrete programs. What if a widely shared norm gets translated into a weak program? How might this influence the program's legitimacy? We examine these issues in the context of the United Nations Global Compact, a voluntary program that embodies the widely shared norm of corporate responsibility. While both international intergovernmental organization (IGO) and international non‐governmental organization (INGO) networks support this norm, they differ on the adequacy of the Compact's program design. We explore how this tension affects the diffusion of the Compact across countries, which vary in their levels of embeddedness in IGO and INGO networks. Our findings suggest that embeddedness in IGO networks encourages adoption, while embeddedness in INGO networks discourages it. Our analysis provides important lessons for sponsors of voluntary governance mechanisms. Widespread support for a norm does not automatically ensure support for a program that claims to embody it.     

Transnational advocacy and domestic law: International NGOs and the design of freedom of information laws

Can international non-governmental organizations (INGOs) influence domestic policy? This paper offers new quantitative evidence of the impact of INGOs in one specific policy area—Freedom of Information (FOI) laws—as well as highlighting an under-studied mechanism of INGO influence on the design of domestic laws. I test this argument by examining the effect of legal analyses of draft FOI legislation published by the INGO Article 19. These analyses provide expert legal assessments and make normative evaluations—both information politics and symbolic politics. I find that in countries in which Article 19 conducted legal analyses, the design of the subsequently passed FOI laws was significantly stronger than in countries that were not subject to such analyses. I demonstrate that this finding is not an artifact of Article 19’s selection process. I also present suggestive evidence that highlights symbolic politics, not information politics, as the more salient mechanism. Finally, I examine the process of FOI drafting and adoption in Serbia to illustrate the argument and specific mechanisms at work.