Three Lenses of Evidence‐Based Policy

This article discusses recent trends to incorporate the results of systematic research (or ‘evidence’) into policy development, program evaluation and program improvement. This process is consistent with the New Public Management (NPM) emphasis on efficiency and effectiveness. Analysis of evidence helps to answer the questions ‘what works? and ‘what happens if we change these settings?’ Secondly, some of the well known challenges and limitations for ‘evidence‐based’ policy are outlined. Policy decisions emerge from politics, judgement and debate, rather than being deduced from empirical analysis. Policy debate and analysis involves an interplay between facts, norms and desired actions, in which ‘evidence’ is diverse and contestable. Thirdly, the article outlines a distinction between technical and negotiated approaches to problem‐solving. The latter is a prominent feature of policy domains rich in ‘network’ approaches, partnering and community engagement. Networks and partnerships bring to the negotiation table a diversity of stakeholder ‘evidence’, ie, relevant information, interpretations and priorities. Finally, it is suggested that three types of evidence/perspective are especially relevant in the modern era – systematic (‘scientific’) research, program management experience (‘practice’), and political judgement. What works for program clients is intrinsically connected to what works for managers and for political leaders. Thus, the practical craft of policy development and adjustment involves ‘weaving’ strands of information and values as seen through the lens of these three key stakeholder groups. There is not one evidence‐base but several bases. These disparate bodies of knowledge become multiple sets of evidence that inform and influence policy rather than determine it.     

The domestic politics of international development in South Korea: stakeholders and competing policy discourses

Abstract

The paper examines the domestic politics surrounding South Korea's foreign aid policy. It delineates the institutional characteristics and strategic interests of key government and non-government stakeholders, and suggests an analytical framework to comprehend the country's aid policy regime. It suggests that two competing policy discourses exist – one emphasising ‘intellectual leadership’ and the other ‘ethical leadership’ as the key principle of aid policy. In practice, the country's political leadership promulgates a complex amalgam of these discourses in alignment with their own political imperatives and interests. The paper discusses ‘Global Saemaul Undong’ as such an example under the incumbent Park Geun-Hye administration.     

Intervention and Statebuilding Beyond the Human: From the ‘Black Box’ to the ‘Great Outdoors’

This article analyses intervention and statebuilding as shifting towards a posthuman discursive regime. It seeks to explore how the shift to ‘bottom-up’ or post-liberal approaches has evolved into a focus upon epistemological barriers to intervention and an appreciation of complexity. It attempts to describe a process of reflection upon intervention as a policy practice, whereby the need to focus on local context and relations – in order to take problems seriously – begins to further undermine confidence in the Western episteme. In other words, the bottom-up approach, rather than resolving the crisis of policy practices of intervention, seems to further intensify it. It is argued that the way out of this crisis seems to be found in the rejection of the aspiration to know from a position of a ‘problem-solving’ external authority and instead to learn from the opportunities opened up through the practices of intervention. However, what is learnt does not seem to be able to fit into traditional modes and categories of expertise.     

Policy analysis,policy practice and political science

Bridgman and Davis have responded to criticism of their widely‐used model of the policy process as a cycle, ‘a series of interlocking steps’ by describing it as ‘pragmatic’, a ‘toolkit’, ‘not a theory’. This article asks what makes for ‘practical knowledge’ of the policy process. It identifies the theoretical basis for the ‘policy cycle’ model, and asks how this model relates to research on policy and to policy practitioners' own knowledge. It argues that we need to recognise the way that underlying theory about policy forms part of policy practice, and to give more attention to the relationship between research, experiential knowledge, and formal maps like the ‘policy cycle’.     

A New Era for Think Tanks in Public Policy? International Trends,Australian Realities

Although the powerful have always sought advice from the knowledgeable, it took the appeal of the policy sciences movement of the late 1940s and onward to build and consolidate a veritable industry of policy analysis and advice. ¹ One of the hallmarks of this development was the advent of institutes that were exclusively devoted to produce research‐based policy arguments and to inject these into the policy‐making process. These organisations were referred to as ‘think tanks’. Half a century later, the project of the policy sciences movement has been amply criticised, and has mutated into various philosophies of policy analysis, each harbouring distinct and often conflicting perspectives on the nature and role of (scientific) knowledge in the battle of arguments that is public policy‐making. The first wave of the policy sciences movement's privileging of science‐based policy has not disappeared. In fact it is currently experiencing a revival under the banner of ‘evidence‐based policy’. But it has to compete with other views of public policy‐making which deconstruct the authority claim of scientific knowledge, emphasising instead its contestability. Yet there are now more organisations that refer to themselves, or can be labelled, as ‘think tanks’ than ever before. Why? And what does it mean to be a ‘think tank’ in the post‐positivist era and in the increasingly boundary‐less, highly networked societies of today? This article first surveys recent developments in the world of think tanks as reported by the international literature on the subject, and then examines the implications for understanding the nature and role of Australian think tanks.     

Whose ‘Freedom of Navigation’? Australia,China, the United States and the making of order in the ‘Indo-Pacific’

The so-called freedom of navigation through the Malacca straits and the South China Sea, some of the world’s busiest trade routes, has long been of concern to scholars and practitioners of international politics in the region. Increasing tensions around territorial disputes recently propelled the issue to the forefront of global foreign and security policy making. Yet, despite the frequent invocation of threats to the ‘freedom of navigation’ for the justification of military measures to protect the ‘liberal rules-based order’, the substance of this rule or norm remains ambiguous and the nature of the threatened order unclear. Located at the confluence of the Indian and Pacific Oceans, Australian discourses represent a suitable case for clarifying both. Starting from the original provisions on navigational regimes in international law, this study analyses the meanings that officials, think tank analysts and academics have been attributing to the freedom of navigation and contextualize them in the evolving debate about order. Focusing on political rather than legal discourses, it finds that concerns with the freedom of navigation are largely unrelated to the safety of maritime transport. Instead, they serve as proxy for an increasingly static imagination of international order – written backward in time – to be secured.     

The Multiple Domains of Harmonisation: Politics,Policy, Process and Program

This article builds a taxonomy of the different functions performed by the term ‘harmonisation’ in contemporary policy debates. Four broad functions or domains of use are identified – political, policy, process and program – within each of which there are multiple different uses. Based on this classification, the article then develops a multi‐dimensional conceptual framework through which the term can be better understood and examined, its political uses identified and isolated, and harmonisation initiatives constructed, framed and analysed. The framework should prove useful for Ministers and government departments called upon to determine if, how and to what extent to harmonise regulations in a particular area; regulators called upon to administer and enforce harmonised regulatory regimes; and regulatees, practitioners and academics concerned to understand the impact of a harmonisation task.     

Putting Food Sovereignty to Work: Civil Society Governmentalities and Canada’s People’s Food Policy Project (2008–2011)

The People’s Food Policy Project (PFPP) used ‘food sovereignty’ to unite civil society organizations and build a national food policy agenda in Canada from 2008 to 2011. Agri-food scholarship largely highlights the resistance and empowerment dynamic of food sovereignty in the context of neoliberal capital relations. We propose that the story of what food sovereignty discourse does, or could do, in the work of civil society organizations (CSOs), is more complicated. This article contributes to agri-food literature and CSOs studies by examining the governmentalities of the PFPP. We find that the PFPP’s food sovereignty produced at least two discourses: food sovereignty as ethic, or a governmentality of resistance and agrarian empowerment; and food sovereignty as tactic, which we see as a governmentality of administration by CSOs. While PFPP activists increasingly share a spoken commitment to food sovereignty, the analytic of governmentality allows us to show these important differences in the movement, rooted in how CSO actors understand their day-to-day work, and the tensions these differences bring to their seemingly united agenda.     

‘Women's rights as human rights’: Feminist practices,global feminism,and human rights regimes in transnationality 1

This paper argues that the recent calls for articulating women's rights as human rights can be successful only by misrecognition of the geopolitical context of human rights internationalism and the nationalisms that are sustained by it. Arguing that it is only on the level of universalized constructions of ‘women’ as a category and the generalized invocations of oppression by ‘global feminism's’ ‘American’ practitioners that such discourses of rights become powerful, this paper argues that policy and action require addressing localized and transnational specificities that created gendered inequalities. Even in national contexts such as in India, generalized invocations of women's human rights have not been useful since hegemonic forms of religion and culture have also been oppressive to women in minority communities. Concepts of economic and social justice rather than rights may work better in many such cases.     

Photographing Handsworth: photography,meaning and identity in a British inner city

ABSTRACT

‘If you say “Handsworth”’, the novelist Salman Rushdie remarked in 1986, ‘what do you see? Most people would see fire, riots, looted shops … and helmeted cops … a front page story.’ In the 1980s, ‘front page’ images of violence and disorder had come to define areas of black settlement such as Handsworth. However, for both Stuart Hall and Paul Gilroy, photography has the potential of unearthing alternative histories of black people in Britain. Connell explores how this might work in practice by taking Handsworth, an inner-city area of Birmingham, as its case study. Following the Handsworth riots in 1985, a photograph of the ‘black bomber’ appeared on the front page of every national tabloid newspaper, and Handsworth became conceptualized by the media as ‘Frontline Britain’. At the same time, there are numerous examples of photographs from within Handsworth that attempt to present a different view of the community: images taken at high-street portraiture studios, community photography projects and the documentary work of the professional photographers Vanley Burke and Pogus Caesar. What such images offer the historian, it will be shown, is not clear cut. Photographs from within Handsworth are suggestive of possible themes in any alternative history of race in Britain, particularly in their emphasis on everyday life. However, Connell shows that it is also necessary to understand what is often the unacknowledged politics behind these images, something that makes them—in differing ways—as problematic as the stereotypical narratives presented on the front pages of tabloid newspapers.     

Relationships between Policy Academics and Public Servants: Learning at a Distance?

The cultures and practices of the public service and academic researchers are very different. However, there are areas of common interest in policy and governance, and some potential for building closer relationships. Public servants make direct use of academic research only in exceptional circumstances. Nevertheless, there are other ways in which academic expertise can be useful and influential. This article surveys the international literature on the ways in which practitioners make use of external expertise, including academic research. It also considers whether the heightened interest in ‘evidence‐informed policy’ might provide avenues for mutual influence between practitioners and academics.     

The Professors on Public Life

Many academics misunderstand public life and the conditions under which policy is made. This article examines misconceptions in three major academic traditions—policy as science (e.g., ‘evidence‐based policy’), normative political theory, and the mini‐public school of deliberative democracy—and argues that the practical implications of each of these traditions are limited by their partial, shallow and etiolated vision of politics. Three constitutive features of public life, competition, publicity and uncertainty, compromise the potential of these traditions to affect in any fundamental way the practice of politics. Dissatisfaction with real existing democracy is not the consequence of some intellectual or moral failure uniquely characteristic of the persona publica, and attempts to reform it are misdirected to the extent that they imagine a better public life modeled on academic ideals.     

Private regulation,public policy,and the perils of adverse ontological selection

What problems can private regulatory governance solve, and what role should public policy play? Despite access to the same empirical evidence, the current scholarship on private governance offers widely divergent answers to these questions. Through a critical review, this paper details five ontologically distinct academic logics – calculated strategic behavior; learning and experimentalist processes; political institutionalism; global value chain and convention theory; and neo-Gramscian accounts – that offer divergent conclusions based on the particular facets of private governance they illuminate, while ignoring those they obfuscate. In this crowded marketplace of ideas, scholars and practitioners are in danger of adverse ontological selection whereby certain approaches and insights are systematically ignored and certain problem conceptions are prioritized over others. As a corrective, we encourage scholars to make their assumptions explicit, and occasionally switch between logics, to better understand private governance's problem-solving potential and its interactions with public policy.     

Another Opportunity Lost? Victorian Labor's Enactment of Sustainability, 1999–2010

‘Sustainability’ provides the dominant frame for environmental policy debate, even though there is considerable debate to as to what sustainability is, why is it needed, and how can it be progressed. From 1999 through to 2010, Victoria was governed by Australian Labor Party (ALP) led governments that, at times, actively pursued the goal of sustainable development. This culminated in the stated ambition for Victoria to be ‘world leaders in environmental sustainability debate and practice’. This paper explores the way in which sustainability was enacted by Victorian Labor while in government. The evidence indicates that the potential of Victorian Labor's vision was never realized, and that it failed to significantly reform the neoliberal policy settings it inherited.     

Pathways to impact in local government: the mini-Stern review as evidence in policy making in the Leeds City Region

Although in recent years great emphasis has been placed on global agreements and national commitments on climate change, ultimately action on mitigation and adaptation must take place at the local level. Many local authorities have to face questions of whether they should develop policies on climate change, and if so, on what evidence should policies be designed and delivered. This paper describes how academic research on the economics of low carbon cities (the ‘mini-Stern review’) helped create such an evidence base for the Leeds City Region and its constituent local authorities. We describe how the response to the evidence and the pathways to impact were different in the individual local authorities and what this means for our understanding of evidence in local policy making. In terms of Weiss’ (Social sciences and modern states: national experiences and theoretical crossroads. Advances in political science, Cambridge University Press, Cambridge, 1991) classification, the study was mainly useful as an argument and idea rather than being used instrumentally. We find that the policy and political context in each authority determines to a large extent whether such an academic study is useable as evidence. The contents and timing of the study need to align with existing policy and/or political agendas: is climate change on the agenda at all, with what priority and how is it framed. We find confirmation of a relationship between the policy problem type and the role of evidence as argument, idea or data. The mini-Stern study itself was just one contribution to wide-ranging processes of informing, convincing, pressurising, etc., not just within the different councils but also within the wider communities. Other contextual factors include composition, agenda and activities of local civil society and the local business community. Finally, it depends on the expertise of policy officers in the councils what use is made of evidence. Making policy takes (much) time, translation and negotiation across levels and sectors. Policy work describes how policy officers bring their diverse forms of knowledge to bear on policy questions; how this work is done is something that is learned from practice rather than from the study.     

The Local Legitimacy of Peacekeepers

ABSTRACT

Recent scholarship and policy doctrine alike have identified local legitimacy as an important ‘success factor’ in peacekeeping – but like many such calls for greater attention to local dynamics, it is often unclear what local legitimacy actually means, how to analyse it, what causal processes are at work, and what might obstruct the operationalization of well-intentioned policy recommendations for peacekeepers to seek local legitimacy. This article aims to bring clarity to the complex concept of local legitimacy, including the ways in which insights drawn from legitimacy theory developed in very different social contexts can be adapted to the realities of the conflict societies into which peacekeepers deploy. First, it examines what it means to locate the legitimacy of peace operations at the local level, rather than the international. Second, it clarifies the causal links between peacekeepers’ legitimacy and their effectiveness, reviewing scholarship on local legitimacy and its adaptation of broader legitimacy theory. Third, it identifies three important reasons that locally legitimizing peacekeepers is so difficult in practice, distinguishing between the difficulties derived from the particular features of conflict societies and those derived from the institutional characteristics of peace operations.     

Journeys to the limits of first-hand knowledge: politicians’ on-site visits in zones of conflict and intervention

ABSTRACT

This article explores the practice and political significance of politicians’ journeys to conflict zones. It focuses on the German example, looking at field trips to theatres of international intervention as a way of first-hand knowledge in policymaking. Paying tribute to Lisa Smirl and her work on humanitarian spaces, objects and imaginaries and on liminality in aid worker biographies, two connected arguments are developed. First, through the exploration of the routinized practices of politicians’ field trips the article shows how these journeys not only remain confined to the ‘auxiliary space’ of aid/intervention, but that it is furthermore a staged reality of this auxiliary space that most politicians experience on their journeys. The question is then asked, second, what politicians actually experience on their journeys and how their experiences relate to their policy knowledge about conflict and intervention. It is shown that political field trips enable sensory/affectual, liminoid and liminal experiences, which have functions such as authority accumulation, agenda setting, community building, and civilizing domestic politics, while at the same time reinforcing, in most cases, pre-existing conflict and intervention imaginaries.     

Learning from NHS Inquiries: Comparing the Recommendations of the Ely,Bristol and Mid Staffordshire Inquiries

If one of the key reasons for an inquiry is to learn lessons and prevent similar events from reoccurring, recommendations must be implementable and implemented, but it is clear that lessons have not been learned and recommendations not implemented. This paper compares the ‘implementability’ of recommendations from the three inquiries of Ely, Bristol and Mid Staffordshire to stress the importance of learning lessons. It examines two broad issues of ‘who?’ and ‘what?’. First, some 80 per cent of the Ely recommendations were aimed at the institution, while 72 per cent of the Bristol and Mid Staffordshire recommendations were aimed at the system. Moreover, about 7 per cent of Ely's forty‐four recommendations have a clearly identified agent, compared to 15 per cent at Bristol and 41 per cent at Mid Staffordshire. Second, the policy tool of ‘sermons’ accounts for some 89 per cent of Ely recommendations, compared to 66 per cent at Bristol and 63 per cent at Mid Staffordshire. However, the earlier sermons did not appear to prevent the events at Mid Staffordshire occurring. Pulling these issues together, it can be suggested that, given the large number of potentially responsible agencies, recommendations should be ‘active’ with a clearly identified agent and that a clear policy tool or mechanism should be identified rather than rely on a vague tendency to sermonise.     

Evaluation and policy learning: The learners' perspective

This article examines how evaluation induces policy learning – a question largely neglected by the scholarly literature on evaluation and policy learning. Following a learner's perspective, the article attempts to ascertain who the learners are, and what, and how, learners actually learn from evaluations. In so doing, it focuses on what different types of learners actually learn within the context of the evaluation framework (the set of administrative structures defining the evaluation goals and process). Taking the empirical case of three EU programme evaluations, the patterns of policy learning emanating from them are examined. The findings are that only two types of actors involved in the evaluation are actually learning (programme units and external evaluators), that learners learn different things (programme overview, small‐scale programme adjustments, policy change and evaluation methods) and that different learners are in control of different aspects of the evaluation (learning objectives and processes) according to the evaluation framework established by the European Commission.