Performance Measurement in Italian and Spanish Local Governments: Comparative Policy Analysis

NPM reforms have become a global trend and performance management systems are considered suitable to enhance the decision-making process and accountability. The aim of the paper is to carry out a comparative study on the adoption of performance measurement tools in Italian and Spanish (medium-sized and large) local governments. It seeks to find out how widespread these tools are and how their usefulness is perceived. The results show differences between the two countries and that the presence of professional managers – experienced with performance measurement tools – positively affects the adoption of these tools. Moreover, performance measurement tools are perceived as a support for accountability purposes.     

Incentives and their dynamics in public sector performance management systems

We use the principal‐agent model as a focal theoretical frame for synthesizing what we know, both theoretically and empirically, about the design and dynamics of the implementation of performance management systems in the public sector. In this context, we review the growing body of evidence about how performance measurement and incentive systems function in practice and how individuals and organizations respond and adapt to them over time, drawing primarily on examples from performance measurement systems in public education and social welfare programs. We also describe a dynamic framework for performance measurement systems that takes into account strategic behavior of individuals over time, learning about production functions and individual responses, accountability pressures, and the use of information about the relationship of measured performance to value added. Implications are discussed and recommendations derived for improving public sector performance measurement systems. © 2010 by the Association for Public Policy Analysis and Management.     

公共部门绩效评估:来自发展中国家的经验

在过去的几年中,公共部门绩效评估的理念在很多发展中国家日渐盛行。但是,由于发展中国家的公共部门软弱无力,法律框架不一致,公共服务提供的数量和质量不足,以及问责机制不完善等因素,导致公共部门绩效评估变得愈加复杂,且充满挑战。因此,总结和分析发展中国家公共部门实施绩效测量系统所取得的经验和教训,提出更具指导性的建议就显得尤其重要。基于此,本文以菲律宾、尼泊尔和印度尼西亚三个亚洲国家公共部门的绩效测量系统为分析对象,采用案例研究的分析方法,着重探讨了近几年来这些国家在绩效测量系统的设计、实施和管理等方面的一些经验教训。尽管没有一种放之四海而皆准的解决方案,但是本文在对这些经验教训反思的基础上,总结出的具有可持续性的绩效评估系统成功的五个关键要素,即所有权、激励、简单化、透明度和部门政策目标,可以为发展中国家的公共部门绩效评估提供最好的实践指导①。     

Can Performance Management Best Practices Help Reduce Crime?

As performance management systems gain popularity in police agencies, they are increasingly being criticized for their ineffectiveness at reducing crime and for encouraging abuse of authority. Scholars and practitioners, however, argue that these systems can be effective if they are implemented properly with the use of best practices. This article contributes to this debate by evaluating the impact of performance management systems and associated best practices on improving police performance. An analysis of primary survey data of 308 U.S. police agencies shows that performance management systems are effective tools in helping reduce crime across almost all crime categories. However, the best practices of performance reporting to citizens and providing discretion to officers have no significant impact on crime reduction, while consulting officers in the target‐setting process has a negative impact on police performance.     

A Guide to Benchmarking COVID-19 Performance Data

If the COVID-19 pandemic has taught us anything, it is that policy makers, experts, and public managers need to be capable of interpreting comparative data on their government's performance in a meaningful way. Simultaneously, they are confronted with different data sources (and measurements) on COVID-19 without necessarily having the tools to assess these sources strategically. Because of the speed with which decisions are required and the different data sources, it can be challenging for any policy maker, expert, or public manager to make sense of how COVID-19 has an impact, especially from a comparative perspective. Starting from the question “How can we benchmark COVID-19 performance data across countries?,” this article presents important indicators, measurements, and their strengths and weaknesses, and concludes with practical recommendations. These include a focus on measurement equivalence, systems thinking, spatial and temporal thinking, multilevel governance, and multimethod designs.     

Caring, Controlling, Contracting and Counting: Governments and Non-profits in Community Services

Performance measurement and contracting out are central elements of new public management systems. At first sight these elements seem necessarily connected for reasons of accountability. However, for some kinds of services, implementation of conventional performance measurement systems may exacerbate tensions in contracting out. Using a case study of child and family welfare services in NSW, this paper shows that differences in the missions and operating modes of public and non-government community service providers are thrown into sharp relief by performance measurement, when observed from the perspective of practitioners in service-providing agencies. Practitioners perceive that their priorities in service provision differ sharply from those of the department funding their activities — and seeking to measure their performance. These findings pose challenges for the 'partnership' model now prevalent in community services provision.     

Changes to Financial Management Performance Measures,Accountability Factors and Accounting Information Systems of Privatised Companies in Australia.

This article examines use of performance measurement and accountability factors and the related changes to accounting systems after organizations are privatised. The outcome has been determined by reviewing prior research and by undertaking a survey of organizations privatised in Australia between 1990 and 1998. Although the government's primary motivation might have been the reduction of government debt overall, changes in performance indicators, accountability factors and information systems suggest that efficiency remains an ongoing goal of the new management arrangements. The article concludes that there have been changes in performance measurement and accountability and that this has required some adjustment to accounting information systems, but not to the extent expected.     

Managing Performance at Local Government Level: The Cases of the City of Brisbane and the City of Melbourne

Local governments have been involved in a continuous reform process during recent decades. In many cases, this process has focused on the introduction of performance measurement and management. Reforms have evolved from the mere use of indicators to integrated management systems. In this article, the Balanced Scorecard, a system designed to answer the need for integrated management systems, is used as the framework to analyse how local governments have managed the use of performance management systems. The demands for better public performance, for greater customer focus, for enhanced decision-making and for increased responsiveness have an important role in the design of performance management systems. In addition, a perceived crisis in the area of management can act as catalyst for the implementation.     

Performance Measurement in the Public Sector in England: Searching for the Golden Thread

Despite the significant volume of studies on public sector performance measurement, a paucity of empirical research describes in detail the systems and processes used at different levels of government to measure and manage performance. This study focuses on the experience of Public Service Agreements in the public sector in England. In particular, the impact of a centralized, performance measurement‐driven approach on public service delivery is analyzed using case studies in a health care and a police organization. Despite efforts to introduce a “golden thread” to link different levels of the public sector hierarchy, in both cases, there was relatively low consistency in terms of performance indicators, targets, and priorities. Significant implications are evident for the design and role of performance targets and indicators, for the possibility to align frameworks at different levels of the public sector, and for the importance of feedback loops in measurement systems.     

From Measurement to Management: Breaking through the Barriers to State and Local Performance

The Winter Commission’s aspirations for improvement of governance at the state and local level resulted in proposals to modernize public institutions and systems to remove the barriers on executive and managerial authority to act. Improving government performance and accountability to citizens requires leadership to empower employees by reducing rules, increasing discretion, and rewarding innovation. The performance measurement movement and its related performance management movement are public management trends of wide influence in state and local government that are both an adjunct to, and a reflection of those aspirations. Case studies of cities that have sought to develop and use performance measurement and engage citizens demonstrate great potential to improve governance and manage for results that citizens want. But even exemplary jurisdictions face challenges using evidence‐based, data‐driven performance management approaches. Promoting best practice requires better scholarship to understand the determinants of successful implementation, adoption, and use of performance measurement. The outcomes of performance management systems are generally unmeasured and little is known about their cost effectiveness or endurance over time. The promise is there, but our expectations should be tempered.     

Factors Influencing the Use of Performance Data to Improve Municipal Services: Evidence from the North Carolina Benchmarking Project

Many local governments measure and report their performance, but the record of these governments in actually using performance measures to improve services is more modest. The authors of this study examine patterns of performance measurement use among a set of North Carolina cities and conclude that the types of measures on which officials rely, the willingness of officials to embrace comparison, and the degree to which measures are incorporated into key management systems distinguish cities that are more likely to use performance measures for service improvement from those less likely to do so.     

One Standard Fits All? The Pros and Cons of Performance Standard Adjustments

Despite the wide‐ranging use of performance measures within the public sector and the growing use of performance bonuses to recognize performance achievements, the use of formal performance standards adjustment procedures in public performance measurement systems is relatively rare. Burt S. Barnow of Johns Hopkins University and Carolyn J. Heinrich of the University of Wisconsin–Madison set forth the basic arguments in favor of and against the use of formal or informal procedures for adjusting performance expectations. They describe how performance standards adjustments processes are currently (or have been) in use, review the evidence of their effectiveness or problems encountered in their application, and explore the consequences of the inadequacy of performance standards adjustments. The authors offer recommendations for the improvement of public sector performance measurement systems and conclude why this area remains fruitful for future research experimentation. The nice thing about standards is that there are so many of them to choose from. —Andrew S. Tannenbaum     

Evaluating Capital Management: A New Approach

The objective of this article is to develop a methodology for evaluating capital management performance. We have employed a new methodology, fuzzy rule–based systems (FRBS), that allows evaluators to break down complex systems into manageable components. FRBS can also use a variety of data types by converting data into ordinal input measures that are not overly sensitive to small measurement errors. In developing an overall performance measure, the evaluator under an FRBS creates explicit rules for combining inputs that can reflect the complex contextual judgments commonly made by evaluators. Using survey data on 35 large American cities from the Government Performance Project, we develop an FRBS for city capital management.     

Models of Performance-Measurement Use in Local Governments: Understanding Budgeting, Communication, and Lasting Effects

While attention has been paid to a few cities and counties exhibiting effective performance measurement systems, most U.S. local governments have been active in the development and use of performance measurement for several decades. This research examines the effects of performance-measurement information on budgetary decision making, communication, and other operations of U.S. local governments. Data are drawn from a national survey of city and county administrators and budgeters that included nearly 300 governments. Findings indicate the use of performance measurement by local departments is pervasive, although survey respondents are less enthusiastic about measurement effectiveness. Study results show subtle distinctions between city and county officials in their use of performance measurement for budgetary purposes and processes. Research findings indicate the consistent, active integration of measures throughout the budget process is important in determining real budget and communication effects in local governments.     

Promoting the Utilization of Performance Measures in Public Organizations: An Empirical Study of Factors Affecting Adoption and Implementation

Despite its appeal for improving government, many state and local governments have not developed performance-measurement systems, and even fewer use these systems to improve decision making. This study examines the factors that affect the utilization of performance measurement, based on the results of a national survey of state and local government officials. The goals of the study were to provide better information on the patterns of usage of performance measurement and to use this information to develop an elaborated model of the factors presumed to affect utilization. Using distinctions from the policy and evaluation literature, hypotheses were tested and confirmed: Policy adoption is driven more heavily by factors from rational and technocratic theory, whereas actual implementation is influenced by factors addressed by political and cultural considerations.     

Strange bedfellows: Federal systems and performance management

This paper offers the first link between models of the measurement and management of performance and the dimensions of governance arrangements in federal systems. Four ideal type approaches to governance in federal systems are correlated against four ideal types of measuring and managing performance. The paper develops a model that will support empirical research examining reform trajectories where evolving systems of federalism require evolving systems to manage performance in joint arrangements between levels of government.     

地方政府绩效评估的"南通模式":效应、瓶颈及努力方向

基于目标导向的地方政府绩效评估的“南通模式”具有十分明显的传递效应、导向效应和监督效应。同时,也存在着指标体系没有充分体现现代政府绩效评估的要求、政府绩效评估工作机制有待统一完善、政府绩效考核的方法和工具比较单一、政府绩效考核的结果运用不够全面等亟待消除的难点与瓶颈。完善基于目标导向的地方政府绩效评估模式的主要路径是：以科学发展观指导地方政府绩效评估、完善政府绩效评估工作机制、将政府绩效评估从技术方法提升到制度安排、深化地方政府绩效评估结果运用等。     

A systems view of the measurement of the performance of public enterprises in India

This article presents systems approach to the measurement of the performance of public enterprises in India. Thus it is a movement from a narrow concept of efficiency to a broader approach wherein measurement of performance is linked to the achievement of objectives. The need for such an approach is based on the theoretical developments and set against the problems currently experienced by public enterprises in India. As an alternative a three-tier objective framework, with standards, and a set of agencies for evaluation is recommended. Finally the problems of application of the three-tier objectives are discussed.The author acknowledges the useful suggestions and comments given by his colleagues Dilip K. Lahiri and J. K. Sen Gupta, and John D. Montgomery of Harvard University.     

Setting the Standard in Performance Measurement Systems

A fundamental challenge in the design of performance measurement and incentive systems is the establishment of appropriate benchmark levels of performance, also known as performance standards. Drawing from the information economics, contract theory and public administration literatures, we derive theoretical implications for the construction of performance standards. We then assess alternative methods that are commonly used to construct performance standards and consider their application in performance measurement systems in public programs. We draw out important lessons for the establishment of performance benchmarks and other implications for performance standards system design in public organizations.     

Pedagogy of regulation: Strategies and instruments to supervise learning from adverse events

Diverse scholars have argued that standards and performance measurements are “instruments of control” that have a profound influence on the day‐to‐day lives of individuals and organizations, causing constitutive effects. Regulatory bodies increasingly use standards to oversee and monitor the regulated. This paper discusses the Dutch Health and Youth Care Inspectorate's use of both standards and a performance measurement system introduced to monitor how Dutch hospitals investigate and learn from serious adverse events. Rather than focusing on how standards affect regulated practices and organizations, our study examines how the use of these instruments affects the standard maker, that is, the Inspectorate. We explore how the Inspectorate's work practices, standards, and coupled performance measurement system influence its regulatory pedagogy, reviewing practices, and decisionmaking. We conclude that standards and performance measurement systems are not by definition “instruments of control” as their constitutive effects are (under)determined by the relationships in which they are enacted.