Question order bias revisited: A split‐ballot experiment on satisfaction with public services among experienced and professional users

Public decision‐makers increasingly rely on satisfaction surveys to inform budget and policy decisions. Yet, our knowledge of whether, and under what conditions, this input from public service users provides valid performance information remains incomplete. Using a preregistered split‐ballot experiment among government grant recipients in Denmark, this article shows that the ordering of survey questions can bias satisfaction measures even for highly experienced and professional respondents. We find that asking about overall satisfaction before any specific service ratings lowers overall user satisfaction, compared to the reverse order, while the correlations between specific ratings and overall satisfaction are relatively stable. Also, the question order effect outweighs that of a large‐scale embezzlement scandal, which unexpectedly hit the investigated government agency during the data collection. Our results support rising concerns that subjective performance indicators are susceptible to bias. We discuss how practitioners should approach satisfaction surveys to account for the risk of question order bias.     

THE ORDER OF QUESTIONS IN A SURVEY ON CITIZEN SATISFACTION WITH PUBLIC SERVICES: LESSONS FROM A SPLIT‐BALLOT EXPERIMENT

Surveys of citizen satisfaction with local public services have become widespread, with the results increasingly used to reorganize services, to allocate budgets, and to hold managers accountable. But evidence from a split‐ballot experiment that we conducted suggests that the order of questions in a citizen survey has important effects on reported satisfaction with specific public services as well as overall citizen satisfaction. Moreover, the correlations of specific service ratings with overall satisfaction, and thus the identification of key drivers of overall satisfaction, also turn out to be highly sensitive to question order. These findings are in line with research on priming and question order effects in the survey methodology literature, but these effects have not been carefully examined before in the context of citizen surveys and public administration research. Policy and management implications of these finding are discussed.     

Public Sector Commissioning: Experiences of Voluntary Organizations Delivering Health and Social Services

The perceived benefits to users and beneficiaries of voluntary organizations delivering public sector services have been well documented and include the engagement with parts of society that the state cannot reach, personalized service delivery, and improved services. There is a lack of clarity, however, as to whether these perceived benefits are being realized. This article presents the experiences of voluntary sector organizations involved in public sector commissioning. The research suggests that the public sector is limiting the voluntary sector's engagement in service design and performance monitoring. These findings raise questions about the role of the voluntary sector in public service provision.     

THE IMPACT OF PUBLIC SERVICE MOTIVES ON WORK OUTCOMES IN AUSTRALIA: A COMPARATIVE MULTI‐DIMENSIONAL ANALYSIS

There is a general consensus that individuals who are driven to serve the public interest can possess a mix of public service motives for engaging in altruistic actions. This article proposes that when analysed simultaneously, some public service motives may play a more important role than others in influencing work outcomes. The pressing questions are which ones and how? Through a survey of a group of Australian public sector employees, this article explores the relationship between the various dimensions of public service motivation (PSM) and the common work outcomes: organizational commitment, job satisfaction and job motivation. The combinations of PSM dimensions that had a greater impact on these work outcomes are also found to vary with different outcomes.     

THE PUBLIC SERVICE ORIENTATION: ISSUES AND DILEMMAS

The public service orientation sets service for the public as the key organizational value, providing motivation and purposes both for the local authority and its staff. This article describes the public service orientation before focusing on the major issues which this orientation raises. In particular, it examines service for, not to, the public; the ways in which the public service Orientation differs from consumerism; and the relationship to the political process. Finally, the article surveys the dilemmas posed by the public service orientation.     

Satisfaction with and Success of Employee Training from a Public Service Motivation Perspective

New public management requires modernization processes, including modern human resource practices, to enhance public sector performance. According to human capital theory, well-qualified and highly motivated public sector employees improve institutional performance; this study investigates the extent to which employee training as human resource practice can enhance one component of employees’ public service motivation (PSM), namely public interest, and their competencies as employee outcome. We examine public interest as a mediator or a moderator of the relationship between satisfaction with employee training and the resulting competence gain. The findings indicate a positive direct effect of satisfaction with employee training on competence gains and a mediating effect of public interest.     

Motivations Behind Using Performance Measurement: City-wide vs. Selective Users

Abstract

This article identifies and describes the utilisation of performance measurement in Florida local governments. Two research questions are considered here: which factors influence Florida city governments to use performance measurement? And how do the factors associated with cities that are city-wide users differ from cities that are selective users? The paper develops a framework constructed from literatures in performance measurement and management innovation to develop hypotheses that are tested with 2005 Florida local government data. This study finds strong support for the role of community attributes, form of government and internal capacity as contributors to the use of performance measurement. The study also finds the factors that influence city-wide users are different from factors that influence selective users, especially with regard to revenue size and the reward/incentive system.     

EXIT AND VOICE IN LOCAL GOVERNMENT RECONSIDERED: A ‘CHOICE REVOLUTION’?

Market‐based public management reform has introduced customer choice among competing providers of public services. Choice entails exit, an option which Albert Hirschman famously reserved for the market, while voice is the key mode of communication in political life. Based on elite and mass surveys, the article studies how exit is perceived by citizens and local political and administrative leaders in Norway and Sweden, and how the two strategic options relate to each other. Citizens are more positive towards customer choice and exit than are leaders, albeit with some variation across different public service sectors. Political and administrative leaders are positive towards customer choice models as a strategy to empower clients but more critical in terms of the potential loss of accountability and control that contracting out services may entail.     

Co‐production as a route to employability: Lessons from services with lone parents

Policy‐makers claim to support personalized approaches to improving the employability of disadvantaged groups. Yet, in liberal welfare states, mainstream activation programmes targeting these groups often deliver standardized, low‐quality services. Such failures may be related to a governance and management regime that uses tightly defined contracting and performance targets to incentivize (mainly for‐profit) service providers to move people into any job as quickly as possible. This article draws on evidence from third sector/public sector‐led services in Scotland to discuss an alternative approach. These services co‐produced personalized support in partnership with disadvantaged service users (in this case vulnerable lone parents). We suggest that, in this case, street‐level co‐production and personalization were facilitated by co‐governance and co‐management in the design and organization of provision. We conclude by identifying lessons for future employability services.     

PUBLIC SECTOR INNOVATION FOR EUROPE: A MULTINATIONAL EIGHT‐COUNTRY EXPLORATION OF CITIZENS’ PERSPECTIVES

This study presents a three‐year effort to study public sector innovation in Europe from the viewpoint of the citizen. It examines a model of public sector innovation across a multinational sample of eight countries and 626 participants. The paper develops a theory of antecedents to and consequences of innovation in public administration as perceived by knowledgeable citizens and end‐users. Participants were senior and mid‐level managers of third sector organizations that work closely with citizens both as individuals and groups, and with public sector agencies in various domains. Structural Equation Modeling technique was used to examine two theoretical and five alternative models. Major findings that transcend national borders were found to be: (1) responsiveness, together with leadership and vision are important antecedents of innovation in the public sector; (2) public sector innovation affects trust in and satisfaction with public administration; and (3) the effect of public sector innovation on trust and satisfaction is both direct and mediated by the image of public organizations. The paper ends with a discussion of the theoretical and practical implications for public administration theory, especially for public sector innovation in Europe, and with directions for future studies.     

Improving public services by mining citizen feedback: An application of natural language processing

Research on user satisfaction has increased substantially in recent years. To date, most studies have tested the significance of predefined factors thought to influence user satisfaction, with no scalable means of verifying the validity of their assumptions. Digital technology has created new methods of collecting user feedback where service users post comments. As topic models can analyse large volumes of feedback, they have been proposed as a feasible approach to aggregating user opinions. This novel approach has been applied to process reviews of primary care practices in England. Findings from an analysis of more than 200,000 reviews show that the quality of interactions with staff and bureaucratic exigencies are the key drivers of user satisfaction. In addition, patient satisfaction is strongly influenced by factors that are not measured by state-of-the-art patient surveys. These results highlight the potential benefits of text mining and machine learning for public administration.     

Yours emotionally: How emotional intelligence infuses public service motivation and affects the job outcomes of public personnel

We investigate the role of emotions in the public sector and their relation with work outcomes typical of public arenas. We focus on the emotional intelligence of public healthcare staff and its potential impact on public service motivation, job satisfaction, affective commitment and the quality of service to citizens. Using data from 200 nurses in a large Israeli public hospital, we examine a mixed model of direct and indirect relationships. The findings support direct positive relationships between emotional intelligence, public service motivation and job outcomes, and several indirect relationships: (1) the mediating effect of public service motivation in the relationship between emotional intelligence and affective commitment, and (2) the moderating role of emotional intelligence in the relationship between public service motivation and service quality. The impact of public service motivation on self‐reported service quality is stronger for public employees with more emotional intelligence.     

Low-Hanging Fruit: Leadership,Perceived Prosocial Impact,and Employee Motivation

Transformational leadership affects public service motivation, but little is known about the context dependency of this association. If citizen contact and, therefore, relative perceived impacts on others and society differ, the association between transformational leadership and motivation is also expected to differ. Analyzing public employees and their leaders from four organizational contexts, we find that employees have relatively higher perceived impact on others and are more user-oriented in contexts with high citizen contact. The association between transformational leadership and employee motivation also depends on employees’ perceived impact, implying that some fruit hangs lower than other when leaders try to increase employee motivation.     

THE DOG THAT DIDN'T BARK: HOW PUBLIC MANAGERS HANDLE ENVIRONMENTAL SHOCKS

Do negative budgetary shocks reduce performance in public organizations? If so, by how much and in terms of which criteria? Are public managers able to make internal management choices to limit or eliminate the effects of such shocks? These questions are investigated in a set of hundreds of organizations over an 8‐year period. For the most part, budgetary shocks of 10 per cent or more have only limited or no negative impacts on performance in the short term. The most salient policy objective and production for more disadvantaged clientele are especially insulated from shocks. Decisions about internal resource allocation and personnel management can be shown to protect core production while sacrificing more peripheral activities and capital investment. Questions that remain to be investigated include whether short‐term protection comes at the expense of some longer‐term losses, and—ironically—whether effective management under such circumstances weakens over time the political case for adequate budgets.     

DOES PERFORMANCE INFORMATION ABOUT PUBLIC SERVICES AFFECT CITIZENS' PERCEPTIONS,SATISFACTION, AND VOICE BEHAVIOUR? FIELD EXPERIMENTS WITH ABSOLUTE AND RELATIVE PERFORMANCE INFORMATION

We evaluate a theory of the effects of publishing performance information on citizens' collective voice to local providers about public service performance and the perceptions and attitudes that influence their voice. Field experiments show that information about low absolute and relative performance of local government household waste recycling services lowers citizens' perceptions of performance, and information about high absolute and relative performance raises perceived performance. Relative information makes citizens judge local providers as being more responsible for outcomes in the case of high performance, suggesting that systems for comparative performance reporting increase local accountability for outcomes. Negativity bias is evident, with information about low absolute performance reducing citizens' satisfaction but information about high performance not raising satisfaction. Information about low performance did not trigger collective voice protest behaviour as hypothesized, suggesting that providers who need citizens' collective voice the most do not get it.     

Does User Co-Production of Public Service Delivery Increase Satisfaction and Trust? Evidence From a Vignette Experiment

Whereas it is assumed that involving users in the delivery of public services yields more positive evaluations of those services, this study shows that levels of satisfaction and trust are not necessarily positively affected by such user co-production. An experimental vignette design among students (n = 174) is used to analyze the differences concerning trust and satisfaction between co-produced and non-co-produced public services. In some cases, the results suggest, co-production actually leads to less satisfaction and trust. This might be explained by the self-serving bias, which states that co-producers take credit for success but blame service providers for failure.     

Public service motivation and continuous organizational change: Taking charge behaviour at police services

Building change capabilities into public organizations is a challenge for strategic management. This study focuses on the micro‐level of extra‐role behaviours that contribute to continuous improvements in working procedures at the front‐end of organizations (i.e., taking charge behaviour; TCB). More particularly, we examine public service motivation (PSM) as a key variable mediating between perceived practices and TCB of street‐level bureaucrats. The analyses are based on survey data from a state police force in Germany (N = 1,165). Results confirm the role of PSM as full mediator, but this mediation is limited to the relationship between leadership behaviours and TCB, while perceived organizational characteristics—except for red tape—have direct positive impact on TCB.     

RESIGNED BUT SATISFIED: THE NEGATIVE IMPACT OF PUBLIC SERVICE MOTIVATION AND RED TAPE ON WORK SATISFACTION

This article examines the relationship between red tape, Public Service Motivation (PSM) and a particular work outcome labelled ‘resigned satisfaction’. Using data from a national survey of over 3754 public servants working at the municipal level in Switzerland, this study shows the importance of looking more closely at the concept of work satisfaction and, furthermore, of thoroughly investigating the impact of the different PSM dimensions on work outcomes. Unsurprisingly, research findings show that red tape is the most important predictor of resignation. Nevertheless, when PSM dimensions are analysed separately, results demonstrate that ‘commitment to public interest/civic duty’ and, to a lesser extent, ‘attraction to policy‐making’ decrease resignation, whereas ‘compassion’ and ‘self‐sacrifice’ increase it. This study thus highlights some of the negative (or undesirable) effects of PSM that have not been previously addressed in PSM literature.     

Funding,Management, and Individual-Level Factors: What Factors Matter in Predicting Perceived Organizational Effectiveness?

Scholars have examined organizational effectiveness in state and federal government agencies to determine which factors matter. Their findings revealed that public organizational effectiveness is affected by environmental, human resource management, organizational, and individual-level factors. However, what is conspicuously absent is the impact funding has on organizational effectiveness. To further previous literature, this article examined agency funding levels as well as management and individual-level factors to determine the relationship these factors had on organizational effectiveness. In doing so, a model was developed to predict perceived organizational effectiveness, and it was tested on 330 United States government workers in the state of New York. The findings from the analysis were clear: perceived organizational effectiveness was impacted by employee perceptions regarding the level of funding the agencies were allocated. Additionally, the level of role ambiguity and employee participation in decision-making as well as employee job performance and public service motivation levels were also found to matter. The implications and limitations of these findings are discussed in the article.     

Outsourcing,bureaucratic personnel quality and citizen satisfaction with public services

This article investigates the relationships between outsourcing, bureaucratic personnel quality (BPQ) and citizen satisfaction with public services. Our baseline expectation is of a negative association between outsourcing and service quality; however, we argue that this tendency can be counteracted when the government buyer has a more competent and motivated personnel, not only in managerial positions, but across the board. Better‐educated and paid public employees are likely to have an important moderating effect on service quality through their input into quality specifications, their ability to recognize the provider's consummate or perfunctory behaviour, and their willingness to act on the observed performance. Using data from a cross‐section of Sweden's municipalities, our analysis reveals a robust association between higher levels of outsourcing and lower levels of citizen satisfaction, but the data do not provide unambiguous support for the hypothesis that the strength of this association diminishes when BPQ is higher.