Strategies for Improving Measurement Models for Secondary Data in Public Administration Research: Illustrations from the Federal Employee Viewpoint Survey

This article builds on Fernandez et al.'s 2015 review of Federal Employee Viewpoint Survey (FEVS) research by focusing on two unexplored areas: measurement models and measurement quality. Employing the notion of an auxiliary measurement theory as an organizing framework, the author assesses the use of FEVS survey items to operationalize theoretical constructs and procedures in order to establish their psychometric quality. Results indicate that there is considerable variability in how FEVS items have been used to measure theoretical constructs, which is expressed as high levels of overlap across FEVS‐derived scales. Inconsistency in the assessment of measurement quality is evident as well, with a bias toward convergent validity. Three cautionary tales are presented to demonstrate the fragility of FEVS data when used with a compromised auxiliary measurement theory. The article concludes with recommendations for future FEVS studies.     

Assessing Qualitative Studies in Public Administration Research

Systematic reviews of research methods in the public administration field have assessed the progress of research practice and offered relevant recommendations to further develop research quality. But most recent reviews examine quantitative studies, and the few assessments of qualitative scholarship tend to focus on specific dimensions. This article calls attention to the overall practice of qualitative research in the field of public administration. The authors analyzed 129 qualitative studies published during a five‐year period (2010–14) in the six top public administration journals, combining bibliometric and qualitative analyses. Three findings are drawn from the analysis. First, qualitative work represents a very small percentage of the journal articles published in the field. Second, qualitative research practice uses a small range of methodologies, mainly case studies. Finally, there is inconsistency in reporting methodological decisions. The article discusses the implications of these findings and offers recommendations to ensure methodological rigor while considering the integrity of the logic of inquiry and reporting standards of qualitative research practice.     

Assessing the Past and Promise of the Federal Employee Viewpoint Survey for Public Management Research: A Research Synthesis

Since 2002, the U.S. Office of Personnel Management has used the Federal Employee Viewpoint Survey (FEVS) to monitor efforts by federal executive agencies to manage human capital. Public management researchers have used FEVS data to produce dozens of peer‐reviewed publications on a range of topics of interest to policy makers, practitioners, and academics. Despite the proliferation of these empirical studies, the field of public management until now has lacked a critical assessment of the FEVS and of how researchers have used the data. In this article, the authors discuss the strengths of the FEVS and the opportunities this survey has created for public management researchers. Despite important contributions made to the literature using the data, there are weaknesses in the content, design, and implementation of the FEVS. The authors offer a set of recommendations for refining the survey and its implementation with the aim of improving the quality and value of the data. In doing so, they hope to foster a dialogue between public management researchers and the Office of Personnel Management on the future of the FEVS and to forge a stronger link between these two communities.     

The Opportunities and Limitations of Using Mechanical Turk (MTURK) in Public Administration and Management Scholarship

Other social science fields are increasingly conducting research using Amazon’s Mechanical Turk (MTurk)—an online crowdsourcing platform—but how might MTurk be useful to public administration and management research? This article provides an introduction of the platform and considers both the opportunities and limitations for using MTurk in public administration and management scholarship. We find that MTurk might be relevant for examining particular types of research questions. We identify five areas where MTurk data may complement and enhance public administration and management research: (1) exploratory analyses and survey construction; (2) measurement refinement of latent constructs; (3) experiments; (4) longitudinal research and data collection; and (5) collection of data from citizens. The article emphasizes how a key requisite conditions both the applicability of MTurk data and the validity of MTurk-based findings: the researcher must understand the boundaries and potential of the platform, since the issues related to representativeness, participation, and data quality are non-trivial.     

An overview of the National Survey of SSI Children and Families and related products

The National Survey of SSI Children and Families (NSCF) is the first nationally representative survey since 1978 of noninstitutionalized children and young adults who currently receive or formerly received Supplemental Security Income (SSI). Over 8,500 interviews were completed between July 2001 and June 2002. The primary objective of the NSCF is to provide data to support research and policy evaluation on the current cross section of children (ages 0 to 17) and young adults (ages 18 to 23) receiving SSI. Following that objective, the survey was designed to answer questions such as those presented below. What are the general characteristics of children and young adults receiving SSI and their families? What are the patterns of access to and utilization of health care among children and young adults receiving SSI? What services are utilized by children and young adults receiving SSI? What are the unmet health care and service needs of children and young adults receiving SSI? What costs are associated with caring for a disabled child? What is the impact on the family of having a disabled child? What is the status of young adults with disabilities as they make the transition to adulthood? How well are they prepared for that transition? In addition, the NSCF questionnaire and sample were designed to be comprehensive enough and large enough to address numerous additional policy issues as they emerge. The NSCF fills a gap in the data available to policy analysts by addressing a wide range of topics that cannot be addressed with SSI administrative data and by providing a large sample in contrast to major national survey databases that cover this target population fairly sparsely. A companion article to this overview describes general characteristics of SSI beneficiary children and their families (see Rupp and others 2005/2006, pages 21-48 of this issue). Other topics being examined include disability-related expenditures for SSI children and young adults and labor force participation of the parents of SSI children. The NSCF data files are accompanied by a detailed User's Manual, which includes a detailed codebook and information about the NSCF sample design, questionnaire design and content, data collection procedures, variable construction, editing, and variance estimation procedures. In order to facilitate research, the Social Security Administration published the NSCF Public-Use File and survey documentation on its Web site. These products are available at http://www.socialsecurity.gov/disabilityresearch/nscf.htm. The NSCF is an outstanding tool for conducting research and policy analysis regarding children and young adults receiving SSI.     

Perceptions of Public and Private Performance: Evidence from a Survey Experiment

Media, politicians, and reform proponents frequently assert that public sector organizations are inefficient and burdened by administrative procedures. But are negative stereotypes of the public sector reflected in people's perceptions of public service provision? Given the methodological challenges of isolating the perception of publicness from other factors related to public organizations, little is known about whether public organizations have a negative image. The authors use a survey experimental design to isolate the effect of publicness on perceptions of the performance of hospitals. The results suggest that public sector organizations have a negative image on productivity‐related aspects of performance but not on normative aspects of performance. As this article is a randomized experiment, it provides strong evidence regarding the causal nature of the relationship between publicness and perceptions of performance. Implications for researchers aiming to understand these mechanisms and for public managers concerned about the image of their organization are discussed.     

Topic Modeling the Research‐Practice Gap in Public Administration

The possible existence of a research‐practice gap is the topic of a long‐standing debate in the field of public administration. In this Viewpoint essay, the authors examine the agendas of scholars and practitioners using the topic modeling technique of computational social science. Topic modeling a content analysis of 35 topics identified in Public Administration Review and PA Times (3,796 articles) showed that just over 50 percent of topics were common to both groups, indicating shared interests. There were, however, topics that the two groups distinctly focused on. Moreover, scholars and practitioners attached significant differences to the weights allocated to the prominent topics in their writing. Taken together, these findings indicate that topic modeling can shed new light on the research‐practice gap in public administration.     

Assembling E‐Government Research Designs: A Transdisciplinary View and Interactive Approach

There is a growing recognition in the field of e‐government that improving the quality and impact of research requires taking into account their complex contexts and drawing on more interdisciplinary and collaborative research. Limited attention so far has been directed toward the conduct of such research, particularly in contract‐based research arrangements for developing e‐government policy. A four‐nation study of public e‐procurement policy is used here to make transparent the process of designing and conducting transdisciplinary and interactive research. Further sharing of research designs and accounts is needed to advance theory, policy, and practice, and to develop a history of ideas in the e‐government research field.     

The Conditions of Care: Reframing the Debate about Public Sector Ethic

While a growing body of research argues for increased attention to ethics within public administration, scholars diverge on how to conceptualize the character of public ethics. Likewise, empirical evidence regarding the role that ethics plays in the quality of service delivery is rare. The author argues that the concept of a public ethics of care is useful for public administration in welfare states. She examines the idea empirically through a large‐N analysis of frontline bureaucrats within the Swedish Social Insurance Administration. The analysis develops two general measures of a public ethics of care as well as a public ethics of justice. The author proceeds to show a clear presence of an ethics of care in the Swedish public sector. Further, analysis shows that these two ethics measures are supplementary, not contradictory, and that age is the main individual determinant behind ethics of care, strongly correlating with number of years in office. The conclusion underscores how public ethics of care results from acquired experience in fulfilling care‐oriented tasks.     

Resilience in Public Administration: The Work of Elinor and Vincent Ostrom from a Public Administration Perspective

This essay examines the remarkable careers of Elinor and Vincent Ostrom, exploring polycentricity and human management of common property resources from the “no‐name fields” of public administration in the late 1950s, through the metropolitan public service industries and public choice approach to democratic administration in the 1960s and 1970s and the institutional analysis of common pool resource management of the 1980s and 1990s. It continues with the diagnosis of the self‐governing capabilities of socio‐ecological systems in the 2000s. Many continuities underlie focal shifts in attention. Their work will be related to developments in the public administration field along with illustrations of their pioneer example for public administration on research as a collaborative enterprise. The 2009 Nobel Laureate in economics, Elinor Ostrom has been working from an academic background and intellectual tradition that, particularly through her long‐term collaboration with Vincent Ostrom, is strongly rooted in the classical and prevailing institutional concerns that may be seen as core to public administration as an academic field of education and research.

相似文献   

Modern leadership principles for public administration: time to move forward

The historical aversion to effective leadership in American public administration literature imposes a troubling controversy over the appropriateness of nonelected public leaders being allowed to exercise the authority and capability to make decisions regarding the direction, focus, and intensity of their organizational efforts. Using principles from distributed, transformational, and authentic leadership theories, we propose a new public leadership theory that addresses the emerging unique characteristics of the public sector and test this theory using three administrations of the Federal Human Capital Survey. Results show strong support for the application of these theories in the public service. We advocate for the research and teaching of modern leadership of these theories in the public administration field. Copyright © 2012 John Wiley & Sons, Ltd.     

Expectations,performance, and citizen satisfaction with urban services

The expectancy disconfirmation model has dominated private‐sector research on customer satisfaction for several decades, yet it has not been applied to citizen satisfaction with urban services. The model views satisfaction judgments as determined—not just by product or service performance—but by a process in which consumers compare performance with their prior expectations. Using data from a New York City citizen survey, this study finds that citizen expectations, and especially the disconfirmation of expectations—factors that previously have not been considered in empirical studies of the determinants of citizen satisfaction—play a fundamental role in the formation of satisfaction judgments regarding the quality of urban services. Interestingly, the modeling results suggest that urban managers should seek to promote not only high‐quality services, but also high expectations among citizens. Additional implications for research and public management practice are discussed. © 2004 by the Association for Public Policy Analysis and Management.     

Public Administration as an Interdisciplinary Field: Assessing Its Relationship with the Fields of Law,Management, and Political Science

Public administration is an interdisciplinary field, building on a variety of disciplinary approaches and values. But how well does the field of public administration reflect those values and processes? In contrast to previous arguments regarding the degree to which the field does or should incorporate values and lessons from other academic disciplines, this study provides a systematic assessment of the field’s reliance on research and theory from the fields of law, management, and political science. An analysis of journal citations across these fields suggests that research in public administration is largely isolated from the three disciplines that are commonly believed to form its foundation.     

Performance measures in tax administration: Chile as a case study

The article proposes a set of tax administration performance measures and contrasts them with measures actually used by the Chilean tax administration agency. The goals assumed for the tax administration agency (TA) are to maximize tax revenue collection and provide quality services to taxpayers. Ideal performance measures (PMs) would measure the deviation of actual outcome from a best‐practice standard, given the value of all variables affecting organisation performance that are outside management control. The key challenge is to build and calculate these best‐practice outcomes. In Chile the PM in use, for the first goal, is the ratio of actual to potential tax revenue collection. This PM does adjust revenue collection for variations in the tax structure and rate, but it fails to control other variables that affect performance such as the TA budget and per capita income. The PM in use, for the second goal, is taxpayer satisfaction measured through sample surveys. This seems the appropriate PM, as quality of taxpayer services depends directly on the TA efforts to improve them. Copyright © 2005 John Wiley & Sons, Ltd.     

Toward a Constitutional School for American Public Administration

A central tenet of The Federalist is that good government depends on good administration. Two hundred and twenty‐three years have passed since Publius began writing this extraordinary text. As American democratic institutions have grown larger and more complex than what the founders ever imagined, many of the ideas expressed in The Federalist remain as relevant today as when James Madison, Alexander Hamilton, and John Jay first advanced them in 1787. The author argues that public administration should move toward a constitutional school that would connect the U.S. Constitution with all aspects of American public administration theory and practice. While the author readily acknowledges this new school’s apparent defects, its most important contribution recognizes that the American Constitution matters, and indeed should serve as a lodestar for our entire field.     

Big Data in Public Affairs

This article offers an overview of the conceptual, substantive, and practical issues surrounding “big data” to provide one perspective on how the field of public affairs can successfully cope with the big data revolution. Big data in public affairs refers to a combination of administrative data collected through traditional means and large‐scale data sets created by sensors, computer networks, or individuals as they use the Internet. In public affairs, new opportunities for real‐time insights into behavioral patterns are emerging but are bound by safeguards limiting government reach through the restriction of the collection and analysis of these data. To address both the opportunities and challenges of this emerging phenomenon, the authors first review the evolving canon of big data articles across related fields. Second, they derive a working definition of big data in public affairs. Third, they review the methodological and analytic challenges of using big data in public affairs scholarship and practice. The article concludes with implications for public affairs.     

Public Administration Scholarship and the Politics of Coproducing Academic–Practitioner Research

Developing greater cooperation between researchers and practitioners is a long‐standing concern in social science. Academics and practitioners working together to coproduce research offers a number of potential gains for public administration scholarship, but it also raises some dilemmas. The benefits include bringing local knowledge to bear on the field, making better informed policy, and putting research to better use. However, coproduction of research also involves managing ambiguous loyalties, reconciling different interests, and negotiating competing goals. The authors reflect on their experience of coproducing a research project in the United Kingdom and discuss the challenges that coproducers of research confront. They situate the discussion within a consideration of traditions of public administration scholarship and debates about the role of the academy to understand better the politics of their joint practice. Thinking about the politics of coproduction is timely and enables the authors to become more attuned to the benefits and constraints of this mode of research..     

American Indian Tribal Governance and Management: Public Administration Promise or Pretense?

Research on tribal governance in the United States is scarce within modern public administration scholarship. Nonetheless, tribal governance is a pre‐Columbian practice that predates the U.S. Constitution and federal law. Drawing from several disciplines, John C. Ronquillo of the University of Georgia demonstrates that interdisciplinary sources offer rich information for present‐day public administration research about Native American tribes. Tribal governance literature is definitely not “missing,” but instead is moderately “unassembled” as a subfield of public administration. Building on what is available, the author suggests several key issues within tribal governance in need of urgent academic attention.     

Prosocial Behavior and Public Service Motivation

Although research on public service motivation (PSM) is vast, there is little evidence regarding the effects of PSM on observable behavior. This article contributes to the understanding of the behavioral implications of PSM by investigating whether PSM is associated with prosocial behavior. Moreover, it addresses whether and how the behavior of other group members influences this relationship. The article uses the experimental setting of the public goods game, run with a sample of 263 students, in combination with survey‐based PSM measures. A positive link is found between PSM and prosocial behavior. This relationship is moderated by the behavior of other group members: high‐PSM people act even more prosocially when the other members of the group show prosocial behavior as well, but they do not do so if the behavior of other group members is not prosocial.