Evaluating expert judgments

Abstract.  Although expert surveys have gained a prominent place in comparative studies of party positions on issues, their validity has been called into question. In this article, some of the validity concerns are evaluated in the context of the authors' own expert survey on national party positions vis-à-vis European integration. One goal of the article is to demonstrate that this expert survey produces valid measures of party positions. An equally important goal, however, is to suggest some methods that can help in assessing the quality of expert survey data. These methods, which are rooted in psychometric theory, are applicable in a variety of contexts and are easily implemented.     

Evaluating irreversible social harms

In this paper we investigate how irreversible social harms should be evaluated from an ethical perspective. First, we define a general notion of irreversibility, drawing on discussions in ecology and economics. This notion is relational in the sense that “irreversibility” is always “irreversibility for a certain party”. We also note that a change may be more or less difficult to reverse, with full reversibility and irreversibility as two extremes. Second, we examine what can make an irreversible change a harm, and why these kinds of harms have particular ethical significance. Here we draw on discussions from ethics, particularly regarding the capability approach. We also show how our notion of irreversibility connects to, and can add to, discussions in the fields of development studies and disaster management, particularly on the concept of resilience. Third, we suggest how potentially irreversible harms can be recognised and dealt with in policy-making. Finally, we show how our framework can be applied by evaluating the land acquisition process of two biofuel producers in Tanzania.     

A sociosemiotic approach to consumer engagement in user-generated advertising

User-generated advertising (UGA) has been booming over the past few years as marketers have been actively seeking to enhance consumer engagement. Yet, our understanding of the implications, the importance and the potential of UGA from a cultural branding point of view remains limited. This study furnishes the conceptual model of consumer cultural engagement in order to appreciate in a more nuanced manner than afforded by consumer sentiment analyses how UGA contributes to fleshing out co-creatively a brand vision. To this end, a sociosemiotic approach is pursued by dimensionalizing the cultural resources employed in UGA along the interlocking layers of text/register/domain in a cline of instantiation. The conceptual model is exemplified by recourse to a UGA corpus from the 10th and final wave of Doritos’ Crash the Super Bowl promo mechanism, undergirded by a mixed methods research design that features a grounded theoretical procedure, facilitated by quantitative analyses.     

Evaluating the Devolution Revolution1

This article provides an evaluation of the impact of the Personal Responsibility and Work Opportunity Reconciliation Act (PRWORA) of 1996. The evidence clearly shows that PRWORA has had a major impact on the poverty population and the welfare system. The data analyzed identify those policy areas in which positive changes can be identified, along with implementation and design problems that need reform. The data also show that while some states have made considerable progress in implementing the law, many are lagging.     

Evaluating the OEO Legal Services Program

During 1970 and 1971, the complex and politically sensitive OEO Legal Services Program received its first independent national evaluation. This paper describes how evaluators dealt with the policy issues arising during the evaluation. Their decisions involved the interaction of three factors: conceptual problems, access to data, and a sense of what would be relevant to public policy. They found only a small area of intersection between a large set of issues important to policy-makers and an equally large, but usually different, set of issues amenable to systematic research.One finding was that the program's use of full-time poverty lawyers is a less expensive way to provide poor clients with legal services than underwriting the fees of private lawyers would be. Another was that the Legal Services attorneys' strong emphasis on law reform apparently adds very little to the cost of providing more routine services.The writer was the government's technical representative on this contract, but the viewpoints expressed in this paper do not necessarily reflect the official position of the Office of Economic Opportunity.     

Evaluating congressional reform: Deregulation revisited

An evaluation of the changes in Congress's structure that occurred in the 1970s requires attention to three dimensions of its performance as a policymaking institution: representation of interests, deliberation, and conflict resolution. Considered this way, the changes seem to have enhanced some aspects of congressional capacity (especially the representation of broadly-based interests) but to have diminished others (especially deliberation and conflict resolution on issues that are salient to mass constituencies). The resulting strengths and weaknesses help to explain differences in congressional performance on trucking deregulation and natural gas deregulation in the late 1970s and early 1980s. To some degree, they have altered the opportunities, strategic considerations, and central skills for policy analysts who seek to influence congressional decisions.     

Varieties of consumer credit data regimes: A regulatory governance approach

Credit markets are expanding, and with them also the automated, large‐scale commercialization of personal credit data. The increasing use of data and scores for commodified decision making lends greater urgency to the study of credit data regulatory regimes. This article promotes a comparative regulatory governance perspective as the basis for theory‐driven, multidimensional measurement. In order to measure consumer protection, we distinguish three different subregimes (collection, profiling, and use) and construct a two‐dimensional index of consumer protection (market restriction and user empowerment). We then assess the index and demonstrate its applicability and validity, building on empirical analysis of the regulatory regimes in the United States, France, Sweden, and Israel for the year 2019. Our approach points to a new direction in researching and measuring regulatory regimes in a comparative manner, which looks beyond national analysis toward an in‐depth understanding of other, equally important, levels of variation.     

Is the consumer price index a fair measure of inflation?

The Consumer Price Index (CPI) is widely used to adjust wages and federal benefits as an offset to inflation, but the index contains substantial sources of bias as used for such purposes. For instance, these sources of bias, such as changes in the real cost of petroleum, the cost of environmental protection, and an inappropriate method for measuring homeownership costs, accounted for nearly half of the CPI increase in the year from November 1978 to November 1979. Because of the nature of the index, such biases will always be present, creating the risk that the CPI may be adding to the inflation that it is only supposed to measure. Therefore, a new index or indexes that are more appropriate for adjusting wages and benefits for inflation should be developed.