The net effects of the Project NetWork return-to-work case management experiment on participant earnings, benefit receipt, and other outcomes

The Social Security Administration (SSA) initiated Project NetWork in 1991 to test case management as a means of promoting employment among persons with disabilities. The demonstration, which targeted Social Security Disability Insurance (DI) beneficiaries and Supplemental Security Income (SSI) applicants and recipients, offered intensive outreach, work-incentive waivers, and case management/referral services. Participation in Project NetWork was voluntary. Volunteers were randomly assigned to the "treatment" group or the "control" group. Those assigned to the treatment group met individually with a case or referral manager who arranged for rehabilitation and employment services, helped clients develop an individual employment plan, and provided direct employment counseling services. Volunteers assigned to the control group could not receive services from Project NetWork but remained eligible for any employment assistance already available in their communities. For both treatment and control groups, the demonstration waived specific DI and SSI program rules considered to be work disincentives. The experimental impact study thus measures the incremental effects of case and referral management services. The eight demonstration sites were successful in implementing the experimental design roughly as planned. Project NetWork staff were able to recruit large numbers of participants and to provide rehabilitation and employment services on a substantial scale. Most of the sites easily reached their enrollment targets and were able to attract volunteers with demographic characteristics similar to those of the entire SSI and DI caseload and a broad range of moderate and severe disabilities. However, by many measures, volunteers were generally more "work-ready" than project eligible in the demonstration areas who did not volunteer to receive NetWork services. Project NetWork case management increased average annual earnings by $220 per year over the first 2 years following random assignment. This statistically significant impact, an approximate 11-percent increase in earnings, is based on administrative data on earnings. For about 70 percent of sample members, a third year of followup data was available. For this limited sample, the estimated effect of Project NetWork on annual earnings declined to roughly zero in the third followup year. The findings suggest that the increase in earnings may have been short-lived and may have disappeared by the time Project NetWork services ended. Project NetWork did not reduce reliance on SSI or DI benefits by statistically significant amounts over the 30-42 month followup period. The services provided by Project NetWork thus did not reduce overall SSI and DI caseloads or benefits by substantial amounts, especially given that only about 5 percent of the eligible caseload volunteered to participate in Project NetWork. Project NetWork produced modest net benefits to persons with disabilities and net costs to taxpayers. Persons with disabilities gained mainly because the increases in their earnings easily outweighed the small (if any) reduction in average SSI and DI benefits. For SSA and the federal government as a whole, the costs of Project NetWork were not sufficiently offset by increases in tax receipts resulting from increased earnings or reductions in average SSI and DI benefits. The modest net benefits of Project NetWork to persons with disabilities are encouraging. How such benefits of an experimental intervention should be weighed against costs of taxpayers depends on value judgments of policymakers. Because different case management projects involve different kinds of services, these results cannot be directly generalized to other case management interventions. They are nevertheless instructive for planning new initiatives. Combining case and referral management services with various other interventions, such as longer term financial support for work or altered provider incentives, could produc     

Transitional employment training for SSI recipients with mental retardation.

Transitional employment training is a promising method for assisting persons with mental retardation to gain and hold regular marketplace jobs. The Social Security Administration (SSA) has concluded a large scale demonstration project in which this training was provided to recipients of Supplemental Security Income (SSI) with mental retardation. This article introduces the concepts and practices of transitional employment and presents findings of the SSA demonstration derived from observation of demonstration operations. A followup article will discuss the effects of the demonstration services on the employment, earnings, and SSI payments of the trainees, as derived from analysis of SSI administrative records and other quantitative data.     

Evaluation and policy learning: The learners' perspective

This article examines how evaluation induces policy learning – a question largely neglected by the scholarly literature on evaluation and policy learning. Following a learner's perspective, the article attempts to ascertain who the learners are, and what, and how, learners actually learn from evaluations. In so doing, it focuses on what different types of learners actually learn within the context of the evaluation framework (the set of administrative structures defining the evaluation goals and process). Taking the empirical case of three EU programme evaluations, the patterns of policy learning emanating from them are examined. The findings are that only two types of actors involved in the evaluation are actually learning (programme units and external evaluators), that learners learn different things (programme overview, small‐scale programme adjustments, policy change and evaluation methods) and that different learners are in control of different aspects of the evaluation (learning objectives and processes) according to the evaluation framework established by the European Commission.     

Employment among Social Security disability program beneficiaries, 1996-2007

We use linked administrative data from program and earnings records to summarize the 2007 employment rates of Social Security disability program beneficiaries at the national and state levels, as well as changes in employment since 1996. The findings provide new information on the employment activities of beneficiaries that should be useful in assessing current agency policies and providing benchmarks for ongoing demonstration projects and future return-to-work initiatives. The overall employment rate--which we define as annual earnings over $1,000--was 12 percent in 2007. Substantial variation exists within the population. Disability Insurance beneficiaries and those younger than age 40 were much more likely to work relative to other Social Security beneficiaries. Additionally, substantial regional variation exists across states; employment rates ranged from 7 percent (West Virginia) to 23 percent (North Dakota). Moreover, we find that the employment rates among beneficiaries were sensitive to the business cycle and persistent over time.     

Lessons to be learnt? The role of evaluations of active labour market programmes in evidence‐based policy making

The interest in results‐based policy formulation requires us to examine the impact of evaluations. This article focuses on the production and use of impact evaluations of UK active labour market programmes. It is intended to be useful for non‐evaluators and for those working in developing and transition countries. The UK provides a case study where there is good evaluation data, available expertise and high‐level political commitment to evaluation. However, obstacles remain in the generation and use of impact data. The article seeks to identify the opportunities and difficulties faced in the UK, and it considers the implications for other countries. It suggests that the measurement of impact concepts will prove difficult in countries that do not have sound administrative data, comprehensive labour market statistics and well‐established macroeconomic and tax‐benefit models. Furthermore, the use of evaluation data may be limited by a range of factors, most crucially those emanating from the legislative and policy‐making environment. The conclusion is that if knowledge‐based policy management is to be improved, changes in evaluation methodology will only be effective if supported by changes in the wider government environment. Copyright © 2006 John Wiley & Sons, Ltd.     

Outcomes–Based Performance Management in the Public Sector: Implications for Government Accountability and Effectiveness

Requirements for outcomes–based performance management are increasing performance–evaluation activities at all government levels. Research on public–sector performance management, however, points to problems in the design and management of these systems and questions their effectiveness as policy tools for increasing governmental accountability. In this article, I analyze experimental data and the performance–management experiences of federal job–training programs to estimate the influence of public management and system–design factors on program outcomes and impacts. I assess whether relying on administrative data to measure program (rather than impacts) produces information that might misdirect program managers in their performance–management activities. While the results of empirical analyses confirm that the use of administrative data in performance management is unlikely to produce accurate estimates of true program impacts, they also suggest these data can still generate useful information for public managers about policy levers that can be manipulated to improve organizational performance.     

The New Beneficiary Data System: the first phase.

The completion of field work for the 1991 New Beneficiary Followup has transformed the 1982 New Beneficiary Survey from a simple cross-sectional data collection effort to the first step in a new longitudinal data base, which is further enriched with information obtained from administrative records. The resulting New Beneficiary Data System will make it possible to develop a better understanding of the dynamics of the experience of aged and disabled populations over the long term. A review of 24 reports prepared by Social Security Administration analysts who have used data from the first wave of interviews reveals a great deal of variation among different types of beneficiaries with respect to income, assets, pensions, work, health, and other factors. These reports provide a useful context for examining patterns of stability and change in the beneficiary population as the data from administrative records and later interviews are added to the data base and used to address issues of policy interest.     

论对抽象行政行为的司法监督

抽象行政行为是具体行政行为的直接依据。然而,理论界对它的法律监督问题不够。本力图从司法监督的角度分析对抽象行政行为司法监督的法理依据和现实需求,论述对抽象行政行为进行司法监督的可靠性,并认为实行司法监督的可行性途径是充实检察监督和完善审判监督。就此作提出了一些具体做法。     

The Quality of Management and Government Performance: An Empirical Analysis of the American States

Government performance is an enduring concern for students of public management, public administration, and political science. Government's administrative arrangements and managerial behavior can profoundly influence programmatic content, activities, and outcomes; therefore, considering public management's effects is necessary for a true understanding of public policy and government performance. This article uses data from the Maxwell School's Government Performance Project to examine the relationship between state governments' managerial capacity and a measure of government performance (specifically, state policy priorities). We find that state management capacity has direct effects on state policy commitments: States possessing higher levels of management capacity tend to favor programmatic areas that distribute societal benefits widely (that is, collective benefits) as opposed to narrowly (that is, particularized benefits). Our analysis demonstrates that public interest group activity, government ideology, and citizen ideology each have significant, predictable effects on state policy commitments. Thus, our findings place managerial capacity alongside other more commonly studied state characteristics as an important influence on government activities.     

Participatory Budgeting and Community-Based Research: Principles,Practices, and Implications for Impact Validity

Research and evaluation is an integral part of the Participatory Budgeting (PB) process. Since PB in New York City (PBNYC) is designed to be a democratic and community-based initiative that is grounded in the values of equity and inclusion, it is important that the research and evaluation methods used to study the process and its participants adhere to the same principles. For the past five years, a team of community-based researchers, academics, and PB participants have designed research questions and instruments, implemented data collection, analyzed and shared data with PB participants and practitioners, and issued reports to the wider public. Like PB, the research design is rooted in the communities where PB is operating. The research is not intended to sit on a shelf but is actively used by participants and practitioners to help reflect on the process, improve deliberation in decision-making, and strengthen the process and outcomes of PB. This article will discuss Participatory Action Research principles used by the Community Development Project of the Urban Justice Center, explore the applicability of these principles to the Participatory Budgeting research context, and explain how these practices have helped to deepen and improve the process and outcomes of PBNYC.     

Positions and saliency of immigration in party manifestos: A novel dataset using crowd coding

Immigration is one of the most widely debated issues today. It has, therefore, also become an important issue in party competition, and radical right parties are trying to exploit the issue. This opens up many pressing questions for researchers. To answer these questions, data on the self‐ascribed and unified party positions on immigration and immigrant integration issues is needed. So far, researchers have relied on expert survey data, media analysis data and ‘proxy’ categories from the Manifesto Project Dataset. However, the former two only give the mediated party position, and the latter relies on proxies that do not specifically measure immigration. The new dataset presented in this article provides researchers with party positions and saliency estimates on two issue dimensions – immigration and immigrant integration – in 14 countries and 43 elections. Deriving the data from manifestos enables the provision of parties’ unified and unfiltered immigration positions for countries and time points not covered in expert surveys and media studies, making it possible to link immigration and immigrant integration positions and saliency scores to other issue areas covered in the Manifesto Project Dataset. Well‐established criteria are used to distinguish between statements on (1) immigration control and (2) immigrant integration. This allows for a more fine‐grained analysis along these two dimensions. Furthermore, the dataset has been generated using the new method of crowd coding, which allows a relatively fast manual coding of political texts. Some of the advantages of crowd coding are that it is easily replicated and expanded, and, as such, presents the research community with the opportunity to amend and expand upon this coding scheme.     

Welfare reform and paternity establishment: A social experiment

From March 1988 through September 1989, a demonstration study was conducted in Cuyahoga County, Ohio, on procedures for expediting paternity establishment. The issue of paternity establishment is central to current concerns about child support. In the 1988 Family Support Act, for example, administrative reforms to expedite paternity establishment are prominently featured. The results of the Cuyahoga demonstration provide early evidence of the likely impact of the 1988 reforms. At the implementation stage, the demonstration points up the complex interorganizational dependencies that are likely to limit the impact of mandated performance standards and associated sanctions directed at state and local child support agencies. As to the impact on paternity establishment outcomes, interventions directed at expediting administrative processes are likely to have a positive effect. However, the results of the demonstration indicate that noncooperative behavior among a significant portion of the client population is likely to seriously limit the effectiveness of expedited processes.     

Why Denmark and Belgium Have Different Implementation Records: On Transposition Laggards and Leaders in the EU

Statistics of the European Commission show different performances among member states regarding the implementation of European policies. In particular, this article explains why Denmark and Belgium have different records with respect to the legal or administrative transposition of European Union environmental directives. The article starts with a short overview of the implementation problematique and a presentation of the latest available statistics. Then European-level factors are ruled out as possible explanations for the differences in performance. The author argues, on the contrary, that the differences between Belgium and Denmark must be explained by national institutional contexts. To this end, an institutional approach is presented, which draws attention to 'hard' and 'soft' institutions as explanatory variables. In total seven categories of variables are discussed: four 'hard' categories – the constitutional and administrative context (division of competencies and coordination mechanisms), institutional capacity, administrative and legal adaptation pressure, communication and continuity – and three 'soft' categories – institutional jealousy, Europeanisation and political adaptation pressure. It was found that both member states under study have different scores on almost all variables, pointing to rather unfavourable implementation conditions for Belgium and much more favourable conditions for Denmark.     

Increasing Community College Completion Rates Among Low-Income Students: Evidence from a Randomized Controlled Trial Evaluation of a Case-Management Intervention

Community college completion rates are low, especially among low-income students. The existing policy and research attention has primarily focused on academic and financial challenges, but there is ample reason to think that non-academic obstacles might be key drivers of dropout rates for low-income students. This study focuses on the role of “life barriers” and investigates the effectiveness of intensive case-management services for low-income community college students. We evaluate the impact of the Stay the Course (STC) intensive case-management program through a multi-armed randomized controlled trial evaluation conducted between 2013 and 2016 in Fort Worth, Texas. Analysis of administrative records indicates that STC significantly increased persistence and degree completion for women; estimates for the full sample are imprecise. The statistically significant estimates for women imply that STC tripled associate's degree receipt by 31.5 percentage points. We find no difference in outcomes between students in an emergency financial assistance (EFA) only treatment arm and the control group. Given program costs of $4,343 per person, the implied cost per additional associate's degree is $27,140. This study complements existing literature on financial and informational interventions designed to increase completion rates and is most closely related to the smaller literature examining coaching and mentoring interventions.     

Public Service Motivation (PSM) and Support for Citizen Participation: A Test of Perry and Vandenabeele’s Reformulation of PSM Theory

This article examines how public service motivation (PSM) relates to public managers’ attitudes toward citizen participation. Perry and Vandenabeele suggest that PSM effects are moderated and/or mediated by self‐regulation and by the salience of an activity to self‐identity. Using data from Phase IV of the National Administrative Studies Project, latent model results suggest a direct, positive relationship between PSM and citizen participation evaluation. The relationship is not mediated by value congruence but rather is moderated by the perceived importance of the organization’s citizen participation efforts. The moderating effect has three interpretations: (1) PSM has a stronger relationship to evaluation as citizen participation becomes more important in the agency; (2) at low and medium PSM levels, the greater the importance of citizen participation, the lower its evaluation; or (3) at high PSM levels, the greater the importance of citizen participation, the higher its evaluation. This suggests that PSM is more germane for activities such as citizen participation, invoking relevant values as perceived organizational commitment increases.     

Whistleblowing in Local Government: An Empirical Study of Contact Patterns and Whistleblowing in 20 Norwegian Municipalities

Whistleblowing by administrative employees in local governments can bring critical knowledge about misconduct and failed policy outcomes and priorities to the attention of politicians. This article examines whether (1) whistleblowing to politicians is considered acceptable among politicians and administrative employees, (2) politicians receive whistleblowing cases and how those who do so handle the case, and (3) contact patterns between politicians and administrative employees influence the whistleblowing activity and the action taken by the politicians to address wrongdoing. The article departs from the theory of pillars of institutions and the tensions between and within institutional pillars to analyse unique data from a survey based on the vignette method and actual whistleblowing among politicians (N = 400) and employees (N = 373) from 20 Norwegian municipalities. The analysis shows that the degree of contact between politicians and administrative employees is correlated with positive perceptions of whistleblowing and constructive handling of wrongdoing reports by the politicians.     

Isolated counties,administrative monitoring,and the misuse of public funds in China

This article empirically investigates the effects of administrative monitoring on the misuse of funds by local governments and provides a representative model of fiscal decentralization with political centralization, where administrative monitoring relies on the top‐down hierarchy of the bureaucratic system in China based on a unique data set from audit programs. We show a double effect between distance and monitoring in local China. The incentive for misusing public funds can be strengthened if the county (a) is governed by a leader whose tenure is longer than 3 years, (b) is governed by a politician from outside the county, or (c) receives more transfer payments. These findings suggest that the administrative monitoring of local governments can be vital to remedying the misuse of public funds.     

Democracy and State Capacity: Exploring a J‐Shaped Relationship

In this article we probe the effect of democratization on the state's administrative capacity. Using time‐series cross‐section data, we find a curvilinear (J‐shaped) relationship between the two traits. The effect of democracy on state capacity is negative at low values of democracy, nonexistent at median values, and strongly positive at high democracy levels. This is confirmed under demanding statistical tests. The curvilinear relationship is due, we argue, to the combined effect of two forms of steering and control; one exercised from above, the other from below. In strongly authoritarian states, a satisfactory measure of control from above can at times be accomplished. Control from below is best achieved when democratic institutions are fully installed and are accompanied by a broad array of societal resources. Looking at two resource measures, press circulation and electoral participation, we find that these, combined with democracy, enhance state administrative capacity.