Moving up versus moving out: Neighborhood effects in housing mobility programs

Abstract

This article suggests ways to better design, conduct, and interpret evaluations of the effects of housing mobility programs on participants, with emphasis on how to isolate neighborhood effects. It reviews earlier critiques of neighborhood effects research and discusses the key assumptions of housing mobility programs—about the benefits of affluent neighbors, the spatial organization of opportunity for the urban poor, and the meanings of “neighborhood” to residents, researchers, and policy makers.

Studying mobility contexts, especially in suburban areas, offers special challenges to researchers. More research is needed that looks at residents’ social ties and uses mixed‐methods approaches. Ethnographic data, in particular, would enhance the validity of the quantitative data that now dominate studies of neighborhood effects. Adding substantially to what we know about the processes or mechanisms—the “how” of neighborhood effects—mixed‐methods approaches would also make research much more useful to policy makers and program managers.     

The Relative Influence of Appropriation Subcommittees: Institutional Structure and Program Performance

Unlike previous analyses that evaluate the influence of the authorization committees on government agency management, we examine the US congressional appropriation subcommittees to see how their structural characteristics affect the performance of the programs that they fund. Specifically, we look at whether the competition for resources and member workload within subcommittees affects the effectiveness and efficiency of the programs under their purview. As part of the Congressional budget process, appropriation subcommittees are annually allocated new budgets from which they must fund a set of government programs. We find that the level of resources in a subcommittee affects program performance. Greater subcommittee resources are negatively correlated with program performance. We also find that workload matters—programs in subcommittees with fewer issue areas and programs per member are more effective and efficient. A subcommittee's capacity to focus on management problems and issue areas leads to better program performance.     

Using Preferred Applicant Random Assignment (PARA) to Reduce Randomization Bias in Randomized Trials of Discretionary Programs

Randomization bias occurs when the random assignment used to estimate program effects influences the types of individuals that participate in a program. This paper focuses on a form of randomization bias called “applicant inclusion bias,” which can occur in evaluations of discretionary programs that normally choose which of the eligible applicants to serve. If this nonrandom selection process is replaced by a process that randomly assigns eligible applicants to receive the intervention or not, the types of individuals served by the program—and thus its average impact on program participants—could be affected. To estimate the impact of discretionary programs for the individuals that they normally serve, we propose an experimental design called Preferred Applicant Random Assignment (PARA). Prior to random assignment, program staff would identify their “preferred applicants,” those that they would have chosen to serve. All eligible applicants are randomly assigned, but the probability of assignment to the program is set higher for preferred applicants than for the remaining applicants. This paper demonstrates the feasibility of the method, the cost in terms of increased sample size requirements, and the benefit in terms of improved generalizability to the population normally served by the program.     

Budget-Making for Social Purposes

A theory of the budgetary process within public resource allocation has to recognize two basic properties of budgetary behavior and budgetary interaction: variation over time and program variation. Our results indicate that the hypothesis of program variation is worthy of effort, as we find different decision mechanisms operating in the six programs studied, which belong to different categories of public resource allocation. Variation over time is particularly difficult to accommodate within the framework of incrementalist notions: incremental decision rules imply structural stability over time slices. We find the opposite to be true in two of the program types analyzed, the transfer programs and the service programs. Bureaucratic programs may look incremental; however, that may only be an appearance, as a closer analysis of the data indicates that the decision mechanism involves the occurrence of shift-points or non-incremental changes. A theory of the public expenditure process has to take into account both incremental decision strategies and non-incremental ones, which requires an econometric methodology based on the possibility of structural variability. Such a methodology includes the use of both test statistics and estimation techniques suitable to the occurrence of structural variability.     

Linking program implementation and effectiveness: Lessons from a pooled sample of welfare‐to‐work experiments

This paper addresses the question: How does implementation influence the effectiveness of mandatory welfare‐to‐work programs? Data from three large‐scale, multi‐site random assignment experiments were pooled; quantitative measures of program implementation were constructed; and multilevel statistical modeling was used to examine the relationship between program implementation and effects on short‐term client earnings. Individual‐level data were analyzed for 69,399 sample members and group‐level implementation data were analyzed for 59 local programs. Findings indicate that, other things being equal, earnings effects are increased by: an emphasis on quick client employment, an emphasis on personalized client attention, staff caseloads that do not get too large, and limited use of basic education. Findings also show that mandatory welfare‐to‐work programs can be effective for many types of people, and that focusing on clients who are especially job‐ready (or not) does not have a consistent influence on a program's effectiveness. © 2003 by the Association for Public Policy Analysis and Management     

Evaluating the benefits and costs of the job corps

Social programs have a wide variety of effects and often have the explicit objective of improving the economic status of the people they serve. In order to be useful to policymakers, benefit—cost analysis of social programs should explicitly take account of these two important program features. The approach used in this analysis of the benefits and costs of the Job Corps does this and provides a useful methodology for evaluating other social programs. According to the analysis, the program has substantial net value for society as a whole as well as for the average Corpsmember.     

Toward a more public discussion of the ethics of federal social program evaluation

Federal social program evaluation has blossomed over the past quarter century. Despite this growth, there has been little accompanying public debate on research ethics. This essay explores the origins and the implications of this relative silence on ethical matters. It reviews the federal regulations that generally govern research ethics, and recounts the history whereby the evaluation of federal programs was specifically exempted from the purview of those regulations. Through a discussion of a recent evaluation that raised ethical concerns, the essay poses—but does not answer—three questions: (1) Are there good reasons to hold federal social program evaluations to different standards than those that apply to other research?; (2) If so, what ethical standards should be used to assess such evaluations?; and (3) Should a formal mechanism be developed to ensure that federal social program evaluations are conducted ethically? © 2005 by the Association for Public Policy Analysis and Management     

Decreasing Improper Payments in a Complex Federal Program

Since the early 2000s, the U.S. federal government has placed increasing focus on combating improper payments. Implementing policies to control improper payments is no easy task. Federal programs are often large, complex, riddled with moral hazard concerns, and jointly implemented. In 2011, the U.S. Department of Labor adopted a national strategy to combat improper payments in the Unemployment Insurance program. This article examines the effect that the Department of Labor's strategic initiative had on lowering states’ improper payments. Findings show that two of its tools—mandatory cross matching of employment records between the National Directory of New Hires and State Directories of New Hires and a communication strategy known as messaging—played a statistically significant role in halting the rise of improperly paid unemployment insurance claims. These results suggest that information technology tools and increased communication among stakeholders can be effective in lowering improper payments and improving government performance.     

How Do Summer Youth Employment Programs Improve Criminal Justice Outcomes,and for Whom?

Cities across the U.S. have turned to summer youth employment programs (SYEPs) to improve the behavioral, economic, and academic outcomes of inner‐city youth. This paper evaluates the impact of the Boston Summer Youth Employment Program using both experimental and non‐experimental variation. Similar to previous studies of summer jobs programs in other cities, I make use of an embedded randomized controlled trial and find that the program reduces violent crime by 35 percent, as measured by the number of arraignments from administrative records during the 17 months after participation. In contrast to prior work, I also find a similar reduction in arraignments for property crimes (?29 percent). This study also provides exploratory evidence on the mechanisms driving these reductions in crime using self‐reported responses of participants from a pre‐/post‐program survey. The results provide suggestive evidence that the beneficial impacts on violent and property crime are largely driven by improved conflict resolution skills versus other factors that would increase the opportunity cost of crime. These findings give researchers some insights into the behavioral changes that occur during the program while also providing a look inside the “black box” as to how SYEPs affect youth outcomes in the long run.     

The price of local discretion: Inequalities in welfare spending within texas

Discretion at the local level in the administration of state or federal programs may generate inequalities in spending among the different localities within a state. Among the counties of Texas, inequalities in welfare programs—Aid to Families with Dependent Children and food stamps—prove substantial, mainly because of variations in rates of participation among the counties. While variables that reflect differences in the conditions for eligibility account for a significant part of the variation, various barriers to participation—including political attitudes, access to welfare offices, and local staffing—are also important. The results suggest that centralized regulation must be retained and strengthened if federal welfare programs are to retain some degree of uniformity within each state.     

The reservation wages of Social Security Disability Insurance beneficiaries

There exists a lot of research on the reservation wages of the unemployed as a determinant of unemployment duration. Little is known about the reservation wages of those who are not in the labor force but might be potential labor force returnees, such as Social Security Disability Insurance (DI) beneficiaries. The main objective of this article is to assess what can be learned from the subjective reservation wages of DI beneficiaries. Using the New Beneficiary Data System (NBDS), the article assesses the magnitudes of reservation wages compared to the last wage earned and the benefit amount, as well as the determinants of reservation wages in a regression framework. The NBDS is unique in that it provides the reservation wages and the work history of DI beneficiaries before and after joining the DI rolls. The article has several noteworthy results and policy implications: *Data show that a significant portion of beneficiaries report being likely to accept a job if offered one. Based on the NBDS, 13 percent of DI beneficiaries who did not work since joining the rolls in 1981-1982 reported in 1991 that they would be willing to work if offered a job and provided their reservation wages. *DI beneficiaries do not appear to price themselves out of the labor market. Half of them would want a wage that is 80 percent or less of the last wage earned before receiving DI. It is estimated that approximately 7 percent of long-term DI beneficiaries may potentially return-to-work if they search for jobs and have a wage offer distribution with a mean at 80 percent of their last wage. *The nonlabor income in addition to the benefit is positively and significantly associated with the reservation wage, while the benefit amount per se is not. However, this result needs to be treated with caution given that nonlabor income is endogenous to the model. *Heterogeneity exists between persons still under the DI program and those that have moved to the Old-Age program. The subsamples of persons who have shifted to the Old-Age program and those who are still under the DI program have median reservation wage to the last wage ratios of 0.69 and 0.93, respectively. A significantly lower reservation wage for persons who have moved to the Old-Age program was also found in a regression framework. This heterogeneity between the two groups may result in part from the different program characteristics both groups face, for instance, in terms of benefit termination and Medicare eligibility rules. *Subjective reservation wage data can be useful to study populations that are out of the labor force. This article is innovative in that it focuses on a group of persons who are typically considered as being out of the labor force, and therefore are not asked reservation wages in general household surveys such as the Current Population Survey. It would be of great interest to collect more reservation wage data for DI beneficiaries in a longitudinal data set to expand this analysis, for instance, to assess conclusively the effects of changing program characteristics on reservation wages and return-to-work outcomes as beneficiaries transition to the Old-Age program or as new return-to-work programs are put in place.     

Disability benefit coverage and program interactions in the working-age population

Over three-fourths of the working-age population in the United States is insured for Disability Insurance (DI); this group is protected against a total loss of earned income typically associated with severe disability. However, little is known about the role the Supplemental Security Income (SSI) program plays in protecting against the financial consequences of severe disability for this population. We find that over one-third (36 percent) of the working-age population is covered by SSI in the event of a severe disability. Three important implications follow, which we discuss in sequence below: (1) SSI increases the overall coverage of the working-age population; (2) SSI enhances the bundle of cash benefits available to disabled individuals; and (3) interactions with other programs also enhance the safety net, most notably in the area of health insurance coverage. Ignoring these implications could lead to inaccurate inferences about disability program coverage, health insurance coverage, and the well-being of working-age individuals with disabilities. The first major finding is that SSI substantially increases overall cash benefit coverage. Thus SSI dramatically increases protection against the financial risk of disablement in the working-age population. While roughly 23 percent of the U.S. working-age population was not insured for DI in November 1996, SSI provides coverage for more than half of this seemingly "uncovered" population. An important innovation of our analysis is that we account for the possibility that many of those who appear ineligible for SSI based on current income could become eligible as a result of a disability shock that causes their earnings to drop. Thus the estimated proportion that is protected by SSI increases when the possibility of earnings loss because of disability is considered. Considering DI and SSI together, roughly 90 percent of the working-age population would be potentially covered for benefits in the event of a disability. Those who are covered by SSI--as opposed to those covered by DI alone-tend to be relatively young, less educated, and in relatively poor health. The remaining 10 percent or so are not covered by either DI or SSI. This group is economically vulnerable in some sense (they are poorer, older, and more likely to be women than those covered only by DI), but they are not as economically vulnerable in terms of income, resource holdings, and private health insurance coverage as those who are eligible for SSI. A disproportionate share of those who are not covered by either DI or SSI consists of married women. The second major finding is that SSI substantially enhances the bundle of available cash benefits. Roughly one-third of those covered by DI are initially covered by SSI as well. SSI enhances the bundle of available cash benefits through two mechanisms: (1) SSI provides cash payments during the 5-month DI waiting period, and (2) SSI supplements the DI benefit after the DI waiting period for people whose initial SSI payment is larger than the DI benefit. We find that the role of SSI cash payments is temporary for most of those who are initially covered by both SSI and DI: They would receive SSI during the DI waiting period, but would lose SSI eligibility afterwards because the higher DI benefit completely offsets the SSI benefit. However, a smaller group of DI beneficiaries with low DI benefit levels would continue to be covered by both SSI and DI after the DI waiting period because the relatively low DI benefit would not completely offset the SSI benefit. The third major finding is that interactions with other programs also substantially enhance the safety net. The most important interactions involve health insurance coverage. In the working-age population, Medicare is available to DI beneficiaries, but only after a 24-month waiting period. By contrast, SSI is an important pathway to Medicaid benefits for severely disabled adults with limited income and resources and has no waiting period. SSI can provide a pathway to health insurance coverage during the 24-month Medicare waiting period for some DI beneficiaries through providing access to Medicaid. Interactions with other programs, such as Temporary Assistance for Needy Families (TANF), Food Stamp, Unemployment Insurance (UI), workers' compensation (WC), and veterans' disability programs, modify the role of DI and SSI in protecting people against the adverse financial effects of disablement. The nature of the interactions with other programs differs depending on individual circumstances. Employment-related programs (including UI, WC, and veteran's disability programs) are particularly important for those who are covered by DI. By contrast, the means-tested programs (including TANF and Food Stamp) are more important for those who would be eligible for SSI. In conclusion, SSI plays a substantial role in protecting working-age people against the adverse financial consequences of disablement through three mechanisms: (1) providing coverage to many who are not DI insured; (2) providing additional cash benefits to many who are DI insured and also covered by SSI; and (3) enhancing the social safety net by interacting with other programs, most notably Medicaid. Through these mechanisms, the role of SSI is substantial enough that it cannot be safely ignored in econometric and policy research on DI.     

From practitioner wisdom to scholarly knowledge and back again

The relationship between scholarly knowledge in public management and the conventional wisdom of capable practitioners needs to be clarified. If we accept that improving practical wisdom is the ultimate objective of scholarly studies in public management, practitioner experience can usefully serve as the starting point of such studies as well. This article uses the maxims about coping with “overhead agencies” supplied by one respected practitioner, Gordon Chase, as a source of ideas concerning the direction of scholarly work. It also conceptualizes three types of practitioner wisdom—rules, principles, and checklists—and advises academic researchers to concentrate on clarifying the conceptualization of the principles and checklists and empirically refining the rules. A focus on those rules that protect the practitioner against large downside risks is especially important.     

Comment on Kirk Mcclure's “The low‐income housing tax credit program goes mainstream and moves to the suburbs”

Abstract

As McClure's article notes, the Low‐Income Housing Tax Credit (LIHTC) program has indeed gone mainstream. Given the tarnished reputation of many other federal low‐income housing programs, this is good news. It is also surprising in some ways considering the many programmatic flaws inherent in the LIHTC program.

As a point of departure, I look at why McClure and others are able to describe the program in a positive light despite its many flaws. I attribute this to the unique political culture of the United States, for which the LIHTC program is well suited. In addition, it sidesteps one of the thorniest problems that have bedeviled low‐income housing programs—the spatial isolation of poor minorities. Until the LIHTC program explicitly addresses this issue, however, any praise must be tempered by a great deal of caution.     

SOCIAL PROGRAM INNOVATION AND DISSEMINATION: A STUDY OF ORGANIZATIONAL CHANGE PROCESSES

The dissemination of social program innovations that have been demonstrated to be effective through rigorous evaluation is an important issue. The classical dissemination framework emphasizes the position that programs implemented with fidelity to the original model are most likely to produce the positive outcomes demonstrated in the model's evaluation phase. However, critics suggest that local programs that are extensively modified are more likely to meet local goals and, therefore, are more likely to be sustained within the organization. The present research examined the implementation, effectiveness, and routinization of seven innovations replicated in a nationwide sample of organizations. The innovations were diverse in both content and implementing context and were located in a variety of sites, including schools, courts, prisons, police departments, and social service agencies. The results suggest that the innovations were replicated with acceptable levels of fidelity to the disseminated program models, and that higher-fidelity implementations tended to be more effective than those implemented with lower fidelity. The implications of the findings for social program dissemination policy are discussed and the authors propose an expansion of Berman's contingency model of innovation dissemination.     

Risk,politics, and development: Lessons from the UK's democracy aid

Political risks are inescapable in development. Donors keep them in check with a range of tools, but existing options provide little guidance about how political forms of risk can—or should—shape programme design. This paper presents a novel framework that offers practical guidance on how to think about and manage some of these risks. This is based on a review of programmes delivered by the Westminster Foundation for Democracy, which provides a specific type of aid: democracy assistance. Political forms of risk have a strong influence on that aid, so it provides a valuable example. Our framework centres on two trade‐offs inherent in the provision of aid for democracy support. The first relates to the type of approach employed in a programme; should it focus on a thematic issue or a specific event, or should it focus primarily on an institution and its processes? The second concerns the scope of a programme in terms of who it includes. Understanding the costs and benefits of these trade‐offs will help development practitioners to make decisions about political risks in a more rigorous and transparent way and, potentially, to shift from a culture of risk aversion, to one of informed risk‐taking.     

Medicare premium buy-in programs: results of SSA demonstration projects.

Three programs known collectively as the Medicare buy-in programs are available to pay Medicare Part B premiums and, in some cases, other medical expenses for certain low-income individuals. The Health Care Financing Administration administers those programs, with most functions performed by the states. The Social Security Administration (SSA) plays an indirect role in the buy-in programs: with certain exceptions, people who qualify for Medicare and hence for buy-in are beneficiaries of Social Security retirement or disability programs. SSA is often cited as an agency that might be able to increase enrollment in the buy-in programs through outreach to its beneficiaries and by acting as an intermediary in the enrollment process. The three buy-in programs have different requirements for eligibility. The Qualified Medicare Beneficiary (QMB) program includes individuals who have Part A Medicare benefits and whose income does not exceed 100 percent of federal poverty guidelines. People in the Specified Low-Income Medicare Beneficiary (SLMB) program are individuals who would otherwise be QMBs but whose income is more than 100 percent but less than 120 percent of poverty guidelines. People in the Qualified Individual (QI) program are those who meet the other criteria but whose income is less than 175 percent of poverty guidelines. Various reports and studies by government agencies and advocacy organizations conclude that the buy-in programs are not reaching many of the people who are eligible. Low enrollment appears to be a particular issue for the SLMB and QI programs. States have tried various outreach efforts, but the effectiveness of those efforts has not been adequately assessed. In 1998, Congress mandated that SSA conduct a demonstration project to determine how to increase participation in the buy-in programs. The project tested six different administrative models in which outreach letters were sent to potential beneficiaries asking them to contact SSA and then be screened for eligibility and referred for enrollment. SSA was able to screen about 7.1 percent of letter recipients for buy-in eligibility: 4.2 percent were potentially eligible for the programs based on income and resources, and 3.7 percent enrolled in a buy-in program. An evaluation of the probability that letter recipients would contact SSA to be screened found that: Among the elderly, older individuals were less likely to be screened but more likely to enroll. Among the disabled, older individuals were more likely to be screened but less likely to enroll. The disabled were less likely to be screened but more likely to enroll. Individuals with higher Social Security benefits were more likely to be screened but less likely to enroll. Women were more likely to be screened and to enroll. Being married did not appear to affect screening but negatively affected enrollment. Individuals with a preference for materials in Spanish were much more likely to be screened and enrolled. In some of the demonstration sites, enrollment in a Medicare+Choice plan increased the probability of being both screened and enrolled. SSA conducted a survey of some people who did not respond to the outreach letter. Most of those from whom explanations of the nonresponse were obtained had not responded because they were not eligible on the basis of their income or resources. If SSA were to reproduce the demonstrations in a nationwide outreach effort, a national mailing would include nearly 20 million individuals. If response rates were similar to those seen in the 1999 demonstrations, outreach would produce over 740,000 new buy-in enrollees. That number might be increased modestly by conducting additional outreach efforts in conjunction with the mailing.     

Policy success for whom? A framework for analysis

This article develops a heuristic framework to help analysts navigate an important but under-researched issue: ‘policy success for whom?’ It identifies different forms of policy success across the policy making, program, political and temporal realms, to assess how a specific policy can differentially benefit a variety of stakeholders, including governments, lobbyists, not-for-profits, community groups and individuals. The article identifies a three-step process to aid researchers in examining any policy initiative in order to understand the forms and extent of success experienced by any actor/stakeholder. Central to these steps is the examination of plausible assessments and counter assessments to help interrogate issues of ‘success for whom.’ The article demonstrates a practical application of the framework to a case study focused on the Fixing Houses for Better Health (FHBH) program in Australia—a time-limited Commonwealth government-funded program aimed at improving Indigenous health outcomes by fixing housing.

     

Understanding voluntary program performance: Introducing the diffusion network perspective

Voluntary programs have rapidly become a means for the public, private, and third sectors to regulate and govern complex societal problems. Following the rapid and widespread emergence of these programs, scholars have been active in mapping, exploring, and interrogating their design and performance. Considerable advances have been made in describing program design and context conditions, and the actors involved in the voluntary program that relate to program performance. Less is known, however, about how these conditions affect program performance. Starting with one of the dominant theories on voluntary programs, the club theory perspective, this article seeks to understand how different program design conditions interact to affect the performance of 26 voluntary programs for low carbon building and city development in Australia, the Netherlands, and the United States. Applying qualitative comparative analysis, the study finds that the club theory perspective has limited explanatory power for this specific set of cases. Iterative rounds of analysis indicate that a diffusion network perspective is the best complementary perspective for explaining the performance of this set of programs. The article concludes that, in situations of a non‐homogeneous market of voluntary program participants, a focus on the programs’ diffusion networks helps to explain their performance. This has implications for the design and implementation of such programs.     

Getting a Job is Only Half the Battle: Maternal Job Loss and Child Classroom Behavior in Low-Income Families

This study uses data from an experimental employment program and instrumental variables (IV) estimation to examine the effects of maternal job loss on child classroom behavior. Random assignment to the treatment at one of three program sites is an exogenous predictor of employment patterns. Cross-site variation in treatment-control differences is used to identify the effects of employment levels and transitions. Under certain assumptions, this method controls for unobserved correlates of job loss and child well-being, as well as measurement error and simultaneity. IV estimates suggest that maternal job loss sharply increases problem behavior but has neutral effects on positive social behavior. Current employment programs concentrate primarily on job entry, but these findings point to the importance of promoting job stability for workers and their children.