Is full better than half? Examining the longitudinal effects of full‐day kindergarten attendance

Kindergarten policy varies widely both across and within states. Over the past decade, a number of states have instituted a full‐day kindergarten requirement and others are considering it as a way to increase educational achievement. Many parents also support full‐day kindergarten as a source of child care. This paper uses the Early Child Longitudinal Study–Kindergarten Class of 1998–1999 to evaluate the efficacy of this policy. In ordinary least squares, probit, county fixed effects, and instrumental variables models, we find that there are initial benefits for students and the mothers of students who attend full‐day kindergarten, but that these differences largely evaporate by third grade. Contrary to claims by some advocates, attending full‐day kindergarten is found to have no additional benefit for students in families with income below the poverty threshold. © 2006 by the Association for Public Policy Analysis and Management     

School Starting Age and Cognitive Development

We present evidence of a positive relationship between school starting age and children's cognitive development from ages 6 to 18 using a fuzzy regression discontinuity design and large‐scale population‐level birth and school data from the state of Florida. We estimate effects of being old for grade (being born in September vs. August) that are remarkably stable—always around 0.2 SD difference in test scores—across a wide range of heterogeneous groups, based on maternal education, poverty at birth, race/ethnicity, birth weight, gestational age, and school quality. While the September‐August difference in kindergarten readiness is dramatically different by subgroup, by the time students take their first exams, the heterogeneity in estimated effects on test scores effectively disappears. We do, however, find significant heterogeneity in other outcome measures such as disability status and middle and high school course selections. We also document substantial variation in compensatory behaviors targeted towards young‐for‐grade children. While the more affluent families tend to redshirt their children, young‐for‐grade children from less affluent families are more likely to be retained in grades prior to testing. School district practices regarding retention and redshirting are correlated with improved outcomes for the groups less likely to use those remediation approaches (i.e., retention in the case of more affluent families and redshirting in the case of less affluent families.) Finally, we find that very few school policies or practices mitigate the test score advantage of September‐born children.     

The Effects of Changing Test‐Based Policies for Reclassifying English Learners

When students labeled English Learners (ELs) are reclassified as Fluent English Proficient, changes often occur in services and settings (e.g., changes in teachers, peers, and ancillary services). Policymakers play an important role in the reclassification process because they establish test‐based criteria that an EL must attain in order to become reclassified. If the criteria established by policymakers are incongruent with the instructional changes that result from reclassification, then services and settings may be denied to students who would otherwise benefit from them. In response to teachers’ and administrators’ concerns that some ELs who were reclassified were not succeeding without additional supports, California policymakers in 2006 to 2007 changed the reclassification criteria. In this paper, we examine the effects of changing these criteria using data on Latino/a students from the Los Angeles Unified School District, the U.S. district serving the largest number of ELs. Using “difference‐in‐regression‐discontinuities” approaches, we find consistent evidence that this policy change, which increased the difficulty of attaining the test‐based criteria for EL reclassification eligibility, had significant effects on high‐school students’ subsequent English language arts achievement (0.18 SDs) and graduation outcomes (11 percentage points). Specifically, when the criteria for reclassification were lower, students experienced negative effects of reclassification; but when the criteria were raised, students no longer experienced these negative effects. Highlighting the complex interplay between assessments, instruction, and policy, these findings demonstrate the important role policymakers play in the academic success of ELs and speak to policymaker considerations when implementing assessment and accountability systems.     

The Effects of Tulsa's Pre‐K Program on Middle School Student Performance

As states have upgraded their commitment to pre‐K education over the past two decades, questions have arisen. Critics argue that program effects are likely to fade out or disappear over time, while supporters contend that program effects are likely to persist under certain conditions. Using data from Tulsa Public Schools, three neighboring school districts, and the state of Oklahoma, and propensity score weighting, we estimate the effects of Tulsa's universal, school‐based pre‐K program on multiple measures of academic progress for middle school students. We find enduring effects on math achievement test scores, enrollment in honors courses, and grade retention for students as a whole, and similar effects for certain subgroups. We conclude that some positive effects of a high‐quality pre‐K program are discernible as late as middle school.     

The Effect of English Language Learner Reclassification on Student ACT Scores,High School Graduation,and Postsecondary Enrollment: Regression Discontinuity Evidence from Wisconsin

The recent increase in the number of students classified as English language learners (ELLs) has focused significant attention on reclassification policy, which governs the process by which ELLs move toward, and are deemed to reach, full English proficiency. In this paper, we draw on a data set containing annual individual‐level records for every Wisconsin student ever classified as an ELL between the 2006–07 and 2012–13 school years to estimate the effects of being reclassified at the end of 10th grade—a crucial period on the pathway to postsecondary education—on several measures related to students’ postsecondary attainments. We estimate these effects in a regression discontinuity framework, exploiting Wisconsin's policy rule that automatically reclassifies ELLs who score above a specified cutoff on the state's English language proficiency exam. Our analysis indicates that being reclassified as fully English proficient in 10th grade has a positive effect on students’ ACT scores. It also provides some evidence of a positive effect on high school graduation and the probability of enrolling in a postsecondary institution the fall after graduation. Together, our analyses provide evidence on the effects of a policy directly relevant to the country's fastest growing student population, and we close the paper with a discussion of the implications for research and policy.     

Impact of the Indiana Choice Scholarship Program: Achievement Effects for Students in Upper Elementary and Middle School

This paper examines the impact of the Indiana Choice Scholarship Program on student achievement for low‐income students in upper elementary and middle school who used a voucher to transfer from public to private schools during the first four years of the program. We analyzed student‐level longitudinal data from public and private schools taking the same statewide standardized assessment. Overall, voucher students experienced an average achievement loss of 0.15 SDs in mathematics during their first year of attending a private school compared with matched students who remained in a public school. This loss persisted regardless of the length of time spent in a private school. In English/Language Arts, we did not observe statistically meaningful effects. Although school vouchers aim to provide greater educational opportunities for students, the goal of improving the academic performance of low‐income students who use a voucher to move to a private school has not yet been realized in Indiana.     

Dual-Credit Courses and the Road to College: Experimental Evidence from Tennessee

Dual-credit courses expose high school students to college-level content and provide the opportunity to earn college credits, in part to smooth the transition to college. With the Tennessee Department of Education, we conduct the first randomized controlled trial of the effects of dual-credit math coursework on a range of high school and college outcomes. We find that the dual-credit advanced algebra course alters students’ subsequent high school math course-taking, reducing enrollment in remedial math and boosting enrollment in precalculus and Advanced Placement math courses. We fail to detect an effect of the dual-credit math course on overall rates of college enrollment. However, the course induces some students to choose four-year universities instead of two-year colleges, particularly for those in the middle of the math achievement distribution and those first exposed to the opportunity to take the course in eleventh rather than twelfth grade. We see limited evidence of improvements in early math performance during college.     

Teacher Incentives and Student Achievement: Evidence from an Advancement Program

This paper examines the effects of a comprehensive performance pay program implemented in high‐need schools using administrative data from Louisiana. Exploiting the within‐student variation in the timing of implementation, we find a large and significant effect beginning with the second year of the program on math achievement. Similar but generally insignificant point estimates are observed in social studies. As for English Language Arts and science, there are no effects of the program. We provide evidence against changes in the composition of teacher workforce and postadoption student sorting as potential explanations for our results. We then show aggregate findings from a web‐survey that teachers may have altered their teaching practices following performance‐based compensation. Finally, under certain assumptions, we calculate the net present value of earnings impact to be close to a million dollars per school‐year for math.     

The Impact of Providing Vision Screening and Free Eyeglasses on Academic Outcomes: Evidence from a Randomized Trial in Title I Elementary Schools in Florida

More than 20 percent of all school‐aged children in the United States have vision problems, and low‐income and minority children are disproportionately likely to have unmet vision care needs. Vision screening is common in U.S. schools, but it remains an open question whether screening alone is sufficient to improve student outcomes. We implemented a multi‐armed randomized controlled trial (RCT) to evaluate the impact of vision screening, and of vision screening accompanied by eye exams and eyeglasses, provided by a non‐profit organization to Title I elementary schools in three large central Florida school districts. We find that providing additional/enhanced screening alone is generally insufficient to improve student achievement in math and reading. In contrast, providing screening along with free eye exams and free eyeglasses to students with vision problems improved student achievement as measured by standardized test scores. We find, averaging over all students (including those without vision problems), that this more comprehensive intervention increased the probability of passing the Florida Comprehensive Achievement Tests (FCATs) in reading and math by approximately 2.0 percentage points. We also present evidence that indicates that this impact fades out over time, indicating that follow‐up actions after the intervention may be necessary to sustain these estimated achievement gains.     

Who Benefits from KIPP?

The nation's largest charter management organization is the Knowledge is Power Program (KIPP). KIPP schools are emblematic of the No Excuses approach to public education, a highly standardized and widely replicated charter model that features a long school day, an extended school year, selective teacher hiring, strict behavior norms, and emphasizes traditional reading and math skills. No Excuses charter schools are sometimes said to target relatively motivated high achievers at the expense of students who are more difficult to teach, including limited English proficiency (LEP) and special education (SPED) students, as well as students with low baseline achievement levels. We use applicant lotteries to evaluate the impact of KIPP Academy Lynn, a KIPP school in Lynn, Massachusetts that typifies the KIPP approach. Our analysis focuses on special needs students that may be underserved. The results show average achievement gains of 0.36 standard deviations in math and 0.12 standard deviations in reading for each year spent at KIPP Lynn, with the largest gains coming from the LEP, SPED, and low‐achievement groups. Average reading gains are driven almost entirely by SPED and LEP students, whose reading scores rise by roughly 0.35 standard deviations for each year spent at KIPP Lynn.     

Improving the Implementation and Effectiveness of Out‐of‐School‐Time Tutoring

School districts are spending millions on tutoring outside regular school day hours for economically and academically disadvantaged students in need of extra academic assistance. Under No Child Left Behind (NCLB), parents of children in persistently low‐performing schools were allowed to choose their child's tutoring provider, and together with school districts, they were also primarily responsible for holding providers in the private market accountable for performance. We present results from a multisite, mixed‐method longitudinal study of the impact of out‐of‐school time (OST) tutoring on student reading and mathematics achievement that link provider attributes and policy and program administration variables to tutoring program effectiveness. We find that many students are not getting enough hours of high‐quality, differentiated instruction to produce significant gains in their learning, in part because of high hourly rates charged by providers for tutoring. We identify strategies and policy levers that school districts can use to improve OST tutoring policy design and launch improved programs as waivers from NCLB are granted.     

The Effect of Breakfast in the Classroom on Obesity and Academic Performance: Evidence from New York City

Participation in the federally subsidized school breakfast program often falls well below its lunchtime counterpart. To increase take‐up, many districts have implemented Breakfast in the Classroom (BIC), offering breakfast directly to students at the start of the school day. Beyond increasing participation, advocates claim BIC improves academic performance, attendance, and engagement. Others caution BIC has deleterious effects on child weight. We use the implementation of BIC in New York City (NYC) to estimate its impact on meals program participation, body mass index (BMI), achievement, and attendance. While we find large effects on participation, our findings provide no evidence of hoped‐for gains in academic performance, or of feared increases in obesity. The policy case for BIC will depend upon reductions in hunger and food insecurity for disadvantaged children, or its longer‐term effects.     

School choice,racial segregation,and test‐score gaps: Evidence from North Carolina's charter school program*

Using panel data that track individual students from year to year, we examine the effects of charter schools in North Carolina on racial segregation and black‐white test score gaps. We find that North Carolina's system of charter schools has increased the racial isolation of both black and white students, and has widened the achievement gap. Moreover, the relatively large negative effects of charter schools on the achievement of black students is driven by students who transfer into charter schools that are more racially isolated than the schools they have left. Our analysis of charter school choices suggests that asymmetric preferences of black and white charter school students (and their families) for schools of different racial compositions help to explain why there are so few racially balanced charter schools. © 2006 by the Association for Public Policy Analysis and Management.     

Status versus growth: The distributional effects of school accountability policies

Although the federal No Child Left Behind program judges the effectiveness of schools based on their students' achievement status, many policy analysts argue that schools should be measured, instead, by their students' achievement growth. Using a 10‐year student‐level panel data set from North Carolina, we examine how school‐specific pressure associated with status and growth approaches to school accountability affect student achievement at different points in the prior‐year achievement distribution. Achievement gains for students below the proficiency cut point emerge in schools failing either type of accountability standard, with the effects clearer for math than for reading. In contrast to prior research highlighting the possibility of educational triage, we find little or no evidence that failing schools in North Carolina ignore the students far below proficiency under either approach. Importantly, we find that the status, but not the growth, approach reduces the reading achievement of higher performing students. Our analysis suggests that the distributional effects of accountability pressure depend not only on the type of pressure for which schools are held accountable (status or growth), but also the tested subject. © 2010 by the Association for Public Policy Analysis and Management.     

Let Them Eat Lunch: The Impact of Universal Free Meals on Student Performance

This paper investigates the impact of extending free school lunch to all students, regardless of income, on academic performance in New York City middle schools. Using a difference-in-differences design and unique longitudinal, student-level data, we derive credibly causal estimates of the impacts of “Universal Free Meals” (UFM) on test scores in English Language Arts (ELA) and mathematics, and participation in school lunch. We find UFM increases academic performance by as much as 0.083 standard deviations in math and 0.059 in ELA for non-poor students, with smaller, statistically significant effects of 0.032 and 0.027 standard deviations in math and ELA for poor students. Further, UFM increases participation in school lunch by roughly 11.0 percentage points for non-poor students and 5.4 percentage points for poor students. We then investigate the academic effects of school lunch participation per se, using UFM as an instrumental variable. Results indicate that increases in school lunch participation improve academic performance for both poor and non-poor students; an additional lunch every two weeks increases test scores by roughly 0.08 standard deviations in math and 0.07 standard deviations in ELA. Finally, we explore potential unintended consequences for student weight outcomes, finding no evidence that UFM increases the probability that students are obese or overweight. We also find no evidence of increases in average body mass index (BMI). Instead, we find some evidence that participation in school lunch improves weight outcomes for non-poor students. Results are robust to an array of alternative specifications and assumptions about the sample.     

High School Exit Exams and Dropout in an Era of Increased Accountability

A key form of student‐level accountability is the requirement for students to pass high school exit exams (HSEEs) in order to receive a diploma. In this paper, we examine the impact of HSEEs on dropout during a period when these exams became more common and rigorous. Further, we study whether offering alternate pathways to graduation for students who cannot pass HSEEs moderates any dropout effects. Using a district‐grade‐level panel assembled from the Common Core of Data, we exploit the fact that new exit exam policies first affect a particular graduating class, so we can isolate the impact of exposure to HSEEs for students in one grade in a district separate from other unaffected grades in the same district. We estimate dropout effects by grade for all students, and by race, sex, and urbanicity. We find that HSEEs increase dropout rates for students in the 12th grade, with especially large effects for African‐American students. Dropout effects are uniformly larger in states that do not provide alternate pathways to receive a diploma or alternative credentials for students that cannot pass exit exams. We estimate that 1.25 percent of 12th graders in these states do not graduate with their high school class, likely due to having a diploma withheld because of inability to pass the requisite HSEE. © 2013 by the Association for Public Policy Analysis and Management.     

Racial Inequality in Democratic Accountability: Evidence from Retrospective Voting in Local Elections

One important and, to date, overlooked component of democratic accountability is the extent to which it might exacerbate existing societal inequalities if the outcomes for some groups of citizens are prioritized over others when voters evaluate governmental performance. We analyze a decade of California school board elections and find evidence that voters reward or punish incumbent board members based on the achievement of white students in their district, whereas outcomes for African American and Hispanic students receive comparatively little attention. We then examine public opinion data on the racial education achievement gap and report results from an original list experiment of California school board members that finds approximately 40% of incumbents detect no electoral pressure to address poor academic outcomes among racial minority students. We conclude by discussing the implications of these findings for several scholarly literatures, including retrospective voting, racial inequality in political influence, intergovernmental policymaking, and education politics.     

Charter High Schools’ Effects on Long‐Term Attainment and Earnings

Since their inception in 1992, the number of charter schools has grown to more than 6,800 nationally, serving nearly three million students. Various studies have examined charter schools’ impacts on test scores, and a few have begun to examine longer‐term outcomes including graduation and college attendance. This paper is the first to estimate charter schools’ effects on earnings in adulthood, alongside effects on educational attainment. Using data from Florida, we first confirm previous research (Booker et al., 2011 ) that students attending charter high schools are more likely to graduate from high school and enroll in college. We then examine two longer‐term outcomes not previously studied in research on charter schools—college persistence and earnings. We find that students attending charter high schools are more likely to persist in college, and that in their mid‐20s they experience higher earnings.     

The Effect of Providing Breakfast in Class on Student Performance

Many schools have recently experimented with moving breakfast from the cafeteria to the classroom. We examine whether such a program increases achievement, grades, and attendance rates. We exploit quasi‐random timing of program implementation that allows for a difference‐in‐differences identification strategy. We find that providing breakfast in class relative to the cafeteria raises math and reading achievement by 0.09 and 0.06 standard deviations, respectively. These effects are most pronounced for low‐performing, free lunch‐eligible, Hispanic, and low body mass index students. A lack of differences by exposure time and effects on grades suggest that these impacts are on test‐taking performance rather than learning. At the same time, the results highlight the possibility that measured achievement may be biased downwards, and accountability penalties may be inappropriately applied, in schools where many students do not consume breakfast.     

The Use and Efficacy of Capacity‐Building Assistance for Low‐Performing Districts: The Case of California's District Assistance and Intervention Teams

The theory of action upon which high‐stakes accountability policies are based calls for systemic reforms in educational systems that will emerge by pairing incentives for improvement with extensive and targeted technical assistance (TA) to build the capacity of low‐performing schools and districts. To this end, a little discussed and often overlooked aspect of the No Child Left Behind Act (NCLB) mandated that, in addition to sanctions, states were required to provide TA to build the capacity of struggling schools and Local Education Agencies (LEAs, or districts) to help them improve student achievement. Although every state in the country provides some form of TA to its lowest performing districts, we know little about the content of these programs or about their efficacy in improving student performance. In this paper, we use both quantitative and qualitative analyses to explore the actions taken by TA providers in one state—California—and examine whether the TA and support tied to California's NCLB sanctions succeeds in improving student achievement. Like many other states, California requires that districts labeled as persistently failing under NCLB (in Program Improvement year 3, PI3) work with external experts to help them build the capacity to make reforms that will improve student achievement. California's lowest performing PI3 districts are given substantial amounts of funding and are required to contract with state‐approved District Assistance and Intervention Teams (DAITs), whereas the remaining PI3 districts receive less funding and are asked to access less intensive TA from non‐DAIT providers. We use a five‐year panel difference‐in‐difference design to estimate the impacts of DAITs on student performance on the math and English language arts (ELA) standardized tests relative to non‐DAIT TA during the two years of the program intervention. We find that students in districts with DAITs perform significantly better on math California Standards Tests (CSTs) averaged over both treatment years and in each of the first and second years. We do not find evidence that students in districts with DAITs perform higher on ELA CSTs over the combined two years of treatment, although we find suggestive evidence that ELA performance increases in the second year of treatment relative to students in districts with non‐DAIT TA. Ordinary least squares (OLS) regressions that explore the association between specific activities fostered by DAITs and changes in districts’ gains in achievement over the two years of treatment show that DAIT districts that report increasing their focus on using data to guide instruction, shifting district culture to generate and maintain high expectations of students and staff, and increasing within‐district accountability for student performance, have higher math achievement gains over the course of the DAIT treatment. In addition, DAIT districts that increase their focus on ELA instruction and shift district culture to one of high expectations have higher ELA achievement gains than do DAIT districts that do not have a similar focus. © 2012 by the Association for Public Policy Analysis and Management.