Curriculum Reform in The Common Core Era: Evaluating Elementary Math Textbooks Across Six U.S. States

Can a school or district improve student achievement simply by switching to a higher-quality textbook or curriculum? We conducted the first multi-textbook, multi-state effort to estimate textbook efficacy following widespread adoption of the Common Core State Standards (CCSS) and associated changes in the textbook market. Pooling textbook adoption and student test score data across six geographically and demographically diverse U.S. states, we found little evidence of differences in average achievement gains for schools using different math textbooks. We found some evidence of greater variation in achievement gains among schools using pre-CCSS editions, which may have been more varied in their content than post-CCSS editions because they were written for a broader set of standards. We also found greater variation among schools that had more exposure to a given text. However, these differences were small. Despite considerable interest and attention to textbooks as a low-cost, “silver bullet” intervention for improving student outcomes, we conclude that the adoption of a new textbook or set of curriculum materials, on its own, is unlikely to achieve this goal.     

Opening up to OERs: Electronic Original Sourcebook Versus Traditional Textbook in the Introduction to American Government Course

Traditional American Government textbooks are expensive and often unpopular with students. New technologies and Open Educational Resources (OERs) open up the potential for change, but questions of quality are ever present: can OERs really help students learn better, or are they just cheaper? I developed an OER based on original sources and compared student learning outcomes with the OER section to those in a free digital textbook section. While the OER I created did not work as well as I had hoped, I nonetheless developed a redesign of my course and my approach to teaching, which is the true benefit of adopting OERs.     

State involvement in limiting textbook choice by school districts

Who gets to decide what textbooks are used in America’s public school classrooms varies by state. States can let each school district decide, provide standards that must be followed and make available an incomplete listing of books meeting those standards, or allow schools to choose books only from a list provided by the state. I present a model that provides an explanation for state limits on textbook selection by school districts. I examine the roles played by decision making costs, effectiveness of voters, religious composition, power of teachers, and propensity of state governments to interfere with or to help districts in textbook selection policies at the state level. There has been virtually no research on this topic. My findings corroborate the extant literature that addresses interference by state governments in local affairs and extend the morality politics literature by finding a strong link between religious fundamentalism and state-level policies. I also find that state book lists are less likely (1) in more educated states, where voters are better able to select the most appropriate textbook, (2) in states with smaller school districts, where voters are more involved in the schools, and (3) in states with stronger teacher unions, giving teachers more power in textbook selection.     

The Impact of Providing Vision Screening and Free Eyeglasses on Academic Outcomes: Evidence from a Randomized Trial in Title I Elementary Schools in Florida

More than 20 percent of all school‐aged children in the United States have vision problems, and low‐income and minority children are disproportionately likely to have unmet vision care needs. Vision screening is common in U.S. schools, but it remains an open question whether screening alone is sufficient to improve student outcomes. We implemented a multi‐armed randomized controlled trial (RCT) to evaluate the impact of vision screening, and of vision screening accompanied by eye exams and eyeglasses, provided by a non‐profit organization to Title I elementary schools in three large central Florida school districts. We find that providing additional/enhanced screening alone is generally insufficient to improve student achievement in math and reading. In contrast, providing screening along with free eye exams and free eyeglasses to students with vision problems improved student achievement as measured by standardized test scores. We find, averaging over all students (including those without vision problems), that this more comprehensive intervention increased the probability of passing the Florida Comprehensive Achievement Tests (FCATs) in reading and math by approximately 2.0 percentage points. We also present evidence that indicates that this impact fades out over time, indicating that follow‐up actions after the intervention may be necessary to sustain these estimated achievement gains.     

Rent-seeking in the classroom and textbooks: Where are we after 50 years?

In this paper, we provide an overview of the influence of Tullock’s work on rent-seeking in the area of economics education. After summarizing the basic rent-seeking model in both a domestic and international context, we conduct an analysis of undergraduate and graduate textbooks in public economics. We find a majority of undergraduate texts cover rent-seeking in depth, but two texts provide zero coverage. No graduate textbook surveyed mentions rent-seeking. We conclude by summarizing the economic education literature on rent-seeking, which can be divided into either classroom experiments or popular culture examples.

     

Pedagogisation of nation identity through textbook narratives in China: 1902–1948

How to construct a national collective identity in a diversified population becomes a challenge for many nation states. Focusing on the tension between diversity, citizenship and national identity, this article adopts the lens of the pedagogical state to analyse national identity construction in Chinese political education textbooks published between 1902 and 1948. The purpose of this research was to explore the pedagogical mechanisms with which the textbook narratives accommodate the tensions of diversity in a culturally heterogeneous population and transmit a newly invented national identity (‘the Chinese nation’, Zhonghua minzu) to the masses. Two general rationales of persuasion are identified in the textbooks: narrative of origin and narrative of promise. Framing the analysis in China's citizenship project by the state, this study argues that the textbooks lead the general public into a citizenship identity contract on the grounds of the two rationales.     

THE IMPACTS OF DIFFERENT TYPES OF COLLEGE INSTRUCTORS ON STUDENTS’ ACADEMIC AND LABOR MARKET OUTCOMES

Based on a novel data set that links college administrative information with earnings records from a state college system for both public two‐year and four‐year colleges, this study quantifies the impacts of exposure to different types of instructors during students’ initial semester in college on their subsequent academic and labor market outcomes. To minimize bias from student sorting by type of instructor, we combine course‐set fixed effects with an instrumental variables approach that exploits term‐by‐term fluctuations in faculty composition in each department, therefore controlling for both between‐ and within‐course sorting. The findings suggest that two‐year students, particularly racial minority students, have substantially higher levels of exposure to adjuncts with temporary appointments than four‐year students. Two‐year students taking a heavy course schedule with temporary adjuncts are adversely affected in college persistence and subsequent credit accumulation, and the penalty is particularly pronounced among males and racial minority students with stronger academic potential. Such negative impacts on academic outcomes do not translate into poorer short‐ to medium‐term labor market performance. In the four‐year setting, no significant distinction is identified between different types of instructors on either student academic or labor market outcomes.     

Connections Matter: How Interactive Peers Affect Students in Online College Courses

Peers affect individual's productivity in the workforce, in education, and in other team‐based tasks. Using large‐scale language data from an online college course, we measure the impacts of peer interactions on student learning outcomes and persistence. In our setting, students are quasi‐randomly assigned to peers, and as such, we are able to overcome selection biases stemming from endogenous peer grouping. We also mitigate reflection bias by utilizing rich student interaction data. We find that females and older students are more likely to engage in student interactions. Students are also more likely to interact with peers of the same gender and with peers from roughly the same geographic region. For students who are relatively less likely to be engaged in online discussion, exposure to more interactive peers increases their probabilities of passing the course, improves their grade in the course, and increases their likelihood of enrolling in the following academic term. This study demonstrates how the use of large‐scale, text‐based data can provide insights into students’ learning processes.     

Dual-Credit Courses and the Road to College: Experimental Evidence from Tennessee

Dual-credit courses expose high school students to college-level content and provide the opportunity to earn college credits, in part to smooth the transition to college. With the Tennessee Department of Education, we conduct the first randomized controlled trial of the effects of dual-credit math coursework on a range of high school and college outcomes. We find that the dual-credit advanced algebra course alters students’ subsequent high school math course-taking, reducing enrollment in remedial math and boosting enrollment in precalculus and Advanced Placement math courses. We fail to detect an effect of the dual-credit math course on overall rates of college enrollment. However, the course induces some students to choose four-year universities instead of two-year colleges, particularly for those in the middle of the math achievement distribution and those first exposed to the opportunity to take the course in eleventh rather than twelfth grade. We see limited evidence of improvements in early math performance during college.     

Interactive Learning Online at Public Universities: Evidence from a Six‐Campus Randomized Trial

Online instruction is quickly gaining in importance in U.S. higher education, but little rigorous evidence exists as to its effect on student learning. We measure the effect on learning outcomes of a prototypical interactive learning online statistics course by randomly assigning students on six public university campuses to take the course in a hybrid format (with machine‐guided instruction accompanied by one hour of face‐to‐face instruction each week) or a traditional format (as it is usually offered by their campus, typically with about three hours of face‐to‐face instruction each week). We find that learning outcomes are essentially the same—that students in the hybrid format are not harmed by this mode of instruction in terms of pass rates, final exam scores, and performance on a standardized assessment of statistical literacy. We also conduct speculative cost simulations and find that adopting hybrid models of instruction in large introductory courses has the potential to significantly reduce instructor compensation costs in the long run.     

Dialectics and the Megamachine: A Critique of Ersatz Education

This article proposes that the learning environment matters, and that there are qualitative differences in online versus face-to-face classes. While online education provides some benefits, they also narrow the opportunities for dialectical conflict that thoroughly challenge student thinking, an interaction more likely to be found in real-time conversations. In person, there is more opportunity for an instructor to challenge the reasoning of students in real time, and for students to ask probing and follow-up questions. The article considers the structure of educational dialectic suggested by important thinkers including Galtung, Habermas, and Buber. Online education is then situated as a technology that interferes with human relations and dialectical reasoning and fits within the notion of technics and the megamachine advanced by Lewis Mumford, which dehumanizes personal interactions with instrumental processes for growth and efficiency. Students follow suit by focusing more on the instrumental absorption of course content to pass the course, instead of higher order critique. Of particular interest to political science education is that if conversational dialectics are weakened in universities, and therefore polities—and the technics are simply considered a natural replacement for in-person conversation—the opportunities to teach critical reasoning required for critique of complex political phenomena are also narrowed. We might temper the dangers of the megamachine by reflexively discussing the political economy of online teaching itself with our students and by starting to expect synchronous conversation, which will open dialectical opportunities.     

For the Guidance of Martians: A Reply to Martin Smith on British Politics Textbooks

A recent review article in the British Journal of Politics and International Relations made a number of criticisms about the supposed lack of innovation and theoretical rigour found in current British politics textbooks. Jones and Robins constructively engage the points made in the article and argue that the criticisms made are only partly valid. They conclude that, within the obvious confines of a basic text, there is more on offer to students than there has ever been and that the success of these textbooks provides publishers with the means to cross-subsidise minority interest scholarship.     

Civic education: do liberals do it better?

Recent research has found that civic education improves the democratic capacity of students and that teachers who employ an ‘open classroom’ approach seem to perform better at accomplishing this goal. We build on behavioural literature suggesting that variation in personality traits across ideology may account for why liberal middle school teachers would be more likely to foster an open classroom climate and as a result do a better job than their conservative counterparts at stimulating in their students’ political knowledge, an important component of democratic capacity. We estimate a series of quasi-experimental multilevel models using data from a survey of American students and teachers. The results indicate that liberal teachers tend to use an open classroom approach more frequently and that the students with the highest levels of political knowledge are in classes taught by liberal teachers. This effect holds up when controlling for individual-level predictors of student knowledge.     

Alternative routes to teaching: The impacts of Teach for America on student achievement and other outcomes

This paper reports on a randomized experiment to study the impact of an alternative teacher preparation program, Teach for America (TFA), on student achievement and other outcomes. We found that TFA teachers had a positive impact on math achievement and no impact on reading achievement. The size of the impact on math scores was about 15 percent of a standard deviation, equivalent to about one month of instruction. The general conclusions did not differ substantially for subgroups of teachers, including novice teachers, or for subgroups of students. We found no impacts on other student outcomes such as attendance, promotion, or disciplinary incidents, but TFA teachers were more likely to report problems with student behavior than were their peers. The findings contradict claims that such programs allowing teachers to bypass the traditional route to the classroom harm students. © 2006 by the Association for Public Policy Analysis and Management     

Food or Thought? Assessing Internal and External Factors Affecting Evaluations of Instructor Effectiveness

Within the broader literature concerned with potential bias in student measures of instructor effectiveness, two broad types of bias have been shown to operate in a course: internal and external. Missing is an assessment of the relative influence of each bias type in the classroom. Do internal or external types of bias matter more or less to student measures of instructor effectiveness? This question is of interest to those who recognize that many forms of bias operate in the classroom simultaneously and to great effect on course evaluations. Through the combination of quasi-experimental and survey methods, we attempt to do something not done before — simultaneously measure and compare the effects of one internal and one external type of bias to which we refer, following convention in the literature, as an internal factor and an external factor. Our findings indicate that, while both factors studied are important, perception of instructor partisanship (internal factor) is more influential on student course evaluations than our external factor (experimental treatment — literally a chocolate treat). The upshot is that American government instructors should be especially careful stating partisan positions in class.     

Where Are the Women? An Analysis of Gender Mainstreaming in Introductory Political Science Textbooks

Textbook content is a powerful indicator of what is and is not considered important in a given discipline. Textbooks shape both curriculum and students’ thinking about a subject. The extant literature indicates that gender is not well represented in American government textbooks, thus signaling to students that women and gender are not part of the mainstream in political science. I contribute to this literature by using quantitative and qualitative content analysis to examine gender mainstreaming in 10 introductory political science textbooks. I find that the quantity of gendered content is small, and the quality of that content varies considerably from text to text.     

White pages: Israeli censorship of Palestinian textbooks in East Jerusalem

This study examined History textbooks taught in East Jerusalem. The political context of East Jerusalem and its education system manifests a continuous power struggle between the Palestinian National Authority and Israeli authorities, in this case, the Israeli Ministry of Education. Through analyzing the textbooks, this study speaks of the power dynamics and systems of political control manifested through the Israeli censorship. The aim of this paper is to present the intricate power relations of the education system in East Jerusalem as it is revealed in the censorship of textbooks. In analyzing the content censored in textbooks for elementary and high schools, three main censorship categories emerged: “erasing symbols,” “leaving out segments,” and “deleting the content of whole pages.” These are presented and analyzed within a political context in the study.     

‘Telling our Way of Life': Modes of Mediating Social Life in German and Polish Primary-School Textbooks

The events of 1989-1991 in Central and Eastern Europe brought political and economic changes to the post-Communist societies, which required them to redraw the social and psychological maps of their countries and carried with them the promise of partaking in the 'Western way of life'. The introduction of liberalised ideologies, both at the official level and in most of the freed media, also had to be translated into the countries' education systems. New textbooks that would accommodate the new social and political realities had to be written. We are interested in this article in whether and how these new realities are reflected in primary-school teaching materials. For this paper, our analysis will focus on data from two current textbooks that are used in German and Polish primary schools, respectively. We shall be focusing particularly upon those units of the book aimed at defining or describing realities. Taking into account both linguistic and visual modes of representation, we are interested in revealing the 'way of life', the lived ideologies, constructed in these textbooks.     

Cost‐Effectiveness of Early Childhood Interventions to Enhance Preschool: Evidence from a Randomized Experiment in Head Start Centers Enrolling Historically Underserved Populations

We evaluate the cost‐effectiveness of two early childhood interventions that use instructional coaching and parent coaching as levers for improvement. The study design allows us to compare the individual effects of each intervention as well as their combined effect on student outcomes. We find that teachers receiving instructional coaching improve their use of evidence‐based instructional practices, while families receiving parent coaching show increases in numerous responsive parenting behaviors associated with positive child outcomes. Both interventions demonstrate positive impacts on students, but only parent coaching shows statistically significant effects across a range of student outcomes. Instructional coaching alone is substantially less costly and may therefore be the most cost‐effective of the three treatment conditions; however, small sample sizes limit our ability to reach definitive conclusions. Policy simulations suggest that implementing these interventions could raise the overall cost‐effectiveness of Head Start by at least 16 percent.