Implementing and Evaluating School-Based Primary Prevention Programs and the Importance of Differential Effects on Outcomes

Abstract

In 2004, Second Step (Committee for Children, 2002), a violence prevention program, was implemented in the Cleveland Heights-University Heights school district for 1,416 K through second grade students. Both process and outcome measures were used to evaluate program impact and examine issues related to the implementation and evaluation of evidence-based practices. Process measures indicated a high level of implementation fidelity, while pre/post outcome testing on a 20% random sample of students demonstrated significant reductions in reactive aggression scores, t= 2.221, df= 238, p< 0.05, and evidence of declines in proactive aggression. Authors discuss challenges and opportunities related to implementing and evaluating evidence-based programming in Safe Schools/Health Students sites, particularly regarding strategies for the assessment of differential intervention effects to evaluate program outcomes.     

Successful Program Development Using Implementation Evaluation

SUMMARY

Four methods used to enhance implementation of a resiliency-based early childhood substance abuse and violence prevention initiative are described. Project staff drew up formal agreements with participating programs to ensure administrative support for the intervention, provided high quality training for program implemcnt-ers, used a participatory evaluation approach, and monitored implementation both directly and through practitioners' self-report. The contribution of each of these methods to fidelity of implementation is discussed, and implementation challenges are identified. The growth and success of the project demonstrates the utility of implementation evaluation data for ongoing program development and improvement.     

School Violence Interventions in the Safe Schools/Healthy Students Initiative

Abstract

The Safe Schools/Healthy Students Initiative was designed to encourage collaboration among school districts and local community service providers in the provision of behavioral health prevention and early intervention efforts. These efforts would address the physical safety of students as well as provide mental health, violence prevention, and social skills services. One local SS/HS Initiative brought together community and school collaborators in an ambitious agenda that included 14 distinct programs that addressed the needs of over 110,000 students in a large school district. The purpose of the current paper is to report the results of the evaluation of two of the programs designed to reduce violent and disruptive behavior in schools. The programs include a school-based anger management program and a community-based, alternative-to-suspension program. Working in cooperation with program staff and the school district, quasi-experimental designs were used to measure change over time for students. The two studies demonstrate the application of multiple methodologies in evaluating the effectiveness of prevention and early intervention efforts with the aim of providing data to support program improvement and sustainability.     

Teen Choices,an Online Stage-Based Program for Healthy,Nonviolent Relationships: Development and Feasibility Trial

This article describes the theoretical foundation, development, and feasibility testing of an online, evidence-based intervention for teen dating violence prevention designed for dissemination. Teen Choices, a program for healthy, nonviolent relationships, relies on the transtheoretical model of behavior change and expert system technology to deliver assessments and feedback matched to stage of change for using healthy relationship skills. The program also tailors feedback to dating status, risk level, and other key characteristics. Ninety-nine students from high schools in Tennessee and Rhode Island completed a Teen Choices session and 97 completed an 11-item acceptability evaluation. Of participants, 100% completed the intervention session as intended. Evaluations of the program were favorable: 88.7% agreed the program feedback was easy to understand, and 86.7% agreed that the program could help people develop healthier relationships. Findings provide encouraging evidence of the acceptability and feasibility of this approach to dating violence prevention.     

School Violence Prevention

Abstract

Objective: This study was designed to describe the level of violence in three high schools and to test the effects of universal and targeted strategies to reduce this violence.

Design:A repeated measures design with two baseline scores and two intervention scores was used during a two year period. Two rural high schools served as control schools with a single intervention high school.

Participants: All freshmen at the three high schools completed a self-report measure of school violence; 420 completed the study at the end of their sophomore year.

Method: Multiple universal and targeted interventions to prevent school violence were used for slightly more than one year. Scores on student Victimization and Perpetration, gathered one year apart, were compared using a pre-test post-test model.

Findings: Student reports of perpetration at the intervention school were significantly lower than the combined scores at the control school. Students, teachers, and administrators reported improved awareness, knowledge, and skills to implement violence prevention programs.

Conclusions: A comprehensive program that includes university and high school partnerships has the capability to reduce school violence during a short period. Despite limitations to the study, continued use of research partnerships to decrease school violence is war-ranted.     

Proposed modification of a school-wide bully prevention program to support all children

Bullying prevention programs in the United States are being implemented in schools from kindergarten through high school to reduce rates of bullying behaviors. The bully prevention in positive behavior support (PBIS) model is an evidence-based, whole school intervention program. The PBIS model trains teachers, school staff, and administrators to model and provide positive reinforcement for children to decrease bullying amongst peers. This article addresses gaps in the current bullying prevention research by exploring challenges and potential modifications to the PBIS model based on staff perspectives of specific student needs. Utilizing focus group methodology, administrators, teachers, and support staff in a northeastern urban elementary school identified challenges experienced by students who were English language learners, impulsive, shy or sensitive, and female. The findings highlight the critical nature of school–parent relationships in addressing student, family, and cultural factors that influence the successful implementation of bullying prevention programs.     

An Assessment of the Relationship Between the Quality of School-Based Tobacco Prevention Programs and Youth Tobacco Use

SUMMARY

This study presents data from an assessment of substance use prevention programs in 23 elementary and middle schools in northern and central Illinois. The quality of prevention programming was assessed based on program intensity, focus on tobacco, staff resources designated for prevention programs, and implementation of the Centers for Disease Control and Prevention recommendations for tobacco prevention. Data from these four dimensions were used to calculate a Quality Index Score. Multilevel logistic regression analysis was used to assess the relationship between individual level variables, school level variables and the outcomes of reported current tobacco use, intent to use tobacco in the coming year, and perceived efficacy of substance use prevention programs. No significant effects were found, indicating that exclusive use of even high quality school-based prevention programs may not be sufficient in changing youth behavior. However, school-based prevention programs may be an important component of a broader ecological approach that uses multiple, community-wide strategies to promote normative change.     

High Schools Respond to Crises

Abstract

Schools across the nation have increasingly coordinated crisis intervention programs to minimize the impact felt by students as the result of a crisis, such as national events and school violence. Through the development of response plans and crisis teams, as well as the instrumental work of school counselors in promoting intervention plans and prevention programs, school systems have taken steps toward assisting students in recovery from crises. Theories of crisis intervention emerge from direct practice; however, minimal research has been conducted to examine how schools plan to respond to crises versus their actual response. This research investigated what high schools in one Massachusetts county have learned from actual response to crises. The study was conducted via written surveys of administrators and qualitative interviews with school counselors.     

Linking Academics and Social Learning

Abstract

This article examines how school staff conceptualize their work with youths in an alternative school for weapon policy offenders after having undergone at least one year of a whole-school violence prevention program conducted by the Syracuse University Violence Prevention Project. The article examines the intent of school staff, their ideas, perspectives, and language about youths, violence, and schooling, and provides insights into the challenges and benefits of a whole-school approach to violence prevention. Their insights highlight what is needed for a violence prevention program to be successful. A major issue raised in the article is the importance of linking social learning and academics in violence prevention strategies, and of sustaining collaborative efforts that connect conflict resolution to acts of justice and support for youths' intellectual and emotional lives.     

A Quasi-Experimental Analysis of Schoolwide Violence Prevention Programs

Violence prevention programs are commonplace in today’s schools, though reviews of the literature reveal mixed empirical findings on their effectiveness. Often, these programs include a variety of components such as social skills training, student mentoring, and activities designed to build a sense of school community that have not been tested for individual effectiveness. To fill this gap, we wanted to determine the relationships between specific violence prevention program components and aggression and violence outcomes. Using the U.S. Department of Education’s School Survey on Crime and Safety, we estimated the effects of components of violence prevention programs through analyses with proportional odds logistic regression and Poisson regression models. We found significant relationships between three violence prevention program components (individual attention, mentoring, tutoring, and/or coaching; recreational, enrichment, or leisure activities; and involving students in resolving student conduct problems) and aggression and violence outcomes.     

Individual differences in safe behavior: A safety practitioner's viewpoint

SUMMARY

This paper focuses on the school as a setting for community-based prevention of factors that place learners at risk such as poverty, violence, substance abuse, learning difficulties and HIV/AIDS. It examines the development of school-based structures aimed at addressing these issues. The health promoting and inclusive schools approaches are explored as strategies to address these and other barriers to learning.

Reference is made to innovative practice at a school in a disadvantaged community outside of Cape Town. The case study reveals how school-based teams could be utilized to mobilize school communities in generating solutions to the difficulties that they encounter.     

A Review of the Use of Social Support in Anti-Bullying Programs

Abstract

Bullying is a significant problem in schools across America. Educators are dealing with the problem of bullying through the implementation of various anti-bullying programs. Additionally, researchers are studying the problem and have begun to focus on the importance of contextual factors surrounding bullying such as social support (Beran & Tutty, 2002; Demaray & Malecki, 2003; Furlong, Chung, Bates, & Morrison, 1995; Malecki & Demaray, 2004a; Natvig, Albrektsen, & Qvarnstrom, 2001; Rigby, 2000; Rigby & Slee, 1999). Social support is an important contextual factor to consider in the bullying cycle. However, the use of social support in anti-bullying programs and interventions is often not explicit or is lacking. This paper provides an overview of the research on social support as a contextual variable in bullying behaviors and reviews six existing anti-bullying programs with a specific focus on how they incorporate social support elements into their interventions.     

Welcome baby programs

SUMMARY

Several successful prevention programs are recognized as exemplars of implementation. Complicated multidimensional interventions with different goals and directed at different target populations have been conducted with a high degree of fidelity using a common set of strategies. Future research priorities involve identifying the specific factors that promote implementation and determining what levels of implementation are necessary to achieve maximum program impact.     

School Violence Prevention

Abstract

School violence has many faces and many casualties. In varying degrees it touches students, parents, educators and communities of every school world wide. At the local level, communities are seen as playing a significant role in violence prevention. Generally, community-based violence prevention approaches involve the assessment of local problems, identification of target issues, selection of a range of interventions, and the encouragement of collaboration among civic groups, the juvenile justice system, local leaders, and young people themselves. These programs are generally judged as successful if they are able to address risk factors effectively for individual youths, strengthen those factors that provide protection and enhance resiliency, provide sufficient support and effective supervision, and increase pro-social attitudes by providing youth with a sense of having an increased stake in their local communities. Although too few educators are aware of its impact, the women's community has been involved in this work for decades. In this paper I discuss the results of interviews with members of the women's community in Atlantic Canada who have developed proactive violence prevention initiatives. I will concentrate on their efforts to bring those programs into the schools and their experiences of the successes and challenges they encounter.     

Role of School Psychologists in Violence Prevention and Intervention

Abstract

Kansas school psychologists were extremely accurate in their estimates of violence in their own schools and viewed school violence prevention as an important part of their job, regardless of the rates of violence in their districts. Most had at least some involvement in their own school's violence prevention program, although many reported that they had little or no training. Despite the fact that the majority of respondents work in districts with relatively low rates of violence, over half reported that fighting, bullying, and substance abuse, early warning signs of school violence, occur a lot or a fair amount in their districts.     

Context Matters: Reactive and Proactive Bystander Action to Prevent Sexual and Dating Violence in High Schools

ABSTRACT

Given high rates of relationship violence among adolescents, there is a need to understand variables that influence adolescents’ helping behaviors to reduce risk for dating and sexual violence (reactive) and promote prevention before violence happens or risk factors are evident (proactive). The current paper examined individual and school variables related to greater actionism in a large sample of high school students. Baseline, cross-sectional data used in the current analyses were gathered before intervention as part of a prevention program evaluation across 25 high schools in New England from students in grades 9–12 (N= 3,404). Students who self-reported a greater number of proactive actions taken were students who identified as sexual minorities, had a history of victimization, and were in schools with supportive peer norms. The current findings suggest a model for prevention that might include training individuals and attending to school level variables.     

Issues facing the dissemination of prevention programs: three decades of research on the adolescent diversion project

This paper argues that the issues facing effective prevention programs when they embark on dissemination, implementation, and routinization have been largely ignored by the field. Through the example of the Adolescent Diversion Program, these issues are illustrated and discussed. Four sequential longitudinal experimental studies are summarized as a context for the discussion of dissemination issues. In each case, the alternative preventive program is demonstrated to be more effective than traditional approaches. Challenges to widespread implementation of effective prevention programs are then discussed with a call for the field to add such issues to its scientific agenda.     

Warning Signs of Problems in Schools

SUMMARY

One need not look hard to find evidence of concern related to the nature of student behavior in our schools. School violence, aggression, bullying, and harassment (e.g., racial or sexual) are often cited as challenging behaviors confronting educators and community leaders. Unfortunately, most schools address these concerns with aversive consequences delivered to individual perpetrators in a hope of reducing the future probability of undesired behavior. A growing body of literature identifies the need to explore the social context of behavior. The community, school, classroom, family, and peer group interact with student characteristics to help prevent, support the development of, and even exacerbate the display of both desired and undesired behavior. This article applies the logic of warning signs and functional behavioral assessment to schools as it explores the social context of the school and the classroom. The school-wide and classroom-based factors that have been associated with or found to support problem behaviors are discussed. Information is provided that will allow educators to assess their own schools and classrooms in an effort to promote a climate that will aid in the prevention of violence and aggression.     

School Violence in Children and Adolescents

Abstract

This article reviews school violence prevention programs that were published between the years of 1990 and 1999. All the interventions fitting inclusion criteria involved being implemented in a school setting, using a control group, and including a quantitative methodology. Effect sizes were calculated for the final sixteen articles that were reviewed in the meta-analysis. A process of inspection was used in order to come up with treatment characteristics most common to each prevention program. Each study was thus described according to six categories: theoretical base, setting, age group, leader training, duration, and random assignment. Four studies resulted with strong effect sizes; however, a regression analysis was not conducted due to inadequate sample size. A review of the literature suggested that program impact could be significantly affected by the use of cognitive-behavioral strategies, multi-setting atmosphere, and primary (elementary school) prevention. In addition, intuitive support (common knowledge in the social science field) indicated that a qualified program leader and longer length of program could also contribute to the influence of a program. Future researchers are encouraged to use a more comprehensive literature review (e.g., past 20 years) in terms of conducting meta-anal-yses in order to provide a larger sample size adequate enough to see the true effects of different intervention components on outcomes (regression analysis; i.e., additive component effects).     

Promoting Methodological Pluralism,Theoretical Diversity and Interdisciplinarity Through a Multi-Leveled Violence Prevention Initiative in South Africa

SUMMARY

Violence prevention within low-income, under-resourced communities presents significant challenges to community development researcher-practitioners seeking to maximize partnerships, resource utilization and overall program effectiveness. This article highlights a South African research and service delivery organization's efforts to develop a violence prevention matrix, premised upon an adaptation of the public health approach and the infusion of a critical, community development praxis. It presents preliminary outcomes of a multi-level pilot application of this matrix in a low-income neighborhood in South Africa, specifically focusing on evaluating its capacity to foster methodological pluralism, theoretical diversity and interdisciplinarity, together with promoting community empowerment and coalition-building strategies.