West After School Center

620 Garfield Avenue, Lancaster, Ohio 43130

740-653-5678

A 21^st Century Community Learning Center

2007-2008

Evaluation Report

Prepared by

Katherine K. McWatters

INTRODUCTION

This is an external evaluation of the West After School Center 21^st Century Community Learning Center.  The 21^st CCLC program is ending its fourth year.  This review is conducted by Katherine McWatters, 21^st CCLC Consultant, 7711 Redman Lane, Reynoldsburg, OH 43068.

This evaluation followed the process of reviewing all of the data collected during annual formative evaluation.  In addition to the data collection, two site visits were conducted.  During the site visits interviews were conducted with:  

·          Paul Young, Executive Director

·          Jane Hart, Student and Family Coordinator

·          Julie Bibler, Program Administrator

·          21^ST CCLC tutors

·          Students

·          Volunteers

·          WASC Board members

All grade level programs were observed.  Students and community volunteers were present during each visit.  Students participated in activities which included Leap Track, homework help, enrichment, snack and an evening meal.   

The 21st CCLC funding is intended to help districts move school sites out of continuous improvement, academic watch, and academic emergency by allowing them to engage at risk students who need the help and support in out of school time academic and youth development programs.

At risk students are those students who meet one or more of these criteria:

·          Participating in the free/reduced lunch program

·          Below district assessment in reading and math

·          OPT Failure (1 or more Sections)

·          Has an IEP and/or 504 Plan

·          LEP student

Expected overall outcome of the 21^st CCLC programs is to increase student’s reading and math performance.

There are four 21st CCLC components that the programs are expected to provide.  These components are:

·          ACADEMICS: "First and foremost the programs must increase reading and math performance."  Programs must provide academic remediation and intervention to build the reading and math skills of at risk students.

·          YOUTH DEVELOPMENT: The intention of the program is to also engage students in activities that provide experiential learning opportunities

·          PARENT ENGAGEMENT: The parent is the first teacher.  Programs should provide resources and support to assist parents in this important role.

·          COMMUNITY INVOLVEMENT: Community partnership is critical to the success and sustainability of the programs.

 PROGRAM DESCRIPTION

According to the 2007 CCIP Project Abstract:

“The West After School Center proposes to provide Year 4 grant services to students and families of the West School attendance area in Lancaster. The West After School Center will serve as fiscal and lead agency, while the Eastside Center for Success will serve as a grant sub-recipient implementing services in another targeted area of the city. Working with community residents, social service providers and community based organizations, the purpose of the partners work will be to improve the academic performance of students who attend East and West Elementary Schools and enhance youth and family community programming through the collaborative efforts of the Eastside Center for Success, the Lancaster City Schools, the West After School Center, community organizations and social service providers. A variety of intervention improvement strategies, in place for the first three years of the grant, will be utilized to address our project goals, which include (1) reduced discipline referrals; (2) less tardiness and absences; (3) improved appreciation for books and literacy; (4) increased parent involvement; (5) improved social skills and mental health issues; (6) increased participation in arts opportunities; (7) increased use of technology.

Under this coordinated community response, the West After School Center will serve students (K-5) and their families who attend West Elementary School and have been identified as below grade level in reading and math as determined by Accelerated Reader Assessments, STAR Literacy Assessments, Study Island data, district report cards, running records, teacher recommendations, the Ohio Achievement test scores and Developmental Reading Assessments (DRA). An out-of-school (after school and summer) structured tutoring and enrichment program will include intensive tutoring in reading and math and homework assistance, health and nutrition education, counseling, and drug and violence prevention.

A social service component will link families of students with a wide array of social service and counseling resources to further the West After School Center philosophy of serving the whole child. Indicator of outcomes for the project will be (1) improved academic achievement as seen by improvements in the reading and math sections of the Ohio Achievement Tests, (2) youth development as seen by improved communication and social skills, increased school attendance and improved grades, (3) family literacy and related educational development as seen by increased involvement of targeted families in school and learning center activities and increased support for their children’s educational activities, and (4)  expansion and better utilization of academic and social service support for students and families as seen by school/community planning involvement, increased coordination among schools, social services and community members.”

The West After School Center operates an after school program. The school year program is held everyday Monday through Friday from 3:15 to 6:00 p.m. when school is in session.  Students from West Elementary School are dismissed at 3:15. 

The West After School Center daily schedule is as follows:

3:15- 3:50 Tutors meet students at school for large muscle activities

3:50- 4:00 Students escorted to Center for Snack 

4:00- 5:00 Homework Help/ Enrichment activities/Special Events    

5:00-6:00 Supper

Special events and activities/field trips occur on Fridays.   

WASC also operates a fee based Latchkey before school (Monday through Friday, 6:00 a.m. till the start of school day) and summer program (Monday through Friday from 6:00 a.m. to 6:00 p.m. June through August).  Children in Latchkey also participate in 21^st CCLC activities. 

A free lunch meal program is also provided to neighborhood children throughout the summer who qualify. 

GOALS AND OUTCOMES

The projected outcomes of the 21st Century Community Learning Center project as indicated by the 2008 CCIP are:

1.      Total number students served will be 90.

GRADE LEVEL

2.      85% of total students will be eligible for free/reduced lunch

75% of the students were eligible for free and reduced lunch

3.      85% of students attending are below basic or below proficient in reading.

90% of the students enrolled in 1^st-5^th grade were below proficient

 in reading when enrolled.

4.      85% of students attending are below basic or below proficient in math.

               ** Data not available

5.      17% of  participating students will have either IEP or 504 plan.

8% of participating students had either an IEP or 504 plan

      6.   2% of the participating students suspended or expelled in the prior year.

                                                ** Data not available

Other Goals and Outcomes as identified in the 2008  CCIP application:

7.      50% of the students will show improved academic achievement as seen by improvements in the reading and math as demonstrated by Ohio Achievement Tests, grade cards and Leapfrog assessment . 

** 2008 Ohio Achievement Test DATA NOT AVAILABLE

Academic performance (Leapfrog) of 1^st-5^th grade student attendees in reading and 2^nd -5^th grade student attendees in math.

Academic performance of regular Student Attendees (30 days or more) in Grades 2,3,4,and 5 according to grade cards.

8.      Youth development as seen by 50% of the students attending WASC will improve communication and social skills.

54 students were scored by staff. See Skill and Rating Scale can be found in   Appendix. Findings are as follows:  

Communication skills:               33 students improved

                                                                  18 students had no change

                                                                  3 students had negative change

Social Skills:                              24 students improved

                                                                  23 students had no change

                                                                  7 students had negative change

9.      Family literacy and related educational development as seen by increased involvement of targeted families in school and learning center activities and increased support for their children’s educational activities

The following events offered Parent Engagement opportunities:  

Parent Newsletter                                

Family Day Dinner                                 13 Families-41Attendees

Lights on After School

GED Classes                                         8 Adults

Poison Smart Presentation

Family Holiday Event                             65 Attendees 

Parent Teacher Conferences                  64 students had an adult attend a conference

Parent Surveys                                     59 parents responded

Responsive Discipline

Valentine day Dinner                             15 Families-49 attendees

Family Festival Juggling Show                11 Families-90 attendees

Benefit Bank        

10. Expansion and better utilization of academic and social service support for students and families as seen by school/community planning involvement, increased coordination among schools, social services and community members.

Information on 31 community agencies and programs was made available to families.

See Community List in Appendix.

Community Partners

The Ohio State University Extension (Master Gardeners)

The Robert K Fox Family Y

Fairfield County Family, Adult, and Children First Council

Fairfield County Jobs and Family Services

Red Barn Productions

Sixth Avenue United Methodist Church

Eastland-Fairfield Career Center

Fairfield Foundation

Gannett Foundation

Fairfield County Health Department

Action for Children

 Program Assessment

A quality program is one that is reflective, willing to improve, change grow and believes in successful outcomes for its participants.  This program assessment instrument is organized under nine essential elements of an effective program.  Each element contains a list of standards of practice or “performance indicators” that provide guidelines for ensuring quality outcomes. The program elements are evaluated on three levels:

1. Meets or Exceeds Performance Indicators (all indicators are being addressed)

2. Approaching Performance Indicators (one or more of indicators need to be addressed)

3. Needs to Improve Performance Indicators (no indicators are being meet)

Program indicators were determined by reviewing all of the information and data collected during annual formative evaluation, two site visits, interviews with the 21^st Century Community Learning Center Program administrators, board members, staff and students and observation of program activities.   This collected information provided data to analyze the success of the program.

ENVIRONMENT/ CLIMATE

Does program provides a safe, healthy, nurturing environment?

Meets or Exceeds Performance Indicators

FINDINGS:

·          Program negotiates optimal use of school facilities to best meet student’s need. 

·          Program provides a stimulating, welcoming and supportive environment.

·          Program uses space that is safe and clean.

·          Program provides adequate security and safety for participants.

·          Program allows participants to explore their interests.

·          Program provides access to and encourages healthy meal options.

ADMINISTRATION/ ORGANIZATION

Does program have a well developed system and sound fiscal management to support and enhance worthwhile programming and activities for all students?

Meets or Exceeds Performance Indicators

FINDINGS:

·          Program has attendance and participation expectations. Participating students interviewed were aware of program expectations.

·          Interviews with program staff and administrators indicated that there was a high awareness of 21^st CCCL program mission, goals and activity opportunities.

·          Program collects and monitors student’s attendance data.

·          Program maintains current and accurate activity schedule. Monthly calendars indicated schedule for enrichment programs and special events.  Calendars and newsletter are distributed to parents and posted on center’s website. 

·          Program data and records are kept up to date and in a manner that would allow the program staff to submit information and reports in a timely manner.  

·          Program has well defined communication mechanisms between students,

      staff, administrators and board of directors.

RELATIONSHIPS

Does program nurture and maintain positive relationship and interactions among staff, students, and community?

Meets or Exceeds Performance Indicators

FINDINGS:

·          Program has staff that respect and communicate with one another.

·          Staff represents excellent role models for students.

·          Program staff treats students with respect. Staff redirection of student behavior indicated that participants were encouraged to interact with one another in a positive way.

·          Interviews with students, school staff and community volunteers involved in programs indicated that incorporating respect and diversity awareness into programs was a high priority.

·          Program has a very large and active group of community volunteers. Program has established meaningful community relationships.

STAFFING AND PROFESSIONAL DEVELOPMENT

Does program recruit, hire and train diverse staff members who value students, understand their developmental needs and work closely with school partners?

Meets or Exceeds Performance Indicators

FINDINGS:

·          Program staff reflects cultural diversity and culture of the community.

·          Program staff are highly qualified professionals with a high level of understanding of the mission and goals of the program. 

·          Program staff, school administrators and community volunteers understand the mission and goals of 21^st CCLC.

·          Program administrator and staff have participated in workshops/ training, 21^st CCLC brown bag events and have visited other 21^st CCLC program sites.

PROGRAMMING AND ACTIVITIES

Does program provide well rounded variety of activities and opportunities that support the physical, social and cognitive growth and development of all students?

Meets or Exceeds Performance Indicators

FINDINGS:

·          Program provides activities that reflect the mission of the program.

·          Program features activities that are commensurate with skill level of the students and enable students to develop new skills.

·          Program includes activities that take into account the culture of the students.

·          Program provides student with a variety of engagement strategies. These include Leapfrog Skills, Homework Help, enrichment learning opportunities and recreational games and activities.

·          Experiential learning opportunities offered provide students with the opportunity to develop new skills, promote creativity and self expression and address the academic, cultural, physical, social/emotional needs of the students

·          Program enables students to develop life skills, explore resources and issues in their community through projects and activities. Opportunities are offered as “special events” and on “Fun Fridays”.

·          Program provides opportunities in which student’s work can be showcased.

LINKAGES BETWEEN DAY AND OUT OF SCHOOL TIME

Does program staff work closely with school staff to ensure that the out of school time academic components and activities are aligned with and enrich school standards and curricula?

Meets or Exceeds Performance Indicators

FINDINGS:

·          Program staff maintains communication with school administration and staff to monitor academic progress of the students. Program able to access student STARS reading and grade card records.

·          Program establishes strong link to school day program. Curriculum materials used by program analyze each student’s learning situation, provides each student with an individual learning plan to independently practice and master the specific skills outlined in the Ohio Content Standards, monitors student performance and adjusts teaching in response to student outcomes.

·          Program and staff appear to be aware of grade level/day school classroom activities.

·          Program activities are planned and documented on monthly calendars that are distributed and posted.  

COMMUNITY PARTNERSHIPS

Does program have established community partnerships in order to achieve program goals?

Meets or Exceeds Performance Indicators

FINDINGS:

·          Program has created and maintains relationships with arts, cultural and other community institutions to expand and enhance program offerings.

·          Program has a strong and active group of community volunteers.

·          Community partners have provided special event opportunities for students and families.

FAMILY INVOLVEMENT

Does program establish strong relationship with families?

Approaching Performance Indicators

FINDINGS:

·          The staff interaction with families on a daily basis is welcoming and comfortable.

·          Staff provides resources to meet family’s needs.

·          Special family programs/events were planned to provide different experiences for families.

·          Staff interacts with families in a comfortable, respectful welcoming way. 

·          Program provides opportunities for literacy and educational related experiences for parents.

RECOMMENDATIONS:

·          Family Advisory Group should be organized to assist in long term planning.

·          Family Advisory Board should assist in marketing programs to school and community.

PROGRAM SUBSTAINABILITY

Does program have a coherent vision/mission and a plan for increasing capacity that supports continuing growth?

Approaching Performance Indicators

FINDINGS:

·          Program has a written mission and vision statement

·          Program employs staff that understands and embraces the program’s mission and goals. Program staff is implementing a program designed to meet program goals.

·          Program is seeking support from and building relationship with local businesses and the community.

·          Program has an effective marketing strategy that publicizes the program with in the school and the broader community.

·          Program has created other sources of funding (WASC SACC, Lancaster-Fairfield County Community Action Head Start (ELI Classes), and WASC Food Program) that provide resources to support center activities and provided some funds for program sustainability.

·          Support from local business, foundations and community agencies is indicated.

·          Staff, administrators and board members are involved in long term planning.

RECOMMENDATIONS:

·          The current design of administration structure should be assessed to determine if the most effective management and support mechanisms are in place.  This should involve input from administrator, site leaders, program staff and families.

·          West After School Center and Eastside Center for Success Boards of Directors must come to an agreement to determine what the structure will be in the administration of Eastside Center for Success in 2010.  Plans for request for grant funding cannot move forward until this is determined and resolved.

Appendix

.