Transcript Click to add title - American Youth Policy Forum | The

Using Data To Build, Grow, And
Sustain Your Afterschool System
In Partnership with
May 13, 2015
@aypf_tweets
@afterschool4all
Webinar Technical Support
•
GoToWebinar Technical
Assistance: 1-800-263-6317
•
To submit live questions,
please use the “Questions”
box on the control panel
• A recording of the webinar and
other resources will be available at
www.aypf.org
@afterschool4all
Agenda
 Role of Data in Building Afterschool Systems: Needs Assessment
 Mila Yochum, Director, Allegheny Partners for Out-of-School Time (APOST)
 Audience Q&A
 Role of Data in Scaling Afterschool System: Use of Quality Improvement
Tools for Accountability
 Charles Smith, Executive Director, David P. Weikart Center for Youth Program
Quality
 Audience Q&A
 Role of Data in Sustaining Afterschool System: Communicating Outcomes
 Lisa Caruthers, Director, Center for Afterschool, Summer and Expanded
Learning (CASE) for Kids
 Audience Q&A
 Closing Remarks: Using Data in Afterschool Systems-Building
 Jen Rinehart, Vice President, Research & Policy, Afterschool Alliance
@afterschool4all
Mila Yochum, Director, Allegheny
Partners for Out-of-School Time
(APOST)

Youth in Allegheny County will
realize their fullest potential by
participating in high quality out-ofschool time opportunities.

APOST focuses on improving
quality of and access to out-ofschool time opportunities
through committed collaborative
and innovative efforts of
community organizations,
government, foundations, schools
and other partners.
About Allegheny Partners for Out-of-School
Time (APOST)

Strategies





Quality Campaign
Professional Development of
Youth Practitioner
Marketing, Communication and
Outreach
Policy for Funding Sustainability
Partnerships, Convening and
community based system-building
The Need for Data
http://www.afterschoolpgh.org/state-of-afterschool-reports/
AMERICA
AFTER3PM
The Funding Inventory
The State of OST Programs
Frequency of OST Programs Serving Each Age-Group
700
586
600
526
541
590
594
539
567
567
Number of Programs
500
400
300
200
116
116
100
103
103
101
91
20
0
5
6
7
8
9
10
11
12
13
Child Age (years)
14
15
16
17
18
19
The State of OST Programs
For every 1000 school-age children in a given zip code, there are 3 OST programs
The Funding Inventory
Association Between Children in Poverty and
Opportunity for OST Programs by Zip Code
Total Number of OST Programs
Per Zip Code
70
60
50
40
30
20
10
0
0
500
1000
1500
2000
Number of Children in Poverty Per Zip Code
2500
3000
For every 1000 school-age children in poverty a given zip code, there are 19 OST
programs
Using Information and Data



Marketing, Communication and Outreach
Policy for Funding Sustainability
Partnerships, Convening and community based system-building
Questions & Contact Information
Mila Yochum
Director APOST (Allegheny Partners for Out-of-School Time)
[email protected]
Questions?
 To submit live questions,
please use the “Questions”
box on the control panel
Charles Smith, Executive Director,
David P. Weikart Center for Youth
Program Quality
Quality Improvement
Systems (QIS) that Build &
Grow Afterschool Services:
Exemplary QIS in 21st
CCLC
QIS for Afterschool Services | May 13, 2015
Necessaries for a QIS
• QIS elements
• Lower stakes approach
• Effective Performance Data
QIS for Afterschool Services | May 13, 2015
Service Production Map
Quality
System
Building
Network
Leader
Engagement
Quality
Management
Practices
Staff
Engagement
Quality
Instructional
Practices
Skill-building
Transfer
Outcome
Youth
Engagement
QIS for Afterschool Services | May 13, 2015
Quality System
Building
• Access
• Targeting Academic
Risk
• Accountability
• Collaboration
Quality
Management
Practices
• Staff Capacity
• Continuous
Quality
Improvement
• Youth Role in
Governance
• Communication
• Student Data
• Community
Engagement
Network Leader
Engagement
• Collaboration
• Job satisfaction
Quality
Instructional
Practices
• Academic Planning
• Homework
Completion
• Instructional
Quality
• School-Day
Content
• Growth and
Mastery Focus
Staff
Engagement
• Vertical
Communication
• Horizontal
Communication
• Job Satisfaction
Skill-Building
• California Outcomes
Toolbox (Vandell et al)
• DESSA Mini
(Devereaux/Apperson)
Youth
Engagement
• Youth Engagement
and Belonging
QIS for Afterschool Services | May 13, 2015
Item Level Description
Targeting Academic Risk
Proportion of students statement is true for: “1” = Almost none, “3” = About half,
“5” = Almost all
•
Targeted because scored below “proficient" on local or state assessments
•
Targeted because did not receive a passing grade in preceding period
•
Referred by a teacher for assistance in reading, mathematics or science
•
Targeted because of status as an English Language Learner (ELL)
QIS for Afterschool Services | May 13, 2015
Telling Stories with Data
Growth & Contribution
Profiles
16
5
4
Targeting
Academic Risk
School Day
Content
3
2
School Day
Data
Number of Sites
14
12
10
8
6
4
2
0
0 1 2 3 4 5 6 7 8 9 10111213141516
2013-14 Risk Index Score
QIS for Afterschool Services | May 13, 2015
In closing…
• Scale of the Leading Indicators systems
• Early findings
• Continuous improvement culture AND systems
QIS for Afterschool Services | May 13, 2015
Contact:
• Charles Smith
[email protected]
• www.cypq.org
For More Information:
• Arkansas 21st CCLC
2012-13 Statewide
Evaluation Report
• Oklahoma 21st CCLC
Statewide Evaluation
Report
• Leading Indicators
Performance
Measurement System
QIS for Afterschool Services | May 13, 2015
Questions?
 To submit live questions,
please use the “Questions”
box on the control panel
Lisa Caruthers, Director, Center for
Afterschool, Summer and
Expanded Learning (CASE) for Kids
Harris County Department of
Education
Evaluating Out-of-School Time
Needs,
Resources and
Initiatives in the
Communities of
Houston
Webinar
5.13.2015
ENRICH Afterschool:
A Collaborative Research Initiative
Lisa Thompson Caruthers, MSW, Ph.D.,
Harris County Department of Education
Director, Center for Afterschool, Summer and Expanded Learning (CASE) for Kids
Primary Goal:
– Use research to drive change:
Phase I:
Funding Map
Logic Model
Stakeholder Perception Study
Historical Trend Analysis
Phase II:
Return on Investment Study
Best Practice Study
Impact Study
Funds/Resources Used for Houston/Harris County
After-School and Out-of-School Time Programming
1%
20%
5%
4%
70%
Federal
State
Local
Private
In-Kind
1.4 M
837,714
US Census/TEA
Estimated Harris County
Youth Participating in
Out-of-School
Time Programming
830,776
214,118
25% est.
served
44,461
*,**
5% est.
served
3% est.
served
daily
30,000
*Public funding streams have different attendance requirements which determine how youth are
counted as served. This final estimate is based on publically available or self-report average daily
attendance from participating ERNICH After-School organizations.
** US Census, 2011, American Community Survey
Return on Investment Framework
Cost Analysis (Survey)
• Identify the current financial investment in after-school programs and the
outputs it supports
• Collect program and cost data at an organizational level
Cost-Benefit Analysis (Literature Review)
• Examine the benefits derived from after-school programs
• Identify financial proxies
Return on Investment Framework (Apply Crosswalk)
• Apply study data to proposed cost-benefit crosswalk to create formulas for
assessment
Crosswalk
A
• Effect of
After-School
Programming
B
• Range of
Benefits
C
• Overall
Formula
Effect of After-School Programming
Increased Retention Rates
Increases in Attendance
Increased Graduation Rates
Delinquency Prevention
Range of Benefits
School-based System Savings
Increases in School-based Earnings
Individual Earnings
Reduction in societal costs
Preliminary Cost Analysis Results
An investment of $23.7 million provides support to 17
out-of-school time organizations in Harris County,
Texas, employing 141 full-time and 465 part-time
Houstonians, while providing activities and services to
41,367 participating youth grades prekindergarten
through 12th grade.
Preliminary Findings
$4.58 return for every
dollar spent on
afterschool programs
Evaluating the Out-of-School Time
Needs,
Resources, and
Initiatives in the
Communities of
Houston
Modifications
•
•
•
Focusing only on necessary data elements
Data collection plan will capture higher
percent of funding for programs
Stronger relations with school-age childcare
community.
Evaluating the Out-of-School Time
Needs,
Resources, and
Initiatives in the
Communities of
Houston
ENRICH Successes:
•
•
•
Robust Dissemination Plan
Community mobilization
City of Houston now invests over $500,000
in after-school programming
Evaluating the Out-of-School Time
Needs,
Resources, and
Initiatives in the
Communities of
Houston
Thank You!
Lisa Thompson Caruthers, MSW, Ph.D.
[email protected]
713.696.1336
www.afterschoolzone.org
@Afterschool4HOU
Questions?
 To submit live questions,
please use the “Questions”
box on the control panel
Jen Rinehart, Vice President,
Research & Policy, Afterschool
Alliance
WE CAN HELP TELL YOUR STORY
44
Better Together: A Resource
Directory for Afterschool System
Builders
Available online at
http://www.aypf.org/better-together-a-resource-directory
The Directory Includes:
• A comprehensive listing of over 50 organizations
• Resources categorized by key themes
• Easy access to relevant information, data, and briefs
THANK YOU!
Please fill out the survey upon exiting the webinar. Your
feedback is important to us!
To learn more and access copies of the slides and event
recording, please visit
www.aypf.org
www.afterschoolalliance.org
@afterschool4all