Transcript Slide 1

GETTING TO OUTCOMES® EVALUATION OF
1TWO1 COMPUTING IN RICHLAND TWO
August 28, 2012
©GTO LLC
OVERVIEW
Formative and Outcome Evaluation
 Some Survey Results

Outcome Evaluation
A
B
Shoot
Implement
Aim
Plan
Ready
No Results
Ready
Plan
Aim
Implement
Shoot
Close
CQI
Ready
Plan
Aim
Implement
Shoot
Results
Hit
GETTING TO OUTCOMES (GTO)

Accountability system

Evaluates implementation and outcomes

Getting to Outcomes and GTO are trademarks
registered by the University of South Carolina
and RAND
Accountability questions, as applied to 1TWO1
GTO Step
1TWO1 Accountability
Question
1TWO1 response
Step 1:
What are needs that the district
has identified and how can
technology help meet those
needs?
Increasing student engagement in authentic, meaningful work was clearly a
priority that needed technology as part of the solution.
Step 2:
What is the district trying to
achieve (outcomes)?
Student achievement and engagement outcomes, teacher outcomes
Step 3:
What are the best practices for
1TWO1 computing when it
comes to everything from
program design to managing
the distribution of devices?
The 1TWO1 steering committee visited top-notch 1TWO1 schools and
districts, delved into the literature, attended conferences and joined on-line
learning communities of practice to benchmark best practices.
Step 4:
How does 1 TWO 1 fit in with
the other initiatives in Richland
Two?
Instructional technology has long been a priority for Richland Two. Richland 2
started the first 1:1 class about a dozen years ago, so this was a logical part
of a progression. Richland 2 also wanted to make sure that 1TWO1 work fit
with what Academics is doing.
Step 5:
Does Richland 2 have the
infrastructure and staffing to
implement and sustain 1
TWO1?
Richland 2 has to upgrade its wireless capacity at all of schools. Richland 2
has ITSs at each school who can provide professional development and
support teachers in the classroom. The board has a history of supporting
computer replacement with 8% funding that will allows for sustaining the
initiative.
GTO Step
1TWO1 Accountability
Question
1TWO1 response
Step 6:
What should the rollout look
like?
The 1TWO1 steering committee developed a 3-year rollout plan that
provided 1TWO1 to all schools in each of three phases.
Step 7:
What is the quality of
implementation of 1TWO1 at
the district-level and at the
school-level?
Richland 2 monitors implementation through information received from the
GTO team, and conversations with teachers, principals and ITSs. Richland 2
leadership team holds weekly meetings to discuss improvements that need
to be made.
Step 8:
Are we getting the outcomes
we want?
Richland 2 is working with GTO to identify and measure teacher and student
outcomes.
Step 9:
How can we improve what
we are doing with 1TWO1?
Periodically, Richland 2 leadership team will review the answers to all the
above questions to see if changes for improvement need to be made.
Step 10:
What are the challenges to
sustaining an effective
1TWO1 program and how can
we meet them?
The technology itself is a challenge to sustain—computers have to be
repaired and replaced over time. As the district grows and teachers turnover,
there is a constant need for professional development. Board support is
needed for computer replacement, infrastructure upgrades, and professional
development.
EVALUATING 1TWO1 IN RICHLAND TWO
1TWO1: Provide technology access and
professional development
Improved instructional quality by
teachers
Improved student engagement
Improved academic achievement
Increased graduation rates and postsecondary success
KEY STUDENT OUTCOMES
Student Engagement
Student Academic
Active learning:
interest and relevancy
 Social and Emotional
Learning (SEL)
 Behavioral
engagement (fewer
discipline problems)


Creativity &
Innovation
 Critical thinking and
problem solving
 Communication,
Collaboration and
Global Awareness
 Information fluency
 CORE academic
domains
MEASURING 1TWO1 IN RICHLAND TWO

Annual surveys:
Teachers
 Students
 Parents

Classroom observations
 Archival records and district logs
 Focus groups

LONGITUDINAL RESEARCH:
PHASE ONE SURVEY DATA 2011-2012
Phase One
Roll Out
Phase Two
Roll Out
Phase Three
Roll Out
2011-12
2012-13
2013-14
INITIAL SURVEY DATA:
PHASE ONE IMPLEMENTATION
1TWO1 ROLL OUT:
Estimated Number of Students in 1TWO1 Classrooms
Phase One
Elementary
Phase Three
N=5541 (74%)
High*
Middle
Phase Two
N=1894 (32%)
N=2652 (46%)
N=1987 (26%)
N=2488
(42%)
N=1599 (27%)
*HS est for Phases 1 and 2: Does not include Westwood
N=1504
(26%)
N=1563 (27%)
TEACHER REPORTS: PHASE ONE
TEACHERS’ CONFIDENCE IN USING
TECHNOLOGY IN THE CLASSROOM

Over 90% of teachers agreed or strongly agreed
that they could

effectively select technologies to use in their
classroom that enhance what they teach, how they
teach, and what students learn.

use technologies that enhance the content for lessons
in their subject area(s).
N=1099
1TWO1 TEACHERS (N=316):
TEACHERS’ CONFIDENCE IN USING TECHNOLOGY IN
THE CLASSROOM
Item:
I can effectively help
others to coordinate
the use of content,
technologies, and
teaching approaches at
my school
Strongly
disagree
3%
Strongly
Agree
27%
Disagree
18%
Agree
52%
1TWO1 TEACHERS (N=316):
PLEASE RATE HOW WELL YOU THINK 1TWO1
COMPUTING IS GOING IN RICHLAND TWO SO FAR
Not well at all
0.8
4.5
4.9
Somewhat well
Extremely well
60.3
38.8
Elementary
69.9
70.7
25.6
24.4
Middle
High
1TWO1 TEACHERS:
SINCE STARTING 1TWO1, I HAVE NOTICED THAT
CLASSROOM MANAGEMENT HAS BEEN...
2.5%
18.8%
9.8%
Much Harder
About the Same
Easier
62.8%
63.4%
56.4%
34.7%
Elementary
24.8%
26.8%
Middle
High
Overall, 88.6% of
1TWO1 teachers
said classroom
management has
been easier or
about the same
n=316
ALL TEACHERS: HOW SATISFIED HAVE YOU BEEN
WITH THE PROFESSIONAL DEVELOPMENT OFFERINGS
FROM THE DISTRICT TO DATE ON USING TECHNOLOGY
IN YOUR CLASSROOM?
Not at all Satisfied
4.2%
10.9%
12.3%
52%
45.2%
50.6%
45.2%
Elementary
Somewhat Satisfied
37.1%
42.5%
Middle
High
Very Satisfied
92.2% of all
teachers
were
somewhat or
very satisfied
n=1122
ALL TEACHERS: HOW SATISFIED HAVE YOU BEEN
WITH THE PROFESSIONAL DEVELOPMENT YOU HAVE
RECEIVED FROM YOUR SCHOOL'S ITS TO DATE ON
USING TECHNOLOGY IN YOUR CLASSROOM?
6.5%
8.2%
2.1%
Not at all satisfied
Somewhat satisfied
37.7%
39%
41.8%
55.8%
52.8%
56.2%
Elementary
Middle
High
Very satisfied
93% of all
teachers were
somewhat or
very satisfied
n=1122
PARENT REPORTS: PHASE ONE
HOW DO YOU FEEL ABOUT THE AMOUNT OF
TIME YOUR CHILD SPENDS ON A COMPUTER…?
Too Much
At home
At school
Just Right
22%
9%
71%
74%
Not Enough
7%
17%
“MY CHILD’S USE OF TECHNOLOGY IN SCHOOL SEEMS TO BE
IMPROVING THEIR EDUCATION.”
Strongly Disagree
Elementary (N=1039)
Middle (N=608)
High (N=770)
1.4
3.5
13.3
4.9
5.3
Disagree
10.7
9.7
Neutral
Agree
Strongly Agree
40.5
17.8
17.5
I'm not sure
37.3
40.1
45.1
2.5
23.7
21.7
2.5
2.5
MY CHILD HAS BEEN CYBER-BULLIED
WHILE AT SCHOOL
46.5%
50.0
40.1%
45.0
40.0
35.0
30.0
25.0
20.0
15.0
6.9%
10.0
2.9%
3.7%
5.0
0.0
Strongly Agree
N=2162
Agree
Neutral
Disagree
Strongly
Disagree
SOME CQI EXAMPLES USING EVALUATION
DATA

Implementation time table shifted for Middle
Schools

Shaping and planning professional development

Use of the Quality Implementation Tool