Transcript VAS Presentation - New Mexico Public Education Department

Value Added Modeling for
Teacher Evaluation
Courtney Hall & Matt Goodlaw
NMPED, Statistical Supervisors
4/9/2015
1
Hanna Skandera
Secretary of Education
Overview
• Access prior knowledge: What are some
of your instructional hypotheses?
• Framework Theory of Action
• Value Added Model
• Tale of 3 Teachers
• Fairness
2
Hanna Skandera
Secretary of Education
Theory of Action
Summative
Score
Observations
with
NMTEACH
Rubric
Multiple
Measures
Teacher
Effectiveness
Teacher Value
Added
Instructional
Practice
SBA
PARCC
Student
Achievement
Interim
Assessments
Educator Support
System
3
End of
Course
Exams
Non
Cognitive
Measures
Teacher
Created
Student
Evaluations
Hanna Skandera
Secretary of Education
Cycle of Continuous Improvement
Rule Setting
Review, Plan, and
Develop
Orientation
Meetings
Contractual
Implications
Pre-Observation
Conference
Summative
conference
Addition of Other
Evidence
4
Classroom
Observation
PostObservation
Conference
Evidence
Scoring
Hanna Skandera
Secretary of Education
•
5
Questions a Leader might ask in
light of evaluation results
Content Knowledge: What is the teacher’s current mastery of content knowledge? How
does the teacher’s content knowledge compare with current expectations for
performance? What supports might enable the teacher to develop a richer content
knowledge?
•
Observation Rubric/Teaching Framework: Has the teacher demonstrated the necessary
skills to ensure that student’s opportunity to learn is maximized? Is the teacher familiar
with strategies needed to teach all students? Has the teacher been exposed to explicit
methods to help them meet expectations?
•
Professionalism: Is the teacher’s contributions to the campus community and climate
positive? What social skills does the teacher need to exhibit to be a successful member
of the team?
•
Motivation: Is the teacher’s motivation to engage in professional development
appropriate? What types of motivation/factors are relevant for this teacher’s target
growth areas?
•
Engagement: What types of engagement are necessary for this teacher to be
successful? Does the teacher demonstrate active learning during professional
development? What are the options provided for the teacher to actively participate in
professional development, can they be increased?
Hanna Skandera
Secretary of Education
Value Added Models
The New Mexico Value-Added
Model for Educator
Effectiveness partitions variance
in student achievement among
teachers, thereby isolating the
portion of student achievement
on assessments that is
attributable to the teacher.
6
Hanna Skandera
Secretary of Education
What is Variance?
7
Hanna Skandera
Secretary of Education
Quick example
• Suppose that you have three reading
interventions and you want to know
which is most effective in boosting
student reading skills.
A. Business as Usual (BAU)
B. Reading Recovery (RR)
C. Close Reading (CR)
8
Hanna Skandera
Secretary of Education
Post Test Results
23.5
24.5
17
But, what if students entered the interventions at different starting points?
9
Hanna Skandera
Secretary of Education
Post Test Results, given pre test
24.5
22.3
18.2
10
Hanna Skandera
Secretary of Education
Mathematical Function
11
Hanna Skandera
Secretary of Education
Statistical Relation
12
Hanna Skandera
Secretary of Education
Nested Structure
Multi-Level, Mixed-Effects
Regression Models
13
Hanna Skandera
Secretary of Education
Teachers Average Scale Score
2013 Reading 8 Averages by Teacher
2013 Reading 8 SBA Average Teacher Scale Score
14
Hanna Skandera
Secretary of Education
2013 Reading 8 Scale Score
Population model
2012 Reading 7 Scale Score (Centered Around Grand Mean)
15
Hanna Skandera
Secretary of Education
2013 Reading 8 Scale Score
Value Added Model
2012 Reading 7 Scale Score (Centered Around Grand Mean)
16
Hanna Skandera
Secretary of Education
Distribution of Teacher Value
Added
Distribution of Teacher Value Added
17
Hanna Skandera
Secretary of Education
Computing VAS Points
18
Hanna Skandera
Secretary of Education
Computing VAS Points 2
TID
crsGrp
2011N
VASy11
1
7
1
8
12
2
19
2
20
3
2012N
VASy12
2013N
VASy13
16
-0.35804
12
-0.06809
0.657911
18
-0.43139
16
0.74354
30
-0.30058
20
-2.93997
10
-0.09262
53
-0.97029
37
-0.61504
15
-0.01236
11
17
0.165387
3
17
17
0.466913
3
40
17
-0.07772
Overall VAS =
VAS Percentile =
19
Hanna Skandera
Secretary of Education
2013 Grade 5 Math Scale Score
Tale of 3 Teachers
2012 Grade 5 Math Scale Score
20
Hanna Skandera
Secretary of Education
Value Added Models and
Fairness
21
Hanna Skandera
Secretary of Education
Value Added Models and
Fairness
22
Hanna Skandera
Secretary of Education
Value Added Models and
Fairness
23
Hanna Skandera
Secretary of Education