Transcript Value-Added Scores for TLE - Moore

Presented by Amy Braun, Moore Public Schools, 2014
[email protected]
100% is Tulsa Model
Rubric (qualitative).
Data collected for
OAM and ValueAdded (quantitative)
portions will make up
“piloted” scores for
14-15.
Tulsa Model Rubric
100% is Tulsa Model
Rubric (qualitative).
OAM and ValueAdded (quantitative)
data will be collected
for “actual” scores
15-16.
Tulsa Model Rubric
OAM
15%
Student
Growth
Measures*
35%
Tulsa
Model
Rubric
50%
Tulsa Model Rubric
Student Growth
Measures
Other Academic
Measures (OAM)
* Student Growth Measures will include Value-Added or Student Learning Objectives.
For the pilot years in 2013-2014 and 2014-2015,
teachers of the following subjects with at least
10 eligible students will receive value-added
reports:




4th – 8th Grades Reading, ELA, and Math
Algebra I & II
Geometry
English III
Administrators of these teachers will also receive a value-added report based on school-wide data.
Student Growth Measures will account for
35% of the TLE Evaluation in 2015-2016.
This category includes:
Value-Added Scores
OR
Student Learning Objectives (SLO)/
Student Outcome Objectives (SOO)
(expect training on this in late summer/early fall)
You do not get to choose the method for determining your Student Growth Measures score.
If you are on the SDE list to receive a value-added score, then that data will make up your 35%.

“Value-added” is a measure of a teacher’s
contributions to students’ academic
growth – the amount of value the teacher
adds to their learning.

Designed to isolate a teacher’s value from
other factors that might affect a student’s
test score that are outside of the teacher’s
control.

Levels the playing field by accounting for the
impact of unequal prior achievement levels

Highlights student progress and credits teacher
for student gains

Controls for factors unrelated to teacher
performance

Does not rely on direct comparison between
two different tests
 actual score: the actual score a student
received on the state assessment
 typical peer score: score achieved by the
“typical peers” of a student throughout the state
 value-added result: difference between
average actual score achieved by students and
the average typical peer score
Mrs. Smith

5th Grade
Math
Teacher

Moore
Elementary

Moore, OK
Mrs. Smith’s 5th Grade
Student
4th Grade
Actual OCCT
Score
5th Grade
Actual OCCT
Score
5th Grade
Typical Peer
Score
James
850
830
?
Marcus
545
540
?
Nikki
645
635
?
Colton
700
730
?
Sarah
495
515
?
SDE will statistically estimate a unique typical peer score for each student.
Student Characteristics Used to Determine Typical Peers for Oklahoma
Value-Added Model During Pilot

Free/reduced lunch status

Limited English proficiency (ELL)

Individualized Education Plan (IEP)

Race/ethnicity

Gender

Mobility (only if move from district to district, not school to school)

Prior attendance
What tests does the SDE use to get prior scores
related to these subjects?




4th – 8th Grades Reading and Math
Algebra I & II
Geometry
English III
Student Characteristics Used to Determine Typical Peers for Oklahoma
Value-Added Model During Pilot

Prior achievement/test scores (highest impact in statistical model)

Free/reduced lunch status

Limited English proficiency (ELL)

Individualized Education Plan (IEP)

Race/ethnicity

Gender

Mobility (only if move from district to district, not school to school)

Prior attendance
Mrs. Smith’s 5th Grade
Student
4th Grade
Actual OCCT
Score
5th Grade
Actual OCCT
Score
5th Grade
Typical Peer
Score
James
850
830
?
Marcus
545
540
?
Nikki
645
635
?
Colton
700
730
?
Sarah
495
515
?
SDE will statistically estimate a unique typical peer score for each student.
Calculate Average Score of Typical 5th Grade Peers throughout Oklahoma based upon Student Characteristics
Mrs. Smith’s 5th Grade Math Class
Student
4th Grade
Actual OCCT
Score
5th Grade
Actual OCCT
Score
5th Grade
Typical Peer
Score
James
850
830
800
Marcus
545
540
530
Nikki
645
635
640
Colton
700
730
710
Sarah
495
515
500
650
636
AVERAGE
Mrs. Smith’s Value-Added Result
Grade 5 OCCT Score
675
650
Value-Added Result = Difference of +14 points
625
650
636
Average Actual Score For All
Students
Average Typical Peer Score For All
Students
600
575
550
TLE Component
Score
Weight
Total
(2 Decimal Places)
(2 Decimal Places)
Tulsa Model
?
x 0.50
?
VA Score or
SLO/SOO Score
?
x 0.35
?
OAM
?
x 0.15
?
OVERALL TLE
SCORE =
+
2 Decimal Places
Overall TLE Score Rankings
Superior
4.80-5.00
Highly
Effective
3.80-4.79
Effective
2.80-3.79
Needs
Improvement
1.80-2.79
Ineffective
1.00-1.79

Like OAMs, VA reports will have a year lag.
Typically, VA results will be reported the
following fall/winter after spring testing.

The VA results you will receive in late May
came from 2012-2013 data. (pilot)

The VA results from 13-14 testing will arrive in
fall/winter of 14-15. (pilot)

The VA results from 14-15 testing will count in
the 15-16 school year.
How are teachers linked to their students?
1.
Infinite Campus district data is imported into
the WAVE system at the SDE.
2.
The WAVE data is then imported into the
Battelle for Kids system.
3.
Teachers accept instructional responsibility for
their students through the roster verification
process in Battelle for Kids.
What if I teach more than one VA subject?
The VA results for all subjects you teach will be combined
into one TLE component score. See sample VA report at
http://www.mooreschools.com/Page/31256
What if I only teach one hour of a VA subject?
Teachers do not get to pick between a VA and SLO score.
If you teach any VA subject, you will receive a VA score for
the 35% Student Growth Measure.
What about students who are retained?
SDE will do research in pilot years to determine
the impact of comparing those retained to those
who haven’t been retained.
What about students who take the OAAP?
Students taking the OAAP will not be calculated in
the value-added result of a teacher. (OMAAP
students from 12-13 will not count in VA report
for this year.)
What if I am a first year teacher in the state?
Teachers in their first year of teaching will not have
a value-added result their first year. Their Tulsa
Model Rubric score will count for 100% their first
year.
What if I am a new teacher in the district, but it
is not my first year of teaching in Oklahoma?
Teachers new to the district will still have a valueadded score based on student scores in their
previous assignment in the other district.