Transcript EVAAS SAS Training - rt3nc
NC Race to the Top EVAAS Soup to Nuts!
May 22 nd , 2012 SAS ® EVAAS ® for K-12 Copyright © 2010, SAS Institute Inc. All rights reserved.
Presenters Dr. Lynne Johnson
Director of Educator Recruitment and Development
Dr. Eliz Colbert
Lead Professional Development Consultant
Jennifer Preston
Race to the Top Project Coordinator for Educator Effectiveness
Dr. Sandy Horn
Senior Educator Support Specialist
Jenn Persson
Educator Support Specialist
Copyright © 2010, SAS Institute Inc. All rights reserved.
2
EVAAS Soup to Nuts!
Reflective Assessments: Value-Added Reports Reflective Assessments: Diagnostic Reports Proactive Assessments: Student Projections Teacher Reports - EVAAS Training - What Might Change
Copyright © 2010, SAS Institute Inc. All rights reserved.
3
EVAAS Soup to Nuts!
What is it?
Where is it?
Copyright © 2010, SAS Institute Inc. All rights reserved.
4
What is EVAAS?
E V A A S • Education • Value • Added • Assessment • System
So What Does It Do?
5
Copyright © 2010, SAS Institute Inc. All rights reserved.
What is EVAAS?
End of Grade End of Course SAT
SAS EVAAS Analyses
Writing LOOKING BACK Evaluating Schooling Effectiveness: Value Added & Diagnostic Reports LOOKING AHEAD Planning for Students’ Needs: Student Projections to Future Tests
6
Copyright © 2010, SAS Institute Inc. All rights reserved.
What is EVAAS?
EVAAS
Improve the Education Program
Copyright © 2010, SAS Institute Inc. All rights reserved.
Local Knowledge & Expertise 7
How can EVAAS help me?
EVAAS: Looking Back Past Program Effectiveness EVAAS: Looking Ahead Incoming Student Needs
Improve the Education Program
Local Knowledge & Expertise
Copyright © 2010, SAS Institute Inc. All rights reserved.
8
How can EVAAS help me?
Educators want all children to succeed.
Educators already work really hard.
But how do Educators
know
if all of their hard work is paying off?
?
= Copyright © 2010, SAS Institute Inc. All rights reserved.
9
How can EVAAS help me?
Educators want all children to succeed.
Educators already work really hard.
EVAAS is
NOT
just another thing to add to your to-do list.
Copyright © 2010, SAS Institute Inc. All rights reserved.
So what is it?
10
How can EVAAS help me?
Educators want all children to succeed.
Educators already work really hard.
EVAAS is
another tool
to use to help educators.
Educator’s Toolbox Copyright © 2010, SAS Institute Inc. All rights reserved.
EVAAS
11
How can EVAAS help me?
Educators want all children to succeed.
Educators already work really hard.
But how do Educators
know
if all of their hard work is paying off?
EVAAS is
another tool
EVAAS
to
?
= Educator’s Toolbox Copyright © 2010, SAS Institute Inc. All rights reserved.
EVAAS
12
Achievement vs. Progress
Copyright © 2010, SAS Institute Inc. All rights reserved.
13
Student Achievement Proficient Copyright © 2010, SAS Institute Inc. All rights reserved.
End of School Year
14
Student Progress Advanced Proficient Start of School Year Copyright © 2010, SAS Institute Inc. All rights reserved.
End of School Year
15
Student Progress Proficient Not Proficient Start of School Year Copyright © 2010, SAS Institute Inc. All rights reserved.
End of School Year
16
Student Progress Advanced Proficient Not Proficient Start of School Year Copyright © 2010, SAS Institute Inc. All rights reserved.
End of School Year
17
Achievement vs. Progress Student Achievement: Where are we?
Highly correlated with demographic factors
Student Progress: How far have we come?
Highly dependent on what happens as a result of schooling rather than on demographic factors By concentrating on the
progress
students make, EVAAS puts the emphasis on something educators can influence.
18
Copyright © 2010, SAS Institute Inc. All rights reserved.
In the Perfect World…
The Kindergarten of Eden
Calculating Progress Measures would be easy The 3 M’s would not exist Measurement Error Mobility Missing Data
We live in the real world.
19
Copyright © 2010, SAS Institute Inc. All rights reserved.
Statistics to the Rescue!
EVAAS Analyses Save the Day!
Minimize the effects of
measurement error
associated with any one test scores Account for
mobility
of students Compensate for
missing data How?
Statistical fairy dust
20
Copyright © 2010, SAS Institute Inc. All rights reserved.
Not Really!
Don’t Tell the Statisticians I Said That!
EVAAS uses advanced statistical methodologies Univariate Response Modeling These methodologies Are regularly used in other fields Have been proved reliable
Copyright © 2010, SAS Institute Inc. All rights reserved.
21
The EVAAS Philosophy
Copyright © 2010, SAS Institute Inc. All rights reserved.
22
The EVAAS Philosophy
All students deserve opportunities to make appropriate academic progress every year.
There is no “one size fits all” way of educating students who enter a class at different levels of academic achievement.
Adjustments to instruction should be based on the students’ academic needs, not on socio economic factors.
"What teachers know and can do is the most important influence on what students learn." (National Commission on Teaching and America's Future, 1996)
Copyright © 2010, SAS Institute Inc. All rights reserved.
23
Achievement and Poverty
How is this fair?
Copyright © 2010, SAS Institute Inc. All rights reserved.
24
Academic Growth and Poverty
No one is doomed to failure.
Copyright © 2010, SAS Institute Inc. All rights reserved.
25
Where are the EVAAS reports?
They’re online.
So let’s get logged in!
Copyright © 2010, SAS Institute Inc. All rights reserved.
26
Where are the EVAAS reports?
1.
Go to the website.
2.
Bookmark it!
3.
Log in.
Copyright © 2010, SAS Institute Inc. All rights reserved.
27
1. Go to the website www.ncdpi.sas.com
Copyright © 2010, SAS Institute Inc. All rights reserved.
28
1. Go to the website ncdpi.sas.com
Copyright © 2010, SAS Institute Inc. All rights reserved.
29
1. Go to ncdpi.sas.com
2.
BOOKMARK IT!
3. Secure & Convenient Online Login Copyright © 2010, SAS Institute Inc. All rights reserved.
30
Do you see this? Copyright © 2010, SAS Institute Inc. All rights reserved.
Then Sit Tight!
31
EVAAS Soup to Nuts!
Reflective Assessments: Value-Added Reports Reflective Assessments: Diagnostic Reports Proactive Assessments: Student Projections Teacher Reports - EVAAS Training - What Might Change
Copyright © 2010, SAS Institute Inc. All rights reserved.
32
Join if you would like…
Todaysmeet.com/SASEVAAS
Copyright © 2010, SAS Institute Inc. All rights reserved.
33
EVAAS Soup to Nuts!
Reflective Assessments: Value-Added Reports Reflective Assessments: Diagnostic Reports Proactive Assessments: Student Projections Teacher Reports - EVAAS Training - What Might Change
Copyright © 2010, SAS Institute Inc. All rights reserved.
34
Diagnostic Reports – Desirable Pattern Copyright © 2010, SAS Institute Inc. All rights reserved.
35
Diagnostic Reports – Desirable Pattern Copyright © 2010, SAS Institute Inc. All rights reserved.
36
Diagnostic Report – Desirable Pattern Copyright © 2010, SAS Institute Inc. All rights reserved.
37
School Diagnostic
Shed Pattern
Copyright © 2010, SAS Institute Inc. All rights reserved.
38
School Diagnostic
Reverse Shed Pattern
Copyright © 2010, SAS Institute Inc. All rights reserved.
39
School Diagnostic
Tent Pattern
Copyright © 2010, SAS Institute Inc. All rights reserved.
40
School Diagnostic
V Pattern
Copyright © 2010, SAS Institute Inc. All rights reserved.
41
School Diagnostic
Opportunity Gap Pattern
Copyright © 2010, SAS Institute Inc. All rights reserved.
42
School Diagnostic
Desirable Pattern
Copyright © 2010, SAS Institute Inc. All rights reserved.
43
Diagnostic & Performance Diagnostic Reports (Part 2)
Copyright © 2010, SAS Institute Inc. All rights reserved.
44
Diagnostic Reports – the whiskers Copyright © 2010, SAS Institute Inc. All rights reserved.
45
Overview of School Effects (sample data) Copyright © 2010, SAS Institute Inc. All rights reserved.
46
Overview of School Effects (sample data) Copyright © 2010, SAS Institute Inc. All rights reserved.
47
Overview of School Effects (sample data) Copyright © 2010, SAS Institute Inc. All rights reserved.
48
Overview of School Effects (sample data) Copyright © 2010, SAS Institute Inc. All rights reserved.
49
Overview of School Effects (sample data) Copyright © 2010, SAS Institute Inc. All rights reserved.
50
Overview of School Effects (sample data) Copyright © 2010, SAS Institute Inc. All rights reserved.
51
Overview of School Effects It’s Your Turn!
Find the blank table.
Do this by yourself.
Pick a school of your choice.
Fill in your table.
Copyright © 2010, SAS Institute Inc. All rights reserved.
52
Overview of School Effects
What did you find?
Interesting Patterns Insights Areas of Concern Areas of Celebration Copyright © 2010, SAS Institute Inc. All rights reserved.
53
Student Pattern Report
Copyright © 2010, SAS Institute Inc. All rights reserved.
54
Student Pattern Report
growth for the lowest, middle, and highest achieving students
within
the chosen group explore the progress of students with similar educational opportunities diagnostic purposes only minimum of 15 students 55
Copyright © 2010, SAS Institute Inc. All rights reserved.
Student Pattern Report Copyright © 2010, SAS Institute Inc. All rights reserved.
56
Student Pattern Report Copyright © 2010, SAS Institute Inc. All rights reserved.
57
Student Pattern Report Key Questions Copyright © 2010, SAS Institute Inc. All rights reserved.
58
Student Pattern Report – Key Questions Different experience?
Different strategies?
Different needs?
Number of hours?
59
Copyright © 2010, SAS Institute Inc. All rights reserved.
Student Pattern Report – Key Questions Different experience?
Different strategies?
Different needs?
Number of hours?
YES!
Rerun the report with new criteria.
60
Copyright © 2010, SAS Institute Inc. All rights reserved.
Student Pattern Report – Next Steps All 31 Students in the Program 16 Students who attended for 40+ hours Copyright © 2010, SAS Institute Inc. All rights reserved.
61
Student Pattern Report – Next Steps Less Informed Conclusion
: We need to change the selection criteria for this program.
Copyright © 2010, SAS Institute Inc. All rights reserved.
62
Student Pattern Report – Next Steps Less Informed Conclusion
: We need to change the selection criteria for this program.
More Informed Conclusion
: We need to adjust the recommended hours for participants.
Copyright © 2010, SAS Institute Inc. All rights reserved.
63
EVAAS Soup to Nuts!
Reflective Assessments: Value-Added Reports Reflective Assessments: Diagnostic Reports Proactive Assessments: Student Projections Teacher Reports - EVAAS Training - What Might Change
Copyright © 2010, SAS Institute Inc. All rights reserved.
64
Student Projection Report
Let’s go to the reporting!
Copyright © 2010, SAS Institute Inc. All rights reserved.
65
What are the Projections?
Copyright © 2010, SAS Institute Inc. All rights reserved.
66
How Are Projections Used?
Population Growth Demand for Electricity Investment Strategies Inventory Management Copyright © 2010, SAS Institute Inc. All rights reserved.
Weather Forecasts
67
What Are Projections Anyway?
Copyright © 2010, SAS Institute Inc. All rights reserved.
68
What Are Projections Anyway?
Given a specific set of circumstances… …what’s the most likely outcome?
Copyright © 2010, SAS Institute Inc. All rights reserved.
69
What Are Projections Anyway?
Given this student’s testing history, across subjects… …what is the student likely to score on an upcoming test, assuming the student has the average schooling experience?
70
Copyright © 2010, SAS Institute Inc. All rights reserved.
Projections
We all set expectations
How do we set expectations in our daily lives?
Information What do we know about this student?
Experience How have students like this one performed in the past?
Copyright © 2010, SAS Institute Inc. All rights reserved.
71
EVAAS Projections
What are they based on?
Expectations based on what we know About this student » Prior test scores (EOC/EOG), across subjects About other students who have already taken this test » Their prior test scores, across subjects » Their scores on the test we’re projecting to
Copyright © 2010, SAS Institute Inc. All rights reserved.
72
What’s the Value of the Projections?
Projections are NOT about predicting the future.
They ARE about assessing students’ academic needs TODAY.
73
Copyright © 2010, SAS Institute Inc. All rights reserved.
Assessing Students’ Needs
What are this student’s chances for success?
What goals should we have for this student this year?
What goals should we have for this student in future years?
What can I do to help this student get there?
74
Copyright © 2010, SAS Institute Inc. All rights reserved.
Setting Goals and Raising Expectations
Is
Proficient
the most appropriate goal for this student?
Copyright © 2010, SAS Institute Inc. All rights reserved.
75
Projections Inform Your Actions Today
The meteorologist says there’s an 80% chance of rain tomorrow
What do you do?
Copyright © 2010, SAS Institute Inc. All rights reserved.
76
Changing the Outcomes
Students’ academic outcomes are not like the weather
You have the power to change them!
77
Copyright © 2010, SAS Institute Inc. All rights reserved.
Using Projections to Take Action
Identify students who need to participate in an academic intervention Assess the level of risk for students who may not reach the Proficient mark Plan schedules and resources to ensure that you can meet students’ needs Identify high-achievers who will need additional challenges Assess the opportunities for high-achieving students who are at risk of not reaching Advanced Inform course placement decisions 78
Copyright © 2010, SAS Institute Inc. All rights reserved.
Reflection + Projection = TODAY
Copyright © 2010, SAS Institute Inc. All rights reserved.
79
Student Projection Report Copyright © 2010, SAS Institute Inc. All rights reserved.
80
Thinking of the State Distribution by QUINTILES QUINTILE 5 QUINTILE 4 QUINTILE 3 QUINTILE 2 QUINTILE 1 Copyright © 2010, SAS Institute Inc. All rights reserved.
81
Note the Student’s Projected QUINTILE QUINTILE 2 Copyright © 2010, SAS Institute Inc. All rights reserved.
82
Reflecting on Past Effectiveness to Plan for Differentiating Student Instruction Past Effectiveness Entering Achievement
83
Copyright © 2010, SAS Institute Inc. All rights reserved.
Reflecting on Past Effectiveness to Plan for Differentiating Student Instruction QUINTILE 2 Past Effectiveness Entering Achievement
84
Copyright © 2010, SAS Institute Inc. All rights reserved.
Academic Preparedness Report
Copyright © 2010, SAS Institute Inc. All rights reserved.
85
Custom Student Report
Copyright © 2010, SAS Institute Inc. All rights reserved.
86
Custom Student Report HANDOUT Copyright © 2010, SAS Institute Inc. All rights reserved.
87
EVAAS Soup to Nuts!
Reflective Assessments: Value-Added Reports Reflective Assessments: Diagnostic Reports Proactive Assessments: Student Projections Teacher Reports - EVAAS Training - What Might Change
Copyright © 2010, SAS Institute Inc. All rights reserved.
88
EVAAS Soup to Nuts!
Reflective Assessments: Value-Added Reports Reflective Assessments: Diagnostic Reports Proactive Assessments: Student Projections Teacher Reports - EVAAS Training - What Might Change
Copyright © 2010, SAS Institute Inc. All rights reserved.
89
Best Practices for Training on EVAAS
Copyright © 2010, SAS Institute Inc. All rights reserved.
90
Thinkaboutthis.wikispaces.com
Copyright © 2010, SAS Institute Inc. All rights reserved.
91
How does someone get an account?
State Admin District Admin School Admin District User School User
Copyright © 2010, SAS Institute Inc. All rights reserved.
State User 92
How does someone get an account?
Kris Knower
State Admin
1 per District Superintendent
District Admin State User
Unlimited State-Level Staff 1 per School Principal
School Admin District User
Unlimited District-Level Staff
School User
Unlimited School-Level Staff (Teachers) Copyright © 2010, SAS Institute Inc. All rights reserved.
93
How does someone know if they are an EVAAS admin?
Copyright © 2010, SAS Institute Inc. All rights reserved.
94
Review, Discussion, & What Might Change
95
Copyright © 2010, SAS Institute Inc. All rights reserved.
SAS ® EVAAS ®
Thank you for your time!
Copyright © 2010, SAS Institute Inc. All rights reserved.