EVAAS SAS Training - rt3nc

Download Report

Transcript EVAAS SAS Training - rt3nc

NC Race to the Top EVAAS Soup to Nuts!

May 22 nd , 2012 SAS ® EVAAS ® for K-12 Copyright © 2010, SAS Institute Inc. All rights reserved.

Presenters Dr. Lynne Johnson

Director of Educator Recruitment and Development

Dr. Eliz Colbert

Lead Professional Development Consultant

Jennifer Preston

Race to the Top Project Coordinator for Educator Effectiveness

Dr. Sandy Horn

Senior Educator Support Specialist

Jenn Persson

Educator Support Specialist

Copyright © 2010, SAS Institute Inc. All rights reserved.

2

EVAAS Soup to Nuts!

Reflective Assessments: Value-Added Reports Reflective Assessments: Diagnostic Reports Proactive Assessments: Student Projections Teacher Reports - EVAAS Training - What Might Change

Copyright © 2010, SAS Institute Inc. All rights reserved.

3

EVAAS Soup to Nuts!

What is it?

Where is it?

Copyright © 2010, SAS Institute Inc. All rights reserved.

4

What is EVAAS?

E V A A S • Education • Value • Added • Assessment • System

So What Does It Do?

5

Copyright © 2010, SAS Institute Inc. All rights reserved.

What is EVAAS?

End of Grade End of Course SAT

SAS EVAAS Analyses

Writing LOOKING BACK Evaluating Schooling Effectiveness: Value Added & Diagnostic Reports LOOKING AHEAD Planning for Students’ Needs: Student Projections to Future Tests

6

Copyright © 2010, SAS Institute Inc. All rights reserved.

What is EVAAS?

EVAAS

Improve the Education Program

Copyright © 2010, SAS Institute Inc. All rights reserved.

Local Knowledge & Expertise 7

How can EVAAS help me?

EVAAS: Looking Back Past Program Effectiveness EVAAS: Looking Ahead Incoming Student Needs

Improve the Education Program

Local Knowledge & Expertise

Copyright © 2010, SAS Institute Inc. All rights reserved.

8

How can EVAAS help me?

 Educators want all children to succeed.

 Educators already work really hard.

But how do Educators

know

if all of their hard work is paying off?

?

= Copyright © 2010, SAS Institute Inc. All rights reserved.

9

How can EVAAS help me?

 Educators want all children to succeed.

 Educators already work really hard.

EVAAS is

NOT

just another thing to add to your to-do list.

Copyright © 2010, SAS Institute Inc. All rights reserved.

So what is it?

10

How can EVAAS help me?

 Educators want all children to succeed.

 Educators already work really hard.

EVAAS is

another tool

to use to help educators.

Educator’s Toolbox Copyright © 2010, SAS Institute Inc. All rights reserved.

EVAAS

11

How can EVAAS help me?

 Educators want all children to succeed.

 Educators already work really hard.

But how do Educators

know

if all of their hard work is paying off?

EVAAS is

another tool

EVAAS

to

?

= Educator’s Toolbox Copyright © 2010, SAS Institute Inc. All rights reserved.

EVAAS

12

Achievement vs. Progress

Copyright © 2010, SAS Institute Inc. All rights reserved.

13

Student Achievement Proficient Copyright © 2010, SAS Institute Inc. All rights reserved.

End of School Year

14

Student Progress Advanced Proficient Start of School Year Copyright © 2010, SAS Institute Inc. All rights reserved.

End of School Year

15

Student Progress Proficient Not Proficient Start of School Year Copyright © 2010, SAS Institute Inc. All rights reserved.

End of School Year

16

Student Progress Advanced Proficient Not Proficient Start of School Year Copyright © 2010, SAS Institute Inc. All rights reserved.

End of School Year

17

Achievement vs. Progress Student Achievement: Where are we?

 Highly correlated with demographic factors

Student Progress: How far have we come?

 Highly dependent on what happens as a result of schooling rather than on demographic factors By concentrating on the

progress

students make, EVAAS puts the emphasis on something educators can influence.

18

Copyright © 2010, SAS Institute Inc. All rights reserved.

In the Perfect World…

The Kindergarten of Eden

 Calculating Progress Measures would be easy  The 3 M’s would not exist  Measurement Error  Mobility  Missing Data

We live in the real world.

19

Copyright © 2010, SAS Institute Inc. All rights reserved.

Statistics to the Rescue!

 EVAAS Analyses Save the Day!

 Minimize the effects of

measurement error

associated with any one test scores  Account for

mobility

of students  Compensate for

missing data How?

Statistical fairy dust

20

Copyright © 2010, SAS Institute Inc. All rights reserved.

Not Really!

Don’t Tell the Statisticians I Said That!

 EVAAS uses advanced statistical methodologies  Univariate Response Modeling  These methodologies  Are regularly used in other fields  Have been proved reliable

Copyright © 2010, SAS Institute Inc. All rights reserved.

21

The EVAAS Philosophy

Copyright © 2010, SAS Institute Inc. All rights reserved.

22

The EVAAS Philosophy

  All students deserve opportunities to make appropriate academic progress every year.

There is no “one size fits all” way of educating students who enter a class at different levels of academic achievement.

 Adjustments to instruction should be based on the students’ academic needs, not on socio economic factors.

 "What teachers know and can do is the most important influence on what students learn." (National Commission on Teaching and America's Future, 1996)

Copyright © 2010, SAS Institute Inc. All rights reserved.

23

Achievement and Poverty

How is this fair?

Copyright © 2010, SAS Institute Inc. All rights reserved.

24

Academic Growth and Poverty

No one is doomed to failure.

Copyright © 2010, SAS Institute Inc. All rights reserved.

25

Where are the EVAAS reports?

They’re online.

So let’s get logged in!

Copyright © 2010, SAS Institute Inc. All rights reserved.

26

Where are the EVAAS reports?

1.

Go to the website.

2.

Bookmark it!

3.

Log in.

Copyright © 2010, SAS Institute Inc. All rights reserved.

27

1. Go to the website www.ncdpi.sas.com

Copyright © 2010, SAS Institute Inc. All rights reserved.

28

1. Go to the website ncdpi.sas.com

Copyright © 2010, SAS Institute Inc. All rights reserved.

29

1. Go to ncdpi.sas.com

2.

BOOKMARK IT!

3. Secure & Convenient Online Login Copyright © 2010, SAS Institute Inc. All rights reserved.

30

Do you see this? Copyright © 2010, SAS Institute Inc. All rights reserved.

Then Sit Tight!

31

EVAAS Soup to Nuts!

Reflective Assessments: Value-Added Reports Reflective Assessments: Diagnostic Reports Proactive Assessments: Student Projections Teacher Reports - EVAAS Training - What Might Change

Copyright © 2010, SAS Institute Inc. All rights reserved.

32

Join if you would like…

Todaysmeet.com/SASEVAAS

Copyright © 2010, SAS Institute Inc. All rights reserved.

33

EVAAS Soup to Nuts!

Reflective Assessments: Value-Added Reports Reflective Assessments: Diagnostic Reports Proactive Assessments: Student Projections Teacher Reports - EVAAS Training - What Might Change

Copyright © 2010, SAS Institute Inc. All rights reserved.

34

Diagnostic Reports – Desirable Pattern Copyright © 2010, SAS Institute Inc. All rights reserved.

35

Diagnostic Reports – Desirable Pattern Copyright © 2010, SAS Institute Inc. All rights reserved.

36

Diagnostic Report – Desirable Pattern Copyright © 2010, SAS Institute Inc. All rights reserved.

37

School Diagnostic

Shed Pattern

Copyright © 2010, SAS Institute Inc. All rights reserved.

38

School Diagnostic

Reverse Shed Pattern

Copyright © 2010, SAS Institute Inc. All rights reserved.

39

School Diagnostic

Tent Pattern

Copyright © 2010, SAS Institute Inc. All rights reserved.

40

School Diagnostic

V Pattern

Copyright © 2010, SAS Institute Inc. All rights reserved.

41

School Diagnostic

Opportunity Gap Pattern

Copyright © 2010, SAS Institute Inc. All rights reserved.

42

School Diagnostic

Desirable Pattern

Copyright © 2010, SAS Institute Inc. All rights reserved.

43

Diagnostic & Performance Diagnostic Reports (Part 2)

Copyright © 2010, SAS Institute Inc. All rights reserved.

44

Diagnostic Reports – the whiskers Copyright © 2010, SAS Institute Inc. All rights reserved.

45

Overview of School Effects (sample data) Copyright © 2010, SAS Institute Inc. All rights reserved.

46

Overview of School Effects (sample data) Copyright © 2010, SAS Institute Inc. All rights reserved.

47

Overview of School Effects (sample data) Copyright © 2010, SAS Institute Inc. All rights reserved.

48

Overview of School Effects (sample data) Copyright © 2010, SAS Institute Inc. All rights reserved.

49

Overview of School Effects (sample data) Copyright © 2010, SAS Institute Inc. All rights reserved.

50

Overview of School Effects (sample data) Copyright © 2010, SAS Institute Inc. All rights reserved.

51

Overview of School Effects It’s Your Turn!

 Find the blank table.

   Do this by yourself.

Pick a school of your choice.

Fill in your table.

Copyright © 2010, SAS Institute Inc. All rights reserved.

52

Overview of School Effects

 

What did you find?

 

Interesting Patterns Insights Areas of Concern Areas of Celebration Copyright © 2010, SAS Institute Inc. All rights reserved.

53

Student Pattern Report

Copyright © 2010, SAS Institute Inc. All rights reserved.

54

Student Pattern Report

   growth for the lowest, middle, and highest achieving students

within

the chosen group  explore the progress of students with similar educational opportunities diagnostic purposes only minimum of 15 students 55

Copyright © 2010, SAS Institute Inc. All rights reserved.

Student Pattern Report Copyright © 2010, SAS Institute Inc. All rights reserved.

56

Student Pattern Report Copyright © 2010, SAS Institute Inc. All rights reserved.

57

Student Pattern Report Key Questions Copyright © 2010, SAS Institute Inc. All rights reserved.

58

Student Pattern Report – Key Questions Different experience?

Different strategies?

Different needs?

Number of hours?

59

Copyright © 2010, SAS Institute Inc. All rights reserved.

Student Pattern Report – Key Questions Different experience?

Different strategies?

Different needs?

Number of hours?

YES!

Rerun the report with new criteria.

60

Copyright © 2010, SAS Institute Inc. All rights reserved.

Student Pattern Report – Next Steps All 31 Students in the Program 16 Students who attended for 40+ hours Copyright © 2010, SAS Institute Inc. All rights reserved.

61

Student Pattern Report – Next Steps Less Informed Conclusion

: We need to change the selection criteria for this program.

Copyright © 2010, SAS Institute Inc. All rights reserved.

62

Student Pattern Report – Next Steps Less Informed Conclusion

: We need to change the selection criteria for this program.

More Informed Conclusion

: We need to adjust the recommended hours for participants.

Copyright © 2010, SAS Institute Inc. All rights reserved.

63

EVAAS Soup to Nuts!

Reflective Assessments: Value-Added Reports Reflective Assessments: Diagnostic Reports Proactive Assessments: Student Projections Teacher Reports - EVAAS Training - What Might Change

Copyright © 2010, SAS Institute Inc. All rights reserved.

64

Student Projection Report

Let’s go to the reporting!

Copyright © 2010, SAS Institute Inc. All rights reserved.

65

What are the Projections?

Copyright © 2010, SAS Institute Inc. All rights reserved.

66

How Are Projections Used?

Population Growth Demand for Electricity Investment Strategies Inventory Management Copyright © 2010, SAS Institute Inc. All rights reserved.

Weather Forecasts

67

What Are Projections Anyway?

Copyright © 2010, SAS Institute Inc. All rights reserved.

68

What Are Projections Anyway?

Given a specific set of circumstances… …what’s the most likely outcome?

Copyright © 2010, SAS Institute Inc. All rights reserved.

69

What Are Projections Anyway?

Given this student’s testing history, across subjects… …what is the student likely to score on an upcoming test, assuming the student has the average schooling experience?

70

Copyright © 2010, SAS Institute Inc. All rights reserved.

Projections

We all set expectations

How do we set expectations in our daily lives?

 Information  What do we know about this student?

 Experience  How have students like this one performed in the past?

Copyright © 2010, SAS Institute Inc. All rights reserved.

71

EVAAS Projections

What are they based on?

 Expectations based on what we know  About this student » Prior test scores (EOC/EOG), across subjects  About other students who have already taken this test » Their prior test scores, across subjects » Their scores on the test we’re projecting to

Copyright © 2010, SAS Institute Inc. All rights reserved.

72

What’s the Value of the Projections?

Projections are NOT about predicting the future.

They ARE about assessing students’ academic needs TODAY.

73

Copyright © 2010, SAS Institute Inc. All rights reserved.

Assessing Students’ Needs

 What are this student’s chances for success?

 What goals should we have for this student this year?

 What goals should we have for this student in future years?

What can I do to help this student get there?

74

Copyright © 2010, SAS Institute Inc. All rights reserved.

Setting Goals and Raising Expectations

Is

Proficient

the most appropriate goal for this student?

Copyright © 2010, SAS Institute Inc. All rights reserved.

75

Projections Inform Your Actions Today

The meteorologist says there’s an 80% chance of rain tomorrow

What do you do?

Copyright © 2010, SAS Institute Inc. All rights reserved.

76

Changing the Outcomes

Students’ academic outcomes are not like the weather

You have the power to change them!

77

Copyright © 2010, SAS Institute Inc. All rights reserved.

Using Projections to Take Action

 Identify students who need to participate in an academic intervention  Assess the level of risk for students who may not reach the Proficient mark  Plan schedules and resources to ensure that you can meet students’ needs  Identify high-achievers who will need additional challenges  Assess the opportunities for high-achieving students who are at risk of not reaching Advanced  Inform course placement decisions 78

Copyright © 2010, SAS Institute Inc. All rights reserved.

Reflection + Projection = TODAY

Copyright © 2010, SAS Institute Inc. All rights reserved.

79

Student Projection Report Copyright © 2010, SAS Institute Inc. All rights reserved.

80

Thinking of the State Distribution by QUINTILES QUINTILE 5 QUINTILE 4 QUINTILE 3 QUINTILE 2 QUINTILE 1 Copyright © 2010, SAS Institute Inc. All rights reserved.

81

Note the Student’s Projected QUINTILE QUINTILE 2 Copyright © 2010, SAS Institute Inc. All rights reserved.

82

Reflecting on Past Effectiveness to Plan for Differentiating Student Instruction Past Effectiveness Entering Achievement

83

Copyright © 2010, SAS Institute Inc. All rights reserved.

Reflecting on Past Effectiveness to Plan for Differentiating Student Instruction QUINTILE 2 Past Effectiveness Entering Achievement

84

Copyright © 2010, SAS Institute Inc. All rights reserved.

Academic Preparedness Report

Copyright © 2010, SAS Institute Inc. All rights reserved.

85

Custom Student Report

Copyright © 2010, SAS Institute Inc. All rights reserved.

86

Custom Student Report HANDOUT Copyright © 2010, SAS Institute Inc. All rights reserved.

87

EVAAS Soup to Nuts!

Reflective Assessments: Value-Added Reports Reflective Assessments: Diagnostic Reports Proactive Assessments: Student Projections Teacher Reports - EVAAS Training - What Might Change

Copyright © 2010, SAS Institute Inc. All rights reserved.

88

EVAAS Soup to Nuts!

Reflective Assessments: Value-Added Reports Reflective Assessments: Diagnostic Reports Proactive Assessments: Student Projections Teacher Reports - EVAAS Training - What Might Change

Copyright © 2010, SAS Institute Inc. All rights reserved.

89

Best Practices for Training on EVAAS

Copyright © 2010, SAS Institute Inc. All rights reserved.

90

Thinkaboutthis.wikispaces.com

Copyright © 2010, SAS Institute Inc. All rights reserved.

91

How does someone get an account?

State Admin District Admin School Admin District User School User

Copyright © 2010, SAS Institute Inc. All rights reserved.

State User 92

How does someone get an account?

Kris Knower

State Admin

1 per District Superintendent

District Admin State User

Unlimited State-Level Staff 1 per School Principal

School Admin District User

Unlimited District-Level Staff

School User

Unlimited School-Level Staff (Teachers) Copyright © 2010, SAS Institute Inc. All rights reserved.

93

How does someone know if they are an EVAAS admin?

Copyright © 2010, SAS Institute Inc. All rights reserved.

94

Review, Discussion, & What Might Change

95

Copyright © 2010, SAS Institute Inc. All rights reserved.

SAS ® EVAAS ®

Thank you for your time!

Copyright © 2010, SAS Institute Inc. All rights reserved.