MAP/NeSA LINKING STUDY

A Study of the Alignment of the RIT Scales of NWEA’s MAP ® Assessments with the Nebraska State Accountability

Assessment

Agenda

• • • • • • • Sampling Cut Scores: Reading & Math Probabilities Chart Correlations (Pearson r) Accuracy Chart Uses & Misuses of this Information Q-N-R

Methods: Sample

Test Unique District Count Test Season NeSA Scores

14 Spring 2011 Total Matched Record Pairs

Unique Student Count

7081 7081

Definitions:

“Current Season” = spring testing, used “equipercentile” method was used (50% probability of being proficient) “Prior Season” = fall testing, used a percent of population at the proficiency cut point method

Sample by Grade

Normal sample size is 1000 per grade 11 th grade has fewer students than a normal alignment study

TABLE SET 1 – MINIMUM ESTIMATED SAME‐SEASON (SPRING) RIT CUT SCORES CORRESPONDING TO STATE PERFORMANCE LEVELS * Note: the cut scores shown in this table are the

minimum estimated scores. Meeting the minimum MAP cut

score corresponds to a 50% probability of achieving that performance level.

TABLE SET 1 – MINIMUM ESTIMATED SAME‐SEASON (SPRING) RIT CUT SCORES CORRESPONDING TO STATE PERFORMANCE LEVELS * Note: the cut scores shown in this table are the

minimum estimated scores. Meeting the minimum MAP cut

score corresponds to a 50% probability of achieving that performance level.

TABLE SET 2 – MINIMUM ESTIMATED PRIOR‐SEASON (FALL) RIT CUT SCORESCORRESPONDING TO STATE PERFORMANCE LEVELS

TABLE SET 2 – MINIMUM ESTIMATED PRIOR‐SEASON (FALL) RIT CUT SCORESCORRESPONDING TO STATE PERFORMANCE LEVELS

TABLE SET 3 –ESTIMATED PROBABILITY OF SCORING AS PROFICIENT OR HIGHER ON THE STATE TEST IN SAME SEASON (SPRING) This table provides the estimated probability of passing the state test based on a MAP test score taken during that same (spring) season. Example: if a fifth grade student scored 200 on a MAP test taken during the spring season, her/his estimated probability of passing the state test is 17%.

TABLE 5 – CORRELATION COEFFICIENTS BETWEEN MAP AND STATE TEST FOR EACH GRADE AND TEST SUBJECT * Note: Correlations range from 0 (indicating no correlation between the state test score and the NWEA test score) to 1 (indicating complete correlation between the state test score and the NWEA test score).

TABLE 6 – PERCENTAGE OF STUDENTS WHOSE PASS STATUS WAS ACCURATELY PREDICTED BY THEIR MAP PERFORMANCE USING REPORTED CUT SCORES

Projected Proficiency Report

What is this Information telling us?

• • • Cut Points are “estimates” Probabilities related to reaching “meets” or “exceeds” levels on NeSA Students do not always perform similarly on two tests: – – – – Motivation Physical wellbeing Emotional wellbeing Paper format vs. Computer format – 80-90% chance of similar scores

What is the PURPOSE?

• • • • • Purpose is NOT for reporting Better purpose is to make some preliminary estimates of proficiency in the fall based on MAP results Mostly for internal use – identify students needing intervention Using MAP data to report “proficiency” defeats the purpose and design of MAP assessments The Major Purpose of MAP is to describe academic growth – Report on Growth to stakeholders

Reporting Growth Data

• • Key Reporting Metric: Percent of students

meeting or exceeding a Growth Projection

Reports to Use: – “Student Growth Summary Reports” – “Achievement Status & Growth Reports” – “Dynamic Reporting Suite – Summary Data” • Correlates growth with projected proficiency