Transcript Accountability Policy
Office of Accountability
CPS School Quality Rating Policy
November 2014
Agenda • • •
Introduction to the SQRP
Purpose & overview Communication plan • • • • •
Policy Scoring
Assigning Points Weighting System Assigning a School Quality Rating Assigning an Accountability Status •
Appendix: Metric Definitions
•
Q&A
Office of Accountability 1
Introduction to the SQRP
Office of Accountability 2
What is the SQRP?
• The School Quality Rating Policy (SQRP) is the Board of Education’s policy for evaluating school performance. • It establishes the indicators of school performance and growth and the benchmarks against which a school’s success will be evaluated on an annual basis.
• Through this policy, each school will receive a
School Quality Rating
and an
Accountability Status
. Office of Accountability 3
What is the Purpose of the SQRP?
The School Quality Rating and Accountability Status serve the following purposes: •
Communicating
to parents and community members about the academic success of individual schools and the district as a whole; •
Recognizing
high achieving and high growth schools and identifying best practices; • Providing a framework for
goal-setting
for schools; • Identifying schools in need of targeted or intensive
support
; and •
Guiding
the Board’s decision-making processes around school actions and turnarounds.
Office of Accountability 4
How is the SQRP Different from the Performance Policy?
“Old” Performance Policy
• Metrics centered on assessments, attendance, and progress towards graduation
SY14-15 School Quality Rating Policy
• Metrics better aligned to district’s strategic action plan, e.g.,
college enrollment, persistence, priority student group growth, 5Essentials
•
Three levels
of school performance • Evaluates Option schools using traditional high school metrics • ISAT is the main elementary assessment • Uses CPS historical benchmarks • Does not account for test participation •
Five-level
rating to more effectively differentiate schools •
New Option School model
more targeted to the students served • Significant changes to ISAT make it unstable for year to year comparisons;
replace with NWEA MAP
• Performance benchmarks are tied to
national standards
where possible • Target
test participation rate of 95%
5
What Measures will be Used?
Elementary Schools High Schools
Metric
Student Growth on NWEA MAP Student Attendance Growth of Priority Groups on NWEA MAP Percentage of Students Making National Average Growth on NWEA 5Essentials Survey Student Attainment on NWEA MAP (Grades 3 8) Student Attainment on NWEA MAP (Grade 2) ELL Language Development Growth on ACCESS
Weight
25% 20% 10% 10% 10% 10% 5% 5%
Metric
Student Growth on EPAS Growth of Priority Groups on EPAS Student Attainment on EPAS Student Attendance Freshman On-Track Rate 4-Year Cohort Graduation Rate
Weight
20% 10% 10% 10% 10% 10% Early College / Career Credentials 5% 1-Year Dropout Rate College Enrollment College Persistence 5Essentials Survey Data Quality 5% 5% 5% 5% 5% Data Quality 5% Office of Accountability Option Schools
Metric
Percentage of Students Meeting / Exceeding National Growth on STAR Average Student Growth Percentile on STAR
Weight
30% 20% 1-Year Graduation Rate 15% Stabilization Rate Student Attendance Growth in Attendance 10% 10% 10% Credit Attainment 5% 6
Current policy per state code – 105 ILCS 5/34-8.3
Provisional Support* status
• Not currently used in performance improvement • Allows the CEO to: •
Draft a new school improvement plan
•
Direct implementation of the school improvement plan
• Provide additional training for the LSC • Mediate disputes or other obstacles to improvement • If the CEO determines the problems are not able to be remediated by the above methods, the CEO shall place the school on Intensive Support.
•
Intensive Support** status
After one year of the school failing to make adequate progress in correcting deficiencies, the CEO is allowed additional corrective measures • • • • • including:
Replacing the principal
Replacement of faculty members Ordering new LSC elections
Reconstitution, contract turnaround Closure
* Listed in state code as “Remediation” ** Listed in state code as “Probation”
Office of Accountability 7
Charter Schools
• All charter schools with sufficient data will receive a School Quality Rating through this policy. • By State law, charter schools are exempt from Section 5/34-8.3, meaning CPS does not have the same authority to place charter schools into “Probation” or “Remediation” status.
• However, CPS charter schools are subject to the performance standards set out in the accountability provisions in their charter contract with the Board, and most contracts are tied to – or will be tied to – the performance standards under the SQRP. Office of Accountability 8
SQRP in the context of other accountability tools
Tool District scorecard School Quality Rating Policy School Progress Report Illinois School Report Card (ISBE) Principal evaluation Teacher evaluation
Office of Accountability
Purpose
• • • Tracks annual progress on KPIs from the Action Plan Includes all schools (district-operated, charter/contract) Holds district leaders accountable to priorities and goals • • • • • • Identifies schools making academic progress Differentiates school performance; determines “probation” status Identifies schools with insufficient academic achievement for school action decisions (e.g., turnaround, charter watch list, renewal and revocation) Communicates holistic picture of school quality, including academic measures (teacher attendance, student behavior/discipline, safety, healthy schools certification) Provides parents with information for school choice decisions Tracks performance on state assessments and AYP • • • • Provides a state-mandated measure of principal effectiveness (practice and student growth) for district-operated schools Provides feedback to support development Provides a state-mandated measure of teacher effectiveness (practice and student growth) for district-operated schools Provides feedback to support development
Relevant Metrics
• All metrics that support the implementation of the district Action Plan • Objective, research-based metrics for assessing student learning and success outcomes • • • Broader set of information for stakeholders, but not appropriate for high-stakes accountability State and federal accountability metrics Objective annual measures that an individual can influence 9
How Will Results be Communicated?
SQRP results will be communicated in the following ways each fall:
•
Direct Principal Notification:
Principals will receive a letter and SQRP report notifying them of the school’s rating and status. •
Direct LSC Notification:
LSC members will receive a letter and SQRP report, which will be sent to the LSC member’s home.
•
The CPS Website:
Each school’s rating, status, and complete SQRP report will be included on the school’s profile page at cps.edu, as well as on the School Data page at
cps.edu/schooldata
. Office of Accountability 10
Where Can I Find More Information?
Materials will be available at the following locations:
• www.cps.edu
(search “SQRP”) • Your school’s main office or network offices
Available Resources include:
• • • SQRP Handbook PowerPoints and FAQs on the SQRP Calculators Office of Accountability 11
Policy Scoring
Office of Accountability 12
Scoring Overview
Points Weighting Weighted Score School Quality Rating Accountability Status
Schools are assigned between 1 and 5 points for each indicator.
Points for each indicator are multiplied by that indicator’s weight. Weights for all indicators add up to 100% Weighted points are added up, resulting in an overall score between 1 and 5.
Based on the overall weighted score, the school receives a School Quality Rating of Level 1+ (highest) to Level 3 (lowest).
Based on the school’s rating (“level”) it receives an Accountability Status of Good Standing, Remediation (“Provisional Support”) or Probation (“Intensive Support”).
Office of Accountability 13
Points
• • Each school receives between 1 and 5 points for each indicator based on its score in the most recent year.
To receive full credit on assessment indicators, a school must have a 95% participation rate. If the school has a lower participation rate, points are adjusted as follows:
Participation Rate for Elementary and High School
Greater than or equal to 95% Greater than or equal to 93% but less than 95% Greater than or equal to 92% but less than 93% Greater than or equal to 90% but less than 92% Less than 90%
Participation Rate for Option Schools
Greater than or equal to 90% Greater than or equal to 85% but less than 90% Greater than or equal to 80% but less than 85% Greater than or equal to 75% but less than 80% Less than 75%
Point Adjustment
No adjustment -1 point -2 points -3 points -4 points Office of Accountability 14
Weighted Score
• • Each indicator has a specific weight in the policy.
Points earned for each indicator are multiplied by the indicator’s weight to calculate that indicator’s
weighted score
.
EXAMPLE School’s Result Points Weight Weighted Points Indicator
School Growth Percentile on NWEA MAP Reading 90 th Percentile 5 points 12.5% 0.625
• The weighted scores for each indicator are added together to calculate the school’s
overall weighted score
, which will also be between 1 and 5 points.
Office of Accountability 15
•
How Are Ratings Assigned?
Schools earn between 1 – 5 points for each metric.
• Points are weighted according to the tables on slide 6 and added together. The school’s overall score is also between 1 – 5.
• Based on the overall score (or minimum attainment percentile – see below), the school receives a School Quality Rating and Accountability Status.
Overall Score
4.0 or more Between 3.5 and 3.9
Between 3.0 and 3.4
Between 2.0 and 2.9
Less than 2.0
OR Minimum Attainment Percentile
90th 70th 50th 40th --
School Quality Rating
Level 1+ Level 1 Level 2+ Level 2 Level 3
Accountability Status
Good Standing Good Standing Good Standing Provisional Support Intensive Support Office of Accountability 16
What Does the School’s Rating Mean?
• • • • •
Level 1+
is the highest performance; nationally competitive school with opportunity to share best practices with others
Level 1
is high performance; a good school choice with many positive qualities - minimal support needed
Level 2+
is average performance; additional support from network team needed to implement interventions
Level 2
is below average performance; “provisional support” rating means increased support from network
Level 3
is the lowest performance; school is in need of “intensive intervention” directed by the district, charter schools in this category are on Academic Warning List Office of Accountability 17
Combining ES & HS Ratings for schools with both student levels
Combined Score
ES Points X # ES Students Served + HS Points X # HS Students Served Total # Students Served This formula provides a
weighted average
of the points earned on the elementary school model and the high school model. The weighting is based on the proportion of elementary (K-8) students served and high school (9-12) students served. The proportions will be established on the 20 th day. This method gives proportional weighting to each grade band, while allowing the school to set goals, because it will know the weighting at the beginning of the year.
Weighted Points Earned
4.0 or more Between 3.5 and 3.9
Between 3.0 and 3.4
Between 2.0 and 2.9
Less than 2.0
School Quality Rating
Level 1+ Level 1 Level 2+ Level 2 Level 3 Office of Accountability 18
Accountability Status (1/3)
• In general…
Level 1+, 1 or 2+ Level 2
= =
Level 3
=
• With some exceptions…
Good Standing Provisional Support* Intensive Support**
* Listed in state code as “Remediation” ** Listed in state code as “Probation”
Office of Accountability 19
Accountability Status (2/3)
Schools may be placed (or retained) in Probation/Intensive Support status if: • The school has been on Probation/Intensive Support for 2+ years and needs 2+ years of Level 2 or higher to be removed; • The school has undergone an action under 5/34-8.3 (principal removal or turnaround) in the last 5 years; • The CEO has determined Remediation/Provisional Support status is insufficient for a Level 2 school and may place the school in Probation/Intensive Support.
• There is a failure or refusal to comply with the provisions of the Illinois School Code, other applicable laws, collective bargaining agreements, court orders, or Board rules and policies, in which case the school may be placed on Probation/Intensive Support.
-- This includes a school that is in state or federal school improvement status under NCLB and is not in compliance with requirements of that status.
Schools may be retained in Retention/Provisional Support status if: • The school has been on Remediation/Provisional Support for 2+ years and needs 2+ years of Level 2+ or higher to be removed Office of Accountability 20
Accountability Status (3/3)
Accountability Status will be determined in 2014 based on the following: Level 3 Yes Level 2 8.3 Action in last 5 years?
No # Years on Probation 2+ years 2013 Rating Level 3 Level 1 or 2 0 or 1 years Yes Level 1+, 2 or 2+ 8.3 Action in last 5 years?
No # Years on Probation 2+ years 2013 Rating Level 3 Level 1 or 2 0 or 1 years Office of Accountability Intensive Support Intensive Support Intensive Support Provisional Support Provisional Support Intensive Support Intensive Support Good Standing Good Standing 21
Elementary School Model
Measure 1 point 2 points National Growth Percentile on NWEA Reading National Growth Percentile on NWEA Math Priority Group National Growth Pctl. on NWEA Reading Priority Group National Growth Pctl. on NWEA Math % Making Nat. Avg. Growth on NWEA Reading & Math National Attainment Pctl. on NWEA Reading (Gr. 3-8) National Attainment Pctl. on NWEA Math (Gr. 3-8) National Attainment Pctl. on NWEA Reading (Gr. 2)
< 10 th pctl.
< 10 th pctl.
< 10 th pctl.
< 10 th pctl.
<40% <10 th pctl.
<10 th pctl.
<10 th pctl.
10 th pctl.
10 th pctl.
10 th pctl.
10 th pctl.
40% 10 th pctl.
10 th pctl.
10 th pctl.
3 points
40 th pctl.
40 th pctl.
30 th pctl.
30 th pctl.
50% 40 th pctl.
40 th pctl.
40 th pctl.
4 points
70 th pctl.
70 th pctl.
50 th pctl.
50 th pctl.
60% 70 th pctl.
70 th pctl.
70 th pctl.
5 points
90 th pctl.
90 th pctl.
70 th pctl.
70 th pctl.
70% 90 th pctl.
90 th pctl.
90 th pctl.
Weight
12.5% 12.5% 5%* 5%* 10% 5% 5% 2.5%
National Attainment Percentile on NWEA Math (Gr. 2) Attendance Rate ELL Progress on ACCESS 5 Essentials Survey Data Quality Index
<10 th pctl.
<92% < 25% Not Yet Organized <80% 10 th pctl.
92% 25% Partially Organized 85% 40 th pctl.
94% 35% Moderately Organized 90% 70 th pctl.
95% 45% Organized 95% 90 th pctl.
96% 55% Well-Organized 99% 2.5% 20% 5% 10% 5% *The priority group percentile is measured separately for African-American, Hispanic, ELL and Diverse Learners. Each priority group calculation is worth 1.25% in reading and 1.25% in math. If there are fewer than 30 students in the priority group, the indicator is not used and the weight is reallocated to all-grades NWEA growth indicators.
Office of Accountability 22
High School Model
Measure National Growth Percentile on EXPLORE, PLAN and ACT National Priority Group Growth Percentile on EXPLORE, PLAN and ACT National Attainment Percentile on EXPLORE, PLAN and ACT 4-Year Cohort Graduation Rate Freshman On-Track Rate One-Year Dropout Rate Attendance Rate Early College & Career Credentials College Enrollment College Persistence 5 Essentials Data Quality 1 point
< 10 th pctl.
< 10 th pctl.
<10 th pctl.
<55% <60% >8% <80% < 10% <45% <55% Not Yet Organized <80%
2 points
10 th pctl.
10 th pctl.
10 th pctl.
55% 60% 8% 80% 10% 45% 55% Partially Organized 80%
3 points
40 th 30 th pctl.
pctl.
4 points
70 th pctl.
50 th pctl.
5 points
90 th 70 th pctl.
pctl.
40 th pctl.
65% 70% 6% 85% 20% 55% 65% Moderately Organized 90% 70 th pctl.
90 th pctl.
75% 80% 4% 90% 30% 65% 75% 85% 90% 2% 95% 40% 75% 85% Organized Well-Organized 95% 99%
Weight
20% 10%* 10% 10% 10% 5% 10% 5% 5% 5% 5% 5% *The priority group percentile is measured separately for African-American, Hispanic, ELL and Diverse Learners. Each priority group calculation is worth 2.5%. If there are fewer than 30 students in the priority group, the indicator is not used and the weight is reallocated to all-grades growth indicator.
Office of Accountability 23
Option School Ratings
Measure Average Growth Percentile on STAR Reading Average Growth Percentile on STAR Math Percent Making Growth Targets on STAR Reading Percent Making Growth Targets on STAR Math 1-Year Graduation Rate 1 point
<30 th pctl. <30 th pctl.
<35% <35% <60%
Credit Attainment Rate Annual Stabilization Rate Average Daily Attendance Rate Growth in Attendance Rate
<40% <60% <60% <60%
2 points
30 th pctl.
30 th pctl.
35% 35% 60% 40% 60% 60% 60%
3 points
40 th pctl.
40 th pctl.
45% 45% 70% 50% 70% 70% 70%
4 points
50 th pctl.
50 th pctl.
55% 55% 80% 60% 80% 80% 80%
5 points
60 th pctl.
60 th pctl.
65% 65% 90% 70% 90% 90% 90%
Weight
10% 10% 15% 15% 15% 5% 10% 10% 10% Office of Accountability 24
SQRP Amendments Since August 2014
Extending Minimum Attainment Percentile Provision (August 2014)
• The original SQRP included a clause whereby schools achieving 90th attainment percentile on NWEA Reading and Math (elementary schools) or EPAS (high schools) would receive a rating of Level 1+. This amendment to the SQRP extends that alternative rating assignment farther down the attainment scale, as described in the table on slide 16.
Nomenclature Change (November 2014)
• This amendment included language changing the rating labels from Tier 1 through Tier 5 to Level 1+ through Level 3, as described in the table on slide 16.
Level 1 CEO Determination (November 2014)
• The November 2014 amendment also included language allowing for a CEO determination to be made for schools where a significant change (e.g. principal change) at a district-operated Level 1 school has impacted the school. The CEO can now designate a school in this situation to remain Level 1 for a one year period.
f
Office of Accountability
Appendix
26
Elementary School Indicators
Office of Accountability 27
NWEA Growth Percentile
Definitions:
Average Spring-to-Spring RIT score growth of students on the NWEA MAP assessment, compared to average national growth for schools with the same average pretest score. The school is assigned a percentile representing where it would fall on the national distribution.
Calculation:
For each school, a national average comparison growth score will be calculated. This will be the mean of the national average Spring-to Spring growth scores at each grade level, controlling for the school’s average pretest performance and weighted by the number of students in each grade level at the school. This comparison score will therefore represent a national average school with the same pretest averages and the same proportion of students at each grade level. Average scores will be based on NWEA’s national school-level norms.
The national average comparison score for each school represents a 50 th percentile school in terms of growth.
The school will receive a percentile score based on how far above or below the 50 th percentile it scored.
SQRP Scoring:
Percentile
1 point
Under 10 th
2 points
10 th to 39 th
3 points
40 th to 69 th
4 points
70 th to 89 th
5 points
90 th or above
Notes:
Student must have taken the same subject test in both periods to be included. Students retained in a grade level are not included. Students are assigned to schools based on “annualized” school, which is the school where the student was enrolled for the most time during the year. Does not include students with an IAA indicator in their IEP and students with an ACCESS Literacy score less than 3.5. Office of Accountability 28
Sample Elementary School 3
rd
Grade Reading
Grade
3 rd
# Students Average Pretest RIT Score
85 181.1
National Avg. Growth Percentile Range Targets
+13 190.9
10 th
193.5
194.1
40 th
195.4
50 th 70 th
197.3
90 th
This is the number of students with a valid pretest and posttest score. Students are attributed to the school where they were enrolled the greatest amount of time during the year.
Office of Accountability This is the average pretest RIT score for this school’s 3 rd graders (i.e., the average of their 2 nd grade RIT scores)
Average Posttest RIT Score National Growth Percentile
193.8
45 th This is the average growth for 3 rd grade for a school with an average pretest RIT score of 181.1.
The 50 th percentile score is the sum of 181.1 and 13. This is the national average posttest score in 3 rd grade for a school with an average pretest score of 181.1.
Other cut points are establishe d based on distance from the 50 th percentile. This is the actual growth percentile of the school based on the average posttest RIT score. This school will fall into the 3-point range, which is from 40 th to 70 th percentile.
Note: The norms in this example are based on fall-to-spring norms from NWEA. NWEA has provided CPS with spring-to-spring norms, which have been used in actual SQRP calculations.
29
Sample Elementary School All Grades Reading
Grade # Students Average Fall RIT Score National Avg. Growth Percentile Range Targets
3 rd 4 th 5 th 6 th 7 th 8 th 85 71 78 115 108 87 181.1
194.0
201.1
208.4
214.9
216.9
+13 +9.2
+7.6
+6.7
+4.0
+4.1
190.9
10 th
200.4
10 th
193.5
194.1
40 th
202.6
40 th 50 th
203.2
50 th
195.4
70 th
204.3
70 th
197.3
90 th
206.0
90 th
206.0
10 th
211.5
10 th
216.4
10 th
208.2
40 th
208.7
50 th
209.8
70 th
213.6
40 th
214.1
50 th
215.2
70 th
218.4
40 th
218.9
50 th
219.9
70 th
211.5
90 th
216.7
90 th
221.3
90 th
218.5
10 th
209.3
10 th
220.3
40 th
220.8
50 th
221.8
70 th
210.5
40 th
210.8
50 th
211.4
70 th
223.1
90 th
212.3
90 th
All Grades Average 544 203.9
+6.9
This is the average pretest RIT score for the school, weighted by the number of students in each grade.
Office of Accountability This is the national average growth for a school with the same pretest scores and the same proportion of students in each grade.
Average Spring RIT Score
193.8
201.5
211.1
216.2
219.1
221.0
211.8
National Growth Percentile
45 th 22 nd 87 th 85 th 85 th 55 th 84 th This is the overall percentile, which is based on the difference between the school’s actual growth and the national average growth. This school would earn 4 points in the policy.
30
NWEA Priority Group Growth
Definitions:
There are 8 possible priority group measures for each school – reading and math for each of the following 4 priority groups: • English Language Learners (ELL) • • • Students with an IEP (does not include 504 plans) African-American students Hispanic students Each priority group must have at least 30 students for a growth percentile to be calculated.
Each priority group with at least 30 students will receive a priority group score which will account for 2.5% of the school’s rating (1.25% for each subject). If a priority group has fewer than 30 students, the 2.5% weighting will be added to the school’s overall NWEA Growth Percentile metrics.
Calculation
Each priority group will receive a NWEA Growth Percentile based on the methodology described in the “NWEA Growth Percentile” section. The priority group’s percentile will be based on a comparison of the average growth of the priority group to the average growth of a national school with the same pretest scores. Note: The national average comparison scores do not account for demographics, so the school’s priority groups will be compared to a national average for students with the same pretest scores, including students nationally that are not in that priority group.
SQRP Scoring
Percentile
1 point
Under 10 th
2 points
10 th to 29 th
3 points
30 th to 49 th
4 points
50 th to 69 th
5 points
70 th or above Office of Accountability 31
Percent Meeting NWEA Targets
Calculation
Numerator:
Number of students meeting national Spring-to-Spring growth targets on the NWEA reading test plus number meeting targets on the math test. Targets are the national average growth of students with the same pretest score based on NWEA research.
Denominator:
Number of students taking the NWEA MAP reading test in both periods plus number taking the NWEA MAP math test in both periods.
SQRP Scoring
Percent
1 point
Under 40%
2 points
40% to 49.9%
3 points
50% to 59.9%
4 points
60% to 69.9%
5 points
70% or above
Notes:
Student must have taken the same subject test in both periods to be included. Students retained in a grade level are not included. Students are assigned to schools based on “annualized” school, which is the school where the student was enrolled for the most time during the year. Does not include students with an IAA indicator in their IEP and students with an ACCESS Literacy score less than 3.5. Office of Accountability 32
NWEA Attainment Percentile (3
rd
-8
th
grade)
Definitions:
Average Spring RIT score of students on the NWEA MAP assessment, compared to average national score. The school is assigned a percentile representing where the school would fall on the national distribution.
Calculation:
For each school, a national average comparison RIT score will be calculated. This will be the mean of the national average RIT scores at each grade level, weighted by the number of students in each grade level at the school. This comparison score will therefore represent a national average school with the same proportion of students at each grade level. Average scores will be based on NWEA’s national school-level norms.
The national average comparison score for each school represents a 50 th percentile school.
The school will receive a percentile score based on how far above or below the 50 th percentile it scored.
SQRP Scoring:
Percentile
1 point
Under 10 th
2 points
10 th to 39 th
3 points
40 th to 69 th
4 points
70 th to 89 th
5 points
90 th or above
Notes:
Students are assigned to schools based on “annualized” school, which is the school where the student was enrolled for the most time during the year. Does not include students with an IAA indicator in their IEP and students with an ACCESS Literacy score less than 3.5.
Office of Accountability 33
NWEA Attainment Percentile (2nd grade)
Definitions:
Average Spring RIT score of 2 nd grade students on the NWEA MAP assessment, compared to average national score. The school is assigned a percentile representing where the school would fall on the national distribution.
Calculation:
The average RIT score for 2 nd grade students in the spring will be compared to the national average score for 2 nd national average score will be based on NWEA’s national school-level norms.
The school will receive a percentile score based on how far above or below the 50 th percentile it scored. grade. The
SQRP Scoring:
Percentile
1 point
Under 10 th
2 points
10
3 points
40 th to 69 th
4 points
70 th to 89 th 90
5 points
th or above
Notes:
Students are assigned to schools based on “annualized” school, which is the school where the student was enrolled for the most time during the year. Does not include students with an IAA indicator in their IEP and students with an ACCESS Literacy score less than 3.5. Office of Accountability 34
ELL Language Development Growth (ACCESS)
Definitions:
Percentage of ELL students meeting individual growth targets on the ACCESS Composite score.
Calculation:
Each student’s ACCESS Composite score is compared to a target score based on the student’s prior year score. Target scores will represent reasonable annual progress and will be adjusted for the student’s score in the prior year.
These targets are currently under development by CPS
.
Schools are rated in the SQRP on the percentage of students meeting their individual target score as follows:
Numerator:
Number of students meeting individual growth target on ACCESS Composite.
Denominator:
Number of students taking the ACCESS assessment. Denominator is limited to students who have a valid score in both years.
SQRP Scoring:
Percentage
1 point
Under 25%
2 points
25% to 34.9%
3 points
35% to 44.9%
4 points
45% to 54.9%
5 points
55% or higher
Notes:
Students are assigned to the school where they were enrolled for the most time between ACCESS administrations. Office of Accountability 35
Attendance Rate (K-8 th grade)
Definitions:
Average daily attendance rate of the school, adjusted for students with medically fragile conditions and early graduation for 8 th and 12 th graders.
Calculation:
Numerator:
Total number of present days for students during the year.
Denominator:
Total number of membership days for students during the year.
For the SQRP rating only, students are removed from the calculation if they are homebound, “medically fragile” per their IEP, or in 8 th or 12 th grade subsequent to the first date on which CPS permits graduation. These adjustments will only be made if they improve the school’s attendance rate.
SQRP Scoring:
Attendance Rate
1 point
Under 90%
2 points
90% to 92.9%
3 points
93% to 94.9%
4 points
95% to 95.9%
5 points
96% or above
Notes:
Students are attributed to each school in which they were enrolled, but only for the days in which they were enrolled in that school. Office of Accountability 36
5Essentials
Definitions:
Overall rating of the school on the 5 Essentials survey (a primary component of the My Voice, My School survey for students and teachers) administered in the Spring.
Calculation:
Ratings are calculated by the Consortium on Chicago School Research at the University of Chicago. The overall rating of the school is determined using data from all 5 essentials, or from whatever combination of essentials for which the school has sufficient data.
SQRP Scoring:
Overall Rating
1 point 2 points 3 points 4 points 5 points
Not Yet Organized for Improvement Partially Organized for Improvement Moderately Organized for Improvement Organized for Improvement Well-Organized for Improvement
Notes
The school must have a minimum level of participation of 50% for the calculation of a rating. Office of Accountability 37
The 5 Essentials
The 5 Essentials are a diagnostic tool measuring schools’ strengths and weaknesses based on 20 years of research by CCSR. • They help schools organize, prioritize, evaluate, and achieve sustainable improvement.
• Surveys are administered in the Spring to 6-12 th grade students and all teachers.
Schools in Chicago that make progress on 3 of 5 of the Essentials are 10 times more likely to make substantial improvement than schools that do not.
The 5 Essentials Effective Leaders Collaborative Teachers Involved Families Description
The principal works with teachers to promote professional growth and school success Teachers collaborate to promote professional growth and school success The entire staff involves families and communities to advance student learning
Primary Responder Teachers Teachers Teachers Supportive Environment Ambitious Instruction
The school is safe, demanding and supportive Classes are challenging and engaging
Students Students
Office of Accountability 38
Data Quality Index
Definitions:
Data Quality Index (DQI) score, which is the percent of data quality indicators that are correct in CPS data systems. The DQI used in the SQRP will include a subset of the data quality sections reported on the Dashboard. DQI will be calculated at the end of the year before year end processing.
Calculation:
For each of the 4 categories of the DQI, the percent of errors is calculated as follows: Numerator: Number of outstanding data quality errors that need to be corrected for the category
Denominator: Total number of data quality checks performed for the category
The DQI scores used in the SQRP will be 100% minus this percentage.
The overall DQI score is calculated as a weighted average of the category percentages using the following weights:
DQI Category
Attendance Registration and Enrollment Student Contact Information Student Health
Weight
40% 40% 15% 5%
SQRP Scoring:
Data Quality Index
1 point
Under 85%
2 points
85% to 89.9%
3 points
90%-94.9%
4 points
95%-98.9%
5 points
99% or above Office of Accountability 39
High School Indicators
Office of Accountability 40
EPAS Growth Percentile
Definitions:
Average Spring-to-Spring Composite score growth of students on the EPAS assessment series (EXPLORE, PLAN and ACT), compared to national average growth for schools with the same average pretest score. The school is assigned a percentile representing where it would fall on the national school-level distribution.
Calculation:
For each school, a national average comparison growth score will be calculated. This is the weighted mean of the national average growth scores at each grade level, controlling for the school’s average pretest performance and weighted by the number of students in each grade level at the school. This comparison score will therefore represent an average national school with the same pretest averages and the same proportion of students at each grade level. National averages will be based on data from ACT, Inc. The national average comparison score for each school represents a 50 th percentile school in terms of growth.
The school will receive a percentile score based on how far above or below the 50 th percentile it scored.
SQRP Scoring:
Percentile
1 point
Under 10 th
2 points
10 th to 39 th
3 points
40 th to 69 th
4 points
70 th to 89 th
5 points
90 th or above
Notes:
Student must have taken all four subject tests in both periods to be included. Students retained in a grade level are not included. Students are assigned to schools based on “annualized” school, which is the school where the student was enrolled for the most time during the year. Does not include students with an IAA indicator in their IEP and students with an ACCESS Literacy score less than 3.5. The pretest score for 9 th grade growth will be measured using the 8 th grade EXPLORE in 2013 2014 and 8 th grade NWEA assessment in subsequent years. NWEA scores will be equated to the EPAS scale to establish a pretest average.
Office of Accountability 41
Sample High School 9
th
Grade EXPLORE
Grade
9 th
# Students
215
Average Pretest Score
14.1
National Avg. Growth
+0.6
Percentile Range Targets
14.2
10 th
14.6
40 th
14.7
50 th
14.9
70 th
15.2
90 th
This is the number of students with a valid pretest and posttest score. Students are attributed to the school where they were enrolled the greatest amount of time during the year.
This is the average pretest score for this school’s 9 th graders. Starting in 2014-15, this score will be converted from students’ 8 th grade NWEA RIT scores to the EPAS scale.
This is the national average growth for 9 th grade for a school with an average pretest score of 14.1.
The 50 th percentile score is the sum of 14.1 and 0.6. This is the national average posttest score in 9 th grade for a school with an average pretest score of 14.1.
Other cut points are established based on distance from the 50 th percentile.
Average Posttest Score
14.5
Growth Percentile
32 nd This is the actual growth percentile of the school based on the average posttest score. This school will fall into the 2 point range, which is from 10 th to 40 th percentile.
Note: The numbers in this example are based on fall-to-spring norms from CPS data. ACT has provided national spring-to-spring norms that were used in actual SQRP calculations.
Office of Accountability 42
Sample High School All Grades EPAS
Grade
9 th 10 th 11 th All Grades Average
# Students
215 187 154
Average Pretest Score
14.1
15.4
16.8
556 15.3
This is the average pretest score for the school, weighted by the number of students in each grade.
Office of Accountability
National Avg. Growth
+0.6
+0.7
+1.5
+0.9
Percentile Range Targets
14.2
10 th
15.6
10 th
17.7
10 th
15.8
10 th
14.6
40 th
14.7
50 th
14.9
70 th
15.2
90 th
16.0
40 th
16.1
50 th
16.3
70 th
18.2
40 th
18.3
50 th
18.6
70 th
16.1
40 th
16.2
50 th
16.3
70 th
16.6
90 th
18.9
90 th
16.6
90 th
Average Posttest Score
14.5
16.4
18.4
Growth Percentile
32 nd 80 th 58 th 16.2
56 th This is the national average growth for a school with the same pretest scores and the same proportion of students in each grade.
This is the overall percentile, which is based on the difference between the school’s actual growth and the national average growth. This school would earn 4 points in the policy.
Note: The numbers in this example are based on fall-to-spring norms from CPS data. ACT has provided national spring-to-spring norms that were used in actual SQRP calculations.
43
EPAS Priority Group Growth
Definitions:
There are 4 possible priority group measures for each school – one for each of the following 4 priority groups: • English Language Learners (ELL) • Students with an IEP (does not include 504 plans) • • African-American students Hispanic students Each priority group must have at least 30 students for a growth percentile to be calculated.
Each priority group with at least 30 students will receive a priority group score which will account for 2.5% of the school’s rating. If a priority group has fewer than 30 students, the 2.5% weighting will be added to the school’s overall EPAS Growth Percentile metric.
Calculation
Each priority group will receive an EPAS Growth Percentile based on the methodology described in the “EPAS Growth Percentile” section. The priority group’s percentile will be based on a comparison of the average growth of the priority group to the average growth of a national school with the same pretest scores. Note: The national average comparison scores do not account for demographics, so the school’s priority groups will be compared to a national average for students with the same pretest scores, including students that are not in that priority group.
SQRP Scoring 1 point
Under 10 th
2 points
10 th to 29 th
3 points
30 th to 49 th
4 points
50 th to 69 th
5 points
70 th or above Percentile Office of Accountability 44
EPAS Attainment Percentile
Definitions:
Average Spring Composite score of students on the EPAS assessment series , compared to average national score. The school is assigned a percentile representing where the school would fall on the national distribution.
Calculation:
For each school, a national average comparison score will be calculated. This will be the mean of the national average scores at each grade level, weighted by the number of students in each grade level at the school. This comparison score will therefore represent a national average school with the same proportion of students at each grade level. The national average comparison score for each school represents a 50 th percentile school.
The school will receive a percentile score based on how far above or below the 50 th percentile it scored.
SQRP Scoring:
Percentile
1 point
Under 10 th
2 points
10 th to 39 th
3 points
40 th to 69 th
4 points
70 th to 89 th
5 points
90 th or above
Notes:
Students are assigned to schools based on “annualized” school, which is the school where the student was enrolled for the most time during the year. Does not include students with an IAA indicator in their IEP and students with an ACCESS Literacy score less than 3.5. Office of Accountability 45
Four-Year Graduation Rate
Definitions:
Percent of students who were first-time freshmen four years prior that have graduated.
Calculation:
Numerator:
Number of students in the 4-year cohort who have graduated, including students who have completed the requirements for graduation but remain enrolled under their IEP.
Denominator:
Number of students who were first-time freshmen in the school four years prior, excluding students with a non-dropout leave code or a verified out-of-district transfer.
SQRP Scoring
Grad Rate
1 point
Under 55%
2 points 3 points 4 points
55% to 64.9% 65% to 74.9% 75% to 84.9%
5 points
85% or above
Notes:
Unverified out-of-district transfers whose transfer took place in the last 150 calendar days of the most recent school year are excluded in this rate. Includes summer graduates.
Office of Accountability 46
Freshmen On-Track (FOT)
Definitions:
Percent of students earning 5 or more credits and failing no more than 1 semester core course during their 9 th year.
grade
Calculation:
Numerator:
Number of first-time freshmen meeting the above criteria.
Denominator:
Number of first-time freshmen enrolled at the school.
SQRP Scoring
FOT Rate
1 point
Under 60%
2 points 3 points 4 points
60% to 69.9% 70% to 79.9% 80% to 89.9%
5 points
90% or above
Notes:
Students are assigned to schools based on “annualized” school, which is the school where the student was enrolled for the most time during the year. Dropouts and unverified transfers are considered off-track. Measure only includes students who are in the 9 th grade for the first time. Students with no credits attempted in the first semester are excluded.
Office of Accountability 47
One-Year Dropout Rate
Definitions:
Percent of students in grades 9-12 dropping out during the year.
Calculation:
Numerator:
Number of students whose end-of-year status is a dropout status or who have transferred out of district and whose transfer has not been verified.
Denominator:
Number of students enrolled or who were last enrolled at the school excluding students with a non-dropout leave code or a verified out-of-district transfer.
SQRP Scoring 1 point
Over 8%
2 points
6.1% to 8%
3 points
4.1% to 6%
4 points
2.1% to 4%
5 points
2% or under Dropout Rate
Notes:
Students are assigned to the school where they were most recently enrolled. Unverified out-of-district transfers whose transfer took place in the last 150 calendar days of the school year are not counted as dropouts in this rate. The rate used in the SQRP excludes students who have previously dropped out in the previous 2 years.
Office of Accountability 48
Attendance Rate (Grades 9-12)
Definitions:
Average daily attendance rate of the school, adjusted for students with medically fragile conditions and early graduation for 8 th 12 th graders.
and
Calculation:
Numerator:
Total number of present days for students during the year.
Denominator:
Total number of membership days for students during the year.
For the SQRP rating only, students are removed from the calculation if they are homebound, “medically fragile” per their IEP, or in 8 th or 12 th grade subsequent to the first date on which CPS permits graduation. These adjustments will only be made if they improve the school’s attendance rate.
SQRP Scoring: 1 point 2 points 3 points 4 points 5 points
Attendance Rate Under 80% 80% to 84.9% 85% to 89.9% 90% to 94.9% 95% or above
Notes:
Students are attributed to each school in which they were enrolled, but only for the days in which they were enrolled in that school. Office of Accountability 49
Early College and Career Credentials
Definitions:
Percent of students graduating from the school with at least one credit from an approved early college course, a 3+ on an AP exam, a 4+ on an IB exam, or an approved career certification.
Calculation:
Numerator:
Number of students graduating from the school with one of the credentials listed above.
Denominator:
Number of students graduating from the school.
SQRP Scoring
Early College and Career Credentials
1 point
Under 10%
2 points 3 points 4 points
10% to 19.9% 20% to 29.9% 30% to 39.9%
5 points
40% or more
Notes:
The denominator includes all graduates in the most recent years, regardless of graduating class. Early college courses and career certifications will need to be pre-approved to count in the metric; schools will have the opportunity to view pre-approved courses or apply for approval for additional offerings. Students meeting multiple criteria are only counted once in the measure.
Office of Accountability 50
College Enrollment and Persistence
Definitions:
College Enrollment:
The percentage of students enrolled in college in the fall after graduation from high school.
College Persistence:
The percentage of students enrolled in college in the fall after graduation from high school that remain enrolled in college the following fall.
Calculation:
For college enrollment rate:
Numerator:
The number of students enrolled in a 2-year or 4-year college in the fall after graduating from high school, as determined by the National Student Clearinghouse.
Denominator:
The number of students graduating from the school in the prior year.
For college persistence rate:
Numerator:
The number of students enrolled in a 2-year or 4-year college in the fall after graduating from high school that remain enrolled in college in the following fall, as determined by the National Student Clearinghouse.
Denominator:
Number of students enrolled in a 2-year or 4-year college in the fall after graduating from high school.
SQRP Scoring:
College Enrollment Rate College Persistence Rate
1 point
Under 45% Under 55%
2 points
45% to 54.9% 55% to 64.9%
3 points
55% to 64.9% 65% to 74.9%
4 points
65% to 74.9% 75% to 84.9%
5 points
75% or above 85% or above Office of Accountability 51
5Essentials
Definitions:
Overall rating of the school on the 5 Essentials survey (My Voice, My School) administered in the Spring.
Calculation:
Ratings are calculated by the Consortium on Chicago School Research at the University of Chicago. The overall rating of the school is determined using data from all 5 essentials, or from whatever combination of essentials for which the school has sufficient data.
SQRP Scoring:
Overall Rating
1 point
Not Yet Organized for Improvement
2 points
Partially Organized for Improvement
3 points
Moderately Organized for Improvement
4 points 5 points
Organized for Improvement Well-Organized for Improvement
Notes
The school must have a minimum level of participation of 50% for the calculation of a rating. Office of Accountability 52
The 5 Essentials
The 5 Essentials are a diagnostic tool measuring schools’ strengths and weaknesses based on 20 years of research by CCSR. • • They help schools organize, prioritize, evaluate, and achieve sustainable improvement.
Surveys are administered in the Spring to 6-12 th grade students and all teachers.
Schools in Chicago that make progress on 3 of 5 of the Essentials are 10 times more likely to make substantial improvement than schools that do not.
The 5 Essentials Effective Leaders Collaborative Teachers Involved Families Description
The principal works with teachers to promote professional growth and school success Teachers collaborate to promote professional growth and school success The entire staff involves families and communities to advance student learning
Primary Responder Teachers Teachers Teachers Supportive Environment Ambitious Instruction
The school is safe, demanding and supportive Classes are challenging and engaging
Students Students
Office of Accountability 53
Data Quality Index
Definitions:
Data Quality Index (DQI) score, which is the percent of data quality indicators that are correct in CPS data systems. The DQI used in the SQRP will include a subset of the data quality sections reported on the Dashboard. DQI will be calculated at the end of the year before year end processing.
Calculation:
For each of the 4 categories of the DQI, the percent of errors is calculated as follows: Numerator: Number of outstanding data quality errors that need to be corrected for the category
Denominator: Total number of data quality checks performed for the category
The DQI scores used in the SQRP will be 100% minus this percentage.
The overall DQI score is calculated as a weighted average of the category percentages using the following weights:
DQI Category
Attendance Registration and Enrollment Student Contact Information Student Health
Weight
40% 40% 15% 5%
SQRP Scoring: 1 point 2 points
Under 85% 85% to 89.9%
3 points
90%-94.9%
4 points
95%-98.9%
5 points
99% or above Data Quality Index Office of Accountability 54
Option School Indicators
Office of Accountability 55
Average Student Growth Percentile
Definitions
Average Fall-to-Spring, Fall-to-Winter, or Winter-to-Spring growth percentile of students on the STAR reading and math assessments.
Calculation
For each school, an average student growth percentile will be calculated from available individual growth percentiles from Fall-to-Spring, Fall-to-Winter, or Winter-to-Spring windows. An average student growth percentile is calculated separately for reading and math.
Performance Policy Scoring
Percentile
1 point
Under 30 th
2 points
30 th to 39 th
3 points
40 th to 49 th
4 points
50 th to 59 th
5 points
Above 60 th
Notes
Student are counted once per subject. For example, if a student has Fall-to Spring growth, the student’s Fall-to-Winter and Winter-to-Spring percentiles are not used. Office of Accountability 56
Percent Meeting Student Growth Targets
Definition
Percentage of students with a growth percentile of 40 or higher on the STAR reading and math assessments.
Calculation
Numerator:
Number of students with a growth percentile of 40 or higher on the STAR assessment
Denominator:
Number of students with valid pretest and posttest scores on the STAR assessment This metric is calculated separately for reading and math.
Performance Policy Scoring
Percent
1 point
Under 35%
2 points
35% to 44.9%
3 points
45% to 54.9%
4 points
55% to 64.9%
5 points
65% or above
Notes
Student are counted once per subject. For example, if a student has Fall-to Spring growth, the student’s Fall-to-Winter and Winter-to-Spring percentiles are not used. Office of Accountability 57
One-Year Graduation Rate
Definitions:
Percent of graduation-eligible students who graduate by the end of the school year.
Calculation:
Numerator:
Number of graduation eligible students who graduate at any point during the school year
Denominator:
Number of students who, at the beginning of the school year or at the time of enrollment, have sufficient credits such that they could graduate by the end of the school year if they took a full course load.
Performance Policy Scoring
1-Yr Grad Rate
1 point
Under 60%
2 points 3 points 4 points
60% to 69.9% 70% to 79.9% 80% to 89.9%
5 points
90% or higher
Notes
Verified transfers are excluded from the calculation. The definition of “full course load” will be individualized per the program model.
Office of Accountability 58
Credit Attainment
Definitions:
Percent of students who earn the total credits possible during their time of enrollment
Calculation:
Numerator:
Number of students earning the total credits possible during their time of enrollment
Denominator:
Number of students receiving grades during their time of enrollment
Performance Policy Scoring 1 point
Under 40%
2 points 3 points 4 points
40% to 49.9% 50% to 59.9% 60% to 69.9%
5 points
70% or above Credit Attainment
Notes
Students who have not been enrolled long enough to earn credits are excluded. The total credits possible are individualized per the program model.
Office of Accountability 59
Annual Stabilization Rate
Definitions:
Percent of stable* students who are enrolled at the end of the school year, completed the program, or successfully transitioned to another CPS school.
Calculation:
Numerator:
Number of stable students who enrolled at any time during the year and are enrolled at the end of the year, complete the program, or successfully transition to another CPS school.
Denominator:
Number of stable students enrolled at any time during the year, excluding students with a non-dropout leave code or a verified transfer.
Performance Policy Scoring 1 point
Under 60%
2 points 3 points 4 points
60% to 69.9% 70% to 79.9% 80% to 89.9%
5 points
Over 90% Stabilization Rate
Notes:
* Stable refers to students who have accumulated at least 42.5 membership days. Unverified out-of-district transfers are counted as dropouts in this rate.
Office of Accountability 60
Attendance Rate
Definitions
Average daily attendance rate of the school.
Calculation
Numerator:
Total number of present days for students during the year.
Denominator:
Total number of membership days for students during the year.
Performance Policy Scoring
Attendance Rate
1 point
Under 60%
2 points 3 points 4 points
60% to 69.9% 70% to 79.9% 80% to 89.9%
5 points
90% or above
Notes
For the Performance Policy rating only, students are removed from the calculation if they are homebound, “medically fragile” per their IEP, or in 8 th or 12 th grade subsequent to the first date on which CPS permits graduation. These adjustments will only be made if they improve the school’s attendance rate.
Office of Accountability 61
Growth in Attendance Rate
Definitions
Percent of stable* students who show an improvement of at least 3 percentage points in their individual daily attendance rates at an Option School compared to their daily attendance rate in the previous school year.
Calculation
Numerator:
Number of stable students whose current year attendance rate at their school of enrollment is at least 3 percentage points greater than their average year-end attendance rate during the previous school year or who have maintained a 90% attendance rate in the current year
Denominator:
Number of stable students with documented current year attendance
Performance Policy Scoring 1 point
Under 60%
2 points
60% to 69.9%
3 points
70% to 79.9%
4 points
80% to 89.9%
5 points
90% or above Growth in Attendance
Notes
* Stable refers to students who have accumulated at least 42.5 membership days. Students without documented attendance from the previous school year who have at least 42.5 days of membership will be counted positively.
Office of Accountability 62