Transcript Report Cards and Student Centered Staging

September 12, 2013
Jonathan Wiens, PhD
Office of Assessment and Information Services
Oregon Department of Education
 Timeline
 Report Card Ratings Review
 Review of the new Report Cards
2
Sept 12
Report Card validation opens (English only)
Sept 12-23
Validation for Supplemental Data Collection
(Letters and Curriculum)
Spanish report card preview opens
Final preview of Report Cards and suppressed
Ratings Details
Media receives embargoed files
Public release of Report Card and Ratings
Sept 19
October 3
October 7
October 10
* - handouts and video for this and other trainings at:
https://district.ode.state.or.us/search/page/?id=226
3
New validation site – see the July 12 th video training at
https://district.ode.state.or.us/search/page/?id=226
for more details
 This is the new site that hosts Report Card Validations.
 Debuted on June 6
 Suggestions for improvement are welcome.
 ODE hosted a training on June 6, available at the
Video Training site:
https://District.ode.state.or.us/search/page/?ID=226
 Contact District Security Administrator
https://district.ode.state.or.us/apps/login/searchSA.aspx
 Permissions are set by validation type
5
If you do not see the application, contact your district security administrator.
6
• Validations tiles
• Latest validation information
• Status/Count down
• Open and All tabs
• Options Menu
7
“Details” report
provides the data
included in the
rating.
“Summary” is the
actual report card.
“Language” will
include Spanish
on September
19th.
Suppressed
details available
on October 3rd.
8
Overview -- See the July 12 th video training at
https://district.ode.state.or.us/search/page/?id=226
for more details
School ratings are rated based on 5 main factors:
 Achievement: percent met in reading and math
 Growth: individual student growth in reading and math
 Subgroup Growth: growth for historically underserved
subgroups*
 Graduation: cohort graduation rates
 Subgroup Graduation: graduation rates for historically
underserved subgroups*
* - Economically disadvantaged; Limited English Proficient; Students with disabilities;
and a combined American Indian/Alaska Native, Black, Hispanic, and Native
Hawaiian/Pacific Islander subgroup.
Categories are weighted according to the table below:
Category
Elementary and
Middle Schools
Combined
Schools (e.g., K12, 6-12)
High
Schools
Achievement
25%
20%
20%
Growth
50%
30%
20%
Subgroup Growth
25%
15%
10%
Graduation
25%
35%
Subgroup Graduation
10%
15%
 Schools receive a rating of Level 1 (lowest) to Level
5 (highest) and points in each of the categories
 The percentage of points earned for each indicator
are combined into an overall score and Level for
the school.
 Missing one or more participation targets lowers the
rating by one level.
 A “Level 1” in graduation means the school’s rating can
be no higher than Level 2.
Schools are given one of five rating Levels. These
levels can be described as follows:
 Level 5
The top 10% of all schools in the state
(5% of Title I schools)
 Level 4
Above average, generally meeting AMOs
 Level 3
Below average, but not in the lowest 15%
 Level 2
In the lowest 15% of schools
 Level 1
In the lowest 5% of schools in the state.
Final ratings were posted on August 22nd.
 (Almost) All schools receive a rating.
 New schools and small schools will not be rated.
 No new priority or focus schools.
 Schools identified last year remain priority or
focus schools for 2013-14 and beyond.
 There will be a new list of Model schools.
 Title I schools with a Level 5 rating
14
Detailed Review of Data Included
 As part of the ESEA Waiver Oregon committed to a




redesign of the school and district report cards.
A Report Card Steering Committee was appointed,
consisting of a diverse group of Oregon Stakeholders.
First meetings were in October 2012 and final
recommendations were given to ODE in April 2013.
Details posted at:
http://www.ode.state.or.us/search/page/?id=3881
State Board approved the redesign at its May
meeting.
16
Validation Notes
This front page will
only show during the
preview window. It
will not be included in
the public release.
It will contain
information pertinent
to each preview.
17
Report Card
Redesign
This is page one of the
Elementary school
prototype.
All prototypes are available
at:
http://www.ode.state.or.us
/search/page/?id=3881
18
 Provided to ODE via the Supplemental Data Collection.
 English and Spanish translations must be provided.
 Header data comes from our Institutions database.
 Please check that the website link is correct.
19
 Data comes from 3rd Period Cumulative ADM. Gives a “May 1”
snapshot of the school.
 English Learners – “Ever EL,” includes students reported as EL
since 2006-07 in Oregon. This definition is used everywhere,
except for high school outcomes.
 Students attending 90% or more days aligns to the “Not
Chronically Absent” measure on the Achievement Compacts.
20
 The Schools Report Card Rating is shown on the left
 Schools are placed in one of three positions within each level based on
their “Weighted Percent.”
 On the right, schools are identified as being in (approximately)
the top, middle or bottom third of comparison schools.
21
 Comparison schools are based on a combination of:
 Percentage of economically disadvantaged students
 Percentage of English learners (using ever-EL)
 Percentage of underserved races/ethnicities: American Indian/AK
Native, Black, Hispanic, and Pacific Islander
 Within school year mobility rates
 Each school has up to 20 comparison schools that are used
for all “Like-School” measures on the report card.
 Comparison school ratings indicate whether or not the
school’s “Weighed Percent” puts them in the top third,
middle third, or bottom third of its comparison schools.
 For other measures the students in the comparison
schools are pooled and the rate for the pooled group is
calculated.
22
 Rating on the left comes from the ratings detail sheets.
 Schools are placed in one of three positions within each level based
on their “Weighted Percent.”
 Comparison schools are determined using a combination of:
 Percent economically disadvantaged
 Percent English learners (using ever-EL)
 Percent underserved races/ethnicities: American Indian/AK Native, Black,
Hispanic, and Pacific Islander
 Within school year mobility
 Each school has up to 20 comparison schools that are used for
all “Like-School” measures on the report card.
 Comparison school ratings indicate whether or not the school’s
“Weighed Percent” puts them in the top third, middle third, or
bottom third of its comparison schools.
 For other measures the students in the comparison schools are
pooled and the rate for the pooled group is calculated.
23
Report Card
Redesign
This is page two of the
Elementary school
prototype.
High schools have
graduation data here.
All prototypes are available
at:
http://www.ode.state.or.us
/search/page/?id=3881
24
 Shows assessment performance for the last four years.
 Includes all students enrolled on May 1 that were full academic year.
Rules match those on the ratings details.
 School results are suppressed if fewer than 6 students, >95%
met/exceeded, or <5% met/exceeded.
 Participation rate won’t be checked on this first preview.
25
 Shows 2012-13 results for student subgroups.
 Includes students enrolled on May 1 for a full academic year.
 Includes comparison to the state.
• Most results will
match the ratings
details. However,
additional
subgroups are
present here.
• Important Note:
English Learners is
ever-EL here. On
the ratings details
it is current EL or
exited within the
previous two years.
26
 Includes completion and college/career
readiness indicators.
• Freshmen on track
submitted by
districts.
• SAT data is from
the College Board
(not yet available)
• Continuing
education is from
the National
Student
Clearinghouse
27
 Shows 2012-13 graduation/dropout indicators by subgroup.
 Students are EL for On Track, Graduation and Completion if
they were served or eligible at any time during high school. This
is the one place that “Ever EL” is not used.
• Includes Oregon
performance for
each subgroup, and
how the school
compares to the state
average for that
subgroup.
• State On Track
numbers not yet
available.
28
Curriculum &
Learning
Environment
This is page three of
the Elementary school
prototype.
High schools and
middle schools have
additional categories.
Priority, Focus, and
Model will have Title 1
information at the
bottom.
29
Detailed Review of Data Included
Validation Notes
This front page will
only show during the
preview window. It
will not be included in
the public release.
It will contain
information pertinent
to each preview.
31
District Report
Card Redesign
This is page one of the
district prototype.
All prototypes are available
at:
http://www.ode.state.or.us
/search/page/?id=3881
32
 Provided to ODE via the Supplemental Data
Collection.
 English and Spanish translations must be provided.
 Header data comes from our Institutions database.
33
 Data comes from 3rd Period Cumulative ADM. Gives a “May 1”
snapshot of the district.
• English Learners
–reported as EL
at any time in
Oregon (since
2006-07).
• Students
attending 90% or
more days aligns
to “Chronically
Absent” measure
on Achievement
Compacts.
• Student wellness
and racial equity
submitted by
districts.
34
Report Card
Redesign
Page two of the
district card is a
continuation of the
district profile on
page 1.
Expulsions data will
be on the preview.
All prototypes available
at:
http://www.ode.state.or.
us/search/page/?id=3881
35
 Shows assessment




performance for the last
four years.
Includes student enrolled
on May 1 that were full
academic year in the
district.
Data is broken down by
grade spans.
Includes Oregon and LikeDistrict values for 2012-13.
Participation rate won’t be
checked on the first
preview.
36
 Includes completion and college/career readiness
indicators. Matches the high school reports.
• Freshmen on track
submitted by
districts.
• SAT data is from the
College Board (not
yet available)
• Continuing
education is from the
National Student
Clearinghouse
• 2009-10 Completion
and Continuing
Education data is not
available.
37
 Shows 2012-13 graduation/dropout indicators by subgroup.
 Students are EL for On Track, Graduation and Completion if
they were served or eligible at any time during high school. This
is the one place that “Ever EL” is not used.
• Includes Oregon
performance for
each subgroup,
and how the
district compares
to the state
average for that
subgroup.
• State On Track
numbers not yet
available.
38
 Submitted in the supplemental data
collection.
Spanish must
also be
submitted.
39
 Shows the number of priority, focus, and
model schools in the district.
40
 Report Card Page:
http://www.ode.state.or.us/search/page/?id=3881
 Assessment Inclusion Rules
 Report Card Technical Manual
 District Training Site:
https://district.ode.state.or.us/search/page/?id=226
 ESEA Waiver: http://www.ode.state.or.us/go/nextgen
 Assessment Reporting Schedule:
http://www.ode.state.or.us/wma/teachlearn/testing/s
chedules/asmtreportsched1213.pdf
 Application Assistance: [email protected]
42
 ESD Partners:
http://www.ode.state.or.us/wma/teachlearn/testing/oaks/esdpa
rtners1213.pdf
 Report Card and RC Validations in general
 Jon Wiens: [email protected]
 Josh Rew: [email protected]
 Assessments
 Cindy Barrick: [email protected]
 School and District Profiles
 Isabell Jacoby: [email protected]
 Cumulative ADM
 Joy Blackwell: [email protected]
 Highly Qualified Teachers
 Anna Haley: [email protected]
43