Transcript High School Assessments - Capital Region ESD 113 / Overview

Smarter Balanced Assessments
2014-15
ESD 113 Superintendents
November 18, 2014
Robin Munson, Ph.D.
OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION
Division of Assessment and Student Information
OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION
A Balanced Assessment System
November 18, 2014 | Slide 2
Smarter Balanced Assessment System:
English Language Arts and Mathematics,
Grades 3–8 and High School
OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION
BEGINNING OF
YEAR
END
OF YEAR
Last 12 weeks of year*
DIGITAL CLEARINGHOUSE of formative tools, processes and exemplars; released items and tasks; model curriculum units; educator
training; professional development tools and resources; scorer training modules; and teacher collaboration tools.
INTERIM ASSESSMENT
Computer Adaptive
Assessment and
Performance Tasks
INTERIM ASSESSMENT
Computer Adaptive
Assessment and
Performance Tasks
PERFORMANCE
TASKS
• Reading
END OF YEAR
ADAPTIVE ASSESSMENT
• Writing
• Math
Scope, sequence, number, and timing of interim assessments locally determined
Optional Interim assessment
system—
Summative assessment
for accountability
* Last 7 weeks for Grade 11.
Source: http://www.ets.org
November 18, 2014 | Slide 3
OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION
Tests for Accountability
ELA
Math
Grade 3
Smarter
Smarter
Grade 4
Smarter
Smarter
Grade 5
Smarter
Smarter
Grade 6
Smarter
Smarter
Grade 7
Smarter
Smarter
Grade 8
Smarter
Smarter
Grade 10
Grade 11
Science
MSP
MSP
Biology EOC
Smarter
Smarter
November 18, 2014 | Slide 4
An Academic Check-up to Measure
College and Career Readiness
OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION




Writing at every grade
New question types and performance tasks that ask students
to demonstrate an array of research, writing, and problem
solving skills
Accessibility tools for all students and accommodations—such
as Braille—for those who need them
Developed with input from K-12 teachers, higher education
faculty, and other experts
November 18, 2014 | Slide 5
Smarter Balanced –
Preparing for New Test Scores
6
7/17/2015
2015 results will set a new baseline of
student performance in Washington
OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION



Some people are predicting that the spring 2015 test
results will see Washington students falling off a
“performance cliff”, with scores dropping.
But the new tests are
not comparable so we
should not compare
scores from one to the
other.
We have a new baseline!
November 18, 2014 | Slide 7
OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION
2015 results, cont’

Think of the standards and the assessment as a new
target with new results…. I envision two mountains:

People who successfully climb Mt Rainer (at 14,000 ft),
will find Mt McKinley (at 20,000 ft) more challenging.
Some will be able to meet the challenge, some will be
close and some who previously were able to summit
Rainier will not be able to summit McKinley at first.

November 18, 2014 | Slide 8
OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION
Preparing for New Test Scores

Smarter Balanced assessments measure the full range of the Common Core
State Standards. They are designed to let teachers and parents know whether
students are on track to be college- and career-ready by the time they
graduate.

Because the new standards set higher expectations for students--and the
new tests are designed to assess student performance against these higher
expectations--our definition of grade level performance is higher than it used
to be.

As a result, it’s likely that fewer students will meet grade level standards,
especially for the first few years. Results should improve as students have
additional years of instruction aligned to the new standards and become better
equipped to meet the challenges they present.

This does not mean that our students are “doing worse” than they did last year.
Rather, the scores represent a “new baseline” that provides a more
accurate indicator for educators, students, and parents as they work to
meet the rigorous demands of college and career readiness.
November 18, 2014 | Slide 9
OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION
Smarter Balanced Scale Scores
•
Scale scores on Smarter Balanced assessments
• Use a four digit number
• Range roughly from 2000-to-3000
•
Avoids confusion with other, commonly-used scales
such as: percentile ranks, percent correct, ACT,
SAT, Lexiles, etc.
•
Provides adequate “space” on the scale to see growth
in whole-number units
November 18, 2014 | Slide 10
OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION
Approved Initial Cut Scores - ELA
November 18, 2014 | Slide 11
OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION
Approved Initial Cut Scores - Math
November 18, 2014 | Slide 12
OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION
Consortium-wide Impact of Cut Scores
November 18, 2014 | Slide 13
OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION
Consortium-wide Impact of Cut Scores
November 18, 2014 | Slide 14
OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION
Percent of Field Test Sample That Met
Standard (Scored Level 3 or Level 4)
Grade
ELA
Math
3
38%
39%
4
41%
37%
5
44%
33%
6
41%
33%
7
38%
33%
8
41%
32%
11
41%
33%
November 18, 2014 | Slide 15
Smarter Balanced + Higher Ed
OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION


Washington has had unprecedented movement to use
mandatory high school tests in college placement
Agreement to provide access to credit bearing courses to
11th graders who score a 3 or 4 on the Smarter Balanced
ELA and math tests



Washington’s Community Colleges
Washington’s Baccalaureates
Recently announced - WACT will be using scores of 3 and
4 for Running Start placement
November 18, 2014 | Slide 16
What about Graduation?
OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

Legislature has given the State Board the option to set a
different cut score for graduation purposes

The ELA exit exam cut score will be determined from 10th
graders’ performance on the Smarter Balanced HS ELA test
(for classes of 2015-2018, at least).

Math EOC exit exam cut scores will be determined from this
year’s performance on new EOC tests (for classes of 20152018). Exit exam cut score on Smarter Balanced math may
also be set next summer – SBE discussion next month.
November 18, 2014 | Slide 17
College and Career Ready Cut Scores vs
High School Graduation Cut Scores
OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

From Draft Position Statement:

As directed by the Legislature, with the assistance of the
Superintendent of Public Instruction, the Board hereby intends
to adopt a performance level requirement for high school
graduation that is statistically equivalent to the current high
school minimum proficiency standard, and intends to
periodically review this standard over time.
November 18, 2014 | Slide 18
Equal Impact
OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

Equal impact cut scores would yield the same “passing”
rates on the new tests as the former tests




Reading, Writing or a combination?
2014 or average of past three years?
10th grade pass rates or 11th grade after retakes?
Higher cut scores over time?
November 18, 2014 | Slide 19
OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION
Achievement Levels

Level 2 instead of Level 3

New ALD for meeting High School graduation standards
November 18, 2014 | Slide 20
Policy Achievement Level Descriptors
OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION




The Level 4 student demonstrates thorough understanding of and ability to
apply the English language arts and literacy (mathematics) knowledge and skills
needed for success in college and careers, as specified in the Common Core State
Standards.
The Level 3 student demonstrates adequate understanding of and ability to
apply the English language arts and literacy (mathematics) knowledge and skills
needed for success in college and careers, as specified in the Common Core State
Standards.
The Level 2 student demonstrates partial understanding of and ability to
apply the English language arts and literacy (mathematics) knowledge and skills
needed for success in college and careers, as specified in the Common Core State
Standards.
The Level 1 student demonstrates minimal understanding of and ability to
apply the English language arts and literacy (mathematics) knowledge and skills
needed for success in college and careers, as specified in the Common Core State
Standards.
November 18, 2014 | Slide 21
Digital Library
Educator resources for
formative assessment practices
to improve instruction
22
Nov 18, 2014
Digital Library
Available Now
OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION
•
•
An online collection of resources
aligned to the Common Core that
will support K-12 teachers’ use of
the formative assessment
process
• Assessment literacy modules
• Exemplar instructional
modules
• Education resources
submitted and vetted by
teachers
Teachers can rate materials and
share their expertise with
educators across the country
November 18, 2014 | Slide 23
Digital Library

Access
OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION


District Assessment Coordinators (DACs), or their designees,
should enroll instructional and support staff who work
directly with students in their districts.
Functionality

The Digital Library offers professional learning resources and
instructional materials—like lesson plans, units, and learning
modules—for educators to use daily with students and staff.
Resources span K-12 and are aligned to Washington State
Learning Standards for English language arts and mathematics.
Resources are also aligned to formative assessment practices.
November 18, 2014 | Slide 24
Interim Assessments
25
November 18, 2014
Interim Assessments
Available Beginning Winter 2014-15
OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION
•
Optional assessments administered in grades 3-8 and high
school
•
•
•
At the high school level, the assessments are consistent with the
grade 11 summative design and may be administered in grades
9, 10, 11, and/or 12.
Allow schools to check in on student progress and provide
information to inform instruction
Flexible administration options
•
•
Interim Comprehensive Assessments use the same design
as the summative assessments, assess the same range of
standards, and provide scores on the same scale.
Interim Assessment Blocks focus on smaller sets of related
standards and provide more detailed information for
instructional purposes.
November 18, 2014 | Slide 26
Interim Assessment Design Principles
OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION








Administered through the same system as Summative
Items drawn from same pool as Summative; full array of
item types
Can be administered at various points in the year
Optional for districts
Online administration
Adhere to Usability, Accessibility, and Accommodations
Guidelines
Adaptive as appropriate (2015-16)
Not intended for accountability decisions
November 18, 2014 | Slide 27
OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION
Interim Assessment Components
Interim
Assessment
Interim
Comprehensive
Assessment (ICA)
Interim Assessment
Blocks
(IAB)
November 18, 2014 | Slide 28
Interim Assessments Timeline
OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION


Interim Assessments will be available Jan 6th

Jan 6th – Comprehensive Interim

Jan 27th – Interim Assessment Blocks
Initial release will include fixed forms; adaptive forms will
be available as the item pool allows
November 18, 2014 | Slide 29
Interim Assessment User Interface,
Scoring and Reporting
OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION


User interface
 Details for accessing items are not yet determined. Interim
test engine is still in development.
Scoring
 Interim assessments will have various item types, most of
which will be machine scored
 Hand scoring will be a local (school/classroom)
responsibility
 Rubrics and training will be provided online as part of the
system
November 18, 2014 | Slide 30
Interim Assessment User Interface,
Scoring and Reporting, continued
OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

Reporting

Interim Comprehensive Assessment (ICA)



Overall composite scale score

Achievement levels

Claim level information
Interim Assessment Blocks (IABs)


Report same information as Summative Assessment
Report information consistent with claim level information
Item level reporting is a future feature (not on current work
plan)
November 18, 2014 | Slide 31
Summative Assessments
32
November 18, 2014
Summative Assessments
Available Spring 2015
OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION
•
•
•
English and math assessments administered in grades 3-8
and 11 toward the end of the school year
Students will complete a computer adaptive test and
performance task in each subject area
Students will receive composite scores for each subject area
and the following claim-level scores:
•
•
English language arts-reading, writing, listening, and research;
Math-concepts and procedures, problem solving and
modeling/data analysis, and communicating reasoning
November 18, 2014 | Slide 33
OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION
WCAP Portal – Opens December 5, 2014
November 18, 2014 | Slide 34
Portal Resources

Administration Resources
OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION






Webinars for District Assessment Coordinators (OSPI/AIR)
Usability, Accessibility, and Accommodations Guidelines
Field Test Report – A report summarizing high-level findings
from surveys conducted by 13 Smarter Balanced member
states
Test Administrator Manual – Coming soon
Classroom Activities Administration Guidelines
Test Administrator course

How to:
 Start and administer tests
 Approve students for testing
 Monitor a test session
November 18, 2014 | Slide 35
Portal Resources

Smarter Balanced training modules (some customized for
OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION
MAAC/OSPI)









What is a CAT?
Technology Requirements for Online Testing
Performance Tasks Overview
Student Interface for Online Testing
Accessibility and Accommodations
Universal Tools
Tech Readiness
Test Administrator (TA) Interface
Test Administration Training
November 18, 2014 | Slide 36
Portal Resources

Classroom supports
OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION





Test Blueprints
Achievement Level Descriptors
Classroom Activities
Scoring Guides
Performance Task Writing Rubrics
November 18, 2014 | Slide 37
Portal Resources

Communication Tools
OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION






Updated Teacher Factsheet – This updated factsheet outlines
what the assessments mean for teachers
Educator Communications Toolkit and the School-District
Leaders Toolkit
Adaptive Algorithm Fact Sheet – A factsheet on how computer
adaptive testing works
Infographics - A new infographic that describes the roll-out of
the full Smarter Balanced assessment system in 2014-15
PIE Assessment Messaging Tools – The PIE Network developed
this series of one-pagers on how to address some of the
common concerns raised about testing
Standard Setting materials when available – Coming soon
November 18, 2014 | Slide 38
Summative Assessments – Paper/Pencil
OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

Smarter Balanced 3–8 and 11 paper/pencil tests will cost
$6.00 per test per content area ($12.00 per student if using
paper for both ELA and Math).



Additional costs do not apply to Braille, MSP science Grades 5
and 8, HSPEs, Off Grade Level tests, EOCs, or Grade 10 ELA.
Selection of paper/pencil is at a school by grade by content area
(e.g., a school selects online except for 5th grade math).
Print-on-demand tests required for visually impaired
students (documented on the Individualized Education
Program), are available through the Smarter Balanced testing
engine at no cost to districts.
November 18, 2014 | Slide 39
High School Assessments
40
November 18, 2014
HS Tests for School and District
Accountability (95% participation required)
OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION
Grade
ELA
Math
Science
Grade 9
Grade 10
Grade 11
Biology
EOC
Smarter
Balanced
Smarter
Balanced
(College and Career
Ready cut score)
(College and Career
Ready cut score)
November 18, 2014 | Slide 41
Spring 2015 - HS Tests for Assessment
Graduation Requirements (access required)
OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION
Grade
ELA
Math
Science
EOC exit exams
Biology EOC
EOC retake if
needed
or
Smarter Balanced
(exit exam cut
score)
EOC retake if
needed
Grade 9
(Class of 2018)
Grade 10
(Class of 2017)
Grade 11
(Class of 2016)
Grade 12
(Class of 2015)
Smarter Balanced
(exit exam cut score)
Smarter Balanced
(exit exam cut score)
or
HSPE retake if needed
HSPE retake if needed
November 18, 2014 | Slide 42
High School Tests for Spring 2015
(accountability and exit exams combined)
OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION
ELA
Math
Science
EOC exit exams
Biology EOC
(paper)
(paper)
Grade 9
(Class of 2018)
Grade 10
(Class of 2017)
Grade 11
(Class of 2016)
Grade 12
(Class of 2015)
Smarter Balanced
(online or paper)
Smarter Balanced
Smarter Balanced
(online or paper)
(online or paper)
HSPE retake if
needed
EOC retake if
needed
(paper)
(paper)
HSPE retake if
needed
EOC retake if
needed
EOC retake if
needed
(paper)
(paper)
(paper)
EOC retake if
needed
(paper)
November 18, 2014 | Slide 43
ELA Exit Exam – more detail
OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION




WA’s ELA Exit Exam will now be available online –
administration within last 12 weeks of school (but no
later than June 15). Previously expected to be
paper/pencil only.
Fixed form paper/pencil can be used (at no cost) –
administered last three weeks of school but no later than
May 30.
Only online test will be Computer Adaptive.
If a student meets or exceeds the College and Career
Ready cut score in 10th grade, we will bank their score so
they won’t need to be tested in 11th grade.
November 18, 2014 | Slide 44
Assessment Menu - Science
OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION
General Assessments
Biology EOC Exam (until
new NGSS comprehensive
exam is developed)

Alternatives


Collection of Evidence
College Entrance Scores





ACT, IB, AP
Out of State Tests
Grades Comparison
Recent Transfer Waiver
Special Education
Alternatives
November 18, 2014 | Slide 45
College Entrance Exams
The State Board just approved the ACT
Science score of 16 for Biology EOC
 Comparison to other College Entrance Exam
cut-scores:
OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

FOR REFERENCE
Algebra 1/Integrated Math 1
16
Geometry/Integrated Math 2
17
Reading
13
Writing
15
Science
16
November 18, 2014 | Slide 46
Superintendent Dorn’s legislative
proposals related to assessments
OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

Plan A: Eliminate assessment graduation requirements




Use Common Core and Next Generation Science Standards
to prepare students for college and career.
Use Smarter Balanced assessments in grades 3-8 and 11 to
signal if students, teachers and systems are on track for
graduating students college and career ready.
Use the 11th grade tests as a “Green,Yellow, Red” indicator of
services/instruction needed in senior year.
Switch resources used for testing retakes and alternatives for
passing exit exams on direct instruction and preparation of
students.
November 18, 2014 | Slide 47
Superintendent Dorn’s proposals
OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

Plan B: Update and streamline options to fulfill assessment
graduation requirements
 Collection of Evidence in Math – reduce to just Year 1 math
(eliminate Geometry COE)
 Out of state test – must be test used for accountability or exit
exam in the other state
 Grades Comparison in Alg 1, Int 1, Geometry or Int 2 –
eliminate minimum GPA for access to this alternative
 Additional HS Credit (1.0) in content area – add this new
alternative
 College Credit in content area – add this new alternative
 Transfer Waiver – change date of transfer to January 1 of senior
year (from March 1)
November 18, 2014 | Slide 48
OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION
Thank you!
November 18, 2014 | Slide 49
Online Practice and Training Tests
•
•
•
•
ELA/literacy and mathematics, grades 3-8 and 11
– www.smarterbalanced.org/practice-test
Students can practice
using the software
Scoring guides
Accommodations
– Text-to-speech
– Braille
– Pop-up Spanish glossary
(mathematics only)
Sample Questions
•
•
More than multiplechoice
– Constructed response
(writing)
– Performance tasks
– Interactive questions
Allow students to
demonstrate critical
thinking and realworld problem solving.
4th grade math question
Technology-Enhanced Item (High School)
Short–Text Item (Grade 11)
Smarter Balanced
Learn More and Stay Connected
Resources for Schools
•
Technology
– Technology Strategy Framework, bandwidth test, and readiness
calculator
http://www.smarterbalanced.org/smarter-balanced-assessments/technology/
– Test-taking devices and approved browsers
•
http://www.smarterbalanced.org/test-taking-devices-approved-secure-browsers/
Accessibility and Accommodations
– Usability, Accessibility, and Accommodations Guidelines, ISAAP
tool, assistive technology typology, and other resources
•
http://www.smarterbalanced.org/parents-students/support-for-under-representedstudents/
Digital Library
– Video tours and presentations
http://www.smarterbalanced.org/k-12-education/teachers/
Resources for Teachers
•
Smarter Balanced factsheet for teachers
http://www.smarterbalanced.org/wordpress/wpcontent/uploads/2012/02/Smarter-BalancedTeachers.pdf
•
Teaching Channel – Videos of teachers demonstrating
their best educational practices aligned to the CCSS
https://www.teachingchannel.org/videos?page=1&categ
ories=organizations_national,topics_commoncore&load=1
•
Student Achievement Partners – Common Core
videos and teacher testimonials
http://achievethecore.org/page/762/introductory-videoson-the-common-core-state-standards
•
Council of the Great City Schools Training Videos
•
•
ELA/literacy
http://www.commoncoreworks.org/domain/127
Mathematics
http://www.commoncoreworks.org/Page/345
Resources for Parents
•
•
Smarter Balanced factsheet for parents
•
http://www.smarterbalanced.org/wordpress/w
p-content/uploads/2012/03/SmarterBalanced-Parents-Factsheet.pdf
Council of the Great City Schools
•
•
Common Core Video
http://www.commoncoreworks.org/domain/157
Parent Roadmaps
http://www.commoncoreworks.org/domain/114
http://www.commoncoreworks.org/domain/149
•
PTA
•
•
Parents’ Guide to Student Success
http://pta.org/parents/content.cfm?ItemNumbe
r=2583
State Assessment Guides
http://www.pta.org/advocacy/content.cfm?Ite
mNumber=3816
Learn More
SmarterBalanced.org
Resources in Spanish
http://www.smarterbalanced.org/parents-students/como-ayudar-atodos-los-estudiantes-a-que-tengan-exito/
Stay Connected
Sign up for Smarter News
SmarterBalanced.org/stay-connected
Get instant updates
Twitter.com/SmarterBalanced