Transcript Document

Transition to Smarter Balanced
Assessments in Washington
ESD 113
March 26, 2013
Robin G. Munson, Ph.D.
Asst. Supt., Assessment & Student Information
OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION
Division of Assessment and Student Information
Smarter Balanced – Who and When?

OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

OSPI staff involved in workgroups 2010-2014
WA teachers involved 2011-2014









Item and stimulus writing and review
Alignment Study
Achievement Level Descriptors
Populating Digital Library
Pilot test in spring 2013 (5%)
Practice Tests widely available in May 2013
Comprehensive summative field test in 2013-14 (35%)
State Networks of Educators began vetting resources to populate the
library in Fall 2013
All components of Smarter Balanced operational in 2014-15



Digital Library “Soft Launch” in late Spring 2014; fully functional Fall 2014
Interim assessments available late fall 2014
Summative assessments administered in spring 2015
03/26/2014 Slide 2
Not your father’s statewide assessment

OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION








Aligned with new state standards
Balanced assessment system (summative and interim
assessment and formative resources)
Supporting teachers with a practical suite of resources
Broader access to assessment through translations, supports
and accommodations
Better measurement through computer adaptive testing and
performance tasks
Articulated across grades
Washington teachers are contributing to development
Comparable with other states
Less expensive
03/26/2014 Slide 3
Current Activities & Timeline
OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

Field test began yesterday





3/26/2014
35% of Wa students participating (~200,000)
22 states and territories
Delay of one week caused loss of 1% of students, in schools
that simply could not reschedule
OSPI is passing along resources and guidance as it is provided –
webinar series, communications with District Assessment
Coordinators
Consortium and OSPI interested in feedback
03/26/2014 Slide 4
Why Field Test?
OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION
Dry Run
Field Tests
Item Data


Operational
Tests
Although this is a field test, we must have valid responses
to shape our future tests.
Accurate item data will determine difficulty, bias and
sensitivity, whether items are kept, and ultimately the cut
scores (or what score is needed to meet standard).
3/26/2014
03/26/2014 Slide 5
Administration Window for Next Year
OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION


The 2015 summative operational assessment
windows/dates are still being discussed…
The complexities include:

Per Smarter Balanced Consortium:



3/26/2014
High schools need to test on Smarter Balanced w/in final 7 weeks of
school
Grades 3-8 test in final 12 weeks of school
In Washington:


Grade 3 results must be returned in time for principals to meet with
parents before the end of the year
High school exit exams need to be scheduled as well (ELA for 10th
and EOC in math and biology) - these will be paper/pencil
03/26/2014 Slide 6
Testing Times
for Summative Assessment
Test
English
Language
Arts/
Literacy
Math
Grades
CAT
Performance Task
In-Class
Activity
Total
Current
Testing Time
3-5
1:30
2:00
:30
4:00
1:30 (gr 3&5)
5:30 (gr 4)
6-8
1:30
2:00
:30
4:00
1:50 (gr 6&8)
5:50 (gr 7)
11
2:00
2:00
:30
4:30
6:00 (HS)
3-5
1:30
1:00
:30
3:00
1:30
6-8
2:00
1:00
:30
3:30
1:50
11
2:00
1:30
:30
4:00
4:00
The testing window is the final 12 weeks of the academic year for
grades 3-8 and final 7 weeks for HS.
Interim Assessment Design Principles
•
•
•
•
•
•
•
•
•
Online administration
Adaptive as appropriate
Adhere to Usability, Accessibility, and Accommodations
Guidelines
Items drawn from same pool as Summative
Full array of item types
Hand-scoring
– Content appropriate
– Scored locally: state or district responsibility
Administered through the same system as Summative
Can be administered at various points in the year
Not intended for accountability decisions
Interim Assessment Components
Interim
Assessment
Interim
Comprehensive
Assessment (ICA)
Interim Assessment
Blocks
(IAB)
Interim Comprehensive Assessments
(ICA): Sample Use Cases
•
•
Mid-year (e.g., February), a teacher might want to know
how students are doing in preparation for the
summative test, to better know what areas to focus
more efforts/attention on.
Beginning of the year, students entered a class from
another state, and the teacher did not have data for
them. A teacher decides to give these students the
previous year’s ICA to complete the data for the class.
Interim Assessment Blocks (IABs)
Sample Use Cases
•
•
A teacher is providing focused instruction on persuasive
writing. Teacher could use a block focused on
persuasive writing to determine degree of students’
understanding before or after the instruction.
An 8th grade math team, in a coordinated fashion, want
to be informed about how their students are doing in
geometry.
IABs for ELA
Current Thinking on Coverage
Proposed Interim Assessment Blocks (IAB)
1
Read Literary Texts
2
Read Informational/Explanatory Texts
3
Write Brief Narrative Text
4
Narrative Performance Task
5
Write Brief Informational/Explanatory Texts
6
Informational Performance Task
7
Write Brief Opinion** Texts
8
Opinion** Performance Task
9
Revise/Edit (across Narrative, Informational/Explanatory, and Opinion texts)
10
Listen/Interpret
11*
Speaking
12
Research
*Placeholder until items are developed
**”Opinion” is “Argumentative” for grades 6-8 and 11
IABs for math
Current Thinking on Coverage
Proposed Interim Assessment Blocks (IAB)
Grades 3-5
1
Operations and Algebraic Thinking
2
Numbers and Operations in Base Ten
3
Fractions
4
Geometry
5
Measurement
Proposed Interim Assessment Blocks (IAB)
Grades 6-7
1
Ratios and Proportional Relationships
2
Number System
3
Expressions and Equations
4
Geometry
5
Statistics and Probability
Proposed Interim Assessment Blocks (IAB)
Grade 8
1
Expressions and Equations - I
2
Expressions and Equations - II
3
Functions
4
Geometry
IABs for math
Current Thinking on Coverage
1
2
3
4
5
6
7
8
9
10
11
12
13
14
Proposed Interim Assessment Blocks (IAB)
High School
Algebra and Functions
Linear Functions
Quadratics
Exponentials
Polynomials
Radicals
Rationals
Trigonometric
Geometry
Transformations
Right Triangle Ratios
Three-Dimensional Geometry
Proofs
Circles
Applications
Other
Statistics and Probability
Interim Assessments
OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

A letter will soon be sent to districts with schools who
are in Priority, Focus or Emerging status:


Smarter Balanced interims will replace Reading Benchmark and
Math Benchmark assessments (RBAs and MBAs)
Districts will have local discretion for appropriate interims for
grades K-2 (WaKIDS can be used in kindergarten)
03/26/2014 Slide 15
A Balanced Assessment System
Needs a Digital Library
Summative
assessments
Benchmarked to college
and career readiness
Common
Core State
Standards
specify
K-12
expectations
for college
and career
readiness
Teachers and
schools have
information and
tools they need
to improve
teaching and
learning
Educator resources for
formative assessment
practices
to improve instruction
Digital Library Basics, 2-26-14
Interim assessments
Flexible, open, used
for actionable
feedback
All students
leave
high school
college
and career
ready
Smarter Balanced Digital Library:
Formative Assessment Practices and
Professional Learning – educator involvement
National Advisory
Panel (NAP)
State Leadership
Team (SLT)
State Network of
Educators (SNE)
• 11-20 experts
• Began December 2012
• Provides policies and
criteria for resources
• 10-14 WA members
• Provides support and
training for State
Network of Educators
• Promote statewide
communications
• 85 WA Members (1,500+
nationally)
• Representation from
LEAs, AEAs, content
leaders, ELL, IHE
• Serve Summer 2013 –
Late Fall 2014
• Submit and review
resources
Digital Library Basics, 2-26-14
•
Digital Library Basics
One Stop:
• Accessed through a single sign-on with user permission levels
• Educators have access to all of the instructional and professional learning
resources for each grade band (Grades K-2, 3-5, 6-8, 9-12)
• There will be resources that educators can share or use with students and families,
but students and families will not be able to access materials directly.
– It WILL NOT be a “bank” of formative assessment items alone. All resources will
have the formative assessment process embedded within them.
•
•
All submitted materials will be vetted through a Quality Criteria Review Process
by SNEs across the nation.
• Each resource will be reviewed and rated by at least 3 SNEs
• If they do not meet the quality criteria, resources will not be included in the library
Functionality
• The applications uses state-of-the art tagging and search features so that
educators will be able to:
 Quickly find resources by CCSS, formative assessment process attributes, etc.
 View and download resources
 Rate resources
 Use social networking features to collaborate with other educators across
the Consortium by posting questions and sharing their knowledge.
Digital Library Basics, 2-26-14
Resources in the Digital Library
Assessment
Literacy Modules
Exemplar
Instructional Modules
• Commissioned professional development modules
• Resources for students and families
• Frame formative assessment within a balanced assessment system
• Articulate the formative assessment process
• Highlight formative assessment practices and tools
• Commissioned professional development modules
• Instructional materials for educators
• Instructional materials for students
• Demonstrate/support effective implementation of the formative process
• Focus on key content and practice from the Common Core State
Standards for Mathematics and English Language Arts
• High-quality vetted instructional resources and tools for educators
• High-quality vetted resources and tools for students and families
Education Resources
* Resources include the following file types: Video, HTML5,
Audio, PPT, Excel, Word, and PDF.
• Reflect and support the formative process
• Reflect and support the Common Core State Standards for Mathematics
and English Language Arts
• Create Professional Learning Communities
Digital Library Basics, 2-26-14
Resources in the Digital Library
Assessment
Literacy Modules
Exemplar
Instructional Modules
Education Resources
* Resources include the following file types: Video, HTML5,
Audio, PPT, Excel, Word, and PDF.
•
Not an assessment bank
•
Not an item bank
•
Not a learning management
system where educators can
register for training or receive
credit by completing specific
online courses
•
Not a library for general public
(will require registration and
login)
•
Not a site where any resource
can automatically be posted; all
resources must be vetted
through the Quality Criteria
Digital Library Basics, 2-26-14
Grounded in this Definition of
Formative Assessment Process
•
Formative Assessment is a deliberate process
used by teachers and students during
instruction that provides actionable feedback
that is used to adjust ongoing teaching and
learning strategies to improve students’
attainment of curricular learning targets/goals.
~ Compiled by the Digital Library National Advisory Panel
Digital Library Basics, 2-26-14
SNE Resource Recommendation Options
•
•
•
•
Recommend with distinction
Recommend
Recommend with revisions
Do not recommend
Digital Library Basics, 2-26-14
Do not
recommend
Resource Posting Work Flow
Step 1:
Resource
Submitted
Step 2:
Gatekeeping
Criteria
Applied
Step 3:
Quality
Criteria
Applied
Step 4:
Decision
Posted
Cover
Profile
SNE
1
SNE
1
Sent to SLT
SNE
2
Returned to Submitter
SNE
3
Digital Library Basics, 2-26-14
Scores and reports
OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

Four Achievement Levels

Level 3 indicates College Career Readiness (Gr 11) or
Adequate Progress to that goal (Gr 3-8)

Preliminary Achievement Levels (cut scores) set by state
schools chiefs in Sept. 2014

Revisited and revised (as necessary) in 2015

Washington’s State Board might set different cut scores
for fulfilling graduation requirements
03/26/2014 Slide 24
Individual Score Reports for
Grades 3-8 and 11
Overall
Claim for
3-8
Student
Scores
forGrades
ELA/Literacy
Student Scores for Mathematics
Overall ELA/Literacy Score
Overall Mathematics Score
Reading
Concepts & Procedures
Writing
Problem Solving/Modeling &
Data Analysis
Listening
Communicating Reasoning
Research/Inquiry
25
What will this cost?
OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

Smarter Balanced tests will cost the state about $30 per
student


Includes both ELA and math
Includes digital library and interim assessments

Current Reading, Writing, and Math tests are about $30
per test, or $60-$90 per student

It will cost another $20 per student for state developed
exit exams
03/26/2014 Slide 26
What about privacy of student data?
OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION





Each state will have control of
student assessment data
Smarter Balanced consortium
will not share identifiable records
US Department of Education does not collect individual
student records
Family Educational Rights and Privacy Act (FERPA)
precludes districts, states, contractors, etc. from disclosing
identifiable student data without parent permission –
except under specific conditions
National PTA has nice handout on student data privacy
03/26/2014 Slide 27
Resources For You!


For the latest news and developments on
Smarter Balanced in Washington:
http://www.k12.wa.us/smarter/default.aspx
Materials for administration, as well as
communication templates for parents and
community: http://sbac.portal.airast.org/fieldtest/resources/

For questions about Smarter Balanced or the
assessment system transitions, contact:
[email protected] 360-725-6348
OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION
Happy Field Testing!!!!!
03/26/2014 Slide 29