Transcript Gina KoencyCalifornia Department of Education (CDE) Senior

Accessing and Using the
Smarter Balanced Interim
Assessment Reporting System
Gina Koency
California Department of Education (CDE)
Senior Assessment Fellow
Yoon Byun
Educational Testing Service
March 2015
CALIFORNIA DEPARTMENT OF EDUCATION
Tom Torlakson, State Superintendent of Public Instruction
Presentation Purpose
TOM TORLAKSON
State Superintendent
of Public Instruction
Familiarize LEA CAASPP coordinators and
others with the following aspects of the
Interim Assessment (IA) Reporting System:
• The results and reports available in the IA
Reporting System
• Navigating results and reports available in
the IA Reporting System
• Using tools and resources in the IA
Reporting System to view displays and
download/export data
Presentation Topics
TOM TORLAKSON
State Superintendent
of Public Instruction
• Background Information (Purpose, Types,
Security, Scoring)
• IA Reporting System Login and Features
• “List of Students” Display
• Individual Student Reports
• Download/Export Data Files
• Interpreting Interim Assessment Results
• Using Interim Assessment Results
• Contact Information
Interim Assessment
Purpose
TOM TORLAKSON
State Superintendent
of Public Instruction
• Designed to support educators during
teaching and student learning throughout
the year
‒ Measures of early and midyear progress
‒ Identification of specific areas of strength
and weakness
• Uses are locally determined
Interim Assessment
Types
TOM TORLAKSON
State Superintendent
of Public Instruction
• Interim comprehensive assessments
(ICAs)
– Assess the same claims and standards
as the summative assessments
• Interim assessment blocks (IABs)
– Assess smaller sets of targets or
specific areas
– Allows for flexibility by selecting blocks
aligned with instruction
Interim Assessment
Scoring
TOM TORLAKSON
State Superintendent
of Public Instruction
• Most items are scored by the Smarter Balanced
test delivery engine.
• Hand scoring of constructed-response items and
performance tasks is a local responsibility.
• Reports are generated only after the constructedresponse item scores and performance task scores
are input into the Interim Assessment Hand
Scoring System (IAHSS).
• Scoring is supported by training guides, rubrics,
exemplars (i.e., anchor papers), and practice
papers in the IAHSS.
Interim Blocks Not Requiring
Local Hand Scoring in 2014–15
TOM TORLAKSON
State Superintendent
of Public Instruction
The following IABs are fully machine
scored:
• English language arts/literacy
(ELA/literacy), all grade levels:
– Edit/Revise
– Listen/Interpret
– Research
• Mathematics, all grade levels:
– All non-performance task blocks
IA Reporting System
Login
TOM TORLAKSON
State Superintendent
of Public Instruction
• Go to http://caaspp.org.
• Select “Interim Assessment Reporting
System” button.
• Use Smarter Balanced Digital Library
login (user LEA e-mail and password).
Important Note! LEAs will use a
different reporting system to access
summative assessment results once
they are available.
IA Reporting System
Login
TOM TORLAKSON
State Superintendent
of Public Instruction
IA Reporting System Home Page
Search
TOM TORLAKSON
State Superintendent
of Public Instruction
List of
Districts
IA Reporting System
Features
TOM TORLAKSON
State Superintendent
of Public Instruction
• By design, the IA Reporting System includes:
‒ “List of Students” display
‒ Interim assessment student reports
• Reports are available:
‒ Within 24 hours after student completes an
IAB with no local hand scoring requirement.
‒ Within 24 hours after any required local
hand scoring is completed.
IA Reporting System
Features
TOM TORLAKSON
State Superintendent
of Public Instruction
• Results for current year are available.
• Results exportable as a text-based file.
• IA student reports downloadable and
printable in batch PDFs (updated nightly).
• Results for students who move within
schools in an LEA.
• If a student moves to a new LEA, the
student’s new LEA would need to contact
the previous LEA for any prior results for
that student.
IA Reporting System
User Access
TOM TORLAKSON
State Superintendent
of Public Instruction
LEA CAASPP Coordinator can:
• Assign additional LEA user roles (i.e., site
coordinators, TAs) access to the IA Reporting
System.
Important Note! Anyone with access to the IA
Reporting System will have access to student
Personally Identifiable Information (PII).
• View list of students or individual student ICA or
IAB results by school, grade, or individual
student.
• Export data file for all students within the LEA
who have interim assessment results.
IA Reporting System
Results
TOM TORLAKSON
State Superintendent
of Public Instruction
ICAs and the IABs provide individual student
results that educators can examine in relation
to the standards to adjust instruction.
• ICA: Overall scale score (i.e., 2000 to
3000); Achievement Level (Level 1, 2, 3, or
4); and Claim level (Below, At/Near, or
Above Standard)
• IAB: Level of Below, At/Near, or Above
Standard for each Block (No overall score
and no achievement level for IAB.)
“List of Students” Display
TOM TORLAKSON
State Superintendent
of Public Instruction
Presents the following information listed by
individual student name:
• Individual results for students within grade or
subgroup.
• Overall scores, achievement levels, and
errors bands for individual student
performance (ICA only).
• Overall individual student performance by
claim (ICA) or block (IAB).
ICA − List of Students
TOM TORLAKSON
State Superintendent
of Public Instruction
IAB − List of Students
TOM TORLAKSON
State Superintendent
of Public Instruction
ICA − IA Student Report
TOM TORLAKSON
State Superintendent
of Public Instruction
• Student’s mathematics and ELA/literacy
overall score and achievement level
(i.e., Level 1, 2, 3, or 4).
• Overall score displayed surrounded by
error bands, marked with brackets.
(i.e., 2000 to 3000)
• Claim level of Below Standard, At/Near
Standard, or Above Standard.
• List of accommodations made available
to student.
IAB − IA Student Report
TOM TORLAKSON
State Superintendent
of Public Instruction
• Block level of Below Standard, At/Near
Standard, or Above Standard.
• Multiple blocks are provided on the same
report.
• Current and previous results for each
block are provided on the same report.
• Overall scores, error bands, and
achievement levels NOT reported for
blocks.
ICA − IA Student Report
TOM TORLAKSON
State Superintendent
of Public Instruction
ICA − IA Student Report
TOM TORLAKSON
State Superintendent
of Public Instruction
IAB − IA Student Report
TOM TORLAKSON
State Superintendent
of Public Instruction
Exportable Data File
TOM TORLAKSON
State Superintendent
of Public Instruction
Exportable Excel file in text-based format
includes the following fields (depends on LEAassigned permission level/role):
• Overall score for mathematics or ELA/literacy
• Lower and upper limits of the error band
• Achievement level (i.e., Level 1, Level 2, Level
3, or Level 4)
• Claim or block level
• Assessment type (i.e., ICA or IAB)
• Accommodations made available to student
• Student demographic information
Remember!
TOM TORLAKSON
State Superintendent
of Public Instruction
Scores and achievement levels from the
Smarter Balanced assessments cannot
and should not be compared with data
from STAR.
• Different standards are being assessed.
• Different assessment methods are being
used.
• Different levels of cognitive rigor are being
assessed.
Interpreting Interim
Assessment Results
TOM TORLAKSON
State Superintendent
of Public Instruction
The following factors should be considered in
interpreting and using interim assessment results:
• Purpose or intended use (e.g., pre-post
lesson/unit, benchmark, new student)
• Conditions under which the administration took
place (e.g., one-on-one, group)
• Test settings such as distractions, noise levels,
accommodations provided
• Student readiness (e.g., no exposure or prior
exposure/practice with same/similar content)
Interpreting Interim
Assessment Results
TOM TORLAKSON
State Superintendent
of Public Instruction
• Extent to which TAs followed and
consistently used training guides, rubrics,
and other scoring resources to train and
hand score the constructed-response items
and performance tasks.
• Extent to which students were taught the
standards aligned to the administered ICAs
and IABs
Interpreting Interim
Assessment Results
TOM TORLAKSON
State Superintendent
of Public Instruction
ICA student reports are similar but do have one
key difference with the summative assessment
Individual Student Results (ISR):
• Achievement levels on the ICA student
reports are reported as Level 1, Level 2,
Level 3, or Level 4.
• Achievement levels on the summative
assessment ISR are reported as Standard
Not Met, Standard Nearly Met, Standard Met,
or Standard Exceeded.
Interpreting Interim
Assessment Results
In addition, keep the following in mind:
TOM TORLAKSON
State Superintendent
of Public Instruction
• Extent to which interim assessments were
administered under standardized conditions
will affect the interpretations.
• Interim assessment results should only be
used in combination with other available
information.
• Interim assessment results should not be
the sole basis for making any high-stakes
decisions.
Using Interim
Assessment Results
TOM TORLAKSON
State Superintendent
of Public Instruction
Interim assessments are designed to support
teaching and learning throughout the year.
Results may inform:
• Achievement on the Common Core State
Standards (when combined with other
information)
• Identification of specific areas of strengths
and weaknesses
• End-of-unit checks on learning
Using Interim
Assessment Results
TOM TORLAKSON
State Superintendent
of Public Instruction
The Smarter Balanced Digital Library provides
Common Core State Standards aligned
resources to assist teachers in modifying
instruction based on interim assessment
results, including:
• Assessment Literacy Modules
• Instructional Modules
• Education Resources
Digital Library can be accessed at:
www.smarterbalancedlibrary.org/
Contact Information
TOM TORLAKSON
State Superintendent
of Public Instruction
The California Technical Assistance
Center (CalTAC) is available to answer
your questions!
Monday–Friday from 7 a.m.–5 p.m. PT
E-mail: [email protected]
Phone: 800-955-2954
Web site: http://caaspp.org
Digital Library Help Desk: 855-631-1510