Smarter Balanced in Washington Preparing for the Transition Webinar #3 February 27, 2014 OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION Division of Assessment and Student Information.

Download Report

Transcript Smarter Balanced in Washington Preparing for the Transition Webinar #3 February 27, 2014 OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION Division of Assessment and Student Information.

Smarter Balanced
in Washington
Preparing for the Transition
Webinar #3
February 27, 2014
OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION
Division of Assessment and Student Information
OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION
Organization of Webinars Series

Future webinars are scheduled for 3:30-4:30 PM on:
March 20 April 9 May 13
June 10
July 15
August 13

PowerPoints and answers to questions raised during the
webinars are posted on OSPI’s Smarter Balanced webpage http://www.k12.wa.us/smarter/default.aspx; audio
recording of webinars are included.

We will minimize repeating previously provided
information, so please check the webpage.
02/27/2014 Slide 1
Summative Field Tests
Getting Ready for the Tests
02/27/2014
Field Testing Updates and the
Countdown to Test Administration!
OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

The USED has approved Washington’s request to avoid
double testing students this spring!!!


Keep in mind that students in grades 5 and 8 must still be
given the science MSP.
Twenty days before the first field test window opens.
02/27/2014 Slide33
Field Testing Updates
OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION



During the next several weeks, district staff must access
resources and materials for the Field Test scheduling,
administration, and communication.
Ensure your district and school coordinators and teacher
administrators are carefully reviewing the training
modules posted on the Field Test Portal.
Refer to the checklists located on the Field Test Portal for
a complete listing of District and School Coordinator and
Teacher Administrator responsibilities.
02/27/2014 Slide 4
OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION
Training and Resources

The Test Administration Manual (TAM), TIDE user guide,
information about the secure browsers, test preparation
checklists, training modules, and a collection of one page
guidance documents are posted on the field test portal
http://sbac.portal.airast.org/field-test/resources/.

The TAM, TIDE user guide, and checklists explicitly
identify which role needs to be trained on what
resources.

As you typically do, schedule training of your school test
coordinators and test administrators per these guidelines.
02/27/2014 Slide 5
Training and Resources
OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

The following is an excerpt (3 tasks out of 21) from the
Test Administrator Checklist and shows the types of
activities, time needed, and from where to access:
Test Administrator
Activities
Reference
in Manual
1.
Review all Smarter Balanced
TAM,
policy and test administration section 2.2,
Table 3
documents posted to the
portal, particularly the Test
Administration Manual (TAM).
1.
Review the training modules
that are posted to the Smarter
Balanced portal and attend any
school or district training
sessions if any are offered.
Show students the videos
“Introduction to the Field
Test” and “What are Universal
Tools?”
1.
Estimated
Target
Notes/Resources
Time to
Completion
Complete
Date
60–90
Complete at
http://sbac.portal.airast.org
minutes
least 2–3
/field-test/resources/
weeks prior
to testing.
TAM,
section 2.2,
Table 4
2–3 hours
Complete at
least 2–3
weeks prior
to testing.
http://sbac.portal.airast.org
/field-test/resources/
TAM,
section 2.2,
Table 4
1 hour
Spaced over
2–3 weeks
prior to
testing
http://sbac.portal.airast.org
/field-test/resources/
02/27/2014 Slide 6
Training and Resources
OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION




Districts will utilize Smarter Balanced resources the same
way they have used OSPI developed resources in the past
(i.e., DFA, ACM) for training staff and preparing students.
Smarter Balanced’s TAM = OSPI’s DFAs and ACM for MSP,
HSPE, and EOC.
Washington state laws and policies are the same for this
administration as they have been for all our other
assessments.
A crosswalk document will soon be posted at
http://www.k12.wa.us/SMARTER/Tests.aspx showing
Smarter Balanced’s resources and OSPI’s comparable
documents for MSP, HSPE, and EOCs.
02/27/2014 Slide 7
OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION
Training and Resources

All Training modules are now available on the
Field Test Portal. They include:

TIDE—Test Information Distribution Engine**

What is a Field Test?

Let’s Talk Universal Tools

What is a CAT (Computer Adaptive Test)?

Performance Task Overview**

Student Interface for Online Testing

Technology Requirements for Online Testing

Accessibility and Accommodations**

Test Administrator (TA) Interface for Online Testing

Smarter Balanced Test Administration Overview**

Smarter Balanced training modules with asterisks are
required trainings for Test Administrators.
02/27/2014 Slide 8
Training and Resources

Also on the field test portal:
OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION



Timing documents for ELA and math
Confirmation code explanation sheet
Accommodations guidance




Technical requirements for Text-to-Braille
Online dictionary/thesaurus
American Sign Language
Coming to the portal “soon”:



Classroom activity guidance
Creating a test session
Glossaries
02/27/2014 Slide 9
OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION
Training and Practice Tests Overview

The Practice Tests and Training Tests, recommended for
every participating student, are available at
http://sbac.portal.airast.org/practice-test/

The purpose of Training Tests is to provide students with
an opportunity to quickly become familiar with
the software and interface features that will be used in
the Field Test.

Grade Bands:



3-5
6-8
High school
02/27/2014 Slide 10
Training and Practice Tests Overview
OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION



The purpose of the Practice Tests is to provide students
with a grade specific testing experience that is similar in
structure and format to the Field Test.
Available at each grade 3-8 and 11
Schedule adequate time for the administration of the
Practice Tests

Simulates the administration of the operational field tests in
types and number of items.
02/27/2014 Slide 11
Feature Update
Feature
Training Test
Current Practice Test
Masking
Yes
Yes
Streamlining
Yes
Yes
Spanish Full Translation
Yes
No
Spanish Glossaries
Yes
Yes
Glossaries:
Arabic, Cantonese,
Filipino, Korean,
Mandarin, Punjabi,
Russian, Ukrainian,
Vietnamese,
English
Yes
No
ASL Videos
Yes
Yes
New Item Types
Yes
No
Scheduled Downtimes
Administration
Downtime
Practice Test/Training
Test
Saturday, April 26 –
Tuesday, April 29, 2014
Field Test
Thursday, April 10 –
Sunday, April 13, 2014
Thursday, May 8 –
Sunday, May 11, 2014
Field Testing Windows and Scheduled
Downtimes

There are four test administration blocks:
OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION




March 18 – April 4
April 7 – April 25
April 28 – May 16
May 19 – June 6 (not for grades 9-10)

Scheduled system downtime for Field Test: April 10-13
(Block 2) and May 8-11, 2014 (Block 3)

Scheduled system downtime for the Practice and Training
Tests: April 26-29, 2014

Changes to testing window are no longer possible
02/27/2014 Slide 14
Scheduling the Field Tests
OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION



The Test Administration Manual lists the Estimated Testing
Times (pg 32) and the Assessment Sequence Charts for
ELA and Math (pgs 34 and 35).
The Assessment Sequence Charts provide ranges of times
expected to complete the tests. The upper ranges
included on these Charts do, in some instances, exceed
the Estimated Testing Times.
The Estimated Testing Times provide schools the estimate
of time when most students will complete the tests.
02/27/2014 Slide 15
Pre-ID’ing and Data Topic Updates
OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

User Roles – ‘District Administrator’ should be finalizing
role assignment


Statewide initial pre-ID uploaded to TIDE


Please review for completeness in time to make corrections in
CEDARS
Next OSPI student upload: March 11



Trainings are catered to user roles and associated tasks
New and Moved records for Window 1 test sites
File extract Monday, March 10
Window 1 test sites must identify remaining students
(“stragglers”) and enter them into TIDE prior to testing
02/27/2014 Slide 16
Pre-ID’ing and Data Topic Updates

TEST TICKETS!!!
OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

Test tickets are available in WAMS Profile Downloads under
‘8. Smarter Balanced Field Test’


Format is PDF rather than DOC due to formatting constraints
2 tickets per student: ELA and MATH



For HS testing single subjects – discard extra tickets
Sorted by school name, grade, group name (if applied), student
last/first/middle
Additional Test Ticket Resources:


MS Access DB/Form posted to web Monday, March 3rd-ish
Excel Student list posted in WAMS Profile Downloads currently
02/27/2014 Slide 17
OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION
Pre-ID’ing and Data Topic Updates
02/27/2014 Slide 18
Pre-ID’ing and Data Topic Updates
OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION


Student Data TIDE tasks prior to
1) Correcting Demographics in TIDE



Demographic data in TIDE is used in item analysis
Make corresponding updates in Local SIS’s and CEDARS
2) Uploading supports/accommodations

TIDE User Guide, pages 30–35 and Test Administration Manual,
section 7.0
02/27/2014 Slide 19
Security
OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

Starting with the Field Test administered in 2014,
improprieties, irregularities, and breaches that result in a
need to invalidate, reset, re-open, or restore individual
student assessments (see Online System Appeals Types
table slide) will be reported in the online administration
system (TIDE).
02/27/2014 Slide 20
Security
OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION



Test Security Incident Log [XLSX]
http://sbac.portal.airast.org/field-test/resources/ This
document provides instructions and a template of the
incident log that Test Administrators, School Test
Coordinators, and District Test Coordinators will use to
report any Test Security Incidents that occur during
testing.
The Test Security Incident Log is the document of record
for all test security incidents.
For more information on test security, please review the
information in the Online Field Test Administration Manual
(TAM).
02/27/2014 Slide 21
Security
OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

For specific steps on reporting incidents in the Online
Administration System, please see the TIDE User Guide
http://sbac.portal.airast.org/wpcontent/uploads/2014/01/Smarter_TIDE_UserGuide_Spring2014.pdf.


The online reporting system is only appropriate for
reporting an action related to a student incident that
impacts a test. All other incidents (involving adults or not
involving tests) should be escalated via the Test Security
Log process described on the Test Security Incident Log.
Types of security incidents in the online administration
system are described in Online System Appeals Types
table below.
02/27/2014 Slide 22
Security
OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION
Appeal Type
Description
Invalidate a Test
Invalidating a student’s test eliminates the test. The student loses that test and does not
receive a score. Invalidations are often requested due to test security incidents; e.g., a TA
sees two students discussing answers to questions during a test session.
Reset a Test
Resetting a student’s test removes that test from the system and enables the student to start
a new test. Scores associated with this test are removed from the system.
A test reset is often requested due to an accommodation not being set properly for test (e.g.,
a student realizes that the required Text-To-Speech accommodation was not set).
Only the most recent test may be reset.
Re-open a Test
Re-open is for a test that has already been submitted or has expired.
The system will prevent an unsubmitted test from being re-opened if the student has already
started a reset test for that content area.
Restore a test that has been Return a test from the Reset status to its prior status. This action can only be performed on
reset
tests that have been reset.
A test can be restored if it was reset in error.
02/27/2014 Slide 23
Supports and Accommodations
OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

The Usability, Accessibility and Accommodations
Guidelines are available on OSPI’s website:
http://www.k12.wa.us/SMARTER/default.aspx.

Two accommodations/designated supports planned for the
Operational Test will not be available for the Field Test:
Audio Glossary (designated support) and Closed
Captioning (accommodation).

We’ll highlight one or two accommodations in each
webinar. This webinar’s topics: Braille and ASL.
02/27/2014 Slide 24
Supports and Accommodations for
Visually Impaired Students
OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

To use Braille for the Smarter Balanced MATH field
test:

A school would need:






Tiger embosser, and
Duxbury software
Training will be needed to know how to administer this test.
There may be a significant delay for students between items.
It is too late in the year for a school that does not have this
equipment to administer the math Field Test in Braille.
OSPI will make available the appropriate MSP math test in
Braille for students whose school is administering the field
test.
02/27/2014 Slide 25
Supports and Accommodations for Visually
Impaired Students

To use Braille for the Smarter Balanced ELA field test:
OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

A school would only need:




JAWS translation software, and
Either an 18 or 40 cell Braille display
If needed, OSPI can make available the appropriate MSP
reading and writing tests in Braille for students whose
school is administering the field test; but we encourage
schools that can administer the ELA Braille test to do so.
OSPI will investigate how to best support districts
that need a Tiger Embosser for future years.
02/27/2014 Slide 26
Supports and Accommodations for
Hearing Impaired Students
OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

ASL will be available on all math items and ELA listening
items only. The Usability, Accessibility, and
Accommodations Guidelines document is available at
(http://www.smarterbalanced.org/wordpress/wpcontent/uploads/2013/09/SmarterBalanced_Guidelines_09111
3.pdf).


For a student needing ASL, set-up is required before the
student sits for the test. Once logged in, the student must
right click to access the videos.
The tests will use academic ASL.
02/27/2014 Slide 27
Supports and Accommodations for
Hearing Impaired Students
OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

Use the Training Tests to provide students with the
opportunity to familiarize themselves with the ASL
feature




Go to: http://sbac.portal.airast.org/practice-test/
Scroll down and select "Student Interface Practice and Training
Tests"
Click on "Sign in"
Use the drop down menu to select a grade (select any grade,
for example, grade 3)
continued….
02/27/2014 Slide 28
Supports and Accommodations for
Hearing Impaired Students
OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION
Continued from previous slide





Be careful here. Click on "Start ELA Grades 3-5 Training Test."
You can select any grade band as long as it is a "Training Test"
version.
For the American Sign Language option, use the drop-down
menu to select "Show ASL videos"
Click on 'Select'
Click on 'Yes, start my test' once you confirm ASL is on. (often
shown at top)
Just click on yes/Begin test now, to get to the first item
02/27/2014 Slide 29
OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION
Accommodation Reminder

Accommodations are those features available for use by a
student with a documentation of need in an Individualized
Education Program (IEP) or 504 accommodation plan.

Accommodations need to be identified and assigned in
the Test Information Distribution Engine (TIDE) prior to
assessment administration.

Students should be familiar with using the
accommodations assigned to them.
02/27/2014 Slide 30
Summative Operational
Assessments
02/27/2014
Administration Window
OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION



The 2015 summative operational assessment window
dates have not yet been determined – the windows will
be determined before the end of March (and will be
announced sooner if possible).
The window will be as long as possible to provide ample
opportunity to test all students.
The window is not designed to allow retakes (additional
opportunities) of the assessment, but is intended to
permit students to makeup tests that are missed due to
absences.
02/27/2014 Slide 32
Interim Assessments
We are all life long learners… patiently learning
a little each month about interim assessments
02/27/2014
Interim Assessments
OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

Updates on the interim assessments will be provided
during the Thursday, March 20 webinar.
02/27/2014 Slide 34
Resources For You!


For the latest news and developments on
Smarter Balanced in Washington:
http://www.k12.wa.us/smarter/default.aspx
Materials for administration, as well as
communication templates for parents and
community: http://sbac.portal.airast.org/fieldtest/resources/

For questions about Smarter Balanced or the
assessment system transitions, contact:
[email protected] 360-725-6348
Thank you!
2007 WASL: Preparing Students to Live, Learn and Work in the 21st Century
8.30.2007 | Slide 36