Transcript Click to add title

Configuring Student Test Settings in the
Test Operations Management System
(TOMS)
CAASPP Coordinator Training
January – February 2015
CAASPP Trainings
In-person Training Series
Series Required for CAASPP Coordinators
Practice and Training Tests
Test Security
Device Set-up Guide Module
Paper-pencil Tests
TOMS
Technology

Configuring Student Test Settings in Test
Operations Management System (TOMS)
Test Administrator Accounts and Student Data
Management
Test Session Management
Testing Schedule
Web-based Videos and Other
Training Resources
Adding and Managing Users in
TOMS (16:54 Runtime) Click here
Accessibility Resources
Performance Task Overview (18:01
Runtime) Click here
Participation Reports
Interim Assessments
Detailed List of Trainings: http://achieve.lausd.net/testing
Smarter Balanced 2015
Configuring Test Settings in TOMS
2
Agenda
 Overview
 Entering Supports in TOMS


One by One Process in the User Interface
File Upload Process
 Hand on activity (Depending on time)
 Questions
Smarter Balanced 2015
Configuring Test Settings in TOMS
3
Purpose
 To instruct CAASPP Coordinators on how
to set embedded and non-embedded
designated supports and accommodations
for students in the Test Operations
Management System (TOMS).
Smarter Balanced 2015
Configuring Test Settings in TOMS
4
Overview
Smarter Balanced 2015
Configuring Test Settings in TOMS
5
Terms you should know
 California Assessment of Student Performance
and Progress (CAASPP)
 Test Operations Management System (TOMS)
 Universal Tools
 Designated Supports
 Accommodations
 Embedded Supports
 Non-embedded supports
 SC – CAASPP Test Site Coordinator
Smarter Balanced 2015
Configuring Test Settings in TOMS
6
Accessibility Features
Smarter Balanced 2015
Configuring Test Settings in TOMS
7
Accessibility Features
Embedded
Digitally available
as part of the test
Smarter Balanced 2015
Configuring Test Settings in TOMS
8
Accessibility Features
Non-embedded
•
•
Smarter Balanced 2015
Configuring Test Settings in TOMS
Not digitally
available as part
of the test
Must be provided
by the school
9
Accessibility Features
Universal Tools
-
Do not have to be set in TOMS
Available to all students
o May be turned off if needed
Embedded
Breaks, Calculator, Digital
Notepad, English Dictionary,
English Glossary, Expandable
Passages, Global Notes,
Highlighter, Keyboard Navigation,
Mark for Review, Math Tools, Spell
Check, Strikethrough, Writing
Tools, Zoom
Non-embedded
Breaks, English Dictionary,
Scratch Paper, Thesaurus
Smarter Balanced 2015
Configuring Test Settings in TOMS
10
Accessibility Features
Designated Supports
-
Must be set in TOMS
Available for all students for whom
the need has been documented
Embedded
Color Contrast, Masking, Text-to-speech,
Translated Test Directions (Glossary), Translations
(Stacked), Turn off Any Universal Tools
Non-Embedded
Bilingual Dictionary, Color Contrast, Color Overlay,
Magnification, Read Aloud, Scribe, Separate
Setting, Translated Test Directions, Translation
(Glossary)
Smarter Balanced 2015
Configuring Test Settings in TOMS
11
Accessibility Features
Accommodations
-
Must be set in TOMS
Must be indicated in IEP or 504 Plan
o One exception: Physical Injuries
which prevent student from using
computer (e.g. broken arm)
Accommodations
Embedded
American Sign
Language,
Braille, Closed
Captioning,
Text-to-speech
Smarter Balanced 2015
Non-Embedded
Abacus, Alternate
Response Options,
Calculator, Multiplication
Table, Noise Buffers, Print
on Demand, Read Aloud,
Scribe, Speech-to-text
Configuring Test Settings in TOMS
12
Accessibility Features
Embedded
Designated Support
Color Contrast
Accommodation
American Sign Language (ELA
listening and math items)
Non-Embedded
Designated Support
Accommodation
Bilingual Dictionary (ELA
Abacus
performance task full writes)
Alternate Response
Color Contrast
Options
Masking
Braille
Text-to-Speech (math and
ELA items)
Translated Test Directions
(math items)
Translations (glossaries)
(math items)
Translations (stacked) (for
math items)*
Closed Captioning (ELA
listening items)
Color Overlays
Calculator
Streamlined Interface
Magnification
Multiplication Table
Text-to-speech (ELA reading
passages)
Noise Buffers
Print on Demand**
Read Aloud (math and ELA
items)
Scribe (ELA non-writing and
math items)
Separate Setting
Translated Test Directions
Translation (glossaries)
(math items)
Special Lighting or Acoustics
Translated Test Directions
(math items)
Read Aloud (ELA reading
passages)
Turn off any universal tools*
Permissive Mode
Print Size
*Must be activated in the test delivery
system.
**Print on demand for stimuli only can be
activated in TOMS. If a student(s) need
print on demand for items and/or items
and stimuli, contact the CDE.
Smarter Balanced 2015
ConfiguringA:Test Settings in TOMS
Scribe
Speech-to-Text
Individualized Aids
13
http://www.cde.ca.gov/ta/tg/ai/documents/caasppmatrix1.pdf
14
Accessibility Features
Who can set online test settings for students in
TOMS?
CAASPP Test Site Coordinators (SCs) have the authorization to
configure online test settings in TOMS.
To receive access to TOMS coordinators:
 must be designated in the Principal’s Portal as the CAASPP
coordinator
 must complete the 2014-15 CAASPP Security Forms
training in the Learning Zone
Smarter Balanced 2015
Configuring Test Settings in TOMS
15
Accessibility Features
When should settings be entered in TOMS?
Before students take Smarter Balanced tests.
 Student demographic information is now in TOMS
 Test settings are entered by the CAASPP
coordinator
 When using their own credentials, students will be able to
use their designated settings when accessing:
 Best Practice

Practice and Training Tests

Smarter Balanced Summative Assessment

Smarter Balanced Interim Assessments
Smarter Balanced 2015
Configuring Test Settings in TOMS
Allow students to
practice using their
assigned supports
16
Accessibility Features
LAUSD
MiSIS
(1) Student Demographic Data
School CAASPP
Coordinator
 Best Practice
(3) Designate Users
(4) Designated Supports
and Accommodations
Smarter Balanced 2015
Configuring Test Settings in TOMS
(2) Student
Registration
Verify student
demographic
information before
students take the
summative test
17
REF-6420: Accessibility and Accommodations
Guidelines For SB Assessments
 Designated supports and
Accommodations must be documented
 Attachments should be completed by
Decision-making teams/designees (e.g.)
 Individualized Education Program (IEP) teams
 Section 504 Plan teams
 Language Appraisal Teams (LAT), and
 Student Success Teams (SST)
 Coordination of Services Team (COST)
Smarter Balanced 2015
Configuring Test Settings in TOMS
18
REF-6420: Accessibility and Accommodations
Guidelines For SB Assessments
(1) Decision-making
team/Designee
complete Attachment
(A,B, or C)
(2) Coordinator collects
attachments and gets
ready for Administrator’s
approval
(3) Coordinator enters
assigned supports/
accommodations in
TOMS
If assigned supports
are in TOMS, student
proceed with testing
(5) Decision-making
team/Designee
performs preadministration check
(4) Coordinator
returns copies of
attachment(s) to
designee
 Best Practice
If assigned supports
are NOT in TOMS,
coordinator must re-enter
supports in TOMS
Smarter Balanced 2015
Configuring Test Settings in TOMS
Verify student
supports/
accommodations
before students take
Summative
Assessments
19
REF-6420: Accessibility and Accommodations
Guidelines For SB Assessments
Attachment A:
 Designated Supports for
English learners
 Do not use Attachment A if the
EL student has an IEP or a
504 Plan
Smarter Balanced 2015
Configuring Test Settings in TOMS
20
REF-6420: Accessibility and Accommodations
Guidelines For SB Assessments
Attachment B:
 Designated Supports for At
Risk Students
 Do not use Attachment B if the
student has an IEP or a 504
Plan
Smarter Balanced 2015
Configuring Test Settings in TOMS
21
REF-6420: Accessibility and Accommodations
Guidelines For SB Assessments
Attachment C:
 Designated Supports and
Accommodations
 Do not use Attachment B if the
student has an IEP or a 504
Plan
Smarter Balanced 2015
Configuring Test Settings in TOMS
22
Configuring Settings
How can I configure online test settings for
students in TOMS?
There are two options to set designated supports and
accommodations in TOMS:
1. One by one manual configuration in the user interface
2. File upload
−
Use the online student test settings template
−
Use the CAASPP ISAAP Tool to create an upload file
Smarter Balanced 2015
Configuring Test Settings in TOMS
23
One by one Process
Smarter Balanced 2015
Configuring Test Settings in TOMS
24
One by One Process
1. http://caaspp.org
 Best Practice
Bookmark this
Webpage
Smarter Balanced 2015
Configuring Test Settings in TOMS
25
One by One Process
2. Log into TOMS
Smarter Balanced 2015
Configuring Test Settings in TOMS
26
One by One Process
3. On the left navigation bar, select the [Students]
button.
Smarter Balanced 2015
Configuring Test Settings in TOMS
27
One by One Process
4. Upon selecting [Students], a dropdown menu will
open. Select the [Search] button.
Smarter Balanced 2015
Configuring Test Settings in TOMS
28
One by One Process
5. Enter details about the student in the search
fields or select the LEA the student is associated
with by selecting the [Select Organization] link.
Smarter Balanced 2015
Configuring Test Settings in TOMS
29
One by One Process
6. Click on the [Search] button.
Smarter Balanced 2015
6.
Configuring
Select
Test
theSettings
[Search]
in button.
TOMS
30
One by One Process
7. Verify the student’s First Name, Last Name, SSID
number, and Grade level.
Smarter Balanced 2015
7. Configuring
Upon selecting
Test Settings
[Search],
in TOMS
search
31
One by One Process
8. Click on the [Magnifying Glass]
 Best Practice
Verify student’s
Name, SSID,
and grade level
before selecting
the student
Smarter Balanced 2015
8.Configuring
To view
Test
and/or
Settings
edit ainstudent’s
TOMS
32
One by One Process
9. The selected student’s profile will open and the
student’s demographic information will be
displayed.
Smarter Balanced 2015
Configuring Test Settings in TOMS
33
One by One Process
10. Click on the [Test Settings] button.
Smarter Balanced 2015
10.Configuring
To configure
Test Settings
the student’s
in TOMS
online
34
One by One Process
11. Set embedded and
non-embedded
designated
supports and
accommodations for
the student by
selecting
the appropriate
selection(s)
in the dropdown
menus
and checkboxes.
Smarter Balanced 2015
Configuring Test Settings in TOMS
35
One by One Process
12.Select the [Update] button at the bottom of the
page.
 Best Practice
Verify all
assigned
supports are
entered before
clicking on
UPDATE
Smarter Balanced 2015
Configuring Test Settings in TOMS
36
One by One Process
13.Upon selecting [Update], a confirmation
message will display.
 Best Practice
Go back into
student search
and confirm
student supports
were saved
Smarter Balanced 2015
Configuring Test Settings in TOMS
37
File Upload Process
Smarter Balanced 2015
Configuring Test Settings in TOMS
38
File Upload Process
1. http://caaspp.org
Smarter Balanced 2015
Configuring Test Settings in TOMS
39
File Upload Process
2. Log into TOMS
 Best Practice
Confirm that you
have accessed
the California
version of TOMS
Smarter Balanced 2015
Configuring Test Settings in TOMS
40
File Upload Process
3. On the left navigation bar, select the [Students]
button.
Smarter Balanced 2015
Configuring Test Settings in TOMS
41
File Upload Process
4. Upon selecting [Students], a dropdown menu will
open. Select the [Online Test Settings] button.
Smarter Balanced 2015
Configuring Test Settings in TOMS
42
File Upload Process
5. Select the [Download Spreadsheet Template] link
to download the online student test settings
template.
Smarter Balanced 2015
Configuring Test Settings in TOMS
43
File Upload Process
5. Select the [Download Spreadsheet Template] link
to download the online student test settings
template.
 Best Practice
Do not move or
change order of
columns
(Only column
width may be
changed for easy
viewing)
Smarter Balanced 2015
Configuring Test Settings in TOMS
44
File Upload Process
5. Select the [Download Spreadsheet Template] link
to download the online student test settings
template.
-
Accepted file format: .csv only
-
Maintain the column headers in row 1 and 2
-
Do not use formulas
-
Save your file frequently!
Smarter Balanced 2015
Configuring Test Settings in TOMS
45
File Upload Process
6. Fill in the necessary
fields of the template.
 Column A: Student’s
Statewide Student Identifier
(SSID)
 Column B: Abacus
Mathematics - NEA_Abacus
 Column C: Alternate
Response Options
Mathematics, ELA,
performance task (PT) NEA_AR
Codes are found in TOMS User Guide (not yet released)
Smarter Balanced 2015
Configuring Test Settings in TOMS
 Best Practice
Ensure correct
codes are
entered in the
appropriate
column
46
File Upload Process
7. Save the file in .csv format and upload it on the
Upload Online Student Test Settings page in the
TOMS interface.
Smarter Balanced 2015
Configuring Test Settings in TOMS
47
File Upload Process
8. Check on the status of your uploaded file(s) on the
Upload Online Student Test Settings page in the
TOMS interface.
: Processing
: Delete file
: Complete
: Download errors
Smarter Balanced 2015
Configuring Test Settings in TOMS
48
File Upload Process
Individual Student Assessment
Accessibility Profile (ISAAP) Tool
What is the CAASPP ISAAP Tool?
•
Optional Process for entering student test settings into TOMS
•
The ISAAP Tool is an Excel workbook with specially designed formulas;
•
The tool facilitates selection of the designated supports and
accommodations that match students’ access needs for the Smarter
Balanced assessments.
•
The ISAAP Tool can also be used to produce the online student test
settings file that can be uploaded to TOMS.
Smarter Balanced 2015
Configuring Test Settings in TOMS
49
File Upload Process
Smarter Balanced 2015
Configuring Test Settings in TOMS
50
Overview
Q: Where can I get more information about designated
supports and accommodations?
A. REF-6420, Accessibility and Accommodations
Guidelines for Smarter Balanced Assessments, dated
January 15, 2015
B. Refer to CAASPP Matrix One for available accessibility
supports
C. Refer to Smarter Balanced Usability, Accessibility, and
Accommodations Guidelines for details on
recommended uses of the supports
D. ISAAP Tool tutorial:
http://caaspp.org/rsc/videos/archivedwebcast_ISAAP-overview-and-instructions.html
Smarter Balanced 2015
Configuring Test Settings in TOMS
51
Live Demonstration
Smarter Balanced 2015
Configuring Test Settings in TOMS
52
Resources and Support
Smarter Balanced 2015
Configuring Test Settings in TOMS
53