Transcript CAASPP: Configuring Online Student Test Settings in TOMS Webcast

California Assessment of Student
Performance and Progress (CAASPP)
Configuring Online Student
Test Settings in TOMS
1 – 2 p.m.
December 18, 2014
Agenda
•
•
•
•
•
Overview
One by One Process in the User Interface
File Upload Process
Live Demonstration
Questions
Configuring Online Student Test Settings in TOMS
2
Purpose
To instruct local educational agency (LEA)
CAASPP Coordinators on how to set embedded
and non-embedded designated supports and
accommodations for students in the Test
Operations Management System (TOMS).
Configuring Online Student Test Settings in TOMS
3
Overview
Overview
Q: Why do I need to set online test settings for
students in TOMS?
A: To ensure students receive the assigned
accessibility supports for the online Smarter
Balanced assessments.
Configuring Online Student Test Settings in TOMS
5
Overview
Q: Who can set online test settings for
students in TOMS?
A: LEA CAASPP Coordinators and Test Site
Coordinators (SCs) have the authorization to
configure online test settings in TOMS. Please
note that LEAs may designate the number of
SCs needed to meet their needs.
Configuring Online Student Test Settings in TOMS
6
Overview
Q: Which embedded and non-embedded designated
supports and accommodations can I configure for
students in TOMS?
A: All embedded and non-embedded designated supports
and accommodations may be assigned and activated
through TOMS except the following, which must be
activated through the test delivery system:
•
•
Turning off a universal tool
Stacked translations
Configuring Online Student Test Settings in TOMS
7
Overview
A:
Embedded
Designated Support
Color Contrast
Accommodation
American Sign Language (ELA
listening and math items)
Non-Embedded
Designated Support
Accommodation
Bilingual Dictionary (ELA
Abacus
performance task full writes)
Alternate Response
Color Contrast
Options
Masking
Braille
Text-to-Speech (math and
ELA items)
Translated Test Directions
(math items)
Translations (glossaries)
(math items)
Translations (stacked) (for
math items)*
Closed Captioning (ELA
listening items)
Color Overlays
Calculator
Streamlined Interface
Magnification
Multiplication Table
Text-to-speech (ELA reading
passages)
Noise Buffers
Print on Demand**
Read Aloud (math and ELA
items)
Scribe (ELA non-writing and
math items)
Separate Setting
Translated Test Directions
Translation (glossaries)
(math items)
Special Lighting or Acoustics
Translated Test Directions
(math items)
Read Aloud (ELA reading
passages)
Turn off any universal tools*
Permissive Mode
Print Size
*Must be activated in the test delivery
system.
**Print on demand for stimuli only can be
activated in TOMS. If a student(s) need
print on demand for items and/or items
and stimuli, contact the CDE.
Scribe
Speech-to-Text
Individualized Aids
Configuring Online Student Test Settings in TOMS
8
Overview
Q: Where can I get more information about
designated supports and accommodations?
A: Refer to the CAASPP Matrix One for available
accessibility supports and the Smarter Balanced
Usability, Accessibility, and Accommodations
Guidelines for details on recommended uses of the
supports. In addition, the CAASPP Individual
Student Assessment Accessibility Profile (ISAAP)
Tool may be used to facilitate selection of the
accessibility supports to match student access
need for Smarter Balanced assessments.
Configuring Online Student Test Settings in TOMS
9
Overview
Q: What is the CAASPP ISAAP Tool?
A: The CAASPP ISAAP Tool is an Excel workbook
with specially designed formulas; the tool
facilitates selection of the designated supports
and accommodations that match students’
access needs for the Smarter Balanced
assessments. The CAASPP ISAAP Tool can
also be used to produce the online student test
settings file that can be uploaded to TOMS.
Configuring Online Student Test Settings in TOMS
10
Overview
Q: Where can I get more information on the
CAASPP ISAAP Tool?
A: A tutorial of the CAASPP ISAAP Tool as well as
the actual tool will be made available later this
month.
Configuring Online Student Test Settings in TOMS
11
Overview
Q: How can I configure online test settings for
students in TOMS?
A: There are two options to set designated
supports and accommodations in TOMS:
1. One by one manual configuration in the user
interface
2. File upload
− Use the online student test settings template
− Use the CAASPP ISAAP Tool to create an
upload file
Configuring Online Student Test Settings in TOMS
12
One by One Process
One by One
1. Select the [Test Operations
Management System (TOMS)]
button on the CAASPP portal at
http://caaspp.org.
2. Log onto TOMS using your
sign in credentials.
Configuring Online Student Test Settings in TOMS
14
One by One (cont.)
3. On the left navigation bar, select the [Students]
button.
Configuring Online Student Test Settings in TOMS
15
One by One (cont.)
4. Upon selecting [Students], a dropdown menu
will open. Select the [Search] button.
Configuring Online Student Test Settings in TOMS
16
One by One (cont.)
5. Enter details about the student in the search fields or
select the LEA the student is associated with by
selecting the [Select Organization] link.
Configuring Online Student Test Settings in TOMS
17
One by One (cont.)
6. Select the [Search] button.
Configuring Online Student Test Settings in TOMS
18
One by One (cont.)
7. Upon selecting [Search], search results will
populate in a table underneath the fields.
Configuring Online Student Test Settings in TOMS
19
One by One (cont.)
8. To view and/or edit a student’s profile, select
the magnifying glass [View] icon.
Configuring Online Student Test Settings in TOMS
20
One by One (cont.)
9. The selected student’s profile will open and the
student’s demographic information will be
displayed.
Configuring Online Student Test Settings in TOMS
21
One by One (cont.)
10.To configure the student’s online test settings,
select the [Test Settings] tab.
Configuring Online Student Test Settings in TOMS
22
One by One (cont.)
11. Set embedded and
non-embedded designated
supports and
accommodations for
the student by selecting
the appropriate selection(s)
in the dropdown menus
and checkboxes.
Configuring Online Student Test Settings in TOMS
23
One by One (cont.)
12.Select the [Update] button at the bottom of the
page.
Configuring Online Student Test Settings in TOMS
24
One by One (cont.)
13.Upon selecting [Update], a confirmation
message will display.
Configuring Online Student Test Settings in TOMS
25
File Upload Process
Online Student Test
Settings Template
1. Select the [Test Operations
Management System (TOMS)]
button on the CAASPP portal
at http://caaspp.org.
2. Log onto TOMS using your sign in
credentials.
Configuring Online Student Test Settings in TOMS
27
Online Student Test
Settings Template (cont.)
3. On the left navigation bar, select the [Students]
button.
Configuring Online Student Test Settings in TOMS
28
Online Student Test
Settings Template (cont.)
4. Upon selecting [Students], a dropdown menu will
open. Select the [Online Test Settings] button.
Configuring Online Student Test Settings in TOMS
29
Online Student Test
Settings Template (cont.)
5. Select the [Download Spreadsheet Template] link
to download the online student test settings
template.
Configuring Online Student Test Settings in TOMS
30
Online Student Test
Settings Template (cont.)
•
Do not move or change the order of the columns
– Column widths can be expanded for easier viewing
•
Accepted file format:
– .csv only
•
•
•
Maintain the column headers in row 1 and 2
Do not use formulas
Save your file frequently!
Configuring Online Student Test Settings in TOMS
31
Online Student Test
Settings Template (cont.)
Configuring Online Student Test Settings in TOMS
32
Online Student Test
Settings Template (cont.)
6. Fill in the necessary fields of the template.
−
Column A: Student’s Statewide Student Identifier (SSID)
 Must be 10 numeric characters
 Required field
 Acceptable values: 0, 1, 2 , 3, 4, 5, 6, 7, 8, 9
−
Column B: Abacus
 Mathematics
 Acceptable values: NEA_Abacus (abacus), leave field blank
to deselect abacus
−
Column C: Alternate Response Options
 Mathematics, ELA, performance task (PT)
 Acceptable values: NEA_AR (alternate response options),
leave field blank to deselect alternate response options
Configuring Online Student Test Settings in TOMS
33
Online Student Test
Settings Template (cont.)
6. Fill in the necessary fields of the template.
−
Column D: American Sign Language (ASL) for ELA
Listening and Math Items
 Mathematics, ELA, PT
 Acceptable values: TDS_ASL0 (do not show ASL videos),
TDS_ASL1 (show ASL videos), leave field blank to deselect
ASL
−
Column E: Bilingual Dictionary for ELA Full Writes
 ELA, PT
 Acceptable values: NEDS_BD (bilingual dictionary), leave
field blank to deselect bilingual dictionary
Configuring Online Student Test Settings in TOMS
34
Online Student Test
Settings Template (cont.)
6. Fill in the necessary fields of the template.
−
Column F: Language
 Mathematics, ELA, PT
 Acceptable values: ENU (English—default), ENU-Braille
(braille), ESN (Spanish—math only)
−
Column G: Calculator (NON-EMBEDDED)
 Mathematics
 Acceptable values: NEA_Calc (calculator), leave field blank
to deselect calculator
Configuring Online Student Test Settings in TOMS
35
Online Student Test
Settings Template (cont.)
6. Fill in the necessary fields of the template.
−
Column H: Closed Captioning for ELA Listening Items
 ELA
 Acceptable values: TDS_ClosedCap0 (not available),
TDS_ClosedCap1 (available)
−
Column I: Color Contrast (EMBEDDED)
 Mathematics, ELA, PT
 Accepted values: TDS_CC0 (black on white),
TDS_CCInvert (reverse contrast), TDS_CCMagenta (black
on rose), TDS_CCMedGrayLtGray (medium gray on light
gray), TDS_CCYellowB (yellow on blue), leave field blank to
deselect color contrast
Configuring Online Student Test Settings in TOMS
36
Online Student Test
Settings Template (cont.)
6. Fill in the necessary fields of the template.
−
Column J: Color Contrast (NON-EMBEDDED)
 Mathematics, ELA, PT
 Acceptable values: NEDS_CC (color contrast), leave field
blank to deselect color contrast
−
Column K: Color Overlays
 Mathematics, ELA, PT
 Acceptable values: NEDS_CO (color overlays), leave field
blank to deselect color overlays
−
Column L: Magnification
 Mathematics, ELA, PT
 Acceptable values: NEDS_Mag (magnification), leave field
blank to deselect magnification
Configuring Online Student Test Settings in TOMS
37
Online Student Test
Settings Template (cont.)
6. Fill in the necessary fields of the template.
−
Column M: Masking
 Mathematics, ELA, PT
 Acceptable values: TDS_Masking0 (not available),
TDS_Masking1 (available)
−
Column N: Multiplication Table
 Mathematics
 Acceptable values: NEA_MT (multiplication table), leave
field blank to deselect multiplication table
Configuring Online Student Test Settings in TOMS
38
Online Student Test
Settings Template (cont.)
6. Fill in the necessary fields of the template.
−
Column O: Noise Buffers
 Mathematics, ELA, PT
 Acceptable values: NEA_NoiseBuf (noise buffers), leave
field blank to deselect noise buffers
−
Column P: Print On Demand
 Mathematics, ELA, PT
 Note: If your student needs print on demand for items, you
must contact the California Department of Education
 Acceptable values: TDS_PoD0 (none), TDS_PoD_Stim
(stimuli), leave field blank to deselect print on demand
Configuring Online Student Test Settings in TOMS
39
Online Student Test
Settings Template (cont.)
6. Fill in the necessary fields of the template.
−
Column Q: Read Aloud for ELA
 ELA, PT
 Acceptable values: NEDS_RA_Stimuli (read aloud), leave
field blank to deselect read aloud for ELA
−
Column R: Read Aloud for Math and ELA Items (NONEMBEDDED)
 Mathematics, ELA
 Acceptable values: NEDS_RA_Items (read aloud for math
and ELA items), NEDS_RA_Stimuli (read aloud for math and
ELA stimuli), leave field blank to deselect read aloud for math
and ELA items
Configuring Online Student Test Settings in TOMS
40
Online Student Test
Settings Template (cont.)
6. Fill in the necessary fields of the template.
−
Column S: Scribe
 ELA, PT
 Acceptable values: NEA_SC_WritItems (scribe), leave field
blank to deselect scribe
−
Column T: Scribe (for ELA non-writing items and Math
items)
 Mathematics, ELA, PT
 Acceptable values: NEDS_SC_Items (scribe), leave field
blank to deselect scribe
Configuring Online Student Test Settings in TOMS
41
Online Student Test
Settings Template (cont.)
6. Fill in the necessary fields of the template.
−
Column U: Separate Setting
 Mathematics, ELA, PT
 Acceptable values: NEDS_SS (separate setting), leave field
blank to deselect separate setting
−
Column V: Speech-to-text
 Mathematics, ELA, PT
 Acceptable values: NEA_STT (speech-to-text), leave field
blank to deselect speech-to-text
Configuring Online Student Test Settings in TOMS
42
Online Student Test
Settings Template (cont.)
6. Fill in the necessary fields of the template.
−
Column W: Text-to-speech for ELA Reading Passages
Grades 6–8 and 11
 ELA, PT
 Acceptable values: TDS_TTS0 (none), TDS_TTS_Stim
(passages), leave field blank to deselect text-to-speech for
ELA reading passages for grades 6–8 and 11
Configuring Online Student Test Settings in TOMS
43
Online Student Test
Settings Template (cont.)
6. Fill in the necessary fields of the template.
−
Column X: Text-to-speech for Math and ELA Items
 Mathematics, ELA, PT
 Acceptable values: TDS_TTS0 (none), TDS_TTS_Item
(items), TDS_TTS_Stim&TDS_TTS_Item (passages and
items), leave field blank to deselect text-to-speech
−
Column Y: Translated Test Directions
 ELA, PT
 Acceptable values: NEDS_TransDirs (translated test
directions), leave field blank to deselect translated test
directions
Configuring Online Student Test Settings in TOMS
44
Online Student Test
Settings Template (cont.)
6. Fill in the necessary fields of the template.
−
Column Z: Translated Test Directions for Math Items
 Mathematics
 Acceptable values: NEDS_TransDirs (translated test
directions), leave field blank to deselect translated test
directions for math items
Configuring Online Student Test Settings in TOMS
45
Online Student Test
Settings Template (cont.)
6. Fill in the necessary fields of the template.
−
Column AA: Translation Glossaries for Math Items
 Mathematics, PT
 Accepted values:
TDS_WL_Glossary (English), TDS_WL_ArabicGloss (Arabic),
TDS_WL_CantoneseGloss (Cantonese), TDS_WL_ESNGlossary (Spanish),
TDS_WL_KoreanGloss (Korean), TDS_WL_MandarinGloss (Mandarin),
TDS_WL_PunjabiGloss (Punjabi), TDS_WL_RussianGloss (Russian),
TDS_WL_TagalGloss (Filipino), TDS_WL_UkrainianGloss (Ukrainian),
TDS_WL_VietnameseGloss (Vietnamese), TDS_WL_ArabicGloss&TDS_WL_Glossary
(Arabic & English), TDS_WL_CantoneseGloss&TDS_WL_Glossary (Cantonese &
English), TDS_WL_ESNGlossary&TDS_WL_Glossary (Spanish & English),
TDS_WL_KoreanGloss&TDS_WL_Glossary (Korean & English),
TDS_WL_MandarinGloss&TDS_WL_Glossary (Mandarin & English),
TDS_WL_PunjabiGloss&TDS_WL_Glossary (Punjabi & English),
TDS_WL_RussianGloss&TDS_WL_Glossary (Russian & English),
TDS_WL_TagalGloss&TDS_WL_Glossary (Filipino & English),
TDS_WL_UkrainianGloss&TDS_WL_Glossary (Ukrainian & English),
TDS_WL_VietnameseGloss&TDS_WL_Glossary (Vietnamese & English), TDS_WL0
(none)
Configuring Online Student Test Settings in TOMS
46
Online Student Test
Settings Template (cont.)
6. Fill in the necessary fields of the template.
−
Column AB: Translation Glossaries for Math Items
(NON-EMBEDDED)
 Mathematics
 Acceptable values: NEDS0 (none), English (English),
NEDS_TRussian (Russian), NEDS_TArabic (Arabic),
NEDS_TCantonese (Cantonese), NEDS_TSpanish
(Spanish), NEDS_TKorean (Korean), NEDS_TMandarin
(Mandarin), NEDS_TPunjabi (Punjabi), NEDS_TFilipino
(Filipino), NEDS_TUkrainian (Ukrainian),
NEDS_TVietnamese (Vietnamese)
Configuring Online Student Test Settings in TOMS
47
Online Student Test
Settings Template (cont.)
6. Fill in the necessary fields of the template.
−
Column AC: Permissive Mode
 Mathematics, ELA, PT
 Acceptable values: TDS_PM0 (disabled), TDS_PM1 (enabled)
−
Column AD: Print Size
 Mathematics, ELA, PT
 Acceptable values: TDS_PS_L0 (no default zoom applied),
TDS_PS_L1 (1.5X), TDS_PS_L1 (1.75X), TDS_PS_L3 (2.5X),
TDS_PS_L4 (3X)
−
Column AE: Streamlined Interface
 Mathematics, ELA, PT
 Acceptable values: TDS_SLM0 (standard), TDS_SLM1
(streamlined)
Configuring Online Student Test Settings in TOMS
48
Online Student Test
Settings Template (cont.)
6. Fill in the necessary fields of the template.
−
Column AF: Special Lighting or Acoustics (NON-EMBEDDED)
Designated Support
 Mathematics, ELA, PT
 Acceptable values: Y (yes), N (no—default)
−
Column AG: Translated Test Directions for Math (NONEMBEDDED) Designated Support
 Mathematics, ELA, PT
 Acceptable values: Y (yes), N (no—default)
−
Column AH: Individualized Aids (NON-EMBEDDED)
Accommodation
 Mathematics, ELA, PT
 Acceptable values: Y (yes), N (no—default)
Configuring Online Student Test Settings in TOMS
49
Online Student Test
Settings Template (cont.)
7. Save the file in .csv format and upload it on the
Upload Online Student Test Settings page in the
TOMS interface.
Configuring Online Student Test Settings in TOMS
50
Online Student Test
Settings Template (cont.)
8. Check on the status of your uploaded file(s) on the
Upload Online Student Test Settings page in the
TOMS interface.
: Processing
: Delete file
: Complete
: Download errors
Configuring Online Student Test Settings in TOMS
51
Creating the Upload File through
the CAASPP ISAAP Tool
• The recorded tutorial on the CAASPP ISAAP
Tool will include instructions and a
demonstration of how to use the tool to create
an upload file. The tutorial will be made
available on caaspp.org.
Configuring Online Student Test Settings in TOMS
52
Live Demonstration
Updates and
Announcements
Updates and Announcements
•
•
•
Target release date for Interim Assessment
Comprehensive Forms is January 15.
Target release date for Interim Assessment
Blocks is January 27.
Target release date for Summative Assessments
is March 10.
− Note: Assessments will be available to LEAs as
dictated by their testing windows.
Configuring Online Student Test Settings in TOMS
55
Resources and Support
Resources
• TOMS Configuring Online Student Test Settings
User Guide is forthcoming
• Matrix One (PDF; Updated Sep-2014)
• Usability, Accessibility, and Accommodations
Guidelines (PDF)
• Guidelines: Frequently Asked Questions (PDF)
Configuring Online Student Test Settings in TOMS
57
Help Desk Support
The California Technical Assistance Center
(CalTAC) is here to support all LEA CAASPP
coordinators!
Monday–Friday from 7 a.m.–5 p.m. PT
E-mail: [email protected]
Phone: 800-955-2954
Web site: http://caaspp.org
Configuring Online Student Test Settings in TOMS
58