Transcript DTC Test Administration Workshop Presentation

2015 Assessment Overview
[Districts may customize all slides and
the background theme]
Presentation Overview
•
•
•
•
Overview of Assessments
CMT/CAPT Science Test Administration
Smarter Balanced Assessments
Special Populations
Connecticut Summative Assessments
School Year 2014 - 2015
State Assessment
CMT/CAPT Science
Grade(s)
Testing Window
Total Testing
Time per Student
65 minutes - Grade
5
70 minutes - Grade
8
50 minutes each (2
sessions) - Grade 10
Delivery
Method
Paper/pencil delivery except
for students requiring
accommodations through
MIST.*
5, 8 and 10
March 2 – 27
5, 8 and 10
Upload Dates:
March 2 – 27
Not Applicable
Completed through the MI
Web Portal.
3 – 8 and
11
March 30 – May
15
Time will vary by
student.
Online
Smarter Balanced
ELA/Literacy & Math
3–8
March 17 – June
12
Approximately
6 – 6.5 hours**
Online
Smarter Balanced
ELA/Literacy & Math
11
April 27 – June 12
Approximately
7 – 7.5 hours**
Online
CMT/CAPT Science
Skills Checklist
NCSC/Connecticut
Alternate
Assessment (CTAA)
TEST SECURITY
Test Security
• Breaches of test security include, but are not
limited to:
– analyzing/copying test items
– coaching students
– giving students answers, and/or changing students’
answers
– Allowing students access to digital, electronic, or manual
devices (except approved accommodations)
– Unauthorized log-in to the TDS
• Cell phone use by students is prohibited in testing
rooms
STATE POLICY REGARDING
PARTICIPATION
CGS 10-14n
(b) (1) For the school year commencing July 1, 2013, and each
school year thereafter, each student enrolled in grades
three to eight, inclusive, and grade ten or eleven in any
public school shall, annually, take a mastery examination
in reading, writing and mathematics.
(2) For the school year commencing July 1, 2013, and each
school year thereafter, each student enrolled in grade five,
eight, ten or eleven in any public school shall, annually, in
March or April, take a state-wide mastery examination in
science.
Participation Calculations
Participant
• CMT/CAPT Science
–
Test Booklet is submitted with
answers or with the Left Blank
bubble filled in
• Smarter Balanced
–
–
The student logs into both the
CAT and PT for each content
area
The student is identified as EL
Exempt for ELA/Literacy
Non Participant
• CMT/CAPT Science
–
Test booklet is submitted with
no answers completed
• Smarter Balanced
–
The student does not log into
both the CAT and PT
CMT/CAPT SCIENCE
2015 ADMINISTRATION
CMT/CAPT Science
• Grades 5, 8, and 10
• Testing Window: March 2 – 27, 2015
• Accommodations delivered via the Measurement
Incorporated Secure Testing (MIST) System
• MIST account usernames and passwords are available on the
Measurement Incorporated Web Portal.
• MIST Student Rosters are available on the MIST Proctor Site.
• Test irregularities require a phone call to CSDE
• CMT and CAPT Science: (860) 713-6890
CMT /CAPT Science Testing Times
Test
Testing Time
Directions Time
Total Time
CMT Grade 5
65 Minutes
10 minutes
75 minutes
CMT Grade 8
70 minutes
10 minutes
80 minutes
CAPT Grade 10
Session 1: 50 minutes
Session 2: 50 minutes
15 minutes
5 minutes*
65 minutes
55 minutes
* Allow 15 minutes for directions if administered on separate days.
CMT/CAPT Science
Test materials are posted on the Student Assessment
page of the CSDE Web site:
www.ct.gov/sde/StudentAssessment
• Test Coordinator Manuals
• Test Examiner Manuals
• Student/Parent Brochures
• Online Training Module
CMT/CAPT Science
Supplemental (Pilot) Testing:
• At grades 5, 8 and 10
• Districts have been notified of schools
selected to participate
• Paper & Pencil (required): March 2-27
• Online (optional): March 9-April 10
• Testing Time = 60 minutes (plus 10-15 minutes
for directions)
Smarter Balanced Test Administration
What is Smarter Balanced?
A. A buttery spread
that helps lower
your cholesterol?
B. A new testing
company?
C. A state-governed
project based at a
research university?
Smarter Balanced Summative Assessments
Estimated Testing Times
Test Type
English Language
Arts
Mathematics
COMBINED
Grades
CAT
Perf. Task
Only
Total
Classroom
Activity
Total
3-5
1:30
2:00
3:30
:30
4:00
6-8
1:30
2:00
3:30
:30
4:00
11
2:00
2:00
4:00
:30
4:30
3-5
1:30
1:00
2:30
:30
3:00
6-8
2:00
1:00
3:00
:30
3:30
11
2:00
1:30
3:30
:30
4:00
3-5
3:00
3:00
6:00
1:00
7:00
6-8
3:30
3:00
6:30
1:00
7:30
11
4:00
3:30
7:30
1:00
8:30
Times are estimates of test length for most students. Smarter Balanced assessments are designed
as untimed tests; some students may need and should be afforded more time than shown in this
table.
ELA Timing and Sequencing
ELA
CAT Items
Classroom Activity
Performance Task (PT)
Number
and
Duration of
Sessions
Recommendations:
Recommendations:
The PT is presented in two parts.


Administer in one session
Recommendations:

Approximate session
duration: 30 minutes


Should occur one to three
days prior to PT
Administer in two sessions
corresponding to Parts 1
and 2 of the PT.

Session durations range
from 60–120 minutes.

Breaks
within
Sessions
Total
Duration
No fewer than two sessions
(recommended) and no
more than six sessions
(rare/extreme).
Session durations range
from 40–60 minutes.
Breaks can be provided during the
test sessions using the software’s
pause feature. If the test is
paused for more than 20
minutes, the student will not be
able to go back to items on the
previous screens.

Should NOT occur on the
same day as the ELA PT
NA

Recommendation: Students
complete Part 1 in one test
session and Part 2 the next
school day.
Once a student has started the
PT, it will be available for 10 days.
Once a student has started the
CAT items, they will be available
for 45 days.
•
Recommendation:
Student completes this
portion within five days of
starting.
The PT is presented in two parts.
Students can take breaks within
Parts 1 and 2; however, once a
student moves to Part 2, he or
she will not be able to review or
revise items in Part 1.
NA

Recommendation: Student
completes each part of the
PT within one day.
Mathematics Timing and Sequencing
Mathematics CAT Items
Classroom Activity
Performance Task (PT)
Number and
Duration of
Sessions
Recommendations:
Recommendations:
Recommendations:


Administered in one session

Administered in one session.

Approximate session duration:
30 minutes

Session duration ranges from
40–120 minutes.

Should occur as close to the PT
as is feasible, and no more
than three days prior to the PT

MAY occur on the same day as
the PT

Administered in two
sessions.
Session durations range from
40–60 minutes.
Most students will complete the
CAT items in two sessions of 60
minutes or less or one long
session of more than 60 minutes.
Breaks within
Sessions
Total Duration
Breaks can be provided during the
test sessions using the software’s
pause feature. If the test is paused
for more than 20 minutes, the
student will not be able to go back
to items on the previous screens.
Once a student has started the
CAT items, they will be available
for 45 days.

Recommendation: Student
completes this portion
within five days of starting it.
NA
NA
Students can take breaks during PT
test sessions. Mathematics PT
items are presented on a single
screen. Following a break, the
student will have access to the
same items.
Once a student has started the PT, it
will be available for 10 days.

Recommendation: Student
completes the PT in one day.
Scheduling Test Sessions
Recommended order of administration for each
content area:
CAT
Classroom
Activity
Note: The ELA PT has two parts:
• Part 1 – Research
• Part 2 – Full write
Performance
Task
Classroom Activity
• Recommended to be administered no more than 3 days
before the PT
• Approximately 30 minutes
• Designed to “level the playing field” to ensure that all
students understand the context of the task
• Administered in a classroom setting
• Topics and scripted classroom activities available for
download in TIDE. Users can only download classroom
activities that were assigned to their school
• Students should proceed with testing if the CA was
inadvertently not provided (this is not submitted in the
Appeals system)
Smarter Balanced Practice and Training Tests
Practice Tests
Training Tests
• Similar in format and structure • Provide students with an
opportunity to quickly become
to the Smarter Balanced
familiar with the software and
assessments
interface features that will be
• Grades 3–8 and 11
used in the Smarter Balanced
• Approximately 30 items per
assessments
grade level test in each content
• Three assessments by grade
area
band, 3-5, 6-8 and HS
• ELA
• Mathematics
• Approximately 14-15 total items
per grade band
• 1 performance task per
• 6 in ELA
content area
• 8-9 in mathematics
• Scoring guides and classroom
• No performance tasks
activities
Response Types
Smarter Balanced Response Types
MC with one correct response
Selected
Response
MC with multiple correct responses
Two Part multiple-choice
Matching Tables
Yes/No or True/False Tables
Fill-in Tables
Constructed
Response
Select or order text or graphics
Complex drag and drop
Graphing
Equation or numeric response
Short Text
Long Essay
Smarter Balanced Practice and Training Tests
Available Embedded Universal Tools, Designated Supports, and Accommodations
• All universal tools
• All designated supports, including:
–
–
–
–
–
–
–
–
Color contrast
Masking
Streamlining
Text-to-speech items
Translated test directions: Spanish
Translations (glossary): Spanish, Arabic, Cantonese, Filipino, Korean, Mandarin, Punjabi,
Russian, Ukrainian, Vietnamese
English Glossary
Stacked Translation: Spanish
•
All accommodations, including:
•
Students who require the use of assistive technology should test the usability
of the devise using the Training Test.
–
–
–
–
American Sign Language for all math items and ELA listening stimuli and items
Braille
Text-to-speech for reading passages in grades 6–high school
Closed Captioning
Improprieties, Irregularities, and Breaches
Test Security Chart
Impropriety
Irregularity
Breach
• Unusual circumstance that
has a low impact on the
individual or group of
students who are testing
• Low risk of potentially
affecting student
performance on the test,
test security, or test validity
• Can be corrected and
contained at the local level
• TA documents impropriety
in Test Security Incident
Log and submits to SC/DC
immediately.
• SC/DC takes corrective
action, usually does not
require an appeal
• Unusual circumstance that
impacts an individual or
group of students who are
testing
• May potentially affect
student performance on
the test, test security or
test validity
• TA documents irregularity
in Test Security Incident
Log and submits to SC/DC
immediately
• SC/DC submits the
incident in the Appeals
system within 24 hours, if
it requires a reset, reopen,
restore, grace period
extension, or invalidation
• Event that that poses a
threat to the validity of the
test
• Examples include the
release of secure
materials
• May result in a Consortium
decision to remove the test
question(s) from the
available secure bank
• TA reports breach to the
SC/DC immediately
• The DC must contact the
CSDE by phone
immediately at
(860) 713-6860
Appeal Types
Appeal Type
Description
Reset a Test
• Removes the test, and scores, from the system
• Enables student to start a new test
Reopen a Test
• Allows for a test that has already been submitted in error, or
has expired to be re-opened
Grace Period
Extension
• Granted if a test session is unexpectedly interrupted
• Allows access to all previous responses
Restore a Test That
Has Been Reset
• Return a test from the Reset status to its prior status
• Only allowed on tests that have been reset
• A test can be restored if it was reset in error
Invalidate a Test
• Eliminates the test
• Student does not receive a score
Note: The Appeals system can also be used to address incidents that are not
security related such as re-opening an assessment for a student who becomes
ill and is unable to resume testing because the test expired.
Interim Assessments
• Available beginning January 27
• Interim Assessment Blocks (IAB)
• Interim Comprehensive Assessments (ICA)
• Requires upload of school users to TIDE
• Requires setting of designated supports and
accommodations for students in TIDE
• Educators must be trained
• Students should be provided opportunity to take
Practice/Training Tests
• CSDE recommends use of IAB only for 2014-2015
school year
AIR Systems Overview
Copyright © 2014 American
Overview
•
•
•
•
•
Portal
Secure Browser
Test Information Distribution Engine (TIDE)
Test Delivery System (TDS)
Online Reporting System (ORS)
2
Portal – http://ct.portal.airast.org
3
User Pages
31
Resources
32
32
Resources Available Now
•
•
•
•
Important Dates
CSDE Assessment Guidelines
Modules:
- What is a CAT?
- Performance Task
- Accessibility and Accommodations
- Embedded Universal Tools
- Student Interface
- TA interface
- Technology Overview
Systems Requirements for Online Testing
33
Resources Coming Soon
•
•
•
•
Practice and Training Tests
Test Administrator and Test Coordinator Manual
User Guides
• TIDE
• Test Administration
• ORS
• Teacher Hand Scoring System
Modules
• Test Administration Overview
• ORS
• Teacher Hand Scoring System
34
What is the Secure Browser?
The secure browser is designed to ensure test security
by prohibiting students from accessing any other
programs or websites during testing.
35
Secure Browser Information
• Download the latest secure browser from the
portal. The field test secure browser will not
work.
• Before taking a test, all applications must be
closed.
• The iPad app will be updated by the end of
January in order to support iOS8.
36
Secure Browser Download
37
Accessing AIR Systems
38
Activating TIDE Account
39
TIDE Overview
40
TIDE Navigation
41
User Roles
Task
DA
DC
SC
Viewing and Editing Student
Settings















Manage Rosters
Adding User Accounts
Create Appeals
Downloading and Installing
Voice Packs
TE
TA




42
Roles and Usernames
43
Manage Users
44
Add Users
45
Student Information
46
Retrieve Students
47
View Retrieved Students
48
Add Student Settings
49
Appeals
50
Types of Appeals
Appeal Type
Description
Reset a Test
•
•
•
Removes the test, and scores associated with the test, from the system
Enables student to start a new test
Requested due to accommodations not being set properly
Reopen a Test
•
Allows for a test that has already been submitted or has expired to be reopened
Grace Period Extension
•
•
Extends the grace period if a test session is unexpectedly interrupted
Gives access to all previous answers
Restore a Test That Has
Been Reset
•
•
•
Return a test from the Reset status to its prior status
Only allowed on tests that have been reset
A test can be restored if it was reset in error
Invalidate a Test
•
•
•
Eliminates the test
Student loses that test and does not receive a score
Requested due to test security incidences
51
Creating Appeals
52
Searching Appeals
53
Viewing Appeals
54
Testing Tickets
55
Rosters
56
Voice Pack
57
Test Delivery System Overview
 Two interfaces:
• Student
• Test Administrator
 Two sites
• Operational
– Interim
– Summative
• Practice/Training Test
58
Student Interface
59
Student Test Selection
60
Student Interface
61
End of Segment
62
End of Test
63
Test Administrator Interface
64
TA Interface: Overview
65
TA Interface
66
Student Entry
67
Save and Edit Details
68
Monitoring Student Progress
69
Pausing and Stopping Sessions
70
ORS Interface: Welcome Page
71
Test Management Center:
Plan and Manage Testing
• Which students have not yet tested?
• Which students have started but not yet completed their test?
• Which students need to finish tests that are going to expire soon?
• Which students have paused tests?
72
SPECIAL POPULATIONS
Special Population Web sites
Resources- Website
Links
Accommodations Data Entry
Web site
Measurement Incorporated
Web Portal
Description
Connecticut State Department of Education website for data collection of
accommodations/supports:

Smarter Balanced Assessments

CMT/CAPT Science

Connecticut Alternate Assessments (CTAA)/ NCSC

CMT/CAPT Skills Checklist Science
• CTAA and CMT/CAPT Skills Checklists Science Eligibility & Learner Characteristics
Inventory (LCI)
Special Education; Section 504, English Language Learners (EL)
Website remains open throughout testing
Measurement Incorporated Web Portal:



District Test Coordinator information
Enter completed CMT/CAPT Skills Checklist Science (March 2-27,2015)
Look up teachers trained to administer the CTAA/NCSC and CMT/CAPT Skills
Checklist Science
MIST Practice Site
This site allows students to take an online CMT/CAPT Science practice test using the
Measurement Incorporated Secure Test (MIST) system. These practice tests are
available to provide students with a first-hand look at the online testing interface
before the live test administration in March. Students will also have the opportunity to
practice using the available online tools as well as learn how to navigate through the
test. No feedback or results will be provided.
2014-2015 CSDE Required
Training for Connecticut
Alternate Assessments
All teachers responsible for administering the alternate assessments, including those
teachers with current Skills Checklist Administration certifications, must participate in
one of two types of CSDE training. The CTAA/NCSC is replacing the CMT/CAPT Skills
Checklist in English language arts and Mathematics for the 2015 administration.
Special Population Resources
Resources- Documents
Links
Description
Assessment Guidelines 2014 - 2015
Edition
This document is intended to provide guidance for Connecticut school
district personnel who must make decisions about testing special student
populations on Smarter Balanced, CMT/ CAPT Science, Connecticut
Alternate Assessments and CMT/CAPT Skills Checklist Science.
Accessibility Chart with Definitions
This document provides an overall description of the Smarter Balanced
universal tools, designated supports, and accommodations for the field
test. Clicking on any of the feature will provide the definition.
2014 - 2015 Test
Supports/Accommodations Form
This form is intended for Special Education, 504 and EL students taking
the Smarter Balanced Test and CMT/CAPT Science to indicate designated
supports, and accommodations. This submitted Accommodations Data
Entry Web site.
Usability, Accessibility, &
Accommodations 2014-2015
Presentation
PowerPoint presentation on the usability features available to students
who will be taking the Smarter Balanced Assessments. This includes a
deeper understanding of the tools, designated supports and
accommodations available to a variety of students.
Universal Tools: Available to ALL students
Designated Supports:
Embedded
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
Breaks
Calculator
Digital Notepad
English Dictionary
English Glossary
English Thesaurus
Expanded Passages
Global Notes
Highlighter
Keyboard Navigation
Mark for Review
Math Tools
Spell-Check
Strikethrough
Writing Tools
Zoom
Non-Embedded
•
•
•
•
Breaks
English Dictionary
Scratch Paper
Thesaurus
~ Requires Trained Educator
Embedded
• *Audio Translation
Glossaries (new)
• Color Contrast
• Masking
• Text-to-Speech
• *Translations-Math
(Glossary)
• *Translations-Math
(Stacked)
• Turn off any universal
accessibility tool
Non-Embedded
•
•
•
•
•
•
•
•
•
*Bilingual Dictionary
Color Contrast
Color Overlay
Magnification
Noise Buffering (new)
~Read Aloud
Separate Setting
Translation-Math (Glossary)
Translation Test Directions
*EL-ONLY
Available to ANY student with a
need determined by educators
Accommodations:
Embedded
• American Sign Language (Video)
• Braille
• Closed Captioning
• Streamline View
• Text-to-Speech (ELA-reading
Passages) grades 6-11
Available to students with an
IEP or 504 Plan
Non-Embedded
Abacus
Alternate Response Options
Calculator- grades 6-11
Multiplication Table-grades 4-11
# Print on Demand
~ # Read Aloud- (ELA-reading
Passages) grades 6-11
• ~ # Scribe
• Speech-to-Text
•
•
•
•
•
•
# Requires Petition for Approval of Special Documented Accommodations
Alternate Assessment Websites & Resources
Resources
Links
Description
National Center And State
Collaborative (NCSC) Website
This website provides information and resources about
the National Center and State Collaborative (NCSC).
NCSC is the consortium Connecticut worked with to
develop the Connecticut Alternate Assessment for
English language arts and math for our students with
significant cognitive disabilities.
NCSC Wiki
The National Center and State Collaborative (NCSC) shared goal of
the is to ensure that students with the most significant cognitive
disabilities achieve increasingly higher academic outcomes and
leave high school ready for post-secondary options. This wiki and the
materials hosted here help educators accomplish the NCSC goals by
supporting instruction aligned to the Common Core State Standards
(CCSS).
Measurement Incorporated Web Portal/CMT Skills Checklist Science
and CAPT Skills Checklist Science:
Measurement Incorporated
Web Portal
(Coming Soon)
Connecticut Alternate
Assessment (CTAA) /NCSC
Portal

District Test Coordinator creates usernames and passwords
for eligible teachers administering the CMT/CAPT Skills
Checklist Science and may Look up teachers trained to
administer the CTAA/NCSC and CMT/CAPT Skills Checklist
Science

Trained teachers enter CMT/CAPT Skills Checklist Science
data collected throughout the year during upload window from
March 2-27, 2015
Connecticut Alternate Assessment(CTAA) /NCSC Portal
• DTCs will manage trained test administrator access and
student records
• Trained Test Administrators will access student tests and
enter student responses vis the test portal
More information will be shared in future Assessment
Newsletters
Comparison of CMT/CAPT Skills Checklist to CTAA
Comparison of CMT/CAPT Skills Checklist to CTAA
CTAA Designed for Students with SCD
• Reading items, passages and response
options to students
• Emphasis on Communicative Competence
• Test Design Includes
– Decreasing Complexity Tier 4 to 1
– Increasing Support Tier 4 to 1
– Tiers 2, 3, and 4 aligned to the Focal Knowledge Skills
and Abilities (FKSA)
– Tier 1 is aligned to Essential Understanding (EU)
CTAA Format
• Online 1: 1 testing
• Math
• English language arts
– Reading
– Writing
• Selected Response
• Constructed Response
• Open Response
Accommodations for CTAA
Accommodations needed are indicated on page 9 of the IEP and the
specific accommodations will be entered on the CTAA/NCSC portal at the
time of testing in accordance with the Directions for Test Administration
• Assistive Technology for Presentation and/or
Response
• Braille
• Paper Version of Item
• Sign Language
• Scribe
• Read Aloud (assessment feature)