Transcript CMAS Colorado Measures of Academic Success

Colorado Measures of Academic
Success (CMAS)
Training for SAC’s
Agenda

SAC Responsibilities
◦ Communication
◦ Scheduling
◦ Test Security

Pearson Access
◦ Online test management

Proctor Training

Accommodations
Windows, grades, content areas
Assessment Window
November 3-21, 2014
Science grade 12
 Social Studies grade 12

Frameworks

The frameworks list
◦ Percent representation and number of score points
for each of the reporting categories/standard areas
that will appear on the summative assessments
◦ Evidence Outcomes eligible for inclusion
 Topics explicitly identified in the Social Studies standards are
legitimate content for the assessment in addition to the
standards' concept and skills

http://www.cde.state.co.us/assessment/newassesssum
Changes…..
Online Assessment vs Paper Pencil
Will be a shift for teachers, proctors,
students, parents, administratorscommunicate regularly
 Using Pearson Access to manage your
testing
 Accessibility features vs Accommodations
 Learning tech readiness for you and your
building
 More rigorous, higher DOK

Similarities
Ethical administration and procedures and
ensuring standardized conditions
 Test security is important for valid and
reliable scores
 Active Proctoring is a must

CMAS: High School Science and
Social Studies Program Overview
CMAS Components

TestNav: Software that runs the
assessment
◦ Make sure your apps are up-to-date
 TestNav 8 is new software that is supported by
iPads and Chromebooks
PearsonAccess: Software that is used to
manage student data
 PearsonAccess.com: Web portal to
PearsonAccess and other resources

Who should be Tested?

Students designated as 12th graders.
Participating 12th graders typically will be
students who are:
◦ Designated as 12th grade for the first
time
◦ Part of School Year 2011-12 freshman cohort
(2014-15 anticipated year of graduation)
◦ Part of School Year 2012-13 freshman cohort
or later classified as 12th grader due to credit
accumulation
◦ In their fourth year or less in high school
Test Structure

Each content area consists of 3 sections
◦ Each section includes 24 items
Option 1: Administer 3 sections to students in
one day
 Option 2: Administer 1(or 2) section(s) per day


The assessments include the following item types:
◦
◦
◦
◦
◦
Selected Response
Constructed Response
Computer-Enabled/Technology-Enhanced
Simulations (science)
Performance Events (social studies)
What are the Responsibilities of
School Assessment Coordinators?
SAC Responsibilities include
Communication
 Scheduling
 Test Security and Ethics

Technology
 Pearson Access
 Test Administrator Training
 Practice tests (epats)

SAC Responsibilities
Test Administration Training


Read Procedures Manual in its entirety after
today’s training and prior to training your
building
A face to face proctor training is required by
you to your building proctors prior to the
start of the testing window
◦ Use the Proctor Training ppt. provided, it includes
ethics and test administration

Keep all signed confidentiality agreements
onsite for all of your trained CMAS proctors
13
SAC RESPONSIBILITIES:
COMMUNICATION
Communication





Lead contact for questions in their building
Always available to school proctors during
all testing sessions in case of tech or test
administration question or concern
Lead communication with building
technology staff
Be part of communication with building tech
staff and district IT
Building communication to DAC
Who to contact with questions

Test administration
◦ Proctor to SAC
◦ SAC to DAC
◦ DAC to CDE
◦ Tech questions
 Building tech to district IT-inform SAC of any tech
issues so they are aware
Assessment
Technology
CDE
SAC RESPONSIBILITIESSCHEDULING
Definitions

PearsonAccess Test Session: Virtual data grouping of
students who are grouped together within PearsonAccess
for test management purposes. Each PearsonAccess test
session consists of one grade level and one content area
(three sections). Students must be placed in a scheduled
PearsonAccess test session before they can log in to a test.

Test Section: The parts of a CMAS: Science and Social
Studies assessment. Each content area of the CMAS: Science
and Social Studies assessments include three sealed test
sections.

Physical Testing Group: Students who test within a
physical testing environment at the same time.
Scheduling

Create school wide testing schedule
◦ including accommodations and make ups

Proctor scheduling: Suggest proctor and
tech savvy person both be in room so if
students are stuck with tech issues
proctor isn’t stuck with one student
◦ Helps keep standardized conditions
CMAS Scheduling Considerations

Each content area consists of 3 sections

Test sections can only be administered to students in consecutive
order

One content area at a time except for make-ups

To the extent possible, all students within a grade should be assessed
at the same time. Should that not prove possible, all students should
be assessed within the shortest timeframe practicable (i.e., in back-toback sections, within the same day or consecutive days if more
sections are needed than can be administered in a day, etc.)
Scheduling considerations cont…

Technology
◦
◦
◦
◦
Number of compatible devices
Bandwidth
Wireless access points
How many concurrent testing sessions can
you run?-use the site readiness tool
◦ Extra computers
CMAS: High School Test Structure
and Timing
CMAS: Science and Social Studies Section
Administration Time for Elementary and Middle School
Time for Set Up Required Testing Additional Testing
and Transition
Time for All
Time
(Estimated)
Students
(10 minutes)
55 minutes
15 minutes
New • If all students have completed the test section, the Test
Administrator may read the script to end that particular test
section.
Time for Set up and Transition
Includes….





Start up TestNav 8.0
Log in
Test transfer (proctor cache…)
Give directions
Review sample items
Students must have 70 minutes
to test
Required to be on task for 55 minutes*
Students are entitled to a full 70 minutes without
interruption to complete section*
 Start the clock when directions are complete
 Treat technology interruptions as any other
“interruption to testing”


◦ Note the time of the technology interruption
◦ Student must be given remaining time to complete section
New
*If all students have completed the test section, the Test
Administrator may read the script to end that particular
test section.
After 55 Minutes

School Decisions:
◦
◦
◦
◦
◦

Sit Quietly
Read (cannot use any electronic reading devices)
Must not do any writing or any other activity
May be released to location outside testing area
What to do when all students are completed
with section
School Site Considerations:
◦ To where will students be released?
◦ To whom will students be released?
Section Timing: School Level
Decisions

Select Timing Option (1, 2, 3, or 4)
◦ If Option 1 or 2 is selected, indicate where
students should go when finished
Timing Options
Timing Options
CMAS Scheduling Considerations

Schedule first group/first day with more of a time cushion than
other groups if you can
If you have to do multiple sessions, schedule smallest group first
 Determine whether one content area will be completed before
beginning the next, or if testing will alternate between the two
content areas (make-ups excluded)


Determine whether the district wants to condense testing
(make-ups excluded) or spread throughout the testing window

Determine whether students will take an entire session in one
day or take one section per day (make-ups excluded)

Remember: This is Colorado
CMAS Scheduling Considerations:
Accommodated Sessions





All students now have extended time included in
their test sessions
Students using Text-to-Speech (TTS, replaces
English Oral Scripts) may be in the same session
with other students if they use headphones if
headphone noise does not impact other students
Students who need double time (110 minutes)
must be scheduled in a separate session
“Teacher Read Directions” Accommodation is
not available in CMAS: Science and Social Studies
CDE recommends administering Oral Scripts for
social studies individually
Student-to-Test Administrator
Ratio

Student-to-Test Administrator ratio must
not exceed 30 to 1
◦ Test Administrator must be able to actively monitor the space
within the testing environment
◦ Recommend 2 proctors to 30 students in order to maintain
standardized testing conditions
Best Practices-Recommendations
2 extra devices in each testing room
 Make a school plan for which timing
option you will use and make sure
everyone knows it

School CMAS schedules
Email to Kim Terry no later than Oct. 24th
 Also send security of testing materials
form

Make-Up Testing
Priority: minimize risk of prior
exposure to test content that could
result in an invalidation
Student completes missed test
section during make-up testing time
in advance of re-joining original
physical testing group
Sample Make-Up Testing Schedule
Day 1
Regularly
Scheduled
Make-Up
Testing Time
(beginning of
morning)
-
Physical
Testing Group
Testing Time
Physical testing
(scheduled
group takes test
after initial
section 1
morning
make-up
testing time)
Day 2
Absent Student
Takes Section 1
Day 3
-
Absent Student Physical testing
re-joins physical group takes test
testing group for section 3
test section 2
CMAS or CoAlt

CSAP-A decision not based on:
◦ Category of disability
◦ Time in special education
◦ Program placement

Must be documented by IEP team

Contact Becky Ford in ESS
if you need clarification
37
Scheduling Discussion – Guiding
Questions

How many compatible devices does your school have
for testing?

How many students in tested grade level?

What option will you use? 1, 2, 3, or 4?

What other impacts to scheduling do you see?

How does make-up testing affect scheduling?
◦ How to schedule for students who miss multiple days?
SAC responsibility
Test and materials security
Test Security
Testing environment-screen security and
number of computers
 How far apart to sit students
 Can students view from front to back
the rows of screens in front of them?
 Student view side to side
 St authorization tickets-secure
 Student pre exposure to items

Test security

No cell phones in testing room
◦ Collect (baggies with names) so students do
not have them during testing
No student tablets allowed in testing
room
 Ipads are allowed for TEST
ADMINISTRATORS only

◦ No recording
◦ No pictures of anything in test environment
ever
Security of Student Authorization
tickets-one approach
SAC print before the test
 Put all into an envelope labeled for that
test

◦ Maybe with a class list on the outside of it,
◦ All used tickets will be collected by the
proctor and put back in that envelope

Have another empty envelope labeled
“MAKE UP TESTING REQUIRED”
◦ Proctors put any unused authorization tickets
Chain of Custody
Student authorization tickets: Count
in/out and test administrator sign for each
time
 Paper forms
 Oral scripts
 Secure central storage location

◦ Not stored in classrooms
Non-Secure
Secure





Student Authorization
Tickets
Seal codes
Paper test books
Social Studies source books
Oral scripts


Test Administrator Manual
(TAM)
Procedures Manual
Test Materials Security
Maintaining Security of CMAS

All secure test materials must be secured while in
the Test Administrator’s possession

No duplication of secure CMAS materials is
permissible

No cell phones or other communication, reproduction
or recording devices are allowed in the classroom
Unauthorized Visitors and the Media

Only students, Test Administrators/Examiners, and
authorized school, district, state personnel or statesanctioned test monitors may be in testing areas during
administration

Media are not allowed to have access to the tests before,
during, or after test administration, or take pictures or
video of testing materials or testing students
The Test Environment

The testing environment must be free of any content
related posters or aids that suggest possible answers to
students
◦ Word walls
◦ Steps for solving math equations
◦ Any content related materials

Generally, posters that do not include content specific
definitions, content related processes or solutions may
remain on the wall
SCHOOL
TECHNOLOGY
RESPONSIBILITIES
School tech




Java updates
shortcut or LAN school set up using login
given by IT that locks out other programs,
puts test nav screen on every computer
Site readiness tool so # of devices to run at
one time is known
http://systemcheck.co.testnav.com/systemCh
eck.jsp?acc=co_chk
Refer to district IT tech training for more
information
System Check
http://systemcheck.co.testnav.com/
 If you have the specifications for which
browsers and versions work with which
operating systems, etc you may not need
this tool

Results From System Check - Failed
System Check - Passed
Without Proctor Caching - 26
Students
With Proctor Caching
With proctor caching- 466 students
Receiving and
Returning Test
Materials
Receiving Test Materials
◦ SAC to verify materials
received with the School
Packing List
Test Materials

Online and Paper
◦ Test Administrator’s Manual
◦ CMAS Secure Return Envelope
◦ School Security Checklist

Online Only
◦
◦
◦
◦

Student Authorization Tickets
Seal Code Document
English and Spanish Oral Scripts for Online Form
Onsite Translations into Languages other than English/Spanish
Paper Only
◦
◦
◦
◦
◦
Test Books, including Braille and Large Print
Source Book (Social Studies Only)
Periodic Table (Science Only)
English and Spanish Oral Scripts for Paper Form
Onsite Translations into Languages other than English/Spanish
Receiving Test Materials

Materials will arrive via district warehouse-date tbd
◦ Green labels on CMAS boxes
◦ Pink labels on CoAlt boxes
Returning Test MaterialsSACs
SACs

Collect all secure materials and group as follows:
 Scorable test books
 Test books must be grouped by content area. Top the
grouped test books with a completed header sheet and
secure with a paper band.





Unused test books
Secure return envelopes
Accommodated materials
Electronic materials must be removed from any devices after
testing and verification sent to the DAC
Prepare materials for packaging
 Check and deliver CMAS scorable test books to the DAC ASAP
 Check and deliver CMAS nonscorable materials to the DAC
 Return materials in original boxes
Questions