Transcript CMAS Overview - Colorado Springs School District 11

Colorado Measures of Academic
Success (CMAS)
English Language Arts – Mathematics – Science – Social Studies
Spring Administration Training for SACs
Test overview and administration
Overview
Timeline and Test Structure
Administration Overview
Important Dates
Before Testing
Preparing for test administration
Student Readiness
The Test Environment
During Testing
Administering Tests
Make-Up Testing
After Testing
2
Acronyms
• CBT: Computer-Based Test
• ELA: English Language Arts
• ELA/L: English Language
Arts/Literacy
• EOY: End-of-Year
• LEA: Local Education Agency
(District)
• LTC: LEA Test Coordinator (DAC)
• PBA: Performance Based
Assessment
• PBT: Paper-Based Test
3
•
•
•
•
•
•
•
•
SRI: Student Registration Import
SDU:Student Data Upload
S&SS: Science and Social Studies
STC: School Test Coordinator
(STC = SAC)
SAC: School Assessment
Coordinator (SAC = STC)
TCM: Test Coordinator Manual
TAM: Test Administrator Manual
TTS: Text-to-Speech
PARCC English Language Arts and
Science and Social Studies:
Mathematics:
Purple
Green
Student Testing Ticket
Student Authorization Ticket
Student Registration Import/Export
(SRI/SRE)
Student Data Upload (SDU/RSDU)
PearsonAccessnext
PearsonAccess Classic
Scratch Paper
No Scratch Paper (District decision)
Personal Needs Profile (PNP) for
Accommodations
No PNP: Assign through SDU or User
Interface
Spanish Text-to-Speech Available
(Math Only)
Spanish Audio and Spanish Source
Book
Colorado Measures of
Unit (Sections Academic
within Unit)
Section (CMAS)
Success
4
Timeline and Structure
5
Administration Overview
• PARCC English Language Arts and Mathematics
– Performance Based Assessment (PBA)
– End-of-Year Assessment (EOY)
Content Area
Grades
English Language Arts 3-11
Mathematics
3-8, three high school assessments
• Pathway 1: Algebra I, Geometry, Algebra II;
• Pathway 2: Integrated/Math I, Integrated/Math II,
Integrated/Math III
• Science and Social Studies
– Elementary and Middle School (one window)
Content Area
Grades
Science
5 and 8
Social Studies
4 and 7
6
Grade of
Student
Mathematics Assessment
Options for 2014-2015
 7th grade
Additional Flexibility Pilot Options for
2014-2015
 7th grade
 Algebra I
8



8th grade
Algebra I
Integrated I (Math I)



8th grade
Algebra I
Geometry
9


Algebra I
Geometry



Algebra I
Geometry
Algebra II
10



Algebra I
Geometry
Algebra II



Algebra I
Geometry
Algebra II
11*


Geometry
Algebra II


Geometry
Algebra II
12**

Algebra II

Algebra II
7
*Test if in Algebra II or below
**Only test if in Algebra II
7
Spring 2015 Assessment Calendar
Assessment
Grades
PARCC
Performance3-8, High School
Based Assessment
(PBA)
CMAS and CoAlt:
4 and 7 (Social
Science and
Studies)
Social Studies
5 and 8 (Science)
PARCC End-of-Year
3-8, High School
Assessment (EOY)
Assessment
Windows
Early Windows
3/09/15 to
4/03/15
3/02/15 to 4/03/15
4/13/15 to
5/01/15
4/27/15 to
5/22/15
4/20/15 to 5/15/15
8
Spring 2015 Tentative Critical Dates
Description
PARCC English Language Arts
and Mathematics
PBA
EOY
Science and
Social Studies
Submit student data/update
participation counts for initial
orders
December 3
January 23
February 16 – March 6
Online test session set-up begins
Open now
Open now
February 16
Materials scheduled to arrive in
districts*
February 23
April 13
March 30
Proctor caching test content
begins (prior to testing)*
February 23
April 13
March 30
Additional Orders – Secure
Materials*
February 23March 27
April 13-May
15
April 1 – April 30
Additional Orders – Non-Secure
Materials*
February 23April 10
April 13-May
29
April 1 – May 6
*If you have an early window, materials will be received one week earlier
9
Guidelines for
Administration Time
Task
Time to be Allotted
for an Administration
Preparing for testing (includes reading
instructions to students and answering questions)
10 minutes (recommended)
Distributing test materials
5 minutes (recommended)
PARCC English language Arts and Mathematics Unit testing
time
Science and Social Studies Section testing time
Completing end-of-unit activities, including closing units,
collecting test materials, and administering a student survey
(after EOY)
10
60-90 minutes*
80 minutes
5–15 minutes
(recommended)
*For PARCC, depending on unit and subject—refer to Unit Guidelines and
Schedule table in the Test Coordinator Manual for each Unit Time.
Guidelines for
Administration Time
Guidelines for Administration Time (continued)
• Schedule the entire amount of Unit/Section Testing Time.
• Once the Unit/Section Testing Time has elapsed, the Unit/Section
must end.
• If all students have completed the Unit/Section, the Unit/Section
NEW
may be ended (no minimum testing time).
• A student may be allowed an extended time accommodation only
if listed in his or her IEP, 504 Plan, or EL Plan.
• PARCC: time-and-a-half is not included in Unit testing time.
• Science and Social Studies: time-and-a-half is included in the
Section testing time
11
Guidelines for Breaks
Breaks
• Between Units/Sections, scheduled breaks may occur.
Example EOY (ELA/L Administration):
8:00 a.m. – 10:00 a.m.
Unit 1
10:00 a.m. – 10:15 a.m.
Scheduled Break
10:15 a.m. – 12:15 p.m.
Unit 2
• During a Unit/Section, short “stand-and-stretch” breaks may
be permitted at the discretion of the Test Administrator.
12
PARCC PBA Test
Administration Flowchart
13
Note: This diagram illustrates
grades 6-8.
PARCC EOY Test
Administration Flowchart
14
Note: This diagram illustrates grade 7 and high school.
Science and Social Studies
Administration Flowchart
Section 1
(Unit)
Science and
Social Studies
(One Window)
Section 2
(Unit)
Section 3
(Unit)
Example of Unit Testing Times: PARCC
16
Science and Social Studies
Section Testing Times
Science and Social Studies
Subject
Unit/Section
For Scheduling/Testing
Purposes
Unit/Section Testing Time
Science and Social
Studies
Section 1
80 minutes
Section 2
80 minutes
Section 3
80 minutes
17
Scheduling Considerations
• Test Units/Sections can only be administered to students in
consecutive order.
– Only PARCC Make-ups may be administered out of order.
• Paper testing: A school must administer the same Unit to all
paper-based students within the same day (e.g., Unit I on
Tuesday).
• Computer testing: To the extent possible, all students within
the school should be assessed at the same time. If not possible,
all students should be assessed within the shortest timeframe
practicable.
• Scheduling may be dependent by school.
18
Scheduling Considerations
• Schedule first group/first day with more of a time cushion than
other groups if you can.
• If you have to do multiple sessions, schedule smallest group first.
• Determine whether one content area will be completed before
beginning the next, or if testing will alternate between the two
content areas (make-ups excluded).
• Determine whether the district wants to condense testing
(make-ups excluded) or spread throughout the testing window.
• Determine whether students will take an entire session in one
day or take one Section/Unit per day (make-ups excluded).
19
PARCC: Scheduling Sessions
• If the time and directions are the same, different grades can be
administered in the same room.
– Algebra I and Geometry can be administered in the same room.
– ELA and Math cannot be administered in the same room because the
directions are different
– PBA of Algebra I and II can be tested together but the EOY cannot
because of Unit time differences
– Ensure that all calculator/non-calculator sections are the same
• Students from different grade levels taking the same
assessment (Algebra I for grades 8-10) can be combined in a
testing environment.
20
Before Testing
21
Selected Tasks to Complete
Before Testing
Steps to Prepare for Computer-based Testing:
 Read manuals.
 Create, manage, and edit test sessions.
 Train Test Administrators on how to manage and monitor Test
Sessions in PearsonAccess/PearsonAccessnext.
 Ensure that students are assigned to appropriate forms
(accommodations and accessibility features).
 Pre-cache test content.
22
Tasks to Complete
Before Testing
Prepare for Test Administration
PARCC
 View applicable training modules at
http://parcc.pearson.com/tms.
 Establish a testing schedule.
Science and Social Studies
 View applicable training modules on the
PearsonAccess Support tab.
 Establish a testing schedule.
23
Tasks to Complete
Before Testing
Prepare for a Test Administration
PARCC and Science and Social Studies:
 Prepare to administer accommodated tests, if necessary.
 PARCC Refer to audio guidelines that must be used by
Human Readers for ELA and Math.
 Schedule practice tests and student tutorials. (Recommended)
 Develop a security plan.
 Develop a logistics plan.
 Develop a training plan.
 Meet with School Technology Coordinators.
 Conduct an Infrastructure Trial.
24
Tasks to Complete
Before Testing
Prepare for a Test Administration (continued)
One month before testing:
 Review the Test Coordinator Manual/Procedures
Manual and recommended online training modules
to prepare for Test Coordinator responsibilities.
 Notify students and parents about the spring state
assessments.
 Update Student Registration.
25
Tasks to Complete
Before Testing
Prepare for a Test Administration (continued)
Two weeks before testing:
 Finalize the testing schedule.
 Finalize the security and logistics plans.
26
Tasks to Complete
Before Testing
Prepare for a Test Administration (continued)
At least one week before testing:
 Meet with Test Administrators and Proctors.
 Receive, document, and store materials.
 Setup test sessions in PearsonAcccessnext and PearsonAccess.



Confirm Test Administrator accounts are active
Proctor Cache Operational Tests
Print Student Testing/Authorization Tickets and Seal Codes
 Check for test administration updates at parcc.pearson.com/bulletins.
Two days before testing:
 PARCC PBT only – Open sealed test packages.

Provide access to accommodated materials as needed.
 Make final preparations, as needed (headphones for PBA ELA).
27
Prior Access for
Accommodations
• PARCC - Human Reader or Signer
– Prior to materials arriving – review and understand the audio
guidelines
– Review the text-to-speech tutorial so that the audio guidelines are
understood
– Two days prior to testing, a TA may have supervised access to the
assessment to determine how to apply the audio guidelines.
o
The TA must check the materials in and out each day
• Science and Social Studies
– English and Spanish oral scripts 24 hours prior to testing
– Translated oral scripts, including Signed presentation, 5 days prior to
testing
– Teacher Notes for braille assessment 24 hours
o
28
May verify the correct form has been received upon shipment arrival
Student Readiness
• Student tutorials and practice materials are available (some
coming soon).
• During testing, TAs will not be able to help students with
navigation within TestNav.
– Not able to help with how to answer a question.
– Not able to show how to go to the next question or the review
screen.
– Not able to assist with drag and drop or other technology
enhanced items.
• Strongly recommended that students have access and
practice prior to testing.
29
Student Readiness
• TestNav 8 Tutorial (~30 minutes)
• Student Tutorials (~30 minutes)
• Equation Editor
• Text to Speech – available for both ELA/L* and Math
• Graphing Calculator
• Printable Paper-Based Student Tutorials
• Online Student Tutorials
• Sample Items
• Practice Tests (~60 minutes)/ePATs
*ELA/L requires unique accommodation
30
The Test Environment
31
Student-to-Test
Administrator Ratio
• Student-to-Test Administrator ratio must not exceed 30 to 1
– Test Administrator must be able to actively monitor the space within
the testing environment.
• Consider room configuration
– Make special considerations for large testing environments or
environments with complicated configurations.
• Test Administrators must:
– Actively proctor.
– Remain attentive and in the room during the entire testing section.
– Circulate throughout the room during the test.
o Should be able to see students working, not student work
32
The Test Environment
The testing environment must:
• Be adequately lit, quiet, free of distractions, and heated or
cooled.
• Provide an adequate writing surface (paper-based).
• Be free of electronic devices and music.
• “Do Not Disturb/Only Authorized Personnel Allowed” sign
must be placed on the door during test sessions.
33
The Test Environment
• No food or drinks are allowed on desks or near test materials.
• The testing environment must be free of any content related
posters or aids that suggest possible answers to students:
–
–
–
–
–
–
–
–
34
Word walls
Steps for solving math equations
Any content related materials
Any resource that defines, explains, or illustrates terminology or
concepts
Graphic organizers
100s charts
Definitions
Math manipulatives
The Test Environment
• Generally, posters that do not include content specific
definitions, content related processes or solutions may remain
on the wall.
• Timing Box (optional box around; other information required)
Unit Name: Math Unit 1
Unit Testing Time: 75 Min
Starting Time:
9:00
Stopping time:
10:15
35
Room Configuration
• Students should not be able to see each other’s work from a
normal testing position.
• Consider the following seating configurations to maintain
test security:
–
–
–
–
–
Seat students in every other seat (useful in a computer lab setup)
Arrange monitors back-to-back
Seat students back-to-back
Seat students in a semicircle (useful for schools using laptops)
Seat students in widely spaced rows or in every other row (appropriate for a
classroom setup)
• Dividing screens or other privacy materials may be used if
students cannot be placed far enough away from each other.
36
Headphones
PARCC
• ELA PBA all students must have headphones for all Units.
– Exception this year for grade 8 – no headphones
Text-to-Speech
• To be in a testing room with other students, headphones must
be worn.
• Students may be tested separately, if they are not able to
wear headphones.
37
Unauthorized Visitors
and the Media
38
•
Only students, Test Administrators/Examiners, and
authorized school, district, state personnel, or statesanctioned test monitors may be in testing areas during
administration.
•
Media are not allowed to have access to the tests before,
during, or after test administration, or take pictures or video
of testing materials or testing students.
•
Parents are not allowed in the testing room with their child.
During Testing
Test Administration
39
Tasks to Complete
During Testing
On the Day of Testing (CBT):









40
Distribute test materials.
Ensure Test Administrators have a computer or tablet available.
Monitor test activity.
Ensure accessibility features and accommodated forms are assigned to
appropriate students.
Be available to Test Administrators and Proctors.
Investigate security breaches and testing irregularities.
Follow protocol for contaminated or damaged test materials, safety
threats and severe weather.
Respond to all technology related issues.
Collect materials from Test Administrators after each test unit/section.
During Testing:
Security Breaches
Monitoring and Reporting Security Breaches and Testing Irregularities
1.
2.
3.
All instances of security breaches and testing irregularities must be reported to
the School Test Coordinator (STC), and subsequently, the DAC, immediately.
DAC will contact the state immediately upon receiving the call.
Testing Irregularity or Security Breach
–
–
41
PARCC: STC (SAC) will complete the Form to Report a Testing
Irregularity or Security Breach within two school days of the
incident and DAC submits it through PearsonAccessnext.
Science and Social Studies: SAC/DAC will complete the Test
Incident Report and fax it to CDE at 303-866-6680
During Testing: Contaminated
& Damaged Materials
PBT - Contaminated or damaged test materials must be replaced.
 Place Student ID label on replacement document or complete data grid.
 Record security barcode number of the damaged and new documents.
 If possible, transcribe responses from contaminated test material into the
replacement. Destroy contaminated material according to local biohazards
protocols.
42
During Testing: Safety Threats
and Severe Weather
Create a Plan and Train Staff for Safety Threats and Severe Weather
Test Administrators and Proctors must:
1. Note the time of the disruption.
2. Secure test materials as specified in your School Security Plan.
3. Prepare students for the continuation of the Unit/Section and
resume students’ tests.
4. Document the situation in writing.
5. If the disruption will cause the Unit/Section to be carried over into
the next day, notify CDE.
43
Test Administration
Materials
• Test Administrator’s Manual (TAM)
–
–
–
–
Fill in and select options for after the test session.
Read script exactly as written (may clarify after read exactly).
Practice in advance!
Exit Instructions.
• Student Testing/Authorization Tickets
– Hand out and collect in the test environment.
– Have a master list of students including accommodations.
– Student Testing/Authorization Tickets are secure!
• Seal Code
– Write on board or poster.
– Take down after testing starts.
44
Science and Social Studies Seal Codes
• Only three seal
codes will be
used for each
assessment
• Cross off the last
six seal codes to
avoid confusion
45
District Decisions:
After Students Finish Unit/Section
• School Site Considerations:
– Will students be able to leave when they have finished testing?
(no minimum time)
– Will students sit quietly?
– Read (cannot use any electronic reading devices)?
– May students be released to location outside testing area?
– What to do when all students are completed with Unit/Section?
– To where will students be released?
– To whom will students be released?
46
Active Administration
Active Administrators:
Ensure students have all necessary
materials for each section
Ensure a standardized testing
environment
Follow all scripts exactly as written
Move throughout the room during
testing
Read directions FROM TAM to
students when asked
Use proximity to keep students on
task
Use “continue working” script
•
•
•
•
•
•
•
47
•
•
•
•
•
•
•
•
Administrators May Not:
Provide feedback
Clarify test questions
Answer content related questions
Interfere with the students’
demonstration of skills
Interact with students in any way
that would impact student responses
Engage in other tasks during test
sessions
Read sources, items, or student
responses
Help with TestNav navigation
Administration Steps for
Computer Testing










Prepare the test environment and situate students
Start session in PearsonAccess/PearsonAccessnext
Follow directions and read script in the Test Administrator’s Manual
Hand out Student Testing/Authorization Tickets and scratch paper
Assist students in logging on to TestNav 8
Complete directions to students and start Unit/Section
Actively administer each test Unit/Section
Collect Student Testing/Authorization Tickets and scratch paper
End test Unit/Section
Close test session in PearsonAccess after last Unit/third Section only
 At this point, the status of all tests for all students in the test session
must be “Completed” or “Marked Complete”*
*For Science and Social Studies, SACs must mark a student’s test complete
48
Schedule Time for Setup and
Transition - Computer Testing
•
•
•
•
School site log in
Start up TestNav 8
Log in
Test transfer (from proctor cache)
– First item may take time to load
• Read directions
• Review sample items (Section 1)
49
Science and Social Studies
Make-Up Testing Options and Considerations
Option 1 **Recommended**
Student Completes Missed Test
Section in Advance of Re-Joining
Original Physical Testing Group
PearsonAccess
Demand on Test
Administrators
Security Risk
Logistical
Demand
Moderate
Low
Moderate
Low
High
Low
High
Moderate
High
Option 2
Student Tests with Original Physical
Testing Group
Option 3
Student Completes Missed Test
Section in Any Available Physical
Testing Group in Advance of ReJoining Original Physical Testing
Group
50
Receiving Materials and
Test Security
51
Test Security Protocols
• Protection of student information and data.
• Protecting the validity of the state assessments.
• Financial considerations.
52
Security Plan
• Successful Security Plan requirements:
– All personnel have appropriate training.
– All involved personnel understand security protocols.
– All involved personnel have signed security agreements.
o Think about anyone who may be in the testing environment!
– Test environments are secured against unauthorized personnel.
– Establish a documented chain of custody.
– Materials are kept in a central, secure location with limited access.
53
Test Materials Security
Secure
• Student Testing/Authorization
Tickets
• Seal codes
• Paper-based Test Booklets
• Social Studies source books
• Oral scripts
• Used scratch paper
• Any student work/responses
• Mathematics Reference Sheets
prior to and after given to
students
54
Non-Secure
• Test Administrator
Manual (TAM)
• Procedures Manual
• Test Coordinator Manual
(TCM)
• Unused (not handed out)
scratch paper
Maintaining Security of
the Assessments
• All secure test materials must be secured while in the Test
Administrator’s possession.
• No duplication of secure CMAS materials is permissible
(exception: Oral Scripts translated into languages other than
Spanish).
• No cell phones or other communication, reproduction or
recording devices are allowed during test sessions unless
required for accessibility.
– Manage devices!
55