Transcript ISTEP+ Online - Merrillville Community School
ISTEP+ Pretest Workshop Spring 2013
1
Agenda
• • • • • • • • • • Operational ISTEP+ – Grades 3, 4, 5, 6, 7, 8 Pilot and Validation Sites ISTEP+ Paper/Pencil ISTEP+ Online Return of Results – Online Reporting – Parent Network ISTAR Assessment IMAST Assessment LEP Students Ethical Testing Practices Questions & Answers 2
Test Windows
• March 4 – 13 ISTEP+ Applied Skills (Paper/Pencil and Online) • April 29 – May 8 ISTEP+ Multiple-Choice Paper/Pencil IMAST • April 29 – May 10 ISTEP+ Multiple-Choice Online • May 6 – 17 CoreLink Online 3
Operational ISTEP+
Applied Skills: Online, Paper/Pencil
• •
Applied Skills Online: Online ELA and SS ONLY Math and Science – custom “partial” paper/pencil booklet
• •
Applied Skills Paper/Pencil:
Gr. 3-8: one single student test booklet Students MUST use the same correct book for ALL sessions What if two books are used (TCM)
Avoid Undetermined test results!
Multiple-Choice: Online, Paper/Pencil
•
Multiple-Choice Online: ELA, Math, Science, Social Studies
• • • •
Multiple-Choice Paper/Pencil:
Insufficient Technology / Accommodation ONLY
Gr. 3 one single test booklet Gr. 4-8 two booklets Test booklet Answer booklet Students MUST use the same answer book for ALL sessions
Avoid Undetermined test results!
Gridded Responses / Calculator Usage begins in Grade 6 4
All Students, Grades 3-8
• • • • Same rules apply – Who participates, accommodations, security – IMAST participation (April/May window)
Critical
– do not take ISTEP+ in IMAST content area(s) (Applied Skills and Multiple-Choice Assessments) Avoid
Undetermined
test results!
Results have consequences for students, schools, and corporations – Remediation, accountability Science and Social Studies required Applied Skills images and Applied Skills items released via the web 5
Student Test Number (STN)
• • • • • Every test MUST have an STN
STN is critical for matching students across test windows (AS, MC)
– Undetermined and accountability concerns
Results are dependent on matching student records (AS, M/C)
– – If you do not have a barcode label for paper/pencil,
bubble!
One STN per student (stays with student) Schools required to supply missing STNs Used to calculate participation rate
Every Undetermined score will count as a “Not Participating” student
Schools must account for every student not tested—keep records now to prepare for the DOE-NT collection.
6
Book II (Pilot) and Validation Sites
• • Book II Sites (Pilot) – – – Applied Skills window ONLY; Paper/Pencil ONLY Selected schools; required participation Early pickup of test materials (by school) March 15
GREEN
label Validation Sites – – Multiple-Choice window ONLY; Online and Paper/Pencil Critical to verifying the equating process • Selected schools; required participation – Early pickup of paper/pencil test materials (by school) May 10
TAN
label 7
DOE-TL Barcode File: Paper/Pencil and Online
• • • Period 1 Barcode file submitted Dec. 10 – Jan. 16 – Labels delivered Feb. 15-19 in Applied Skills TC Kits
Period 2
Barcode file submission
Feb. 25 – March 8
– Via STN site – Any students who were not submitted in Period 1, including: Students new to the school Additional IMAST students, based on Case Conference Committee decisions for students that were not submitted in Period 1 – Labels delivered April 15-16 in Multiple-Choice TC Kits Paper/Pencil (due to insufficient technology/accommodation) IMAST
Barcode files used to “populate” ISTEP+ Online (AS, MC)
8
ISTEP+ Paper/Pencil: Barcode Labels
• Review Barcode Label “rules” in the Test Coordinator’s
Manual (TCM)
SIQ #3 - #8 • Not all data on the label; see the roster for details • Bubble for all “new” students without labels • Use ONLY labels for the Spring 2013 test administrations Destroy all unused labels after Multiple-Choice test (May) Students’ names MUST also be on the tests
written in the students’ own handwriting!
9
• • • • • •
ISTEP+ Paper/Pencil: Calendar
Applied Skills
Dec. 10 – Jan. 16 Period 1 Barcode File Feb. 11-15 Test Materials Delivery Feb. 15-19 Test Coordinator Kits
(include Period 1 Barcode Labels)
Feb. 27 Last day to report shortages
(TMA opens 2/15)
www.ctb.com/ March 15 Mandatory pickup date for ALL Book II schools;
GREEN
label March 18-26 Scheduled pickups for corporations and nonpublic schools;
YELLOW
and
BLUE
labels • • • • • •
Multiple-Choice
Feb. 25 – Mar. 8 Period 2 Barcode File Via STN site Include any new students and additional IMAST students April 3-12 Test Materials Delivery April 15-16 Test Coordinator Kits
(Per. 1 & 2: ISTEP+ and IMAST Barcode Labels)
April 23 Last day to report shortages www.ctb.com/
(TMA opens 4/11)
May 10 Mandatory pickup date for ALL Validation schools;
TAN
label May 13-15 Scheduled pickups for corporations and nonpublic schools;
PURPLE
and
BLUE
labels
(very tight schedule—no extensions!)
February 15 – Predetermined Pickup Schedule posted: IDOE-TCC and www.ctb.com/istep
10
ISTEP+ Paper/Pencil: Large Print & Braille
• • • Shipped directly to TC Know how to process documents – – See Appendices in TCM Avoid
Undetermined
results!
Non-Standard Responses (NSR) – – – – Use
pastel paper
(computer-generated) Insert document(s)
in front of the back cover Keep a copy in a secure location
(principal’s office) Documentation At top of
CG response
and on
School/Group List CGR bubble on front of test booklet
11
ISTEP+ Paper/Pencil: Materials Return
• • • • • • SAVE YOUR BOXES!! (ISTEP+ and IREAD-3) – Return in correct boxes - do not mix (
Blue
;
Gold
) Please read directions! (TCM and posters) “Things To Remember” (TCM) How will you account for every test document?
–
ALL student test documents must be returned
Teacher names
must match exactly
– Group Information Sheet (GIS) and – School/Group List (SGL) on: All three counts must match
(GIS, SGL, actual documents)
This is a critical issue with regard to turnaround time for results!
12
ISTEP+ Paper/Pencil: Packing & Shipping
•
ISTEP+: Use “Stack Cover Cards” and Paper Bands
– Please read directions, TCM •
IREAD-3: Use envelopes
•
Unique Barcode Shipping Labels (by school)
•
Be sure to use the correct shipping labels and boxes for each test!! (ISTEP+, IREAD-3)
13
IREAD-3: Gold-and-white box
• • •
Blue-and-white box
used for paper/pencil tests: Applied Skills Multiple-Choice (Insufficient Technology / Accommodation only) IMAST 14
ISTEP+ Online: Calendar
• • • • •
Applied Skills
Dec. 10 – Jan. 16 Period 1 Barcode File Feb. 15 AS Online Examiner’s Manual Delivery Feb. 15-19 Test Coordinator Kits
(include Period 1 Barcode Labels)
Feb. 18 AS Content Release and Pre-assigned
Practice
and
Operational
Tests Feb. 25 – March 13 AS Online Practice Test Window • • • • • •
Multiple-Choice
Feb. 25 – Mar. 8 Period 2 Barcode File Include any new students and additional IMAST students March 8 MC Online Examiner’s Manual Delivery March 15 MC Content Release and Pre-assigned
Practice
Tests March 18 – May 10 MC Online Practice Test Window April 1 MC Pre-assigned
Operational
Tests April 15-16 Test Coordinator Kits
(IMAST and ISTEP+ P/P Barcode Labels)
• • • Test Administration System (TAS) Trainings February 20 – April 16 5 Regional (onsite sessions) & 15 Webinars Optional 7 Pre-Administration Q&A Sessions CoreLink: • Early April – Content Release and Pre-assigned Practice/Operational Tests • April 15-16 Online Examiner’s Manual Delivery • May 6-17 CoreLink Test Window 15
ISTEP+ Online: Overview
• • • • • Applied Skills: ELA and Social Studies ONLY Multiple-Choice: Extended window (April 29 – May 10 ) List of schools with testing online status posted www.ctb.com/istep Test Administration Trainings (TAS) Train-the-Trainer: February 20 – April 16 Required Session: Regional (onsite) or Webinar Optional: Pre-Administration Q&A Sessions
Practice Test Required
2 opportunities scheduled per student;
at least 1 required
16
ISTEP+ Online: iPads
• iPads for Multiple-Choice Online (and CoreLink) only – iPad 2 or later – – – – iOS 6 or later iTunes Store “OAS IN” • • Expected availability week of February 11 Watch for more information from CTB “Guided Access” MUST be enabled Android tablets supported next year (10-inch class) • More info & WebEx posted www.ctb.com/istep 17
ISTEP+ Online: Details
• •
Accommodations must be assigned Scheduling
– All students in a class complete test session on the same day •
Critical changes for 2013
– – Display of “Not Testing” Confirmation of “Do Not Score” • EVERY one of these must be documented!!!
18
ISTEP+ Online: CTB Web Portal
www.ctb.com/istep
a b Test and Technology Coordinator Support Materials c e General information about the tests d Single Sign-on Access a f Demo TAS Website Access i g h Report testing problems to CTB News and Information Community forum access c j k Contact details to reach the Help Desk Scrolling News Ticker e b d f j g h i k
ISTEP+ Online: Enhancements
Test Administration System (TAS) Enhancements • Display students “Not Testing” on student panel • “Do Not Score” status change confirmation • Class name included on student and summary test tickets • Test ticket student credentials printed in lowercase • Corporation or school name visible after login without having to click double arrow button • Ability to view up to 500 students in test session status from single screen
ISTEP+ Online: Student Testing Tools
Blocking Ruler
NEW!
Eraser Highlighter Manipulative (protractor, ruler, calculator) Mark for Later Review Option (Answer choice) Eliminator Reference card (grade 8)
ISTEP+ Online: Student Testing Accommodations
Accommodations available for students with an IEP, Section 504 Plan, ILP include: • Screen reader / Text-to-speech (TTS) • Variable Font Size, Font Color • Variable Screen Background Color
ISTEP+ Online: Pre-Assigned Test Sessions
CTB
• Create and pre-assign students to all test sessions using Barcode data by February 19: • Two practice test sessions created and students assigned • Operational test sessions created and students assigned
Corps/Schools
• Prior to Testing: • Add new students to system and assign to test sessions • Assign online testing accommodations (font, screen reader) • Move students to different classes (reporting)
ISTEP+ Applied Skills and IREAD-3 Spring
ISTEP+ Online: Pre-Assigned Test Sessions
CTB
• Create and pre-assign students to all test sessions using Barcode data by April 1: • Two practice test sessions created and students assigned • Operational test sessions created and students assigned
Corps/Schools
• On or before March 25: • Add new students to system for CTB to create and assign • Assign online testing accommodations (font, screen reader) • Move students to different classes (reporting) • After April 1: • Add new students to system; assign new students to sessions
ISTEP+ Multiple-Choice
ISTEP+: Experience Online Testing , Practice Test
Experience Online Testing (Optional) Practice Test (Required)
Access at IDOE Website Create Test Session in TAS Internet Simulation of Test Delivery Client Open Access – No Login Credentials Required No Software or Content to Download or Install Available 24/7 Can be Taken at Home URL: http://www.doe.in.gov/achievement/assessment/ Assign Students in TAS Requires Test Tickets and Access Codes Requires use of Workstation Installed Test Delivery Client One Practice Test per Student Required by IDOE
Must Be Taken at School
ISTEP+ Online: Marking a Test Session “Do Not Score”
Click the Toggle DNS (Do Not Score) button, which is activated after highlighting the student record.
ISTEP+ Online: Mark a Student as “Moved/Not Testing”
Indicating students who will not test
Results: Online Reports
• • All reports via Indiana Online Reporting System (INORS) Corporation- and school-level Secure site with unique passwords Contains FERPA-protected data! (Family Educational Rights and Privacy Act) Teacher Access • Determined by GIS and SPN/Online teacher groups Available 24/7 • Student-level data, end of May • Summary-level data, June One paper copy of Student Report and Label (June) 28
Results: Details
ELA, Math, Social Studies: Grades 3-8 ELA, Math Grades 5, 7 Social Studies
• • • • End of May: INORS Reports and Applied Skills Images available June 7: Student Reports and Labels delivered End of May/mid-June: Rescore Window Late July/Early August: Rescore reports arrive • • • • •
Science: Grades 4, 6
Late June: ISTEP+ and IMAST Science
Cut Score Setting
Late August: INORS Reports and Applied Skills Images available Late August: Student Reports and Labels delivered Late September: Rescore Window October: Rescore reports arrive 29
Results: Parent Network
• • • • Online parent access Parents can see test results “over time” (multiple years) Invitation Codes sent to May “testing schools” –
Distribute upon receipt
Applied Skills Images linked to results in PN – Parent review of student response •
Parent Request Required for Rescore
– – Parent / school staff collaborate School to document and submit rescore request 30
Parent Network
31
ISTAR: Indiana’s Alternate Assessment
• • Indiana Standards Tool for Alternate Reporting ISTEP+ or ISTAR – All students must participate in assessment; Case Conference Committee decision to use ISTAR Referenced to Indiana Standards; will NOT lead to diploma March 1 – April 30 window; Web-based system Requires use of STN Teacher ratings; cut scores (Pass+, Pass, Did Not Pass) – Federal Regulation Sets a 1% limit for corporations & state on students who can be “
proficient
on Alternate Standards” for accountability
No limit on the number of students who can in ISTAR participate
It is important for each student to participate in the most appropriate assessment for that student.
32
IMAST: Indiana’s Modified Assessment
• • • • • Indiana Modified Achievement Standards Test – – Grades 3-8; E/LA, Math, Science, Social Studies Students on-track to receive a diploma Eligibility criteria – Case Conference Committee decision by February 28 Collecting student counts (no survey this year) – Include students in DOE-TL Barcode submissions Multiple-Choice Format – April/May window ONLY – –
Critical
– do not take ISTEP+ in IMAST content area(s) (AS, M/C) Avoid
Undetermined
test results!
No limit
on the number of students taking IMAST
It is important for each student to participate in the most appropriate assessment for that student.
33
English Learners/LEP Students
•
All EL students MUST take ISTEP+
– Except those enrolled in US schools < 1 year Enrolled after March 1, 2012 to be <1 year MAY substitute LAS Links for ISTEP+ E/LA Corporation-wide decision!
Must take Math and Science (4 & 6) Social Studies (5 & 7) – Accommodations (refer to Appendix C) 34
Accommodations for Special Education and LEP students
• Appendix C in the Indiana Assessment Program Manual – Outlines the standard accommodations for students with an IEP, Section 504 Plan, ILP or Nonpublic Service Plan • Non-Standard Assessment Accommodation – – – – One NOT identified in the Indiana Assessment Program Manual Deadline to submit based on dates listed on the Request for Non-Standard Assessment Accommodation form Must be approved by the Office of Student Assessment Note: Request for paper test during Online administration
=
non-standard 35
Ethical Testing Practices: Overview/Highlights
• • • Indiana Assessment Program Manual – Chapter 10 – – The basis for local training Test security and integrity training prior to actual test window represents a review; highlight areas of critical importance.
Formal Training for Staff – To administer the assessment, staff MUST have • participated in security training (at the beginning of the school year).
• • signed the Indiana Testing Security and Integrity Agreement.
received training regarding specifics of test administration (mechanics).
Policy requirement –
Every school corporation and school (public, charter, nonpublic, and Choice) MUST have a test security policy.
36
Ethical Testing Practices: Preparing for the Test
•
Review and approve materials used to prepare students
•
Provide training for staff
(classroom practices, test administration)
– – – Acceptable teacher practices: prior to, during, and after the test Appropriate test administration policies/practices (mechanics) Specifics regarding test security and integrity •
Assign test examiners and proctors
– Review examiner qualifications 37
Ethical Testing Practices: Ensuring Examiner Readiness
• • • •
Examiner’s Manual: secure document
Access to Examiner’s Manual (EM) – Staff may retain EM in a secure location after orientation session Access to assessment books (student documents) –
NO advance access to actual student test documents Usernames, passwords and access codes
–
Same level of security as test books
38
Ethical Testing Practices: Administering the Test
• • • • • Administer test sessions in order Examiners/Proctors must monitor test sessions – Reminder: no cell phones (students and adults)
Examiners/Proctors should not use a student’s keyboard
except in the case of a scribe.
If a concern arises regarding an item….
– –
Refer to the item by content area, test session, and item number
NEVER make a copy or email the item (even to IDOE)!
Unannounced security audits (IDOE due diligence) 39
Ethical Testing Practices: Materials Security
•
CTCs and STCs MUST:
– Control secure storage, distribution, administration, and collection of test documents/materials Inventory and track materials, including Test Tickets
Critical:
Daily sign-in/sign-out system for paper tests – Ensure that no test items are copied from a computer screen or by using a copy machine – Return all used and unused test materials 40
Ethical Testing Practices: Security Violations – Part 1
• • • • Communicate security policy, ethical practices, consequences Provide a way for students and staff to report concerns and insure rights of those involved Establish a process to investigate irregularities, concerns, complaints Report security violations to the Assessment Office – – Appendix B: Testing Irregularity Report form (send via fax) Note: “Testing Concerns & Security Violations Report” designed for use by parents or other concerned individuals 41
Ethical Testing Practices: Security Violations – Part 2
• It is a
violation of test security
to: – Give students access to test questions in advance – Coach students in any way during the test – Copy, reproduce, or use in any manner any portion of a secure test document for any reason – Alter answer documents during or after testing –
Score student responses on the assessment
Refer to Chapter 10 of the Indiana Assessment Program Manual for more details.
42
What if…
• If in doubt call the ISTEP+ office! (317-232-9050) – A number of events can occur; time is of the essence!
– – Document (Write it down at the time!) Sample issues/concerns: Test material issues Test irregularities Student or adult cheating Student illness Interruption to testing Exposure of items Acts of nature Inappropriate testing practices 43
Assessment Resources
•
Visit
www.doe.in.gov/achievement/assessment – ISTEP+ Blueprints; Item Samplers; Instructional/Assessment Guidance – – Diagnostic Assessments And more!
•
Test Coordinator Corner (TCC)
– – Information specific to TCs Electronic copies of TCM and other resources Located in
Learning Connection
community
IDOE - Test Coordinator Corner
For CTCs and nonpublic/charter/Choice STCs 44
• • • •
Contact Information
ISTEP+ Office
Telephone 317-232-9050; Toll Free 888-544-7837 Fax 317-233-2196 Web site
www.doe.in.gov/achievement/assessment
Karen Stein, Spec. Programs Asmt. Specialist
CTB / Indiana Help Desk
Telephone 800-282-1132 ISTEP+ Online – Option 2 Fax 800-282-0266 Email
CTB ISTEP+ Web Portal
www.ctb.com/istep
ISTAR – Office of Special Education 317-232-0570 EL/LEP – Office of English Learners 317-232-0555 45
Questions?
Thank you for participating!
46