End-of-Course Assessment Test Coordinator’s Manual Training Phase I and Phase II 2009/2010

1

Agenda



EOC General Information and Changes

 Testing Windows & Test Formats  Online Test Examiner’s Manual  Questions 2

End-of-Course Assessments

Required Tests

 English II  Algebra I  Biology  Government 3

End-of-Course Assessments

Phase I Assessments

 Include: English II, Algebra I, and Biology  Were the first group of EOC tests created  Became operational in Spring 2009  Required for AYP, APR and/or NCLB 4

End-of-Course Assessments

Phase I Assessments ~ Session II

Points are not the same for each content area

‣ English II writing prompt is worth 4 points ‣ Algebra I PE is worth 4 points ‣ Biology PE is worth 20 points 5

End-of-Course Assessments

Phase II Assessments

 Include: English I, Algebra II, Geometry, American History, and Government  Were the second group of EOC tests created  Become operational October 13, 2009 6

End-of-Course Assessments

Phase II Assessments

 Government is the only required Phase II Assessment  Government is required for APR 7

End-of-Course Assessments

Phase II Assessments

• Have selected response (SR) items only • English I has 52 items – 7 passages with 6 or 8 items each • All other Phase II Assessments have 50 items each.

• All are worth 40 points 8

End-of-Course Assessments

Scoring EOC

 SR Items for both Phase I and Phase II Assessments are officially scored by Riverside Publishing immediately after testing  Official SR scores are returned to the district within 5 business days from receipt of tests 9

End-of-Course Assessments

Scoring EOC

 WPs and PEs are officially scored by the Assessment Resource Center (ARC) at a later time  Unscored WP and PE items are scanned and electronic copies are returned to the district for local scoring 5 business days from receipt of tests 10

End-of-Course Assessments

Scoring EOC

 Session I official scores and locally scored Session II results can be included in a student’s final grade  DESE highly recommends that EOC Assessments be used as 10-25% of the students’ final grades  The percentage is a district-level decision 11

End-of-Course Assessments

Scoring EOC

 Riverside Publishing sends two e-mails with attachments to the DTC – one for training and one for scoring  Task Scoring Workshop and Teacher Interface have URLs, user names, and passwords 12

End-of-Course Assessments

Scoring EOC

 User names and passwords for Task Scoring Workshop and Teacher Interface allow teachers access to secure materials  For security reasons, the passwords are not forwarded to the STC or teachers until district testing is complete 13

End-of-Course Assessments

EOC score results

 Official scores for PEs and WPs arrive in the district in August  Both Session I & II are combined into a Scale Score for Student Reports  Official state scores will be used for AYP and APR  Crystal Reports have breakdown of Session I and Session II scores  Teachers will be able to compare their scored Session II assessments to the official state-scored Session II 14

End-of-Course Assessments

EOC score results Advanced Proficient Basic Below Basic Subject Raw Score Cut Score Raw Score Cut Score Raw Score Cut Score Raw Score Cut Score

Algebra I 31-39 225-250 22-30 200-224 13-21 177-199 0-12 100-176 Biology 45-55 225-250 32-44 200-224 18-31 177-199 0-17 100-176 English II 33-39 225-250 24-32 200-224 15-23 180-199 0-14 100-179 15

End-of-Course Assessments

Level Not Determined (LND)

• For EOC Assessments, a district will receive a Level Not Determined (LND) for a student if that student NEVER participates in a required EOC Assessment (English II, Algebra I, Biology, Government) before they graduate • beginning with the graduating class of 2011 • EOC Assessments are not a graduation requirement 16

End-of-Course Assessments

Lowest Obtainable Scale Score (LOSS)

 Students who participate in an EOC Assessment receive scores  A student receives the Lowest Obtainable Scale Score (LOSS) if a student’s test is invalidated for cheating or paraphrasing in any content area because they have participated in the test 17

End-of-Course Assessments

Individualized Education Program (IEP)

 Students who have an IEP with accommodations can be accommodated during testing 18

End-of-Course Assessments

Changes and Updates

 The “Not Enrolled” bubble is used for a student who begins any session of an EOC Assessment and moves either out of the district or from building to building within a district before finishing the entire assessment  The sending school should keep documentation on file about the student’s move  In the manuals EOC Assessments will be categorized as Phase I and Phase II 19

End-of-Course Assessments

Changes and Updates

 Dictionaries, thesauruses, and grammar handbooks can be used with the writing prompt for English II, Session II  When students are taking the online version of the test, do not mark a student as absent until the END of the district’s testing window  English II will not have a stand alone field test this year - however, the Phase II GIS has a bubble for an English II field test so please disregard 20

Agenda

 EOC General Information and Changes 

Testing Windows & Test Formats

 Online Test Examiner’s Manual  Questions 21

EOC TESTING WINDOWS for SJSD

• • •

Fall/Winter

• 11/30 – 12/4 Biology and English II • 12/7 – 12/11 Algebra I and Government

Spring

• 4/19 – 4/23 Biology and English II • 4/26 – 4/30 Algebra I and Government

Summer

22

EOC in Two Versions



Paper/Pencil version



Online version

23

End-of-Course Assessments

All Phase I Assessments

 Two sessions: • Session I - Selected Response Items • Session II - Performance Events (PE) or Writing Prompts (WP) 24

End-of-Course Assessments

Phase I, Session I Assessments

 Have 47 selected response (multiple choice) items  Present students with a question followed by four response options  Are worth 35 points total 25

End-of-Course Assessments

Phase I, Session II Assessments

• Require students to work through more complicated items • Make allowances for more than one approach to a correct answer • Allow insight into a student’s ability to apply knowledge and understanding to real-life situations 26

Session II Performance Events for Algebra I and Biology

 Assesses student’s applied knowledge  Algebra I PE assesses CLEs with a Level 3 DOK from the Algebraic Relationships strand  Biology PE assesses the Inquiry strand 27

Session II Writing Prompt for English II

 On-demand writing proficiency  Scored holistically, using a four-point scoring guide  The prompt may be persuasive, descriptive, expository, or narrative 28

Phase I

Algebra I Session I Algebra I Session II Biology Session I Biology Session II English II Session I English II Session II

Snapshot of Phase I

Fall/Winter

35 operational + 12 EFT

Spring 2010

35 operational + 12 EFT,

Summer 2010

35 operational + 12 EFT, 2 PE, taking about 30 minutes each 2 PE, taking about 30 minutes each 2 PE, taking about 30 minutes each 35 operational + 12 EFT 35 operational + 12 EFT 35 operational + 12 EFT 2 PE scenarios with approximately 6 – 12 separate items per scenario, taking about 30 minutes for each scenario 2 PE scenarios with approximately 6 – 12 separate items per scenario, taking about 30 minutes for each scenario 2 PE scenarios with approximately 6 – 12 separate items per scenario, taking about 30 minutes for each scenario 35 operational + 12 EFT 1 Writing Task 35 operational + 12 EFT 1 Writing Task 35 operational + 12 EFT 1 Writing Task 29

Phase II

American Government American History English I Integrated Math 2 Integrated Math 3 Geometry Algebra 2

Snapshot of Phase II

Fall/Winter

40 operational + 10 EFT 40 operational + 10 EFT 40 operational + 10 EFT 40 operational + 10 EFT 40 operational + 10 EFT 40 operational + 10 EFT 40 operational + 10 EFT

Spring 2010

40 operational + 10 EFT 40 operational + 10 EFT 40 operational + 10 EFT 40 operational + 10 EFT 40 operational + 10 EFT 40 operational + 10 EFT 40 operational + 10 EFT

Summer 2010

40 operational + 10 EFT 40 operational + 10 EFT 40 operational + 10 EFT 40 operational + 10 EFT 40 operational + 10 EFT 40 operational + 10 EFT 40 operational + 10 EFT 30

Agenda

 EOC General Information and Changes  Testing Windows & Test Formats 

Online Test Examiner’s Manual

 Questions 31

Purpose of Test Coordinators Manual

Detailed instructions for:

 Preparing for online testing  Delivering of online tests  Administering of online tests 32

Test Coordinators

 District Test Coordinator (DTC) – the point person for testing in a school district  School Test Coordinator (STC) – the point person for testing in a particular building  These are sometimes the same person and/or they may have interchangeable roles 33

Breakdown of EOC Assessments Guidelines for Testing: Prepare

 Notify parents in advance so that students will be well rested  Pre-read the manual  Inclusions of Special Populations  Make-up Sessions  Use of Translators  Invalidation Procedures  Accommodations and Status Codes 34

Special Populations

  IEP students must take all EOC Assessments administered by the district or portions of each content-area assessment as determined by the IEP team IAP/504 Students • •

Students Not Tested

MAP-Alternate (MAP-A) ELL students who have been in the US for 12 months or fewer (cumulative time) may be exempt from the English II assessment 35

Students who move

before or during testing

(p. 5)  If a student was enrolled to take an EOC Assessment but moved prior to test administration, the sending school should keep documentation on file about the student’s move  The receiving district tests the student in any applicable EOC Assessment  The “Not Enrolled” bubble is used for a student who begins any session of an EOC Assessment and moves before finishing the entire assessment, either out of the district or from building to building within a district. The sending school should keep documentation on file about the student’s move.

36

Students Who Are Absent During Testing

 Districts should make every attempt to have all students take the entire test. If a student is absent and unable to take the test during the testing window, the school should keep documentation on file about the student’s absence and use the following procedures : 1. If a student is absent and unable to take the test at a later test window, fill in the “Absent” bubble 2 . If a student is absent and the district will assess the student during the next testing window, fill in the “District Team Decision – Delayed” bubble 3. The districts may re-enroll the student in the next semester’s testing window.

37

Use of Translators

 Translators must be trained in test administration  No for English I and English II assessments  Yes for all other Phase I and Phase II tests  Native language responses are acceptable from ELL students – transcribe appropriately 38

Invalidation Procedures

 Check the chart (Page 7)  Mark appropriately 39

Test Invalidation Reasons

Neither student behavior nor the judgment of student effort can invalidate test.

40

What Districts Must Do When Invalidating A Test

 Agreement on Invalidation (between STC and Examiner)  Information STC must provide to DTC  The Letter to DESE from the Superintendent  A Copy of the letter for the District 41

Accommodations and Status Codes (Pages 22 - 23)

 Student accommodations are recorded for the entire assessment  Accommodation Code definitions can be found in the EOC manual and on the DESE website. Check the appropriate box for the corresponding test.

 Status code definitions can be found in the Test Examiner’s Manuals.

42

Electronic Devices

 Yes to Calculators – at minimum, students can use, a four-function calculator for Algebra I – both sessions (nothing with Internet access of a Qwerty keypad) 

No

to cell/mobile phones, electronic music players, digital cameras, handheld scanners, gaming devices, any portable device that can be connected to the internet, etc.

43

Testing Periods

–

Phase I Suggested Times

 Algebra I  Session I = 90 – 100 minutes  Session II = 60 – 70 minutes  Biology  Session I = 55 – 60 minutes  Session II = 65 – 70 minutes  English II  Session I = 90 – 110 minutes  Session I = 90 - 100 minutes

Testing Periods

–

Phase II Suggested Times

 Government – 60 - 80 minutes  American History – 60 - 80 minutes  English I - 90 - 110 minutes  Algebra II – 90 - 100 minutes  Geometry – 90 - 100 minutes

DTC Responsibilities

 The District Test Coordinator (DTC) is responsible for training ALL School Test Coordinators (STCs) on EOC Assessment processes.  Communicating with RPC (Riverside Publishing Company) – one point of contact for the district  Responsible for test security  Ordering additional materials if/when needed 46

STC Responsibilities

 Ensure EOC Browser is on each workstation for test delivery  Input students who were not included in the MOSIS precode file to the online testing system  Verify/edit student demographic information for pre imported students  Contact District Assessment Office if any students need to be transferred  View/set student classes, testing statuses, and accommodations 47

District Team Decision

–

Delayed

This is a bubble designed for students who are not yet ready to take the EOC assessment for which they were enrolled.



PRIOR

to the testing window(s), the district should have their “delay” procedure clearly in place  The procedure should:    include decision parameters include who is on the team to make the decision be in writing 48

Bubble and Document

 If the district believes a particular student is not ready to take the EOC assessment for which he/she was enrolled, the district team makes the decision based upon the qualifications in the procedure.

 The STC bubbles in the “District Team Decision – Delayed”  The district keeps documentation about the decision to delay testing.

49

Post Test Administration

Task Scoring Workshop

 The Task Scoring Workshop is an Internet-based tool that provides training on how to score the Session II portion of the Phase I Missouri End-of-Course assessments. Through this system, teachers have access to scoring rubrics, anchor papers, annotations and practice papers that allow them to practice the scoring process independently.

 Once Riverside has received a district’s testing materials, an e-mail will be sent to the DTC with the Task Scoring Workshop URL, user IDs, and passwords. The e-mail will be sent from [email protected] with the subject line of “MO EOC: Task Scoring Workshop.” The DTC is responsible for distributing the information to their teachers. Please note that this information should not be distributed until all testing has been completed for a subject area.

50

  

Post Test Administration

Teacher Interface

The Teacher Interface is the system through which teachers are able to view students’ selected response raw scores and view, print, and locally score the unscored, scanned copies of their students’ performance events. Teachers are able to include these scores in the students’ final grades. However, the official state scoring of the Session II items will not occur until a later time. Teacher Interface does not provide export files of raw scores, nor does it allow for batch printing of the performance events/writing prompts.

Within 5 business days of Riverside receiving a district’s testing materials, an e-mail will be sent to the DTC with the Teacher Interface URL, user IDs, and passwords. The e-mail will be sent from [email protected] with the subject line of the DTC’s name followed by “MO EOC Teacher Interface.” DTCs and STCs will have access to a performance event summary report for their buildings. Teachers will have access to their class roster page with the selected response raw scores and performance event images.

51

Accommodation Codes List for English Language Learners (ELL)

 The following slide are the only accommodations

allowed for ELL students.



Oral reading, oral reading in native language, or the use of a bilingual dictionary during the

English II assessment will result in the LOSS (Lowest Obtainable Scale Score).

52

53

Accommodations List for Students with Disabilities Has changed since last year!

54

Note 1 for Students with Disabilities

NOTE 1: Oral reading, oral reading in native language or signing any English assessment will result in the LOSS (Lowest Obtainable Scale Score). The use of a bilingual dictionary during the English I or English II, Session I assessment will result in the LOSS. Students identified as blind/visually impaired (who do not read Braille) may use the oral reading accommodation if it is their primary instructional method.

55

Note 2 for Students with Disabilities

Paraphrasing test questions invalidates all EOC Assessment student scores for accountability purposes.

Note 3 for Students with Disabilities

Use of magnifying equipment, amplification equipment, graph paper and testing with the teacher facing the student are not listed as accommodations because these are not required to be reported as accommodations for the EOC Assessments.

56

Examiner’s Manual Phase I & II

 Directions for Administering Online Assessments  English II (Pages 34-37)  Biology (Pages 38-41)  Algebra I (Pages 42-47)  Government (Pages 54-55) 57

Test Materials



Student Materials

 Computer workstation with EOC Browser  Scratch, graph or draft paper (not provided)  At minimum four-function calculators for Algebra I (not provided and not required)  Algebra I reference sheet (for Algebra I Sessions I and II)  Dictionary, thesaurus, grammar handbook (for English II Session II only – not provided) 58

Prepare for Test Administration

 Organize the classroom  Plan seating arrangements/computer usage  Eliminate distractions under your control  Use a Do Not Disturb sign (not provided) on your door  Remove or cover any maps, charts, or other materials that relate to the content and processes of the test.

 Make testing arrangements for students who do not finish testing in the allotted time frame.

59



Electronic Devices

At minimum, students may use a four-function calculator during the Algebra I (Session I and Session II) Assessment. Other electronic devices must not be accessible during the testing session. Such items include, but are not limited to:  cellular/mobile phones  electronic music players  digital cameras  handheld scanners  portable gaming devices  any portable device that can connect to the Internet 60

Administer the Tests

 Specific directions for each content area are in the Examiner’s manual.

 The following symbol is used throughout the specific directions: 61

Agenda

 EOC General Information and Changes  Testing Windows & Test Formats  Online Test Examiner’s Manual 

Questions

62

What If We Still Have Questions After Today?

•Re-Read the Manuals •Who Calls Riverside?

The district should have

one

point of contact – the DTC!

63