Smarter Balanced Assessments 2014-15 Webinar #6 March 10, 2015 OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION Division of Assessment and Student Information.
Download ReportTranscript Smarter Balanced Assessments 2014-15 Webinar #6 March 10, 2015 OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION Division of Assessment and Student Information.
Smarter Balanced Assessments 2014-15 Webinar #6 March 10, 2015 OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION Division of Assessment and Student Information Today’s Topics 2015 is HERE!! OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION Portal Updates Science Training Test Summative Assessment What we heard today Last Minute Loose Ends Technology Readiness Shipping Issues Known Issue Log Digital Library Access Interim Scoring Tips March 10, 2015 | Slide 2 As we begin, remember…. OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION This is new to everyone Challenges abound Remain calm and assure staff and students to try their best Unexpected issues will be encountered but they will be resolved This will be a tough season Next year’s administration will be much easier June 16, 2015 (the day after the test administration window closes) will come! We will all make it!! March 10, 2015 | Slide 3 Portal Smarter Balanced page/WCAP Portal OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION Please share widely with all district and school personnel: OSPI’s Smarter Balanced page at http://www.k12.wa.us/smarter/default.aspx AIR’s WCAP portal at http://wa.portal.airast.org/ March 10, 2015 | Slide 5 Available on the Portal – Manuals and Guides OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION TAM Online ELA/Mathematics TAM Paper-ELA (Updated 3/7. Refer to the revision log for details) The original posting was Smarter Balanced and had not yet been edited or vetted by OSPI. TAM Paper-Math TAM Paper-Math-Spanish Smarter Balanced Online Math Translated Student Directions: Arabic, Cantonese, Dakota, English, Filipino, French, Haitian, Hmong, Japanese, Korean, Lakota, Mandarin, Punjabi, Russian, Somali, Ukrainian,Vietnamese and Yupik March 10, 2015 | Slide 6 Available on the Portal – Manuals and Guides OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION Test Coordinators Manual (TCM) Off-Grade Science (DAPE), HSPE, MSP, EOC TA User Guide DFA Off-Grade Science (DAPE) ES/MS DFA HSPE Reading/Writing Braille Requirements Document for Online Systems Feature Restrictions for iOS Devices Guidelines for Configuring iOS devices for Test Security Guidelines on Tools, Supports, & Accommodations for State Assessments (updated 1/27/15) Pre-ID Details Document (Updated 3/7) March 10, 2015 | Slide 7 Available on the Portal – Manuals and Guides OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION Secure Browser Manual System Requirements Document System Support Sunset Document Teacher Hand Scoring System Guide Tech Specs Document March 10, 2015 | Slide 8 Available on the Portal - Modules OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION Read-Aloud Reading CD DEMO Student Testing Interface Training Module TA Certification Teacher Hand Scoring System (THSS) Training Technology Requirements Training Module Test Administrator Training PowerPoint Test Administrator Online System Interface Module Example Coordinator Training PPT – Smarter Balanced and P/P Example TA Training PPT – Smarter Balanced and P/P March 10, 2015 | Slide 9 Available on the Portal – General Information OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION Bring Your Own Device (BYOD) Guidance for Online Smarter Balanced ELA/Literacy Summative Assessment Blueprint Mathematics Summative Assessment Blueprint Teacher Fact Sheet TIDE Student Records Pull Logic Washington Training Webinars Writing in Grades 3-5 Smarter Balanced P/P Test Booklet Samples –ELA Grades 3-5, 6-8, and HS Smarter Balanced P/P Test Booklet Samples –Math Grades 3-5, 6-8, and HS March 10, 2015 | Slide 10 Posting to the Portal - Weeks of March 9 and 16 OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION Off-Grade Science (DAPE) DEMO ES/MS (available 3/9/15 EOB) Off-Grade Science DEMO Translated Tool Button Tip Sheet (to be posted 3/6/15 EOB) Off-Grade Science DEMO Test Proctor Supplemental Directions (to be posted 3/6/15 EOB) March 10, 2015 | Slide 11 Posting to the Portal - Weeks of March 9 and 16 OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION Off-Grade Science (DAPE) DFA Translated Directions: Arabic, Chinese, English, Korean, Russian, Somali, Spanish, and Vietnamese (available 3/09) DFA MSP Science (available week of 3/9 EOB) DFA EOC Math/Biology (available 3/18 EOB) DFA EOC Translated Directions: Arabic, Chinese, English, Korean, Russian, Somali, Spanish, and Vietnamese March 10, 2015 | Slide 12 New Training Test Available OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION Science Training Tests for Grades 5 & 8 to be added Available beginning Monday, March 16 Accessed via Portal, along with the Smarter Balanced Practice and Training Tests 14 items A Lesson Plan document to help teachers guide students through the Science Training Test will be available by Monday, March 23. It will be posted on the Science Assessment webpage: http://www.k12.wa.us/Science/EducatorResources.aspx and on the Portal. March 10, 2015 | Slide 13 Summative Assessments 14 Summative Assessments OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION Smarter Balanced uses separate test booklets and answer documents No demographic page on the answer document Use of student label is required March 10, 2015 | Slide 15 Test Administrator Certification OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION Test Administrator (TA) certification module available on TA Portal page (link also coming to resources section) Narrated Interactive Takes approximately 30 minutes Short quiz at end of module Provides a Certificate Certification module is not required by OSPI but recommended that districts use as part of TA training March 10, 2015 | Slide 16 OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION New and Moved Students All Students need SSIDs in TIDE, SSIDs and TIDE records only come from CEDARS, Issuing an SSID creates a TIDE record. SSID Issuance process updated (for CEDARS admins): http://www.k12.wa.us/CEDARS/TrainingMaterials/SSIDUserGuideandPolicy.p df Data Flow from TIDE to CEDARS (for CEDARS admins and DACs): http://wa.portal.airast.org/wp-content/uploads/TIDE-StudentRecords-Pull-Logic-Update.docx Pre-ID Details (for DACs): http://wa.portal.airast.org/wpcontent/uploads/PreIDdetailsSpring2015_ECR.pdf March 10, 2015 | Slide 17 OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION New and Moved Students No Booklet Bubbles for Student Identity or Demographics Must print LABEL from TIDE Release of functionality not-yet available Tracking Online test completion for students who move during window ORS: Plan and Manage Testing IF student has TIDE record in your district MUST check if they have completed Performance Task – if your site has a different PT, student not blocked from taking a second, different PT Students cannot retake CAT March 10, 2015 | Slide 18 TA Interface: 2 things to know Student Lookup OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION Within TA interface, TA can search for a student to verify whether they are in TIDE Useful as a workaround if a new student is not exited from their former district Turn Universal Tools on/off: In TA interface – ‘edit test settings’ Student by student No bulk option March 10, 2015 | Slide 19 TA Interface: ALL tests still in the dropdown menus OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION Easier to select only the summative CAT or PT from Menu on LEFT All summative tests have “Summative” in the title March 10, 2015 | Slide 20 Accommodations and Supports Primary Info Sources OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION Info on Accommodations and supports: Guidelines on Tools, Supports & Accommodations for State Assessments (http://wa.portal.airast.org/wpcontent/uploads/GuidelinesToolsSupportsAccommodations_124-15v1.pdf) How to set accommodations: TIDE User Guide (http://wa.portal.airast.org/wpcontent/uploads/WATIDEUserGuide2014-2015_Final.pdf) Translated Directions (non-embedded) coming to Portal Maine: http://www.maine.gov/doe/assessment/mathela/administration/index.html#trans Oregon: http://oaksportal.org/resources/ March 10, 2015 | Slide 21 OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION Off-Grade Testing & Classroom Activity / Performance Task Assignment In TIDE March 10, 2015 | Slide 22 OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION Online School Program Students at Alternate Testing Sites Classroom Activities are intended to be administered in a setting as consistent with routine educational environment as possible, so Enrolled Site (ALE/Online Program) must: 1) For online tests, print and ship/fax test tickets 2) For paper tests, print and ship Pre-ID labels 3) Administer the Classroom Activity within guidance in TAM 4) Assign any Off-Grade tests (including OG performance tasks), supports and accommodations before start of testing; communicate those to test site 5) Communicate to test site which Performance Task the student is assigned March 10, 2015 | Slide 23 OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION Online School Program Students at Alternate Testing Sites IF ALE/ONLINE PROGRAM CANNOT ADMINISTER THE CLASSROOM ACTIVITY FOR SOME REASON the Enrolled Site (ALE/Online program) must also: 1) Contact test site to ensure student can participate in classroom activity at test site 2) Confirm which CA/PT are to be administered at the test site and assign that to the student in TIDE at least 24 hours prior to administration of the PT 3) Do steps 1, 2, and 4 from previous slide (as applicable) March 10, 2015 | Slide 24 OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION Off-Grade Performance Tasks and Classroom Activities OSPI Is not dictating that any specific classroom activity or performance task be administered to students taking OffGrade ELA or math assessments DC/DA roles can see which CAs/PTs are available at schools in the district and access the CA material in TIDE DC/DA can select from ANY CA/PT available at the grade of off-grade test for a student and assign to the student in TIDE Contact OSPI (assessment analysts for now) if a particular grade is not served in your district but a student will be offgrade-testing at that grade level to obtain the CA materials March 10, 2015 | Slide 25 OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION “L2 Basic”, Absences, Refusals, H/P/F AIR is still building the functionality to code students as able to ‘meet standard’ with a level 2, non-attempt attempt codes, and home-based/private/F-1 Must be entered prior to end of testing DOES NOT AFFECT student access to tests Allow time for makeup opportunities March 10, 2015 | Slide 26 Technology Readiness Reminders OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION Chromebooks should be updated to version 40.0.2214.115 to avoid technical issues Try out Secure Browser with practice tests or optional Interim assessments using proctor to approve sessions Practice using keyboards with iPads if students have not had experience with them (and to ensure they are working properly) Mac OS X 10.7 and Above: Spaces, Launchpad, and Fast User Switching must be disabled March 10, 2015 | Slide 27 Preventing Technology Security Issues OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION iPads running iOS 8.1.3 - security settings needed to prevent unauthorized use of iPad dictionary and predictive text features (see Technology Coordinators tab on WCAP portal), or must have sufficient proctoring oversight to ensure that students don’t use the “define” feature. Disable or refrain from using remote desktop monitoring software on all computers that will be used for testing. Student use of dual monitors during testing is not permitted. March 10, 2015 | Slide 28 OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION Summative Reporting Scores are available in the Online Reporting System within three weeks of completing online tests and submitting paper/pencil tests. Paper/Pencil tests are submitted by school (ELA and math) except for grade 3 ELA. Grade 3 ELA paper/pencil tests can be submitted in batches before other grades/content areas are completed, in order to have results within three weeks of receipt by the vendor. March 10, 2015 | Slide 29 Known Issue Log Issue # Topic Description Solution Documentation Needed OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION TIDE Description Description Description Description Description Description Description Description 3 Description Description Description Description New issue TIME STAMP 4 Description Description Description 1 TDS 2 ORS Description March 10, 2015 | Slide 30 Issues Shipping OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION Smarter Balanced and Off-Grade Science accommodated materials. Shipment shortages occurred statewide. Corrected/supplemental shipments were sent. Correction will ensure EOC or Science MSP shipments are complete. March 10, 2015 | Slide 31 Issues Shipping, cont’. OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION Pre-ID Labels Incorrect algorithm generated additional labels. Securely dispose of overage. Shipping Addresses Some districts received materials at an address other than that listed in WAMS. March 10, 2015 | Slide 32 OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION Issues Classroom Activities and Performance Tasks labeled incorrectly (ignore grade 9 – we don’t test grade 9 in Washington). Appeals functionality won’t be available until March 17th COB. To report appeals (to have tests reopened, reset, etc.), call the AIR Helpdesk. Will take 24-48 hours to be adjusted. March 10, 2015 | Slide 33 Scheduled Downtime OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION Friday though Sunday, April 17-19, the system will be unavailable as MSP science for grades 5 & 8 will be loaded to the test engine. System will be back online Monday, April 20. No other downtime is planned. Updates, if required, will be communicated. March 10, 2015 | Slide 34 Reminders OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION Familiarization with TIDE Familiarization with TAM Provides the lists of resources needed by staff Schedule computer labs Ensure technology is working Develop communication plan for your teacher administrators and technology and school coordinators Headphones will be needed March 10, 2015 | Slide 35 Digital Library 36 Digital Library OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION New Digital Library Account requests Problems with slow or non-delivery of Welcome and Password Reset emails. The issues have been diagnosed by Smarter Balanced and most have been rectified with thousands of welcome and password reset emails delivered. A perpetual issue is that some district or school spam filters trap the welcome and password reset emails. March 10, 2015 | Slide 37 Interim Scoring Tips 38 Steps for hand scoring success Decide what interim your students should take OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION Comprehensive / Block Check to make sure student rosters are loaded in TIDE Set up the test using the Test Administration tab Administer the test with students Access, download and print the Training Guide and the Exemplars from the THSS Train scorers (training on all ELA item types could take a few hours) Score student responses Access scores in the ORS March 10, 2015 | Slide 39 OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION Locating the materials When you open a student’s test in the THSS to score, a rubric appears with the item. To understand how the rubric is used educators will need to open and practice using the Training Guide and Exemplar. March 10, 2015 | Slide 40 What is located in each? Training Guide Exemplars Instructions Stimulus Item stem Rubric Condition Codes Prep Set 3/10/2015 Scored responses Scoring comments Check Set Scores located on a key Used for practice 41 Communications 42 Resources and News OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION Family Resources page on Portal Consolidated PPT and Questions/Answers (Oct ‘14- Feb ‘15) Contains current information Redundancies removed Organized by category News articles http://www.kitsapsun.com/news/local-news/smarter-balancedready-or-not-here-it-comes_63293842 http://www.yakimaherald.com/home/2946118-8/common-coreexams-begin-soon-and-many-school March 10, 2015 | Slide 43 Resources and News OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION http://www.kimatv.com/home/video/Yakima-feelprepared-for-Common-Core-testing-294779441.html March 10, 2015 | Slide 44 OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION Thank you, your staff, and students for taking on this new assessment! March 10, 2015 | Slide 45