Transcript Document

District Assessment
Training for 2010-11
•
•
•
•
•
•
•
Good morning!
Thank you for all you do and will be asked to do!
Please have some coffee, water or juice
Get assessment notebook materials
Sign-in for CPD credit
Submit leave requests to Wayne Goates
Good news – state testing is generally the same as
last year
1
2
3
District Assessment Notebook
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
Orchid Information At-A-Glance
2010-11 Test Coordinators
Salmon Oregon Achievement Standards Summary
Grey 2010-11 District Assessment Calendar
2010-11 Oregon’s Assessment of Knowledge & Skills (OAKS)
Statewide Testing Schedule
Tan
OAKS Online Keyboard Navigation Key
Pink STC – School Test Coordinator Assurance of Test Security
Canary TA – Test Administrator Assurance of Test Security
Blue
NTA – Non-Administrator Assurance of Test Security
Ivory Security Practices & Examples
Green 2010-11 Test Administration Manual
Canary 2010-11 Appendices for Test Administration Manual
Buff
OAKS Online User Guide for the Test Information Distribution Engine
(TIDE)
Ivory Extended Assessment Updates and Information
Pink English Language Proficiency Assessment (ELPA)
Blue 2010-11 Oregon Online Assessment Reporting System Users Guide
4
5
A new secure test browser is
required for OAKS testing.
The installation is automatic
when logging into Novell on
computers having the secure
test browser last year.
6
7
Test Administration Manual (green)

Foreword is OAR 581-022-0610
Administration of State Tests (5 pages)
I. Introduction - who must read what on page 2
II. Test Roles – DTC, STC, TA & regional help
III. Student Confidentiality – No names with SSID
IV. Test Security with reporting & security forms
V. Accommodations and Modifications
VI. Students and Assessment Options
VII. English Language Learners
VIII.Students with Disabilities
8
Test Administration Manual
Requirements
• School Test Coordinators must read and
understand Parts I – VIII and the appendices.
• Test Administrators must read and understand
Parts I – V and Appendices A & Q, as well as
appendices specific to assessments which they
will be administering.
9
10
In a Nutshell
• The Assessment options generally are the same
this year as last year, except high school is now
grade 11 and there is no OAKS Paper/Pencil or
Large Print tests
• Oaks Online Writing will be available to all Grade
7 and HS students
• STCs must ensure that a student does not use
OAKS Online in the content area in which a
student will use a paper test (e.g., Braille,
Extended, or Paper/Pencil Writing)
11
Oregon Assessment of
Knowledge and Skills (OAKS)
•
•
•
•
•
OAKS Online
OAKS Braille
OAKS Writing Performance Assessment
OAKS Extended
English Language Proficiency Assessment (ELPA)
• Appendices includes information about PSAT,
NAEP, and Work Samples
12
Required Assessment Options
• Reading & Math: at grades 3 – 8, and 11
• Science: at grades 5, 8, and 11
• Writing: at grades 4, 7, and 11
Students in grades 9, 10, and 12 may also take
the High School level test.
13
Online Assessment Options
• Reading & Mathematics: Up to 3 online
opportunities at grades 3 – 8, and 11
• Science: Up to 3 online opportunities at grades
5, 8, and 11
• Writing: 1 online opportunity – grades 7 & 11
Students in grades 9, 10, and 12 may also take the
grade 11 test.
14
Up to 3 Online Opportunities
Multiple Opportunities are a means of
limiting the impact of the “real world”
on a student’s results including: Adult
errors, network problems, student
illness, etc. Therefore 3 opportunities
for each student are not guaranteed.
15
OAKS Writing Assessment
OAKS Paper Writing Performance
• 1 opportunity at grades 4, 7, and 11.
OAKS Online Writing Performance
• 1 opportunity at grades 7 & 11.
• Students in grades 9, 10 and 12 may also take the
High School level test.
• Students must not under any circumstance take
more than 1 opportunity!
16
OAKS Extended Assessments
• Reading & Math : 1 opportunity at grades
3 – 8, and 11.
• Science: 1 opportunity at grades 5, 8, and 11.
• Writing: 1 opportunity at grades 4, 7, and 11.
17
OAKS General Review
• The Assessment options generally are the
same this year as last year
• ELPA will be integrated into OAKS Online
• OAKS online or paper writing will be
available to all grade 7 and H.S. students,
but each student only has 1 writing
opportunity.
18
School Test Coordinator Role
• May set school test schedules for OAKS tests.
• Must coordinate determination of appropriate
assessment options for students.
• Must coordinate secure storage, distribution, and
inventory of paper test materials for the school.
• Must ensure that all test administrators receive test
administration and security training.
• Must report any test improprieties.
• Help code students who do not test because they were
not enrolled during the school test window using
Administration Code 8 in student centered staging.
• May not Set school test schedules for Extended
19
Assessments or the ELPA.
Test Administrators
• TAs must read the 2010-11 Test Administration Manual,
receive annual test administration and security training, and
sign an Assurance of Test Security form before administering
state tests.
• TAs may only provide upon request students with allowable
resources listed by content area in the 2010-11 Test
Administration Manual Appendices.
• TAs may only provide the version of allowable resources
provided by ODE. These are posted online at
http://www.ode.state.or.us/search/page/?=2346
• TAs must read verbatim the student directions provided by
content area in the 2010-11 Test Administration Manual
Appendices.
• TAs must sign the Test Security form in order to administer
tests.
20
Test Administrators
• TAs may not allow untrained aides, volunteers, or
substitutes to assist with test administration.
• TAs may not coach students (including requiring
students to show their work).
• Students may not access non-allowable resources
such as textbooks or class notes
• Students must not talk to or help other students
during testing.
21
Test Administrators
• TA reviews the Test Administration Manual before
testing, focusing on test security and content-specific
allowable resources and accommodations.
• TA spaces students appropriately or provides visual
barriers to prevent students from seeing others’ tests.
• TA reads student directions verbatim and circulates
through test environment to ensure proper testing
conditions.
• TA makes available but does not require students to
use allowable resources.
22
Test Administrators Review
• TAs must receive training each year
• TAs enforce valid test environment for students
• When in doubt about a particular testing
practice:
– Check the Manual
– Check your training notes
– Ask your School Test Coordinator
– If all else fails, assume the answer is “no”
23
Test Security
• Purpose: To protect the integrity and confidentiality of
secure test items, prompts, and passages. The security of
these materials is necessary so that they can be used in
later years to measure trends in performance. In addition,
test security helps to ensure test results can be used in
accountability reporting
• Definition: A test impropriety is any instance where a test
is not administered in a manner consistent with the Test
Administration Manual or OAR 581-022-0610
Administration of State Tests
24
Secure Testing Environment
• A quiet environment, void of distractions and
supervised by a trained test administrator
• Visual barriers or adequate spacing between
students
• Student access to only allowable resources
• All paper test materials collected and accounted
for after each testing event
• Student data is treated as confidential
25
Secure Testing Environment
• Reading aloud words, numbers and symbols on OAKS math test
is allowable – see Read-Aloud handout for grade 3-5, 6-8 and
HS
• Test Administrators may not explicitly or implicitly direct a
student to identify reasons or strategies used to determine test
answers, nor otherwise provide instructional or learning
strategies for guidance during the assessment process (see
Administration Manual for examples of Allowable Resources)
• Any teacher review or analysis of test items constitutes a breach
in test security – both districts and teachers are responsible
• Do not score the tests or otherwise give students any feedback as
to how well you believe they are performing
26
Test Security Do’s
• TAs must ensure that students use the correct SSID and
take the correct test.
• TAs must securely shred test materials such as reading
passages, scratch paper, or other paper hand-outs written
on by students after each testing event
• Test materials must be securely stored at all times
• Test improprieties must be reported to ODE within 1
day of learning of them and the investigation must be
completed within 30 days.
• If a DTC can not investigate an impropriety, the district
must assign someone else to the task
27
28
Test Security Don’ts
• TAs must not review or analyze secure test items
• Students must not access non-allowable resources such
as cell phones, iPods, or e-mail
• Students must not remove test materials from the test
environment
• TAs must not copy or retain any test materials,
including secure test booklets, writing prompts, or
reading passages
• DTCs, STCs, and TAs must not share their TIDE log-in
information with anyone (even other authorized TIDE
users)
29
Test Security Do’s
• Using colorful materials to identify which students
have printed reading passages remaining at their
stations
• When setting up the test environment, the TA should
ensure that the TA’s computer is set to print in the
computer lab where the students are testing.
• The TA uses the class roster to mark which students
received printed reading passages and then matches
the class roster to the printed reading passages
collected at the end of the testing event to account
for all printed reading passages
30
Security Review
• Test materials must be inventoried and securely stored
both before and after each testing event.
• Only authorized staff who have signed an Assurance
of Test Security Form may have access to secure test
materials.
• Scratch paper and all other printed materials written
on by students during testing must be collected and
securely shredded at the end of each testing event.
• DTCs must report all test improprieties to ODE within
1 day of learning of them. Report form is available at:
www.ode.state.or.us/go/testsecurity
31
New TIDE System
(Test Information Distribution Engine)
• Centralized login to access multiple OAKS systems
• Found at www.oaks.k12.or.us
• Includes test administration, training, practice tests and
online reporting system
• New design for ease-of-use and simplified navigation
• View performance data from previous test administrations
32
Student Information for OAKS Online
(See Appendix B for Student Directions)
•
•
•
•
•
•
SSID
Student’s legal name
Student’s enrolled grade
Language of assessment (English or Spanish)
Print size
Any student restrictions for accessing OAKS online
for students taking Braille or Extended Assessments
• Accommodations to be administered to the student
33
34
Test Administration Procedures
• Oregon assessment tests are NOT timed tests
• Students should be allowed to continue working as long as
they are making reasonable progress
• Administering the test in smaller segments is an
acceptable practice (remember test security)
• Providing less time than indicated by the guidelines in the
Test Administration Manual is an extreme disadvantage to
students
• If a student “rushes” through the test, this will be counted
as one of their opportunities. Test Administrators must
monitor student progress to reduce this risk.
35
Breaking Up the Test
• If you know you will be administering the test in
multiple sessions, remind students before they begin
testing that they will be resuming the test at another
date/time
• When students resume a test, the test will start on the
same number/passage where he/she previously
stopped
• If a student pauses an OAKS Online test for 20
minutes or more, the student will not be able to
return to previously answered or marked questions.
• When resuming a test, Test Administrators should
review the process and re-read the student directions.
36
Student Readiness for Testing
– Familiarize students with test format by allowing
them to take Sample/Practice Tests, if available
– Explain to students that the purpose of the
assessment is to “measure your current progress
on state content standards” and remind them
that “I can’t help you with reading passages,
test questions, test answers or formulas.”
– Encourage students to “do their best”
37
Accommodations Overview
Accommodation — a change in how a test is presented to
or responded to by a student.
– Provides the student equal access and equal opportunity
to demonstrate proficiency.
– Is considered “standard administration;” students have
the opportunity to “meet” or “exceed” the standard.
– Should be consistent with support provided during
individual student’s instruction.
– Listed at www.ode.state.or.us/search/page/?=487
38
Accommodations
• Necessary accommodations should
be identified and implemented
during classroom instruction prior to
the student’s participation in the state
assessment. Accommodations used
in state assessment must have been
previously approved by the
Accommodations Panel and listed in
the Accommodations
39
Accommodations
• For students with disabilities who take the general
education assessment, accommodations must be
coded. OAKS tests allow for test administrators
to pre-set the flag in TIDE or to set the flag during
approval for testing.
• In Tide, the required field is “Number of
Accommodations”.
• More detailed codes are optional this year. This
field is called “Accommodation Code”.
• Different naming convention in Student Centered
Staging.
40
Accommodations Do’s
• Refer to the accommodations tables and or manual
as posted for accommodations implementation
guidance.
• Refer to student’s IEP or classroom practices to
determine which accommodations should be
provided.
• Note that although writing prompts may now be
translated locally, they must be completed in
advance by a trained translator endorsed by the
district and must be stored securely. Translator
also needs to be trained in Test Security and sign
an Assurance of Test Security form.
41
Accommodations Do’s
• TAs may now read numerals and math symbols
aloud on the math test if they follow the guidance
and examples posted on the ODE website.
– In general, numbers and symbols can be read according
to their common English usage. For example, > would
be read as “is greater than.”
– Numbers 99 and less should be read using standard
place value language. For example, 23 would be read as
“twenty-three.”
– However, numbers greater than 99 should be read as
individual numbers. For example, 579 would be read
as “five seven nine.”
42
Accommodations Don’ts
• TA may not instruct students to print reading passages.
• TAs may not provide instruction or give suggestions
regarding process.
• TAs may not read Reading items or response choices
aloud.
• Do not choose to administer an accommodation for all
students in a class or a grade.
• TAs may not read ELPA items or response choices aloud.
• Items may not be translated.
• If you can’t find it in the TAM, don’t do it.
43
Extended Assessments
• Extended assessments must be identified on a
student’s IEP
• IEP teams should determine whether the student
would be best served by the standard or
scaffolded extended assessment
• Results will be included in AYP calculations
• Only “qualified” assessors should administer
extended assessments
44
ELPA - English Language
Proficiency Assessment
• Enrolled after May 1, 2010 – Must take
ELPA and OAKS Math & Science
• Enrolled before May 1, 2010 – must take
ELPA and all other OAKS tests
• Must be flagged for ELPA in SSID system
prior to ELPA testing
45
English Language Proficiency
Assessment (ELPA)
• 1 opportunity for grade bands:
K – 1, 2 – 3, 4 – 5, 6 – 8, and 9 – 12.
• ELPA will be integrated into OAKS
Online.
46
DIBELS, Maze & Common Math
DIBELS
Grades K – 5
Sept 24, Dec 3,
March 16 & June 3
Maze
(optional)
Grades 6 – 8
September & March
Grades K – 8
Pre & Post Test
at Trimester
Common
Math
47
Writing Test Schedule
• Grades 4, 7, & HS students Paper & Pencil
– January 12- February 24
– For HS students only: April 13 – 28
• Online Writing for grade 7 & HS students
– January 12 to March 17
• Students in High School must not under any
circumstance take more than 1 opportunity.
48
Essential Skills
• Class of 2012 (Juniors) – Reading
• Class or 2013 (Sophomores) – Reading and
Writing
• Class of 2014 (Freshmen) – Reading,
Writing and Apply Mathematics
49
50