Transcript Document

District Assessment
Training for 2009-10
•
•
•
•
•
•
•
•
Welcome
Thank you for all you do and will be asked to do
Get coffee, water or juice
Get assessment notebook materials
Sign-in for CPD credit
Submit leave requests to Wayne Goates
Introducing assessment secretary Sharon Wills
Good news – state testing is generally the same as
last year
1
2
3
District Assessment Notebook
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
Orchid Information At-A-Glance
2009-10 Test Coordinators
Salmon Oregon Achievement Standards Summary
2009-10 Elementary Work Sample Overviews
2009-10 Middle School Work Sample Overviews
2009-10 High School Work Sample Overviews
Grey 2009-10 District Assessment Calendar
2009-10 Oregon’s Assessment of Knowledge & Skills (OAKS)
Statewide Testing Schedule
Tan
OAKS Online Keyboard Navigation Key
Pink STC – School Test Coordinator Assurance of Test Security
Canary TA – Test Administrator Assurance of Test Security
Blue
NTA – Non-Administrator Assurance of Test Security
Ivory Security Practices & Examples
Green 2009-10 Test Administration Manual
Canary 2009-10 Appendices for Test Administration Manual
Buff
OAKS Online User Management System (UMS)
Ivory Extended Assessment Updates and Information
Pink English Language Proficiency Assessment (ELPA)
Blue 2009-10 Oregon Online Assessment Reporting System Users Guide
4
5
When Are You Starting
OAKS Online Testing?
A new secure test browser
must be installed.
6
7
Test Administration Manual (green)

Oregon Administrative Rule 581-022-0610
Administration of State Tests – 5 pages
I. Introduction - who must read what on page 2
II. Test Roles – DTC, STC, TA & regional help
III. Student Confidentiality – No names with SSID
IV. Test Security with reporting & security forms
V. Accommodations and Modifications
VI. Student and Assessment Options
VII. English Language Learners
VIII.Students with Disabilities
8
Test Administration Manual
Requirements
• School Test Coordinators must read and
understand Parts I – VIII and the appendices.
• Test Administrators must read and understand
Parts I – V and Appendices A & R, as well as
appendices specific to assessments which they
will be administering.
9
10
Test Administration Manual was
updated on September 21
• Appendix A: Extended the test window for
HS Online Writing
• Appendices D & E: Provided updated
timeline for the phase-in of the Essential
Skills graduation requirement
• Appendices I, J, K, & L: Corrected the
session expiration period to 45 calendar
days
11
Oregon Assessment of
Knowledge and Skills (OAKS)
•
•
•
•
•
OAKS Online
OAKS Paper&Pencil/Braille/Large Print
OAKS Writing Performance Assessment
OAKS Extended
English Language Proficiency Assessment (ELPA)
• Manual includes information about PSAT, NAEP,
Aprenda and Work Samples
12
Required Assessment Options
• Reading & Math: at grades 3 – 8, and 10
• Science: at grades 5, 8, and 10
• Writing: at grades 4, 7, and 10
Students in grades 9, 11, and 12 may also take
the High School level test.
In preparation for the implementation of the
new Mathematics content standards, there
will be an additional set of “field test”
questions.
13
Online Assessment Options
• Reading & Mathematics: Up to 3 online
opportunities at grades 3 – 8, and 10
• Science: Up to 3 online opportunities at
grades 5, 8, and 10
• Writing: 1 online opportunity at grade 10
Students in grades 9, 11, and 12 may also take
the grade 10 test.
14
Up to 3 Online Opportunities
Multiple Opportunities are a means of
limiting the impact of the “real world”
on a student’s results including: Adult
errors, network problems, student
illness, etc. Therefore 3 opportunities
for each student are not guaranteed.
15
Paper/Pencil, Braille, and Large Print
Reading and Mathematics: 1 opportunity at
grades 3 – 8, and 10.
• Science: 1 opportunity at grades 5, 8, and 10.
• Writing: 1 opportunity at grades 4, 7 and 10.
16
OAKS Writing Assessment
OAKS Paper Writing Performance
• 1 opportunity at grades 4, 7, and 10.
OAKS Online Writing Performance
• 1 opportunity at grade 10.
• Students in grades 9, 11 and 12 may also take the
High School level test.
• Students in High School must not under any
circumstance take more than 1 opportunity.
17
OAKS Extended Assessments
• Reading & Math : 1 opportunity at grades
3 – 8, and 10.
• Science: 1 opportunity at grades 5, 8, and 10.
• Writing: 1 opportunity at grades 4, 7, and 10.
18
OAKS General Review
• The Assessment options generally are the
same this year as last year
• ELPA will be integrated into OAKS Online
• Oaks Online Writing will be available to all
H.S. students, but a H.S. student only has 1
writing opportunity.
19
School Test Coordinator Role
• STCs may set school test schedules for OAKS tests
(Online, Paper/Pencil, and Writing) in collaboration with
DTCs.
• STCs must coordinate determination of appropriate
assessment options for students.
• STCs must coordinate secure storage, distribution, and
inventory of paper test materials for the school.
• STCs help code students who do not test because they
were not enrolled during the school test window using
Administration Code 8 in student centered staging.
• May not Set school test schedules for Extended Assessments
or the ELPA.
20
School Test Coordinators Role
• STCs coordinate determination of
appropriate assessment options for students.
• STCs assist DTCs in ensuring that all test
administrators receive test administration
and security training.
• STCs ensure security of paper test materials
before, during, and after testing.
21
Test Administrators
• TAs must read the 2009-10 Test Administration Manual,
receive annual test administration and security training, and
sign an Assurance of Test Security form before administering
state tests.
• TAs may only provide upon request students with allowable
resources listed by content area in the 2009-10 Test
Administration Manual Appendices.
• TAs may only provide the version of allowable resources
provided by ODE. These are posted online at
http://www.ode.state.or.us/search/page/?=2346
• TAs must read verbatim the student directions provided by
content area in the 2009-10 Test Administration Manual
Appendices.
• TAs must sign the Test Security form in order to administer
tests.
22
Test Administrators
• TAs may not allow untrained aides, volunteers, or
substitutes to assist with test administration.
• TAs may not coach students (including requiring
students to show their work).
• Students may not access non-allowable resources
such as textbooks or class notes
• Students must not talk to or help other students
during testing.
23
Test Administrators
• TA reviews the Test Administration Manual before
testing, focusing on test security and content-specific
allowable resources and accommodations.
• TA spaces students appropriately or provides visual
barriers to prevent students from seeing others’ tests.
• TA reads student directions verbatim and circulates
through test environment to ensure proper testing
conditions.
• TA makes available but does not require students to
use allowable resources.
24
Test Administrators Review
• TAs must receive training each year
• TAs enforce valid test environment for students
• When in doubt about a particular testing
practice:
– Check the Manual
– Check your training notes
– Ask your School Test Coordinator
– If all else fails, assume the answer is “no”
25
Test Security
• Purpose: To protect the integrity and confidentiality of
secure test items, prompts, and passages. The security of
these materials is necessary so that they can be used in
later years to measure trends in performance. In addition,
test security helps to ensure test results can be used in
accountability reporting
• Definition: A test impropriety is any instance where a test
is not administered in a manner consistent with the Test
Administration Manual or OAR 581-022-0610
Administration of State Tests
26
Secure Testing Environment
• A quiet environment, void of distractions and
supervised by a trained test administrator
• Visual barriers or adequate spacing between
students
• Student access to only allowable resources
• All paper test materials collected and accounted
for after each testing event
• Student data is treated as confidential
27
Secure Testing Environment
• Mathematics symbols (including #s) can not be read aloud
125 + 25 =
• Test Administrators may not explicitly or implicitly direct a
student to identify reasons or strategies used to determine test
answers, nor otherwise provide instructional or learning
strategies for guidance during the assessment process (see
Administration Manual for examples of Allowable Resources)
• Any teacher review or analysis of test items constitutes a breach
in test security – both districts and teachers are responsible
• Do not score the tests or otherwise give students any feedback as
to how well you believe they are performing
28
Secure Testing Environment
• TAs must ensure that students use the correct SSID and
take the correct test.
• TAs must securely shred test materials such as reading
passages, scratch paper, or other paper hand-outs written
on by students after each testing event
• Test materials must be securely stored at all times
• Test improprieties must be reported to ODE within 1
day of learning of them and the investigation must be
completed within 30 days.
• If a DTC can not investigate an impropriety, the district
must assign someone else to the task
29
30
Secure Testing Environment
• TAs must not review or analyze secure test items
• Students must not access non-allowable resources such
as cell phones, iPods, or e-mail
• Students must not remove test materials from the test
environment
• TAs must not copy or retain any test materials,
including secure test booklets, writing prompts, or
reading passages
• DTCs, STCs, and TAs must not share their UMS log-in
information with anyone (even other authorized UMS
users)
31
Security Suggestions
• Using colorful materials to identify which students
have printed reading passages remaining at their
stations
• When setting up the test environment, the TA should
ensure that the TA’s computer is set to print in the
computer lab where the students are testing.
• The TA uses the class roster to mark which students
received printed reading passages and then matches
the class roster to the printed reading passages
collected at the end of the testing event to account
for all printed reading passages
32
Security Review
• Test materials must be inventoried and securely stored
both before and after each testing event.
• Only authorized staff who have signed an Assurance
of Test Security Form may have access to secure test
materials.
• Scratch paper and all other printed materials written
on by students during testing must be collected and
securely shredded at the end of each testing event.
• DTCs must report all test improprieties to ODE within
1 day of learning of them. Report form is available at:
www.ode.state.or.us/go/testsecurity
33
Needed Login Information
From Appendix H
34
35
Test Administration Procedures
• Oregon assessment tests are NOT timed tests
• Students should be allowed to continue working as long as
they are making reasonable progress
• Administering the test in smaller segments is an
acceptable practice (remember test security)
• Providing less time than indicated by the guidelines in the
Test Administration Manual is an extreme disadvantage to
students
• If a student “rushes” through the test, this will be counted
as one of their opportunities. Test Administrators must
monitor student progress to reduce this risk.
36
Breaking Up the Test
• If you know you will be administering the test in
multiple sessions, remind students before they begin
testing that they will be resuming the test at another
date/time
• When students resume a test, the test will start on the
same number/passage where he/she previously
stopped
• If a student pauses an OAKS Online test for 20
minutes or more, the student will not be able to
return to previously answered or marked questions.
• When resuming a test, Test Administrators should
review the process and re-read the student directions.
37
Student Readiness for Testing
– Familiarize students with test format by allowing
them to take Sample/Practice Tests, if available
– Explain to students that the purpose of the
assessment is to “measure your current progress
on state content standards” and remind them
that “I can’t help you with reading passages,
test questions, test answers or formulas.”
– Encourage students to “do their best”
38
Accommodations Overview
Accommodation — a change in how a test is presented to
or responded to by a student.
– Provides the student equal access and equal opportunity
to demonstrate proficiency.
– Is considered “standard administration;” students have
the opportunity to “meet” or “exceed” the standard.
– Should be consistent with support provided during
individual student’s instruction.
– Braille and large print paper/pencil tests are available.
– Listed at www.ode.state.or.us/search/page/?=487
39
Extended Assessments
• Extended assessments must be identified on a
student’s IEP
• IEP teams should determine whether the student
would be best served by the standard or
scaffolded extended assessment
• Results will be included in AYP calculations
• Only “qualified” assessors should administer
extended assessments
40
ELPA - English Language
Proficiency Assessment
• Enrolled after May 1, 2010 – only ELPA
• Enrolled May 2, 2009 to May 1, 2010 –
ELPA and OAKS Math & Science
• Enrolled before May 2, 2009 – must take
ELPA and all other OAKS tests
41
English Language Proficiency
Assessment (ELPA)
• 1 opportunity for grade bands:
K – 1, 2 – 3, 4 – 5, 6 – 8, and 9 – 12.
• ELPA will be integrated into OAKS
Online.
42
DIBELS, Maze & Common Math
DIBELS
Grades K – 5
Sept, Jan, May
Maze
(optional)
Grades 6 – 8
September & March
Grades K – 8
Pre & Post Test
at Trimester
Common
Math
43
Writing Test Schedule
• Grades 4, 7, & HS students Paper & Pencil
– January 11- February 26
– For HS students only: April 12 – 30
• Online Writing for HS students
– January 11 to April 30
• Students in High School must not under any
circumstance take more than 1 opportunity.
44
Essential Skills
• Class of 2012 – Sophomores must read &
comprehend variety of text.
• Class or 2013 – Freshman must do above
and write clearly and accurately
• Class of 2014 – 8th grade must do above and
apply mathematics in variety of settings
45
Work Sample Requirements
• The change in the law does not go into effect until July 1,
2008
• For writing, speaking, and mathematics problem solving,
students in grades 3, 4, 5, 6, 7 & 8 must complete one work
sample scored with the state scoring guide, meeting the
performance standard.
• Students at the CIM level must complete 2 work samples
from different strands (SRCs 3, 4, or 5) in mathematics
problem solving; and 3 samples in writing (one persuasive,
one expository AND one imaginative or narrative). In
speaking, CIM students must complete 3 samples (one
persuasive, one informative, and one unrehearsed).
46
Work Sample Requirements
• For scientific inquiry, students in grades 3 – 8 and at the
CIM level must complete one work sample, scored in the
required dimensions.
• For social science analysis, students in grades
6 – 8 and at the CIM level may complete one work sample,
scored in the required dimensions. To earn the Social
Sciences Endorsement, students must complete one work
sample scored with the state scoring guide, meeting the
performance standard.
The phase in schedule for science work samples can be found at:
http://www.ode.state.or.us/search/page/?id=518
The phase in schedule for social sciences work samples can be found at:
http://www.ode.state.or.us/search/page/?id=34
47
48