Transcript COPPER PATINA

Test Administrators
Test Administrators
Big Picture Objectives
• Be aware of what’s new this year in
OAKS
• Understand the roles and
responsibilities of test administrators
• Understand how to use valid test
administration practices
• Learn where to find test administration
resources and tools
7/18/2015
Free Template from
www.brainybetty.com
2
STC Training
Big Picture Objectives
• Understand the roles and
responsibilities of school test
coordinators
• Be able to support the DTC in
training test administrators
• Understand state policies so that
you can help build effective
school procedures
7/18/2015
Free Template from
www.brainybetty.com
3
Test Administrators
Purpose: To ensure consistent statewide test
administration and valid test results.
Test Administration Resources:
• 2010–2011 Test Administration Manual
http://www.ode.state.or.us/go/tam
• Accommodations Manual
http://www.ode.state.or.us/search/page/?id=487
Promising Testing Practices
http://www.ode.state.or.us/search/page/?=2444
7/18/2015
Free Template from
www.brainybetty.com
4
STC Training
Required Assessment Options
(cont)
OAKS Online (cont)
•Reading & Mathematics: Up to 3 opportunities at grades
3 – 8, and 11
New in 2010-11: implementation of the new
Mathematics content standards.
•Science: 3 opportunities at grades 5, 8, and 11
Optional OAKS Online Assessment
•Social Sciences: 2 opportunities at grades 5, 8, and 11
If students are receiving High School Level instruction,
students in grades 8, 9, and 10 may take High School
Test. Students in grade 12 may also take the High
7/18/2015
Free Template from
School
level test.
www.brainybetty.com
5
STC Training
Required Assessment Options,
(cont)
OAKS Paper Writing Performance
•1 opportunity at grades 4, 7, and 11
OAKS Online Writing Performance
•1 opportunity at grades 7 and 11
•Students in grades 9, 10 and 12 may also take
the High School level test.
•Students in High School must not under any
circumstance take more than 1 opportunity
7/18/2015
Free Template from
www.brainybetty.com
6
STC Training
Required Assessment Options
(cont)
English Language Proficiency Assessment (ELPA)
• 1 opportunity for the following grade bands:
K – 1, 2 – 3, 4 – 5, 6 – 8, and 9 – 12
• Administered as two sub-tests: ELPA (listening,
reading, and writing) and ELPA Speaking
• New for 2010-11: Students must have LEP flag
marked in the SSID system in order to access the
ELPA
7/18/2015
Free Template from
www.brainybetty.com
7
Test Administrators
What’s new
OAKS Online
• OAKS Test Administrator Interface easier to
use
• User accounts managed through new TIDE
system instead of UMS
• New item types included in OAKS Online
Math and Science tests
• Pilot of text-to-speech feature in spring 2011
7/18/2015
Free Template from
www.brainybetty.com
8
Test Administrators
What’s new (cont)
OAKS Online (cont)
• OAKS Paper/Pencil and Large Print no longer
offered
• Printing of test items available as a restricted
resource
• DSAs or DTSAs must authorize in TIDE prior to testing
• For students on IEPs or 504 Plans, the student’s plan must
indicate the student needs access to test items in paper
format
• For students not on an IEP or 504 Plan, the decision must
be based on individual student
need
7/18/2015
Free Template
from and documented by
www.brainybetty.com
the district
9
Test Administrators
What’s new (cont)
Writing Performance Assessment
• Online Writing an option for all Grade 7 and
H.S. students
• New for 2010-11, Online Writing will include
a spell check feature
• Paper-based Writing tests for Grades 4, 7, and
H.S. will be ordered through TIDE
• H.S. papers will be double-scored; Grade 4
and 7 papers will be single-scored
7/18/2015
Free Template from
www.brainybetty.com
10
Test Administrators
New Math Achievement
Standards
Implementation of Math core content standards
• New math standards will become operational
• Achievement Standards were reviewed by
committee in August 2010. May be adopted by
the Board as early as October 2010. If Not, then
in December of 2010. Tests administered in
October, November and December of 2010 will
be scored against the December 2010
achievement standards (even if the new
achievement standard is higher than the
7/18/2015
Freeat
Template
from
achievement standard
the
time the test was
www.brainybetty.com
11
Test Administrators
Required Testing Environment
•Trained test administrator
•Quiet environment void of distractions
•Only allowable resources made available to
students upon request
•Limited interaction with students
– Read student directions
– Administer accommodations appropriately
– No coaching
7/18/2015
Free Template from
www.brainybetty.com
12
Test Security
Test Security
Secure Testing Environment
•A quiet environment, void of distractions and
supervised by a trained test administrator
•Visual barriers or adequate spacing between
students
•Student access to only allowable resources
•All paper test materials collected and accounted
for after each testing event
•Student data is treated as confidential
7/18/2015
Free Template from
www.brainybetty.com
14
Test Security
Definition and Purpose
•Purpose: To protect the integrity and
confidentiality of secure test items, prompts, and
passages. The security of these materials is
necessary so that they can be used in later years to
measure trends in performance. In addition, test
security helps to ensure test results can be used in
accountability reporting.
•Definition: A test impropriety is any instance
where a test is not administered in a manner
consistent with the Test Administration Manual or
OAR7/18/2015
581-022-0610 Administration
of
State
Tests.
Free Template from
www.brainybetty.com
15
Test Security
Potential Consequences
• Test opportunities may be invalidated in cases
where test validity was compromised. Students
will not receive additional test opportunities.
• If the district determines that the testing
impropriety qualifies as gross neglect of duty,
then the district must report it to TSPC within
30 days. Personnel may then be subject to
disciplinary action as determined by TSPC.
• Districts may also evaluate cases according to
their own Human Resource policies.
• Private schools and programs may have their
access to state tests revoked.
7/18/2015
Free Template from
www.brainybetty.com
16
Writing Performance
Assessment
Writing
Objectives
• Understand the ways in which
the writing assessment differs
from other assessments
• Conduct writing testing
appropriately
7/18/2015
Free Template from
www.brainybetty.com
18
Writing
Definition
The writing assessment is a performance
assessment where students produce an essay
over a 2-3 day period. It is considered an
“authentic” assessment in that students follow
a writing process, including prewriting,
drafting, editing and publishing, much as they
would for a typical classroom assignment.
7/18/2015
Free Template from
www.brainybetty.com
19
Writing
Purpose
•The purpose of the writing assessment is to
measure student proficiency on adopted state
standards in the area of writing. Through
analytic trait scoring, strengths and
weaknesses may be identified to inform
classroom instruction.
•Participation, not performance in the writing
assessment is included in the Report Card
ratings.
7/18/2015
Free Template from
www.brainybetty.com
20
Writing
Test Schedule
•Winter window (Jan. 12 – Feb. 24) for
grades 4, 7, and high school
•Spring window (April 13 – April 28) for
high school only
•Online window for participating schools
(Jan. 12 – March 17) for grade 7 and high
school
•Online Spring window (March 28 – April
28) for high school only
7/18/2015
Free Template from
www.brainybetty.com
21
Writing
Scoring
•High School Level
• Paper assessments will be scored same as last
year
• High School paper and online assessments
will be double scored
7/18/2015
Free Template from
www.brainybetty.com
22
Writing
Do’s and Don’ts
Do’s
•Testing Coordinators may test students in grade 9
or 10 if individual students have produced work
that shows they are capable of meeting the HS
writing standard.
•High School students may test once during one of
the two regular windows, regardless of grade.
•Students in Grade 11 (or their third year in high
school) must test once during one of the two
regular windows unless they met in a previous
year.
7/18/2015
Free Template from
www.brainybetty.com
23
Writing
Do’s and Don’ts (cont)
Do’s (cont)
•Students in Grade 12 may test once and need
to test during the winter window to receive
results prior to graduation
7/18/2015
Free Template from
www.brainybetty.com
24
Writing
Do’s and Don’ts (cont)
Don’ts
•Students who are not yet ready to
successfully complete the high school writing
assessment should not participate; it is not
intended as a “practice” opportunity in
anticipation of the eleventh grade attempt.
•Do not provide resources unless they are
explicitly described in the test administration
manual.
7/18/2015
Free Template from
www.brainybetty.com
25
Test Administrators
Do’s
Do’s and Don’ts
•TAs must read the 2010-11 Test Administration Manual, receive
annual test administration and security training, and sign an
Assurance of Test Security form before administering state tests.
•TAs may only provide students with allowable resources listed
by content area in the 2010-11 Test Administration Manual.
•TAs may only provide the restricted resource of printed test items
to students for whom the district has identified individual student
need.
•TAs may only provide the version of allowable resources
provided by ODE. These are posted online at
http://www.ode.state.or.us/search/page/?=2346
•TAs must read verbatim the student directions provided in the
2010-11 Test Administration Manual.*
7/18/2015
Free Template from
www.brainybetty.com
26
Test Administrators
Dos and Don’ts (cont)
Don’ts
•TAs may not allow untrained aides, volunteers, or
substitutes to assist with test administration.
•TAs may not coach students (including requiring
students to show their work).
•Students may not access non-allowable resources such
as textbooks, class notes, or cell phones during testing.
•Students may not talk to or help other students during
testing.
7/18/2015
Free Template from
www.brainybetty.com
27
Test Security
Do’s
Do’s and Don’ts
•TAs must ensure that students use the correct SSID
and take the correct test.
•TAs must securely shred test materials such as
printed test items or reading passages, scratch paper,
or other paper hand-outs written on by students after
each testing event.
•Test materials must be securely stored at all times.
•Test improprieties must be reported to ODE within
1 day of learning of them and the investigation must
be completed within 30 days.
•If a DTC cannot investigate an impropriety, the
7/18/2015
Free Template from
district
must assign someone
else to the task.
www.brainybetty.com
28
Test Security
Don’ts
Dos and Don’ts (cont)
•TAs must not review or analyze secure test items
•Students must not access non-allowable resources
such as cell phones, iPods, or e-mail
•Students must not remove test materials from the
test environment
•TAs must not copy or retain any test materials,
including secure test booklets, writing prompts, or
reading passages
•DTCs, STCs, and TAs must not share their OAKS
log-in information with anyone (even other
authorized OAKS users)
7/18/2015
Free Template from
www.brainybetty.com
29
Test Administrators
Promising Practices
•TA reviews the Test Administration Manual before
testing, focusing on test security and content-specific
allowable resources and accommodations.
•TA spaces students appropriately or provides visual
barriers to prevent students from seeing others’ tests.
•TA reads student directions verbatim and circulates
through test environment to ensure proper testing
conditions.
•TA makes available but does not require students to use
allowable resources.
7/18/2015
Free Template from
www.brainybetty.com
30
STC Training
Promising Practices
• To protect student confidentiality, if log-in cards are
used, be sure to store them securely. Schools must
take all practical steps to maintain the security of
SSIDs by making sure they are not displayed publicly
on items such as web sites, student body cards, or
other posted documents or lists.
• To ensure that students receive the appropriate
assessment, schools should keep track of which
students must take OAKS Braille or OAKS Extended;
schools may restrict these students in TIDE from
accessing OAKS Online for specific test subjects.
• To avoid test expirations, schools should track which
tests are close to expiration and ensure those students
complete testing before the 45-day expiration period
ends.
7/18/2015
Free Template from
www.brainybetty.com
31
Test Security
Promising Practices
•Using colorful materials to identify which students
have printed reading passages remaining at their
stations.
•When setting up the test environment, the TA should
ensure that the TA’s computer is set to print in the
computer lab where the students are testing.
•The TA uses the class roster to mark which students
received printed test items, reading passages, and how
many each student received. The TA then matches the
class roster to the printed items, reading passages
collected at the end of the testing event to account for
all printed items, and reading passages.
7/18/2015
Free Template from
www.brainybetty.com
32
Writing
Promising Practices
•Local scoring of classroom assessments using
the official scoring guide, to provide feedback
in some or all of the writing traits to prepare
students for the writing assessment.
•Districts require that students in grades other
than 11th meet the standard on a work sample
before taking the state writing assessment.
•Districts create a system where teachers trade
papers for double scoring, thus ensuring
reliability.
7/18/2015
Free Template from
www.brainybetty.com
33
Test Security
In a Nutshell
• Test materials must be inventoried and securely
stored both before and after each testing event.
• Only authorized staff who have signed an
Assurance of Test Security Form may have access
to secure test materials.
• Scratch paper and all other printed materials written
on by students during testing must be collected and
securely shredded at the end of each testing event.
• DTCs must report all test improprieties to ODE
within 1 day of learning of them. Report form is
available at:
7/18/2015
Free Template from
www.ode.state.or.us/go/testsecurity
www.brainybetty.com
34
Test Administrators
In a Nutshell
• TAs must receive training each year
• TAs enforce valid test environment for students
• When in doubt about a particular testing
practice, before testing begins:
– Check the Manual
– Check your training notes
– Ask your School Test Coordinator
– If all else fails, assume the answer is “no”
7/18/2015
Free Template from
www.brainybetty.com
35
7/18/2015
Free Template from
www.brainybetty.com
36