Transcript Slide 1

School Test
Coordinators
Review
DTC Training
Oregon’s Performance
NAEP 2009 – Grade 4 Math, DTC Training
Economically Disadvantaged Student Performance Gap
Source: Education Week Quality Counts 2010
NAEP Average Scores
2003
2009
Economically Disadvantaged
266
270
Not Economically Disadvantaged
286
296
20
26
Gap
DTC Training
Key Reporting Policy Reminders
•A valid grade level assessment will always be
treated as a higher score than an extended
assessment.
•Students cannot take an Online and Paper-based
test in the same content area.
•The “district special education” flag should be
used only for students who are not served by a
school.
•ODE will soon report as a group “students at the
district, not associated with a school”.
•AYP resets will only occur with new institution
IDs.
STC Training
Required Assessment Options
OAKS Online
•Multiple Opportunities are a
means of limiting the impact of the
“real world” on a student’s results
including: Adult errors, network
problems, student illness, etc.
•Therefore 3 opportunities for each
student are not guaranteed
STC Training
Required Assessment Options
(cont)
OAKS Online (cont)
•Reading & Mathematics: Up to 3 opportunities at
grades 3 – 8, and 11
New in 2010-11: implementation of the new
Mathematics content standards.
•Science: 3 opportunities at grades 5, 8, and 11
Optional OAKS Online Assessment
•Social Sciences: 2 opportunities at grades 5, 8,
and 11
If students are receiving High School Level instruction,
students in grades 8, 9, and 10 may take High School Test.
Students in grade 12 may also take the High School level test.
STC Training
Required Assessment Options
(cont)
OAKS Braille
Reading and Mathematics: 1 opportunity at grades
3 – 8 and 11
• Science: 1 opportunity at grades 5, 8, and 11
Students in grades 8*, 9, 10 and 12 may also take
the High School level test
OAKS Paper/Pencil and Large Print
New for 2010-11: OAKS Paper/Pencil and OAKS
Large Print are no longer available
*Student must take the 8th grade test before taking the HS level test
STC Training
Required Assessment Options
(cont)
OAKS Paper Writing Performance
• 1 opportunity at grades 4, 7, and 11
OAKS Online Writing Performance
• 1 opportunity at grades 7 and 11
• Students in grades 9, 10 and 12 may also take the
High School level test.
• Students in High School must not under any
circumstance take more than 1 opportunity
STC Training
Required Assessment Options
(cont)
OAKS Extended Assessments
• Reading : 1 opportunity at grades 3 –
8, and 11
• Mathematics: 1 opportunity at grades
3 – 8, and 11. New in 2010-11: implementation of
the new Mathematics content standards
• Science: 1 opportunity at grades 5, 8,
and 11
• Writing: 1 opportunity at grades 4, 7,
and 11
STC Training
Required Assessment Options
(cont)
English Language Proficiency Assessment (ELPA)
• 1 opportunity for the following grade bands:
K – 1, 2 – 3, 4 – 5, 6 – 8, and 9 – 12
• Administered as two sub-tests: ELPA
(listening, reading, and writing) and ELPA
Speaking
• New for 2010-11: Students must have LEP
flag marked in the SSID system in order to
access the ELPA
STC Training
Required Assessment Options
(cont)
OAKS Online Grade 3 Spanish Reading/Literature
Assessment
• Native language Spanish Reading assessment (not an
English-Spanish side-by-side test)
• Students may use up to 2 out of 3 available Reading test
opportunities (only 1 Spanish opportunity per student
between 10/13/10 and 1/3/11)
• Pending approval by the U.S. Dept. of Education, students
must also take at least 1 English opportunity in order to
count for accountability purposes
• Following approval by the U.S. Dept. of Education, ELL
students may use Grade 3 Spanish Reading for
accountability purposes
Additional Assessments (PSAT/NMSQT® and NAEP)
Test Schedule
STC Training
http://www.ode.state.or.us/search/page/?id=499
• OAKS Online
10/13 – 5/19
*includes Grade 3 Spanish Reading
1st Grade 3 Spanish Reading Opportunity
10/13 – 1/3
2nd Grade 3 Spanish Reading Opportunity
1/4 – 05/19
• OAKS Braille MC
3/9 – 4/7
• OAKS Writing (Paper/Pencil)
•Winter (Grade 4, 7 & High School) 1/12 – 2/24
•Spring (High School Only)
4/13 – 4/28
• OAKS Writing (Online)
•Winter (Grade 7 & High School) 1/12 – 3/17
•Spring (High School Only)
3/28 – 4/28
• Extended Assessment
2/16 – 4/28
• ELPA
1/12 – 5/12
• PSAT/NMSQT
10/13 or 10/16
• NAEP
1/24 – 3/4
Do’s
Dos and Don’ts
STC Training
• STCs must coordinate determination of
appropriate assessment options for students
• STCs must coordinate secure storage,
distribution, and inventory of paper test
materials for the school
STC Training
Promising Practices
• To protect student confidentiality, if log-in cards
are used, be sure to store them securely. Schools
must take all practical steps to maintain the
security of SSIDs by making sure they are not
displayed publicly on items such as web sites,
student body cards, or other posted documents or
lists.
• To ensure that students receive the appropriate
assessment, schools should keep track of which
students must take OAKS Braille or OAKS
Extended; schools may restrict these students in
TIDE from accessing OAKS Online for specific
test subjects.
• To avoid test expirations, schools should track
which tests are close to expiration and ensure
those students complete testing before the 45-day
expiration period ends.
TA Training
What’s new
OAKS Online
• OAKS Test Administrator Interface
easier to use
• User accounts managed through new
TIDE system instead of UMS
• New item types included in OAKS
Online Math and Science tests
• Pilot of text-to-speech feature in
spring 2011
TA Training
What’s new (cont)
OAKS Online (cont)
• OAKS Paper/Pencil and Large Print no longer
offered
• Printing of test items available as a restricted
resource
• DSAs or DTSAs must authorize in TIDE prior
to testing
• For students on IEPs or 504 Plans, the student’s
plan must indicate the student needs access to
test items in paper format
• For students not on an IEP or 504 Plan, the
decision must be based on individual student
need and documented by the district
TA Training
What’s new (cont)
Writing Performance Assessment
• Online Writing an option for all Grade 7
and H.S. students
• New for 2010-11, Online Writing will
include a spell check feature
• H.S. papers will be double-scored; Grade 4
and 7 papers will be single-scored
TA Training
New Math Achievement
Standards
Implementation of Math core content standards
• New math standards will become
operational
• Achievement Standards were reviewed by
committee in August 2010. May be adopted
by the Board as early as October 2010. If
Not, then in December of 2010. Tests
administered in October, November and
December of 2010 will be scored against the
December 2010 achievement standards
(even if the new achievement standard is
higher than the achievement standard at the
time the test was administered)
TA Training
When are Achievement
Standards Revised?
The review and revision of achievement standards
follows Board approval of Academic Content
Standards. During the interim,
• Schools are provided an opportunity to implement
new curricula
• Students are provided opportunity to learn the new
content
• Assessments are re-designed to reflect the new
content expectations
• Test items are field tested at the appropriate grade
TA Training
Who is Involved in Achievement
Standards Setting?
• ODE establishes standard setting panels that
include educators, parents,
community/business representatives and
higher education officials.
• Panel members provide a consensus
recommendation on achievement standards
and edit the achievement level descriptors.
• ODE invites public input on the proposed
achievement standards prior to official
adoption by the State Board of Education.
TA Training
Required Testing Environment
• Trained test administrator
• Quiet environment void of distractions
• Only allowable resources made
available to students upon request
• Limited interaction with students
– Read student directions
– Administer accommodations
appropriately
– No coaching
TA Training
Do’s
Dos and Don’ts
•TAs must read the 2010-11 Test Administration Manual,
receive annual test administration and security training, and
sign an Assurance of Test Security form before administering
state tests.
•TAs may only provide students with allowable resources listed
by content area in the 2010-11 Test Administration Manual.
•TAs may only provide the restricted resource of printed test
items to students for whom the district has identified individual
student need.
•TAs may only provide the version of allowable resources
provided by ODE. These are posted online at
http://www.ode.state.or.us/search/page/?=2346
•TAs must read verbatim the student directions provided in the
2010-11 Test Administration Manual.*
TA Training
Dos and Don’ts (cont)
Don’ts
•TAs may not allow untrained aides,
volunteers, or substitutes to assist with test
administration.
•TAs may not coach students (including
requiring students to show their work).
•Students may not access non-allowable
resources such as textbooks, class notes, or
cell phones during testing.
•Students may not talk to or help other
students during testing.
Test Security
Secure Testing Environment
•A quiet environment, void of distractions
and supervised by a trained test administrator
•Visual barriers or adequate spacing between
students
•Student access to only allowable resources
•All paper test materials collected and
accounted for after each testing event
•Student data is treated as confidential
Test Security
Definition and Purpose
•Purpose: To protect the integrity and
confidentiality of secure test items, prompts, and
passages. The security of these materials is
necessary so that they can be used in later years
to measure trends in performance. In addition,
test security helps to ensure test results can be
used in accountability reporting.
•Definition: A test impropriety is any instance
where a test is not administered in a manner
consistent with the Test Administration Manual
or OAR 581-022-0610 Administration of State
Tests.
Test Security
Potential Consequences
• Test opportunities may be invalidated in cases
where test validity was compromised.
Students will not receive additional test
opportunities.
• If the district determines that the testing
impropriety qualifies as gross neglect of duty,
then the district must report it to TSPC within
30 days. Personnel may then be subject to
disciplinary action as determined by TSPC.
• Districts may also evaluate cases according to
their own Human Resource policies.
Dos and Don’ts
Test Security
Do’s
•TAs must ensure that students use the correct
SSID and take the correct test.
•TAs must securely shred test materials such as
printed test items or reading passages, scratch
paper, or other paper hand-outs written on by
students after each testing event.
•Test materials must be securely stored at all times.
•Test improprieties must be reported to ODE
within 1 day of learning of them and the
investigation must be completed within 30 days.
•If a DTC cannot investigate an impropriety, the
district must assign someone else to the task.
Test Security
Dos and Don’ts (cont)
Don’ts
•TAs must not review or analyze secure test
items
•Students must not access non-allowable
resources such as cell phones, iPods, or e-mail
•Students must not remove test materials from
the test environment
•TAs must not copy or retain any test materials,
including secure test booklets, writing prompts,
or reading passages
•DTCs, STCs, and TAs must not share their
OAKS log-in information with anyone (even
other authorized OAKS users)
Test Security
Promising Practices
•Using colorful materials to identify which students
have printed reading passages remaining at their
stations.
•When setting up the test environment, the TA
should ensure that the TA’s computer is set to print
in the computer lab where the students are testing.
•The TA uses the class roster to mark which
students received printed test items, reading
passages, and how many each student received. The
TA then matches the class roster to the printed
items, reading passages collected at the end of the
testing event to account for all printed items, and
reading passages.
Writing
Definition
The writing assessment is a
performance assessment where
students produce an essay over a 23 day period. It is considered an
“authentic” assessment in that
students follow a writing process,
including prewriting, drafting, editing
and publishing, much as they would
for a typical classroom assignment.
Writing
Purpose
•The purpose of the writing assessment is to
measure student proficiency on adopted state
standards in the area of writing. Through
analytic trait scoring, strengths and
weaknesses may be identified to inform
classroom instruction.
•Participation, not performance in the writing
assessment is included in the Report Card
ratings.
Test Schedule
Writing
•Winter window (Jan. 12 – Feb. 24) for
grades 4, 7, and high school
•Spring window (April 13 – April 28)
for high school only
•Online window for participating
schools (Jan. 12 – March 17) for grade
7 and high school
•Online Spring window (March 28 –
April 28) for high school only
Scoring
Writing
• High School Level
• Paper assessments will be scored
same as last year
• High School paper and online
assessments will be double scored
Writing
Dos and Don’ts
Do’s
•Testing Coordinators may test students in
grade 9 or 10 if individual students have
produced work that shows they are capable of
meeting the HS writing standard.
•High School students may test once during
one of the two regular windows, regardless of
grade.
•Students in Grade 11 (or their third year in
high school) must test once during one of the
two regular windows unless they met in a
previous year.
Writing
Dos and Don’ts (cont)
Do’s (cont)
• Students in Grade 12 may test once
and need to test during the winter
window to receive results prior to
graduation
Writing
Dos and Don’ts (cont)
Don’ts
•Students who are not yet ready to
successfully complete the high school writing
assessment should not participate; it is not
intended as a “practice” opportunity in
anticipation of the eleventh grade attempt.
•Do not provide resources unless they are
explicitly described in the test administration
manual.
Writing
Promising Practices
•Local scoring of classroom assessments using
the official scoring guide, to provide feedback
in some or all of the writing traits to prepare
students for the writing assessment.
•Districts require that students in grades other
than 11th meet the standard on a work sample
before taking the state writing assessment.
•Districts create a system where teachers trade
papers for double scoring, thus ensuring
reliability.