Transcript Proctors` Training 2010 (PowerPoint)

ADMINISTERING THE NEW 2010 STATE ASSESSMENTS
Critical Information for Principals,
Test Proctors and Monitors
Pat Cummings, Director, Research & Evaluation —
Tacoma Public Schools
[email protected]
253-571-1280
Terry Easley, Student Assessment Coordinator —
Tacoma Public Schools
[email protected]
253-571-1193
Thea Turnley, Testing Secretary —
Tacoma Public Schools
[email protected]
253-571-1190
2
INTENT
Effectively implement the state assessment program
To ensure the best opportunity for students to accurately show what they
know and are able to do.
3
CODE OF CONDUCT
It is your responsibility to ensure that standard procedures are
followed.
Ensure understanding of test protocol.
Ensure accuracy of student demographics.
Watch for irregularities during testing.
Document any unusual or inappropriate behaviors
during testing.
Follow the Code of Professional Conduct.
4
CODE OF CONDUCT (…
CONTINUED)
WAC 181-87-060 Disregard or abandonment of generally
recognized professional standards.
Any performance of professional practice in flagrant disregard or
clear abandonment of generally recognized professional
standards in the course of any of the following professional
practices is an act of unprofessional conduct:
(1) Assessment, treatment, instruction or supervision of students
5
TEST PREP
Educators must ensure that test preparation activities and materials
provided to students will not adversely affect the validity of test score
inferences and maintain the integrity of test results by eliminating
practices designed to raise test scores without improving students’ real
knowledge, skills or abilities in the areas tested.
Review the Washington Educational Research Association (WERA)
publication: Ethical Standards in Testing
http://www.wera-web.org/pages/publications.php
6
RESPONSIBILITIES OF TEST PROCTORS
(THOSE WHO READ THE DIRECTIONS TO THE STUDENTS)









Attend required training.
Read all training materials for each test they administer.
Provide a positive test-taking climate.
Administer tests to all eligible students.
Ensure that test documents are given to the student
identified in the coding on the document.
Administer tests according to the Directions for
Administration.
Maintain confidentiality of test items, passages,
performance tasks and individual student results.
Document and report any testing irregularities to the
School Assessment Coordinator and principal.
Sign Test Security Assurance Form as required by OSPI.
7
TEST SECURITY
State laws RCW 42.56.250 and 28A.635.040 limit access to tests
and supportive materials and define penalties for disclosure
of test items. They are designed to protect the integrity of the
test.
State laws RCW 28A.635.040 and WAC 180-87-060 provide
penalties for the unauthorized use or disclosure of test
content and flagrant disregard of generally recognized
professional standards in test preparation and
administration. Unprofessional conduct must be reported to
the Office of Professional Practices at OSPI.
8
TEST SECURITY (…
CONTINUED)
Staff are not permitted to read, inspect, discuss or transmit secure test
items, passages or performance tasks before, during or after the
assessment has been administered. Public school employees must not
read, review or scrutinize test items, passages or performance tasks,
unless directed to do so by OSPI.
(Note: Under very limited circumstances the appropriate testing practice
for some students with IEPs, Section 504 Plans or in ELL programs may
require staff reading or reviewing items, passages or tasks.)
The annual release of test items from past state administrations may be
found at http://www.k12.wa.us/Assessment/WASL/testquestions.aspx.
These released items may be freely shared with teachers, students and
parents.
All test booklets must be kept in a secure location when not in use.
9
TEST SECURITY (…
CONTINUED)
All testing irregularities must be documented. The front cover of the test
booklet contains a space for the test proctor to document any deviation
from testing procedures.
All Test Proctors, School Assessment Coordinators and Principals are
required to sign security reports.
The District Assessment Coordinator and Superintendent are required to
return a signed security report to OSPI.
10
UPDATES FOR 2010
NEW
• WASL has been replaced with: Measurements of Student Progress (MSP) for grades 3 – 8, High School
Proficiency Exams (HSPE) for High School
• MSP Reading, Math and Science assessments consist of one session. Work must be completed in one day
according to your district approved testing schedule.
• MSP Writing (gr 4 & 7) consists of two sessions (both in one test booklet). Work for each session must
be completed in one day according to your district approved testing schedule.
• HSPE Reading, Math and Science assessments consist of one session to be administered according to
the mandatory testing schedule.
• HSPE Writing consists of two sessions. Day One test booklet will be green, Day Two test booklet will be
purple. Each session must be administered according to the mandatory testing schedule.
• No testing of 9th graders.
• Testing for MSP has moved to May (paper/pencil testing May 12 – 28; online testing May 3 – June 4)
• Tacoma Middle Schools are registered to participate in online testing for Reading & Math. OSPI will
review participation decisions and notify districts in January.
• Developmentally Appropriate Proficiency Exams (DAPE) have replaced the WAAS-DAW. Testing is still
available for 11th and 12th graders in reading and math by grade-band (ES or MS). Writing will still be
available at grade levels 4 and 7.
• Direction manuals for grades 3 – 8 will be in grade bands 3-5 and 6-8.
• Math Formula Sheets will be included inside the front cover of the 6-8 and High School test booklets.
• NO CALCULATORS allowed for gr 3 – 6 MSP Math.
• Calculators are allowed for grades 7 & 8 MSP Math and grades 5 & 8 MSP Science. Calculators are also
allowed for grades 10 – 12 HSPE, ES & MS WAAS DAPE Math and grades 10 – 12 HSPE Science.
• Braille and large print materials are returned to CAB with your MSP/HSPE/WAAS-DAPE materials. DO
NOT return materials to the Instructional Resource Center (IRC). Research & Evaluation will return all
materials to the appropriate vendor.
• Two new categories of students are now eligible for Direct Access to CAA Options: 11th & 12th grade
transfers into Washington public schools from in-state home or private school, and Non-Native English
Proficient (NNEP) students in the 11th & 12th grades who were exempt from the 10th grade WASL/HSPE
due to first year transfer into a Washington school.
• Online Proctor Questionnaires will be available during each test administration.
• Early return of High School Grade 12 results will be available no later than the day after Memorial Day.
• As in previous years, new Non-English Proficient (NNEP) students are not required to take the Reading
and Writing assessments. However as of 2009, the Elementary and Secondary Education Act
(ESEA) requires them to take the Math and Science assessments.
11
12
BEFORE TESTING
It is inappropriate to try to find ‘a right technique’ that would give
advantage to any student(s). The goal is to have scores accurately reflect
what our students know and can do.
Remove or cover any materials that may help students answer items that
are on the test.
The following are allowed to remain:
- alphabet line (with pictures and/or Open Court are OK)
- number line (cannot include fractions, decimals or multiplication
chart)
- verbatim copy of the “Writing Checklist” as it appears in Directions
for Administration (Note: these checklists are also in the student test
booklet)
13
BEFORE TESTING (
CONTINUED)
The following must be removed or covered:
Six Trait Posters
Strategies for Reading, Writing, Math, Science
Guides or lists showing paragraph structure or transition words
Posters showing math/reading/science vocabulary lists
Posters showing math problem-solving steps
Posters showing science investigation attributes
Math 300 chart must be covered
Multiplication charts or tables
14
GO…
MSP
&
HSPE!
Answer Every
Question!
15
TEST ADMINISTRATION
Cell phones (staff and students) or other hand-held electronic devices must be turned off during
all testing sessions.
Backpacks, purses, cell phones and other hand-held devices must be out of view and out of
reach of students during testing.
16
DURING TESTING
Create a positive testing environment.
The TESTING sign provided must be posted at the door of
each testing site to prevent interruptions.
17
TEST PREPARATION ETHICS
It is ethical to review skills, strategies and concepts previously taught.
It is ethical to teach and/or review test-taking skills that address test-item
characteristics.
It is ethical to provide students with instructional reviews using released
items. Such test preparation activities should be viewed as being a
continual process, not something that is only done immediately prior to
testing.
18
TEST ADMINISTRATION
• The test must be administered by a trained staff member of a school district.
• Student teachers, interns and paras may be test proctors and/or roaming
monitors providing they have received the training for test administration.
(Student teachers, interns and paras have a contractual relationship with the
district.)
• Approximate ratio for a standard classroom should be 1:30-35. Testing
group of 200 would require 6 or 7 staff members.
• MBWA: Monitor by walking around
• Proctors and monitors should be instructed to watch for the following:
 be sure students are working in the correct section;
 be sure they are writing in their booklets (not on loose pages);
 be sure they are generally following the directions given at the
beginning of the session.
• Monitors should notify the test proctor of any irregularities. All testing
irregularities must be documented. The front of the test book contains a
space for the test proctor to document any deviation from testing
procedures. A note should be placed in the cumulative file of any
student involved in the irregularity.
19
TEST ADMINISTRATION (
CONTINUED)
Read directions exactly as written, no paraphrasing.
• You may highlight or mark in your Directions for Administration
to facilitate their use.
• Note: Test Proctors must refer to a student test booklet when
reading the writing prompts to students on the days of
testing because they are not included in the Directions for
Administration.
Always have an adult in the room when students are testing.
20
TEST ADMINISTRATION (
CONTINUED)
If students ask questions, it is ethical for Test Proctor to:
• Advise the group to:
• Read the question quietly aloud to yourself.
• Think about what the question is asking you to do.
• Even if you’re unsure, take a good guess. You might know more
than you think you do.
• Use your pencil to underline key words in the test question.
21
TEST ADMINISTRATION (
CONTINUED)
It is unethical to:
• You may not paraphrase questions or read the items to students.
• You may not give specific feedback to individual students about
completing specific questions.
• You may not make comments about quality or quantity of student
work.
• You may not suggest or “coach” students to mark or change their
answers in any way.
• You may not point out an incorrectly answered question, questions
that have not been completed or read and comment on student essays.
22
TEST ADMINISTRATION (
CONTINUED)
Breaks should last no longer than 10–15 minutes and should not
extend over lunch or recess.
• All Schools: Students taking breaks must be reminded that they
should not discuss the tests with one another.
• All Schools: Students should not miss their scheduled lunch. Students
may continue to work on tests following a supervised lunch break. (If
necessary, lunch can be brought to the students who need additional
time.)
• Elementary Schools:
• The regular recess schedule should not be followed during
testing. It may be beneficial to suspend the ringing of the bells.
• For Grade 4 Writing: It may be appropriate for all students to
complete the transcription and final editing of their writing tasks
after a supervised lunch break.
23
TEST ADMINISTRATION (
CONTINUED)
Test Irregularities: Examples (but not limited to):
• Reproduction of test booklets or secure supporting testing materials.
• Improper test preparation.
• Improper test proctoring including:
• Coaching and/or departing from prescribed script in Directions
for Administration (DFA).
• Not following the State or Building Test Schedule.
• Providing accommodations (group or individual) not permitted in
Directions for Administration (DFA).
• Allowing breaks during testing outside the parameters listed in
DFA.
• Providing student access to tools or materials not allowed for that
test.
• Unforeseen interruption in test administration.
24
TEST ADMINISTRATION (
CONTINUED)
If a testing irregularity occurs (suspected cheating, test
administration error, etc.) DO NOT Stop the Testing Session!
Test Proctor should make note of the irregularity on the students book
and report the incident to the building Test Coordinator and principal
who will report to the District Assessment office.
25
AFTER TESTING
Invalidation decision will be made by OSPI if the resulting scores are
judged not to accurately reflect what the tested student knows and is able
to do. Tests may be invalidated when a testing irregularity occurs. Some
irregularities that could lead to invalidation are:
• inappropriate test preparation or materials on walls
• cheating on a test is discovered
• the test was improperly administered.
Invalidated tests are treated as not having been tested. These students are
included in calculations of percentages of students not meeting
standard.
26
AFTER TESTING (
CONTINUED)
Shred all writing drafts, they are confidential and secure. (Also, test books
must not contain any loose papers.)
Count and accurately return all test materials.
Be sure signed Pre-ID Student Rosters are returned with your test
materials.
Be sure signed Staff and School Security Reports are returned with your
test materials.
27
PARTICIPATION
The statewide testing program focuses on assessing student progress in
meeting the content standards in the Essential Academic Learning
Requirements (EALRs) and Grade Level Expectations (GLEs) at grades 3,
4, 5, 6, 7, 8 and 10.
Participation in state testing, including Washington Alternate Assessment
System (WAAS), helps ensure that needs of all students will be considered
in policy and curriculum decisions
Students with an IEP have four assessment options:
• MSP/HSPE without accommodations;
• MSP/HSPE with accommodations;
• MSP/HSPE-Basic with or without accommodations. This allows a
student to pass the grade level test with a Level 2.
• WAAS Portfolio
28
PARTICIPATION (
CONTINUED)
Assure Wider Access, Not Advantage
• The goal is to assure every student has the opportunity to participate
in the assessment without providing a special advantage.
• Some test procedures may be altered for any student, based on a
review of the individual needs of the student. The alterations in the
procedures must not be used for the first time on state assessments.
• These procedures are available to any student who would benefit
and uses them during regular instruction.
• Refer to Accommodations Available for All Students in the
Directions for Administration for detailed information.
29
PARTICIPATION
(CONTINUED)
Accommodations for Special Populations
• Accommodations are practices and procedures in the areas of presentation,
response, setting and timing/scheduling that provide equitable access during
assessments for students with disabilities and limited access.
• Accommodations provided must align with accommodations provided for
the student in daily instruction and local assessments. No accommodation
should be used for the first time on a state assessment.
• Special populations in Washington state include:
• Students in special education programs
• Students with Section 504 Plans
• English as second language/bilingual students
• Be familiar with the following documents:
• Accommodations Guidelines for Students with Disabilities
(http://www.k12.wa.us/assessment/altassess.aspx)
• Assessment Accommodations Guidelines for English Language Learners 20092010 (http://www.k12.wa.us/assessment/WLPTII/default.aspx)
30
PARTICIPATION (
CONTINUED)
IEP and NNEP
• Make arrangements for those students whose IEP specifies they will take the
Washington Alternate Assessment System (WAAS) Portfolio.
• Make arrangements for any Bilingual students who are New Non-English
Proficient (NNEP) Students and are not participating in the state assessment.
• NNEP students are those who first enrolled in a U.S. public school within
the past 12 months. They are not required to take the Reading or Writing
assessments. (Lists of NNEP students will be provided by the Second
Language Office)
• ESEA/NCLB, however, requires them to take the Math and Science tests.
Test scores, including those in mathematics, are not counted in any way
(i.e., % Meeting Standard or AYP results). If they do not take math, they will
be counted in AYP as non-participants. Students who attempt at least two
items will be counted as participants in the Math test. ESEA requires 95%
participation. Be sure to have no more than 5% excluded from testing in
math. For further information contact AYP Specialist at OSPI (360)7256348.
• Your Test Coordinator should follow specific instructions provided by Research
& Evaluation for proper coding of test booklets.
31
PARTICIPATION (
CONTINUED)
Excused Absence
• Students who do not take the assessment due to a ‘valid excuse’ will
not be included in AYP or % Meeting Standard results. However, they
will be counted as non-participants for AYP. Keep in mind AYP requires
95% participation.
• A ‘valid excuse’ (OSPI term) is any ‘excused absence’ in Tacoma
School District. Buildings should treat absences on test days in
the same manner as any other day.
32
STILL NEED HELP? CALL 1193.
33