Transcript 2015 Campus Test Security, Confidentiality

Animated Frame
The citizens of Sheldon know that they are
about to be tested!!!!
There are villains around every
corner trying to cause chaos and
crime!!!
With a support staff surrounding our
hero….one person will ensure our citizens are
successful, follow the rules, and have
order………
TESTMAN
Testman (CTC)
•
•
•
•
•
•
•
Superpower = his mind
Crusades against endless crime
Logical demeanor
Strong moral code
Great detective
Uses network
Always watching and planning
Motto = Nothing is insurmountable
CTC Responsibilities
• Serving as a liaison between the DTC and campus
personnel for test-related communication
• Monitoring and maintaining test security
• Designating and training test administrators
• Preparing and distributing test materials on the campus
for each administration
• Preparing testing materials for return to the DTC at the
conclusion of test administrations
• Coordinating online administration activities on campus
Bruce Wayne
(Campus Principal)
•
•
•
•
•
•
Alter ego of Testman
Always watching
Always analyzing
Gathering data
Monitoring people
Wants order and rules
to be followed
Principal Responsibilities
•
•
•
•
•
•
Ensuring that test security is maintained
Overseeing the implementation of the test administration
process stated in this manual, the test administrator
manual, and the Test Security Supplement.
Establishing, in conjunction with the campus coordinator, the
test administration processes specific to the campus
Overseeing the training of campus personnel, in
cooperation with the campus coordinator
Reporting any suspected violation of test security to the
DTC
Be available and visible during testing
Secondary
Assistant/Academy Principals
• Monitor for active monitoring
• Be available and visible
• Assist with discipline issues (work with campus
coordinator…be careful not to create a
testing irregularity)
• Ensure students are in correct locations
Who helps Testman?
Alfred Pennyworth
(DTC)
•
•
•
•
•
•
Gives Guidance
Not afraid to get his hands dirty
Helps Testman stay organized
Keeps up with current trends
Quick wit
Puts things in perspective
Commissioner Giles
& Police Chief Bowman
• Has the direct line to the heart of Sheldon
• Authority over the Gotham Police Dept.
• Understands that Testman is necessary
–
–
–
–
–
–
Law-abiding
Dutiful
Conscientious
Driven
Dedicated
honest
The VILLAINS are
trying to disrupt our
great citizens of
Sheldon…
They want break rules, cause chaos,
and even organize crime…
Testman is going to need a
sidekick……
Robin
(Test Administrators)
•
•
•
•
Another person for Testman to rely on
Helps Testman fight crime
Trained by Testman
Can still make mistakes
Test Administrator Responsibilities
•
•
•
•
•
•
Maintaining security of test materials until returned to the
coordinator
Preparing and distributing test materials in the classroom
for each administration
Implementing the test administration processes and
procedures stated in the manuals
Monitoring and maintaining test security
Reporting any suspected violation of test security to the
campus coordinator
Preparing test materials for return to the campus
coordinator at the conclusion of test administrations
Sheldon Police
(Monitors)
Campus Monitors will be there to ensure that the
citizens of Sheldon are testing in a secure
environment. There presence will keep the villains
away.
Hall monitors will be there to monitor the halls for any
citizen that might be up to no good OR any visitors to
our city that should not be there.
Monitor Responsibilities
• Maintain secure environment
• Notify campus coordinator or
principal of concerns
• Monitor for active monitoring
• Check for seating charts
The Manual
When you are in need of
assistance looked in your manual!
Always call for help if you
can’t find the answer in the
manual…..
The Writers (Law Makers) determine
the story for our characters.
The Artist (TEA) take the story and give
it life so we can better understand the
writers’ intention.
Let’s see what the
story takes us……
Training Requirements
All district and campus personnel who participate in statemandated testing or handle secure test materials must meet
eligibility requirements, be trained, and sign an oath.
Testing personnel are required to receive annual training in test
security and administration procedures and are responsible for
complying with state assessment requirements.
Optional Web-based Test Administrator Training Modules are
available: Active Monitoring; Distribution of Test Materials;
and Proper Handling of Secure Materials
Animated Frame
Procedures for maintaining the security and
confidentiality of assessments are specified in the
following guides:
– Test Security Supplement
– District and Campus Coordinator Manual
– Test administrator manuals (STAAR ALT 2, TELPAS)
Conduct that departs from the test administration procedures
as established in these resources is considered a testing
irregularity.
The superintendent and campus principal of each school
district must develop procedures to ensure the security
and confidentiality state assessments.
These administrators will be responsible for
notifying TEA in writing of conduct that violates
security or confidentiality of a state assessment.
Failure to report can subject the person
responsible to the applicable penalties.
Principals and campus testing coordinators are
responsible for security and confidentiality of test
materials on their campus.
Test Security and Confidentiality
Requirements
It’s the Law!
All assessments as defined under TEC 39.023 and 39.027 are
considered secure, and the contents of these tests, including
student information used or obtained in their administration, are
confidential. As specified in the Test Security Supplement in 19
TAC Chapter 101, each person participating in the student
assessment program is required to maintain and preserve the
security and confidentiality of all test material and student
data, and must also handle this information in strict accordance
with the instructions contained in the DCCM, the Test Security
Supplement, and in the test administrator manuals.
19 TAC §101.3031
It’s the Law!
(b) Test administration procedures. Test administration
materials shall include, but are not limited to, the following:
(1) general testing program information;
(2) requirements for ensuring test security and confidentiality
described in the 2014 Test Security Supplement provided in
this subsection; Figure: 19 TAC §101.3031(b)(2)
(3) procedures for test administration;
(4) responsibilities of personnel involved in test administration;
and
(5) procedures for materials control.
TEST SECURITY
•
•
•
•
Accounting for all secure materials and confidential
student information before, during, and after each
administration
Ensure that only individuals permitted to have access to
these materials and information are district personnel who
meet the requirements, have been trained, and have
signed the appropriate oath.
Implement controls to ensure the proper storage and
accurate tracking of secure materials through each state
of the administration
Documents used to account for materials should be
completed accurately and carefully maintained in a
location that would prevent them from being compromised
Confidentiality Requirements
Maintaining the confidentiality of the
assessment program involves protecting
the contents of all secure test materials,
including test booklets, online
assessments, student authorizations,
completed answer documents, and
TELPAS holistically rated components
Confidentiality
•
•
•
•
All testing personnel must undergo training and must sign the
appropriate oath affirming that they understand their
obligations concerning security and confidentiality of the state
assessments BEFORE handling secure materials or
administering assessments
All tests must be administered in strict accordance with the
instructions contained in the test administration materials
No person may view, reveal, or discuss the contents of a test
booklet or online assessment before, during, or AFTER a test
administration unless specifically authorized to do so…
No person may duplicate, print, record, write notes about, or
capture any portion of a secure assessment instrument
(including compositions)
Confidentiality
•
•
•
Only students may respond to test questions, perform
calculations, and create rough drafts to written responses
TA who have permission to view secure materials in order to
provide an approved accommodation must be reminded that
they are viewing secure content, and that responding to test
questions, recording the information they see, scoring the test,
or discussing the contents of the test at any time is strictly
prohibited. As a reminder, these individuals must sign an
additional section of the oath (STAAR ALT 2 TA require more
interaction with materials that typically permitted).
NO person may review or discuss student responses or solicit
information from students about test questions before, during,
or AFTER a test administration.
Penalties for Violation of Security and
Confidentiality of Assessments
It’s the Law!
Violation of security or confidentiality of any test required by
the Texas Education Code (TEC) Chapter 39, Subchapter B, is
prohibited.
A person who engages in conduct prohibited by the Test
Security Supplement and in other test administration
materials may be subject to a sanction of credentials. This
includes any person who violates, assists in the violation
of, or solicits another to participate in the violation of test
security or confidentiality. Additionally, this includes any
person who fails to report such a violation.
Penalties for Violation of Security and
Confidentiality of Assessments
A person who engages in conduct prohibited by the Test
Security Supplement and in other test administration
materials may be subject to the following penalties:
– placement of restrictions on the issuance, renewal, or
holding of a Texas teacher certificate;
– issuance of an inscribed or non-inscribed reprimand;
– suspension of a Texas teacher certificate for a set
term; or
– revocation or cancellation of a Texas teacher
certificate.
Penalties for Violation of Security and
Confidentiality of Assessments
Release or disclosure of confidential test content
is a Class C misdemeanor and could result in
criminal prosecution under TEC §39.0303,
Section 552.352 of the Texas Government Code,
and section 37.10 of the Texas Penal Code.
In addition, any irregularities in test security or confidentiality
may result in the invalidation of student results.
Testing Irregularities
Serious Irregularities
 constitute severe violations of test security or
confidentiality
 must be investigated by the district coordinator
immediately
 require a district to call or email TEA immediately to
inform test security of the incident
 can result in the individual(s) responsible being
referred to the TEA Educator Certification and
Standards Division for consideration of disciplinary
action
Testing Irregularities
Serious Irregularities
- Directly or indirectly assisting students with responses to test
questions;
- Tampering with student responses
- Falsifying TELPAS holistic ratings or STAAR Alternate 2
student responses
- Viewing a test before, during, or after an assessment unless
specifically authorized to do so;
- Discussing secure test content, student responses, or student
performance
- Scoring tests, either formally or informally
Testing Irregularities
Serious Irregularities
- Duplicating, recording, or electronically capturing confidential
test content without permission from TEA
- Fraudulently exempting or preventing a student from the
administration of a required state assessment; or
- Failing to complete TELPAS online calibration or practice
activities in the online training course independently.
- Encouraging or assisting an individual to engage in the
conduct described above.
- Failing to report to an appropriate authority that an individual
engaged in any of the events listed above;
How to AVOID Serious Violations
•
•
•
•
Ensure that TA understand how to address students who might
request assistance or drift off task during an assessment.
Stress that test content should not be viewed or discussed even
AFTER the test administration has been completed. This
applies to discussion regarding the specific contents of the
test.
Discuss with TA the proper way in which students should be
prompted to bubble in answer documents. Remind ALL campus
personnel that erasing stray marks or darkening responses is
strictly prohibited.
Verify that all formula charts, graph paper, or scratch paper
that are used or written upon are destroyed immediately
after test sessions.
The test administrator notices that a
student did not transfer a few of his
answers from his test booklet to his
answer document, so the test
administrator did it for him.
SERIOUS
In an attempt to better prepare her students for the
English II EOC next year, the test administrator
wrote down the writing prompts and short answer
questions she saw on the test. She thought she
might be able to use them in class.
Several test administrators were in the teacher’s lounge
the day after the English I EOC. They were discussing
the writing prompts they saw the day before and what
they saw several students write.
The test administrator sees a student struggling
with a question. The test administrator walks over
to the student’s desk and gives her a test strategy
that might help her answer the question.
SERIOUS
The test administrator was curious as
to how the students in his testing room
were doing on the test. So while he
was walking around the room, he was
looking to see how the all of students
answered #21 on the Biology EOC.
While collecting students’ test booklets as they finished
their test, the test administrator decided to take a picture
using his cell phone of a particular question on the US
History EOC. He knew this question would make an
excellent discussion point during class the next week.
After Test Administrations
•
•
•
•
•
•
•
•
•
•
Ensure the return of materials is verified and noted on Materials Control form
Account for every answer document AND every test booklet
Verify that the correct score code, test taken information, and
accommodations have been marked on each answer document and that all
hand gridding and transcribing have been properly completed.
NO ONE SHOULD ERASE STRAY MARKS OR DARKED ANSWER CHOICES
Confirm that each examinee has recorded responses on his/her answer
document
Contact DTC if a blank answer document is discovered
Confirm that all seating charts are accurately completed and contain the
required information (TA, test session start and stop time)
Follow procedures for returning materials to DTC
ALWAYS Check storage area for any left items or stray items
Maintain all inventory records
Testing Irregularities
Procedural Irregularities
 reflect minor errors or deviations in testing
procedures
 do not represent severe breaches in security or
confidentiality
 do not require a call to TEA unless guidance is
needed by the district
 do not require supporting documentation
Procedural Violations
•
Eligibility Errors
– Eligible students not tested
– Ineligible students tested
•
IEP Issues
– Student was provided an unapproved or undocumented
accommodation or was not provided a prescribed accommodation
– Administered the wrong test
•
Improper Accounting for Secure Materials
– Secure materials were not returned, checked in, and accounted for at
the end of each testing day
– Answer document(s), test booklet(s), or other secure materials were
lost or misplaced
Procedural Violations
Monitoring Error
• TA did not verify that a student recorded his or her responses and
accepted a blank answer document.
• TA left a room unattended when students or secure materials were
present or when secure online tests were open and visible.
• Secure materials were left unattended, or secure tests were left open
and visible, during a lunch break, short break, or restroom break.
• Testing personnel did not monitor students during a lunch break.
• TA did not ensure that students worked independently during testing.
• Students were not prevented from using cell phones or other
electronic devices to take pictures, share posts, or send messages.
• Student was allowed to remove secure materials from the testing
area.
Procedural Violations
Other Procedural Errors
• TA failed to issue the correct materials or students were provided
nonallowable materials
• Testing personnel who were not properly trained were allowed to
administer tests or handle secure materials.
• A student was permitted to test beyond the allowed time limit OR was
not provided the full time allotment to complete a STAAR assessment.
• A TA failed to use the test administration materials or failed to read
aloud the bolded, scripted test administration directions verbatim as
outlined in the TA materials.
• A student was provided an unallowable accommodation.
• A TELPAS writing collection was not submitted in accordance with
required assembly criteria.
How to avoid Procedural
Irregularities
• Open your Test Security Supplement to page 20
• Review the sections on how to avoid and how to
address on pages 20-24
During a restroom break, student A and student
B begin talking. The restroom monitors sitting a
few feet away did not stop the conversation.
A test administrator, anxious to get all of
his testing materials turned in, forgot to
check Sue Bob’s answer document when
he collected it. The Testing Coordinator
discovered that the answer document was
turned in blank.
A test administrator failed to
provide the students in her
small group their approved
accommodations.
A test administrator allowed students
who were finished testing to walk
around the room during an active test
administration.
PROCEDURAL
A test administrator asked
one of her bright students
to help her organize her
testing materials after
everyone was finished. The
student alphabetized the
answer documents and put
the test booklets in
numerical order.
A test administrator was running late the morning of the Algebra I EOC. He
arrived at 7:10 to collect his test materials from the Testing Office. Because he
was running late and students were waiting on him, he did not clear the
calculators before and after the test administration.
It was 10:30 and a test administrator
needed to take a break; however, he
could not get the attention of a
reliever. He stepped into the hallway
to try and flag someone down. While
in the hallway, he could not see his
students testing.
PROCEDURAL
A test administrator failed to
record the start and stop
times on his seating chart
and did not write down the
students’ test booklet
numbers.
A test administrator came to school
early the morning of her test
administration, collected her
materials, and headed to her
testing room. While getting her
room ready, an announcement was
made that donuts and coffee were
being served in the teacher’s
lounge. Hungry, she headed to the
teacher’s lounge... leaving her
testing materials unattended.
A test administrator returned students’ cell
phones as they finished testing. One student
took a picture of another student’s test
booklet during this time.
Tips to Avoid the Most Common Testing Irregularities
– Ensure that test administrators have accurate testing rosters
that include updated information about accommodations
– Create accurate seating charts
– Announce the time left to test in one hour intervals
– Verify that students have recorded their responses on the
answer document or in the online form
– Ensure that principals, campus coordinators, and other staff
are available to support test administrators and to monitor
testing
– Account for all test materials immediately upon materials
check-in
Student Cheating
• If a district determines that a student is involved in a
cheating incident, either by providing or receiving
assistance, the district is required to invalidate the
student’s test.
• The district should contact TEA immediately if a student
electronically captures (e.g., cell phone picture) any
portion of a test or an answer document.
• Any disciplinary actions taken locally against a student
for cheating must be reported to TEA using the Locally
Determined Disciplinary Action (LDDA) online form
Active Monitoring
•
Giving the right answer document and test booklet to the right
student
•
Moving around the room to ensure that each student is working
independently.
•
Also applies to monitoring during breaks (lunch, restroom, nurse,
relocation, etc.)
•
Being aware of students that may be attempting to cheat
–
Contact the Campus Test Coordinator if you suspect cheating or
cheating has occurred.
Active Monitoring
•
Checking each answer document as students finish to ensure that
the student has marked his/her answers on the answer document.
(Do not accept blank answer documents)
•
Remind students of the time left to test in one-hour intervals.
•
Making sure students do not have access to materials that are not
allowed on an exam.
•
Making sure students have access to those materials that are
allowed on the exam (Calculators, dictionary, accommodations, etc.)
Ensure Proper Testing Procedures
Actively monitor
–
–
–
–
–
Moving around the room
Be able to have access to all students
When sitting—sit at a level higher than students if
possible, sit where you are able to see all students
Ensure that students are working independently
Ensure that students are working in the correct part
of the answer document and test booklet
Ensure Proper Testing Procedures
Actively monitor
–
–
–
–
Ask for clarification or help if needed from the
testing coordinator
Students must remain seated (Do not allow them to
bring you materials)
Students are not talking to each other during testing
STAAR: you are reminding students during the
allowed time intervals
Non-monitoring related activities
• Reading
• Grading papers
• Checking email
• Texting
Proper Handling of Materials
1.
2.
3.
4.
5.
Accurately completing documents to account for secure materials
(material control form)
Completing seating charts for all test sessions
Placing test booklets and answer documents in limited-access
(testing coordinator access) locked storage when not in use
Collecting and destroying immediately after each test
administration any charts or reference materials students have
written on and any scratch* or graph paper* used during an
assessment
Ensuring when testing has concluded that all secure materials
have been accounted for and returned to the campus coordinator.
Test administrators
• You need to collect the materials and turn them in—CTC will
destroy the used materials
Start and Stop
Times (inc.
Lunch/Nurse/
Relocation)
Seating
assignments
(front and
back)
Seating
Chart
Names of ALL
students
(absent and
late students
documented)
Requirements
Will be
kept for 5
years
Times and
names of
relievers
in the
room
55
2015 STAAR Manuals
• Scripts cover multiple
subjects and programs
• To accommodate some
differences in programs,
the manual will uses
callout boxes
• You will need to know
what subjects your are
testing each day and if
you are testing any
special groups (STAAR A
or STAAR L)
56
2015 STAAR Manuals Activity
Using the scripts on your table and your
elbow partner, determine which callout
boxes you would read if you are going to
administer:
Insert subject and accommodation…
57
These are allowed for any student but should NOT be given to every
student unless requested. You are not allowed to have them on every
desk… “Would anyone like a highlighter?”
Scratch
paper
Test
directions
translated
Gentle
reminders
to stay on
task
Colored
overlays
Place
markers
Highlighters
ALLOWABLE
PROCEDURES
& MATERIALS
Individual or
Small Group
Administration
Directions
TIME
Monitoring
• Read them word for word
• Honor statement is required to be read;
students are not required to sign it
• Begins after you say, “You may now begin.”
• Start timer on computer
• Document start time on board and seating
chart
• Move around the room
• Do not sit where you can not see every
student
• Do not sit for long periods of time
STAAR: Time Limit Policies
and Procedures
•
•
Breaks INCLUDED in the
4 (or 5) hour time limit •
•
Water
Bathroom
Snack
Short physical or mental break
Breaks NOT INCLUDED
in the 4 (or 5) hour time
limit
* Start and stop time
must be documented on
seating chart
Lunch
Emergency situations
Medical breaks (medicine)
Moving to overflow
•
•
•
•
STAAR: Time Limit Policies
and Procedures
Reminders
• You may periodically
remind students to
mark answers on their
answer document.
• It is a good idea to
remind them about
marking answers after
reminding them about
time left.
Reminders of
TIME
• 3 hours remaining
• 2 hours remaining
• 1 hour remaining
• 30 minutes remaining
• 15 minutes remaining
• 5 minutes remaining
• 1 minute remaining
Time is UP
• Say, “Time is up, put
your pencil down.”
• Students MAY NOT
record answers after
time is up
• Collect materials
immediately
• Record the stop time
on the seating chart
PRIOR TO DAY OF TESTING
Come to Testing Office and fill
out your seating chart.
Morning of Testing
Keep the materials
SECURE and with you at
all times
Have your Test
Administrator Manual
REPORT to the testing room
Time:
COUNT answer
documents and test
booklets
SIGN OFF on the
Materials control
form—make sure
numbers match
Be FAMILAR with the
day’s test (directions,
materials needed, etc.)
Everything on walls are covered
LCD Projector is ON
(done by room’s owner)
Phone is off the hook
Nothing is under the desk
(done by room’s owner)
Computer is ON
Computer Screensaver is disabled
All other programs are closed on computer
Countdown link is ready and set to 4 HOURS
http://www.online-stopwatch.com/large-stopwatch/
Board is erased or covered
(done by room’s owner)
Write START TIME and
STOP TIME on the board
TEST READY ROOM
Students arrival
Only allow entrance to those on your roster
Belongings (including food and drinks) in the
front of the room
Electronics & Attendance
Every student MUST sign off on the
electronics log
Collect each electronic device/ put a sticky
note with student’s name on each device
Ready to begin
Send materials to late arrival
Post seating chart and “Testing Do not
Disturb” sign on the door
Room needs to be quiet and ready
before you pass out materials….
set the tone.
Pass out allowed materials for all students
(Dictionary, Calculators, charts, etc)
IF possible, have these already on the desks
Pass out answer document
Tell students: NO BUBBLING on the answer
document.
Tell students: Check name and birthday (Contact
Holt if wrong)
Pass out test booklets
(each student’s name will be on the
back)
Student is finished
• Go to the student’s desk to collect materials
• Scan the answer document to make sure the multiple choice
sections, compositions and short answer sections are complete
• Collect materials (scratch paper
/charts/dictionaries/calculators/pencils, etc.)
• Mark the score code (S) and bubble in the date (STAAR)
• Student may read a book or put head down on desk
Blank Answer Document
• If there is still time, you will say, “You have not recorded your
answers on the answer document. Please go back and mark
your answers on it now.”
• If the student refuses, do not collect and contact Holt
• If time is up, you will need to collect the answer document and
document that the student did not answer the questions before
the time was up.
Relievers in the Room
•
•
•
•
Only the Test administrator should collect testing
materials from a finished student.
Relievers should tell finished students to wait for the
test administrator to return.
If there is a situation in which a reliever MUST collect
the materials, then the reliever is to INITIAL next to the
student’s or students’ name(s) on the seating chart.
FOR DOCUMENTATION PURPOSE,S WE MUST KNOW
WHO COLLECTED EACH STUDENT’S ANSWER
DOCUMENT.
• Every role is important on testing days
• You will most likely give a STAAR EOC
test this calendar year
• LOOK for ANSWERS in your manual
• ASK QUESTIONS if you are not sure