2014 TELPAS Principal Training - Killeen Independent School District
Download
Report
Transcript 2014 TELPAS Principal Training - Killeen Independent School District
TELPAS Training for Principals
2014
Disclaimer
This presentation does not take the place
of reading the manuals
Campus test coordinators, raters,
verifiers, and reading test administrators
are responsible for reading the
appropriate manual(s) and complying
with all the instructions
Components of Today’s Training
Scope and Purpose of Training
General Testing Procedures
Test Security & Confidentiality
Overview of TELPAS
Principal’s Role
Online Reading Test
Final Documentation Submission
District and Campus Coordinator Manual
(DCCM, pg. T-13)
Principal’s Role in TELPAS
General Testing Procedures
Test security
Test security procedures and oaths
Active monitoring
Consequences of cheating
Scheduling test administrations
Testing window
Time limits
Breaks
Make-up testing
Preparing for test administrations
Identifying eligible students
Managing secure materials
Preparing for online administrations
General Testing Procedures
(Continued)
Testing with accommodations
Allowable test administration procedures and materials
Accommodations for students with disabilities
Linguistic accommodations
Ensuring students receive appropriate
accommodations
Monitoring test administrations
Availability of test coordinator and principal
Completing the testing process
Documentation
Test Security And Confidentiality
Test Security
Must secure and account for all secure materials and
confidential student information before, during, and after
each test administration
Writing samples
Rating rosters
Student authorization letters
Paper-based tests (if applicable)
Access must be limited to personnel who meet the
requirements to participate in the testing, have been
trained, and have signed the appropriate oath
Holistic raters
Writing collection verifier(s)
Reading test administrator(s)
Rating entry assistant
Technology staff
Test Security and Confidentiality
Confidentiality
Before handling secure materials, testing personnel must be
trained and sign the appropriate oath
Personnel working in the AMS must read and accept a
statement of confidentiality
No person may view, reveal, or discuss the contents of an
online assessment before, during, or after a test
administration unless specifically authorized by TEA
If circumstances necessitate that an online assessment be
examined, permission must first be obtained from TEA
No person may duplicate, print, record, write notes about, or
capture by electronic means any portion of a secure
assessment without prior approval from TEA
No individual other than the student may respond to test
items
No person may review or discuss student responses or
performance data during or after a test administration unless
specifically authorized to do so by the procedures outlined in
the test administration materials
Test Security and Confidentiality
Two categories of irregularities:
Serious
Procedural
Serious irregularities constitute severe violations of test
security and/or confidentiality and can result in the
individual(s) responsible being referred to the TEA Educator
Standards and Certification Legal Division for consideration
of disciplinary action including:
Placement of restrictions on the issuance, renewal or
holding of a Texas educator certificate, either
indefinitely or for a set term
Issuance of an inscribed or non-inscribed reprimand
Suspension of a Texas educator certificate for a set
term
Revocation or cancellation of a Texas educator
certificate without opportunity for reapplication for a set
term or permanently
Test Security and Confidentiality
Testing Irregularities (Serious)
Directly or indirectly assisting students
with responses to reading test questions
or holistic writing samples
Tampering with student responses or writing samples
Falsifying TELPAS holistic ratings
Unauthorized viewing of secure test content
Discussing secure test content, student responses, or
student performance
Scoring student reading tests, either formally or
informally
Unauthorized duplicating, recording, or electronically
capturing secure test content (online reading test)
Teachers sharing answers to the online calibration
activities or practice rating activities (online training)
Test Security and Confidentiality
Testing Irregularities (Procedural)
Eligibility errors
Testing ineligible students
Failure to test eligible students in all appropriate
domains
IEP Implementation Errors
Failure to provide a prescribed accommodation
Providing an unauthorized accommodation
Improper accounting for secure materials
Lost or misplaced writing samples or other confidential
or secure materials
Rating rosters and writing samples must be
secured until the assessments are complete
Rosters should be given to CTCs to be stored
Writing samples remain confidential but
should be placed in the student’s permanent
folder after the assessment has been
recorded in the AMS
Test Security and Confidentiality
Testing Irregularities (Procedural)
Monitoring errors
CTC did not require raters to return confidential
materials
Test administrator left a room unattended when
students or secure materials were present or when
secure online tests were visible
Secure online tests were left open and visible during a
lunch break, short break in room, or restroom break
Testing personnel did not monitor students during a
break
Testing personnel did not ensure that students worked
independently during the online reading test
Students were not prevented from using cell phones or
other electronic devices to take pictures or send
messages
A student was allowed to remove secure materials
Test Security and Confidentiality
Testing Irregularities
Procedural errors
Test administrator failed to issue the correct
materials or non-allowed materials were
provided to students
Untrained or improperly trained personnel were
allowed to rate students or administer tests
Test administrator failed to use the test administrator
manual or failed to read the bolded test
administration instructions verbatim
Displays that might provide assistance were visible
TELPAS writing collection was not submitted in
accordance with the required assembly criteria
Test administrator failed to provide a student with the
correct student authorization to access the reading
test
Test Security and Confidentiality
Reporting Testing Irregularities
Contact Teresa Daugherty immediately upon discovery
Incidents involving disciplinary actions taken against
students for cheating
Contact Teresa Daugherty
Overview: What is TELPAS?
Texas
English
Language
Proficiency
Assessment
System
TELPAS is the assessment
tool that fulfills federal
requirements for assessing
the English language
proficiency of ELLs in grades
K-12
What Does TELPAS Measure?
TELPAS assesses the proficiency of students in
four domains and reports student performance in
terms of four English language proficiency levels:
Domains Assessed
Listening
Speaking
Reading
Writing
Proficiency Levels
Beginning
Intermediate
Advanced
Advanced High
Assessment Components
Grades K–1
Holistically rated observational assessments of
listening, speaking, reading, and writing
Grades 2–12
Holistically rated observational assessments of
listening and speaking
Holistically rated writing collections
Multiple-choice online reading tests in six grade
clusters: 2, 3, 4–5, 6–7, 8–9, 10–12
Students’ online reading test answers, holistically rated assessments,
and all other student data are submitted through the Assessment
Management System
TELPAS Student Rating Roster
Principal’s signature
verifies:
• Rater is a trained
and calibrated rater
• Additional rater
meets the
requirements
• Roster is
completed properly
• Ratings are
accurately
displayed
Rater Credentials
Rater must:
Have the student in class at the time of the spring
assessment window
Be knowledgeable about the student’s ability to use
English in both instructional and informal settings
Hold valid educational credentials
Be appropriately trained in the holistic process
Rate the student in all eligible domains
May include bilingual teachers, ESL teachers, general
education teachers, special education teachers, G/T
teachers, and teachers of enrichment subjects
Paraprofessionals may NOT serve as raters!!
Fall
ELPS-TELPAS
Professional
Development
Grades
K–12 Holistic
Rating Training
Flowchart
(For new teachers and new prospective raters -- recommended)
Spring TELPAS Administration
Procedures Training
Covers holistic rating training requirements
and procedures for conducting TELPAS
New Raters
Returning Raters
Online Basic Training
Course
Online
Calibration Activities
Sets 1 and 2:
Set 2 required if not successful
on Set 1
If not calibrated:
Supplemental Holistic
Rating Training
Final Online
Calibration Activity
Set 3
Online
Calibration Activities
Sets 1 and 2:
Set 2 required if not successful
on Set 1
Online Training Components
Online Basic Training Course
Required for:
All NEW raters
All raters who have not completed training
within the last three school years
Any rater who failed to calibrate on the 1st or
2nd attempt last year
Two basic courses
K-1: Covers all four language domains
(listening, speaking, reading, and writing)
2-12: Covers the listening, speaking, and
writing domains
Must be completed before attempting the online
calibration
Approximate time to complete: 4-5 hours
R
A
T
E
R
R
E
S
P
O
N
S
I
B
I
L
I
T
I
E
S
Online Training Components
Online Calibration
Required for ALL raters (new & returning)
Consists of 3 sets of (10) students to be rated
in all applicable domains
Approximate time to complete: 1 hour
R
A
T
E
R
R
E
S
P
O
N
S
I
B
I
L
I
T
I
E
S
Training Certificates & Professional
Development Credit
Training certificates are generated for raters who complete
training courses and calibration activities
*Certificate of completion issued when a rater
completes an online course
*Certificate of successful completion issued when a
rater demonstrates sufficient calibration (70 percent or
better) on a calibration set
Five hours are awarded for the K–1 and 2–12 basic training
courses
Two hours are awarded (in all) for calibration
* Raters must provide a copy to the CTC for documentation
Supplemental Support Providers
Purpose:
To provide a system of supplemental support to assist
raters who have not successfully calibrated by the end
of the second set
Each campus must assign at least one SSP
Requirements for SSP
Be a 2012-2013 fully trained rater in the applicable K-1
or 2-12 grade span
Complete the recorded web-based training
Calibrate successfully on either set 1 or set 2
End Dates for Holistic Rating Training
TEA recommends completion of training
requirements by the first day of the TELPAS
assessment window (March 17)
Basic training courses and calibration activities will
be open throughout TELPAS assessment window to:
allow districts to handle extenuating
circumstances
allow raters to refer back to course information
and practice activities as they rate their students
Key Holistic Training Dates
* KISD window closes on April 4th to provide adequate time for
verification of completion
Monitoring Course Completions & Calibration
Activities (CTC Responsibility)
Statewide rater lookup tool: Texas TrainingCenter
Reports for online training and calibration
TELPAS Returning Rater Planning Roster
Uses records from the last five school years to
generate a list of previously trained raters
TELPAS Confidential Course Completion Roster
Lists online basic training course status and
performance by user for the current year
TELPAS At-a-Glance Training and Calibration Report*
Lists training course and calibration status for all
registered users for the current year
Identifies “Time Spent” on calibration activities
TELPAS Confidential Calibration Summary Report
Provides calibration summary information by grade
cluster (K–1, 2, 3–5, 6–8, 9–12) and for grade
clusters combined
*TELPAS At-a-Glance Training and Calibration Report
New: “Time Spent” column documents how long the
rater spent on the calibration activities
If “Time Spent” field indicates an unlikely value for
successfully working through the scenarios and rating
the students, CTC must investigate
If the rater did not perform the calibration activities
independently, CTC must report this irregularity
These types of irregularities fall into the “Serious”
category that could result in severe consequences
*TELPAS At-a-Glance Training and Calibration Report
Assembly & Verification of Grades 2-12
Writing Collections
CTC appoints individual(s) to verify the collection of
writing samples meets the criteria required
Writing Collection Verifier Credentials
May be LPAC administrators, school counselors,
or other suitable staff
May NOT be paraprofessionals
May NOT be teachers serving as TELPAS raters
this year
Assembly & Verification of Grades 2-12
Writing Collections
Raters are responsible for assembling writing
collections that accurately depict the ability of the
students to communicate in writing
Writing samples should come from a variety of
core content areas
Writing samples should be taken from authentic
classroom activities that are grounded in
content area TEKS and ELPS
Recent writing samples should be weighted more
heavily in the event that a student’s rating is
borderline between two levels of proficiency
Classroom observations are not used for these
grade levels
Assembly & Verification of Grades 2-12
Writing Collections
Requirements for samples:
Must contain at least 5 writing samples
At least 1 narrative writing sample about
a past event
At least 2 academic writing samples from
math, science, or social studies
Assigned on/after February 17, 2014
Should reflect current proficiency
Each sample must include student’s name
and date
Cover sheet and verification checklist
(Appendix C) must be completed and stapled
to student’s writing samples
Photocopies of classroom writing
assignments may be used if clear and legible
Writing samples may be typed if
spelling/grammar checkers disabled
Writing from Authentic Classroom
Activities
Do not gather all of your LEP students and have a
“writing party” for TELPAS
Writing samples should be collected from classroom
assignments in which all students participate
Assembly & Verification of Grades 2-12
Writing Collections
The district coordinator is required to submit a
testing irregularity incident report to TEA if the
student writing samples submitted are based
on incorrectly assembled writing collections
Validity and Reliability
CTC oversees procedures to ensure validity and reliability
of holistic ratings
Killeen ISD’s policy is to implement the 1st and 4th
recommendations of TEA
Validity and Reliability
Procedures to Ensure Validity & Reliability
As was the case last year, there must be a second set of
eyes reviewing the rater’s assessment for each student
Writing samples must be reviewed by a trained and
calibrated 2nd rater, but he/she does not have to have
the student in class
Other holistic domain ratings can be corroborated by
any certified professional who has a knowledge of the
student’s listening and speaking capabilities in an
academic and social environment
UNLIKE primary raters, 2nd raters need not rate all
domains; each needs to sign appropriate form
TELPAS Assessment Eligibility
Requirements
Campuses are required to assess all K-12 ELLs enrolled
during the TELPAS testing window*:
Currently identified as LEP
LEP code = 1 in eSchoolPlus
Includes parent denials
Includes homebound students
Does NOT include students who have been exited from
the program and who are in their 1st or 2nd year of
monitoring
LEP codes F, S in eSchoolPlus are NOT tested
* In rare instances due to ARD specifications or other unusual
circumstances, a student may not be required to participate in
one or more TELPAS domains--see DCCM Page T-4
Identifying Eligible ELLs
CTC Responsibility
1.
Use the Advanced Search tab in eSchoolPlus to find
currently identified LEP students
2.
KISD Connect Precode report (filtered on LEP = C) should
match the students found in #1
3.
*Use KISD Reporting (SSRS) to identify students who were
previously enrolled as LEP and who were not exited from the
program
* Use this report with either of the other two methods to make sure
your list is complete.
Key Dates in Determining Which Campus is
Responsible for Assessing Students
Responsibility for assessing students who enroll or
withdraw before the testing window
Student withdraws/enrolls before March 17
Sending campus:
Do NOT enter any ratings
Remove student from all online test sessions
and holistic rating entry groups
If student has writing samples, give them to
receiving campus
Receiving campus:
Responsible for assessing all domains
Enter holistic ratings
Administer online reading test
Key Dates in Determining Which Campus is
Responsible for Assessing Students
Responsibility for assessing students who enroll or withdraw
during the testing window
Student withdraws/enrolls on or after March 17
Sending campus:
Responsible for entering all holistic ratings
If student has not taken the online reading test,
remove student from all test sessions
Receiving campus:
Responsible only for administering the online
reading test (if student has not already completed
the test)
Note: Students whose last day is March 7th, are not officially
withdrawn until March 17th so the sending campus must
enter holistic ratings for these students
Important Dates
Timeline
Holistic rating completion/rating roster turn-in to CTC
Earliest Date: 3/17/2014
Deadline: 4/4/2014*
Assembling & verifying writing collections (grades 2-12)
Earliest Date: 3/17/2014
Deadline: 4/4/2014*
* KISD window closes on April 4th to provide adequate time for
verification of completion
TELPAS Student Rating Roster
Rating
Section
Signatures
Legend
Properly Completing the TELPAS Student Rating
Roster (Rating Section)
Place one name—the entire name—on one line (if possible)
Grade level must be K, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, or 12
Rating domain entries must be B, I, A, H, E, or X
NO substitutions or other abbreviations allowed
The Reading (K-1 only) column should be blank for grades 2-12
There should be NO other blank entries
Properly Completing the TELPAS Student Rating Roster
(Rater Information Section)
Rater A and Rater B Information columns must
be completed
Rater A entries must be 1, 2, 3, 4, 5, 6, 7, OR 8
Rater B entries must be 1, 2, or 3
Consult the Rater Information listed below the
roster to determine the correct value for each
Properly Completing the TELPAS Student
Rating Roster (Signature Section)
Rater must sign and date the roster
Additional rater (almost all should have one) must sign and date
the roster
Principal must sign and date the roster
Nobody else may sign for the principal
Campus Name must be written on the roster
What’s Wrong with this Picture?
What’s Wrong with this Picture?
.
.
What’s Wrong with this Picture?
What’s Wrong with this Picture?
What’s Wrong with this Picture?
What’s Wrong with this Picture?
What’s Wrong with this Picture?
What’s Wrong with this Picture?
So… Now that you know what a rating roster should NOT
look like, what might a correctly completed roster look like?
TELPAS Writing Collection Cover Sheet
Properly Completing the TELPAS Writing
Collection Cover Sheet (Front Side)
Student Name,
Campus Name,
Enrolled Grade Level,
and Number of Writing
Samples must be
legibly written on the
cover sheet
Rater must sign the
cover sheet
Additional rater (most
should have one)
must sign the roster
Writing Rating must
reflect just the final
rating
Properly Completing the TELPAS Writing
Collection Cover Sheet (Back Side)
All boxes must be
initialed by the rater
and/or verifier as
indicated unless there
is documentation
attached explaining
why the criteria is not
met
Verifier must print,
sign, and date the
sheet on the
appropriate lines
Online Reading Tests For Grades 2–12
TELPAS Reading Test Change
New standards were set for TELPAS reading**
Standards were adjusted to meet the new
definition of “grade level-appropriate” that
accompanies the increased rigor of STAAR
Domain weights have been shifted in the
composite score calculations:
Reading: 50% Previously 75%
Writing: 30%
Previously 15%
Listening: 10% Previously 5%
Speaking: 10% Previously 5%
**What this means for you: TELPAS Reading scores may
be lower overall this year
Accommodations
Eligible students with disabilities:
Majority of testing accommodations available for
STAAR reading and STAAR English I & II are
available for the TELPAS reading test
Large print/projection device (project test on wall)
Colored overlay (tape to monitor)
Individual or small group administration
See Accommodations Resource page
Non-allowed accommodations
Braille administration
Oral administration
Dictionary of any kind
Accommodations
If a student with a disability is allowed a testing
accommodation, the accommodation type(s) must be
indicated at the time of testing:
Type 1 (accommodations approved locally)
Available for students who meet specific eligibility
criteria
Decision is made by the appropriate team of people
at the campus level; e.g., ARD committee & LPAC
No ARF required
Type 2 (accommodations requiring TEA approval)
Appropriate campus level teams determine whether
or not the student meets all of the criteria
If all criteria is met, an ARF must be submitted to
TEA
Accommodations
Linguistic Accommodations:
No linguistic accommodations are allowed
Only test directions may be clarified, translated, or
reworded in simplified English
No dictionaries of any type may be used
Extra time is not needed because the test is not timed
(but must be completed within the school day)
Linguistic accommodations are designed for STAAR and STAAR-L
assessments to minimize the impact of language deficiencies on the
assessment of subject knowledge and skills
General information
Multiple-choice online reading tests in six grade
clusters: 2, 3, 4–5, 6–7, 8–9, 10–12
Administered in the TestNav 7 format
Accessed from the Texas Assessment Management
System
In rare circumstances (juvenile detention centers, homebound), a
paper administration of a reading test for grade 2 or above may be
authorized by TEA. Refer to the 2014 District and Campus
Coordinator Manual (page T-10) for more information about
submitting a formal request for a paper administration.
Reading Test Administration Procedures
Test administrators must become familiar with the test
administration directions
Sentences are shorter, language is simpler
TA’s may adjust the language and specificity of the
administration directions to the level of English
proficiency of the students
TA’s must NOT change the substance of the information
contained in the directions
TA’s may translate into the native language the
administrative directions that they read aloud to the
students before the test.
TA’s must NOT translate test items or reading selections
Gather Materials for Testing
TELPAS Manual for Raters and Test Administrators
Seating chart – must use district chart
Session roster of students to be tested
Printed student authorizations
Secure documents
Keep in locked storage before the test
Scratch paper for each student
Pencils for use with the scratch paper
Note: All scratch paper and student
authorization letters must be returned to the
CTC and destroyed at the completion of the
test session.
What’s Wrong with this Seating Chart?
What test was administered?
What is the location of the test? Campus? Room?
What date was the test administered?
Who are the test administrators/monitors?
What times were the test administrators/monitors in the room?
What times were the students testing?
Final Data Verification Window
Assessment window closes Wednesday, April 9
Verification window closes Friday, April 11
Allows districts time to verify completeness and accuracy
of student data before scoring begins
If during verification process it is discovered a student
was not tested, the student must be tested during the
verification window
Reminder: KISD’s deadline for completion or ratings
entry is April 4th
Final CTC Duties
Bring the following items to KLSS at your scheduled time
on Monday, April 7th:
TELPAS Rater Oaths (for all raters)
TELPAS Writing Collection Verifier Oath(s)
TELPAS Reading Test Administrator Oath(s)
Online Basic Training Certificates
Online Calibration Certificates
TELPAS Student Rating Roster
TELPAS Writing Collection Cover Sheet (both sides)
with writing samples for every student assessed
Seating Charts for online reading test
Session rosters for online reading test
* Technology Staff Oath not needed because I will verify
technologists have signed their oaths before giving them
access to TAMS.
Resources
District and Campus Coordinator Manual
Coordinator Manual Resources Webpage
TELPAS Rater Manual
TELPAS Reading Test Administrator Manual
TELPAS Resources Webpage
PowerPoint training modules posted
Assembling and Verifying Grades 2–12 Writing Collections
online course
Found on the Texas TrainingCenter
Coordinator’s and Rater’s User Guides for Online Holistic
Rating Training
Educator Guide to TELPAS
User’s Guide for the Texas Assessment Management
System
User Roles and Permissions for the Texas Assessment
Management System
TestNav 7 Combined Technical Guide
Unified Texas Minimum System Requirements
Contact Information
•
•
•
•
•
•
•
Teresa Daugherty, Director for Assessment & Accountability
• Direct line to office: 336-0318
• Cell Phone: (254) 760-4897
• Home Phone: (254) 986-2242
Brenda Gooding, Director’s Secretary : 336-0319
Matt Howell, Testing Coordinator: 336-0336
Deb Brockway, Testing Specialist: 336-0298
Rose Childers, Testing Specialist: 336-0333
Martin McGinnis, Technician: 336-6990
Renee Ham, Data Manager: 336-0320