Transcript Rater Training and Holistic Components

eCourse Prerequisite for Face-to-Face Coordinator
Training, Spring 2015
TELPAS Basics
Chapter 1
2015 Holistic Ratings eCourse Prerequisite for Coordinators
2
Definitions
• ELLs
o English Language Learners
• ELPS
o ELPS = English Language Proficiency Standards
o Federally required instructional standards designed to ensure that ELLs
are taught the academic English they need for school purposes
• TELPAS
o TELPAS = Texas English Language Proficiency Assessment System
o A federally required assessment program designed to measure the annual
progress that ELLs make in learning academic English
• TELPAS Raters
o Teachers trained to assess ELLs in Listening, Speaking, Writing, and
Reading domains
2015 Holistic Ratings eCourse Prerequisite for Coordinators
3
TELPAS Assessment Encompasses
• Grades K–1
– Holistically rated observational assessments of Listening, Speaking,
Writing, and Reading
• Grades 2–12
– Holistically rated observational assessments of Listening and Speaking
– Holistically rated Writing collections
– Multiple-choice online Reading tests in six different grade clusters:
–
–
–
–
–
–
2nd
3rd
4th and 5th
6th and 7th
8th and 9th
10th thru 12th
2015 Holistic Ratings eCourse Prerequisite for Coordinators
4
TELPAS provides proficiency level ratings for each language
domain, plus an overall, composite rating.
2015 Holistic Ratings eCourse Prerequisite for Coordinators
5
Purpose of TELPAS
• For each domain (listening, speaking, reading, and writing),
TELPAS answers the following question:
How well is the student currently able
to understand and use English during
grade-level instruction?
2015 Holistic Ratings eCourse Prerequisite for Coordinators
6
TELPAS Results
TELPAS results are used to —
• set learning goals for ELLs
• keep parents and students aware of annual progress in learning
English
• inform instructional planning and bilingual/ESL program exit
decisions
• report performance to the public
• evaluate programs, resources, and staffing patterns
• evaluate districts and campuses in federal and state accountability
and monitoring indicators
2015 Holistic Ratings eCourse Prerequisite for Coordinators
7
Which Students are Administered TELPAS?
• All ELLs in grades K–12 are assessed annually, including those
whose parents decline bilingual/ESL program services, until
they meet ESL/Bilingual Program exit criteria and are reclassified as non-LEP
• Do NOT assess M1 or M2 students – they have been exited.
• All ELL students must be accounted for in TAMS for the TELPAS
submission – including student exempted from one or more
domains
•
In rare cases, an ELL served by special education may be exempted
from TELPAS by the ARD committee in conjunction with the LPAC
•
ARD exemption is on a domain-by-domain basis as a result of a
severe disabling condition and is addressed by the LPAC and ARD
committees and documented in the student’s IEP
2015 Holistic Ratings eCourse Prerequisite for Coordinators
8
Students Precoded for TELPAS
• District submitted a file for all ELL students enrolled as of
January 15, 2015. Students on this file are precoded or
“registered” for TELPAS at your campus
 Students who enrolled after January 16 must be registered for
TELPAS
• When students are registered for TELPAS, the following
information must be included:
–
–
–
–
–
Student identification
Demographics
Program information
Years in US Schools
Additional Data Collection for ELLs with special circumstances resulting
in extenuating needs (Asylee/Refugee and SIFE)
2015 Holistic Ratings eCourse Prerequisite for Coordinators
9
Prepare Yourself and Your
Faculty for Holistic Rating
Chapter 2
2015 Holistic Ratings eCourse Prerequisite for Coordinators
10
Grades K-1
Assessment Approach: Listening, Speaking, Reading, Writing
• K-1 Teachers evaluate:
o 4 domains - Listening, Speaking, Reading and Writing
o English proficiency levels by observing students in class
•
Teachers watch how their ELLs
–
Interact informally with them and with other students
–
Understand and use English
o when receiving academic instruction and completing
class work
o during cooperative learning activities
2015 Holistic Ratings eCourse Prerequisite for Coordinators
11
Grades 2–12
Assessment Approach: Listening, Speaking, Writing, Reading
• Gr. 2-12 Teachers evaluate Listening and Speaking in the same
manner as K-1 Teachers (teacher observation and interaction)
• Assessment approach for Writing is based on an evaluation of each
student’s Writing Collection (writing samples taken from a variety of
content areas)
o Teachers compare student performance on the ELPs by using a
comparative, descriptive tool called Proficiency Level Descriptors
o Raters do NOT consider additional classroom observations when
evaluating the Writing Collection to determine a student’s rating for
the Writing domain
• Assessment for Reading is based on an online multiple choice
reading exam
2015 Holistic Ratings eCourse Prerequisite for Coordinators
12
Language Domain Definitions
2015 Holistic Ratings eCourse Prerequisite for Coordinators
13
Proficiency Level Definitions
• For all grade levels and domains,
ratings are:
–
–
–
–
Beginning (B),
Intermediate, (I)
Advanced (A), or
Advanced High (H)
2015 Holistic Ratings eCourse Prerequisite for Coordinators
14
TELPAS Resources
• Please refer to the TELPAS Resource page at
http://tea.texas.gov/index4.aspx?id=2147496942&menu_id=7
93 for information regarding:
– Rater training
– Introductory training Power points
– Rater Training Requirements
– Holistic Writing Collection Requirements
– TELPAS Student Tutorials
2015 Holistic Ratings eCourse Prerequisite for Coordinators
15
Holistic Rating Process
Chapter 3
2015 Holistic Ratings eCourse Prerequisite for Coordinators
16
Overview of the Rating Process
• Campuses identify ELLs in grades K–12 and designate Raters to assess
students
• Test administration procedures and Holistic Rating training conducted to
prepare grades K–12 Raters to assess English language proficiency
consistent with the holistic scoring rubrics, the Proficiency Level
Descriptors (PLDs)
• Raters gather writing samples for ELLs in grades 2–12 to include in each
student’s writing collection
• Raters use PLDs to assign students a rating in each language domain
assessed
2015 Holistic Ratings eCourse Prerequisite for Coordinators
17
Who is involved in the Rating Process?
• Campus Testing Coordinator
• Verifier –
– assists with Writing Collection (applicable for gr. 2-12)
– Certified personnel only
• LPAC Administrator and Master List Clerk (assist with providing
a list of all ELL students)
• Raters (certified personnel only)
2015 Holistic Ratings eCourse Prerequisite for Coordinators
18
Coordinator Responsibilities for Holistic Rating Training
• Vital for Testing Coordinators to have good working knowledge of
holistic rating training
• Ensure Raters understand the importance of being properly
trained on the holistic rating process
• Ensure new and returning Raters understand which training to
take (separate trainings required for New vs. Returning Raters)
and for which grade clusters
• Monitor that all Raters complete their training requirements and
receive supplemental training support if needed
2015 Holistic Ratings eCourse Prerequisite for Coordinators
19
Coordinator Responsibilities for Holistic Rating Training
• It is critical for Coordinators to read the “TELPAS Coordinator’s
User Guide for Online Holistic Rating Training” available for
download at
http://tea.texas.gov/index4.aspx?id=2147496942&menu_id=793
This is one of the best things you can do to prepare yourself. It
includes information such as:
–
–
–
–
New user registration
Requesting access for the Campus Coordinator role for existing users
User Look Up
Reports to monitor Rater training
2015 Holistic Ratings eCourse Prerequisite for Coordinators
20
TELPAS Verifier Responsibilities
• Must be certified individuals - they can be Teachers, Librarians,
Counselors, or Administrators
• Verifiers cannot be paraprofessionals or individuals who are
also Raters
• Complete the online “Assembling and Verifying Grades 2-12
Writing Collections” training course available at Texas
TrainingCenter
• Manage Writing Collections
• Provide each Writing Collection with a “Writing Collection Cover
Sheet” and “Writing Collection Verification Checklist”
• Campuses must have at least one Verifier, but it is suggested to
have more than one, or at least train a “back-up” Verifier
2015 Holistic Ratings eCourse Prerequisite for Coordinators
21
LPAC Administrator & Master List Clerk
•
LPAC Administrators work with Master List Clerk to ensure that
all ELL students are identified, and correct demographics,
Years in US Schools, testing information, and required
accommodations are entered in Chancery. All information in
Chancery will be assigned to the student’s registration record
in the Texas Assessment Management System (TAMS)
•
Master List Clerks will provide the Testing Coordinator with a
list of ELL students. They will work together to make sure all
ELL students are accounted for, assigned to a Rater, and
listed on a Student Rating Roster
2015 Holistic Ratings eCourse Prerequisite for Coordinators
22
TELPAS Student Rating Roster
ALL ELL students are listed on a Rating Roster – even
•
Students receiving Special Education Services who will be exempted
from one or more domains
•
Students whose parents have waived services
2015 Holistic Ratings eCourse Prerequisite for Coordinators
23
Electronic Student Rating Roster Form
Special Programs has developed an electronic Rating Roster using Excel
•
List and sort students in any order
•
Add or delete columns and fields as needed – includes Homeroom
•
You may use the Excel document or the standard form in the TELPAS
Rater Manual Appendix
2015 Holistic Ratings eCourse Prerequisite for Coordinators
24
TELPAS Rater Responsibilities
•
A student’s TELPAS Rater is the Teacher designated by the
campus as the official Rater of the student’s English language
proficiency
•
The student’s Rater must rate the student in all domains for
which the student is eligible. A student is not permitted to
have one Rater for some domains and another Rater for other
domains
2015 Holistic Ratings eCourse Prerequisite for Coordinators
25
Rater Credentials
Each Teacher selected to rate an ELL must:
• Know the student well - have the student in class
• Be knowledgeable about the student’s ability to use English in
instructional and informal settings
• Hold valid education credentials such as a Teacher certificate or
permit
• Be appropriately trained, as required by TEA
2015 Holistic Ratings eCourse Prerequisite for Coordinators
26
Holistic Rating Training
Requirements
Chapter 4
2015 Holistic Ratings eCourse Prerequisite for Coordinators
27
Training Requirements: K–1 and 2–12
• Fall (recommended)
o ELPS-TELPAS professional development for new Teachers and new
Raters – foundational (awareness) training
• Spring (required)
o In addition to required training courses, Raters and Verifiers must
complete test administration procedures training and sign an Oath
of Test Security and Confidentiality
o All courses are delivered in an online format
o New Raters – complete online Basic Training course and online
Calibration Activities
o Returning Raters – complete online Calibration Activities
o Verifiers – All Verifiers (New or Returning) must complete the online
“Assembling and Verifying Grades 2-12 Writing Collections” course
2015 Holistic Ratings eCourse Prerequisite for Coordinators
28
Fall ELPS-TELPAS Professional Development
Grades
K–12and
Holistic
Rating Training
Flowchart
(For new teachers
new prospective
raters
-- recommended)
Spring TELPAS Administration
Procedures Training
Covers holistic rating training requirements
and procedures for conducting TELPAS
New Raters
Returning Raters
Online Basic Training
Course
Online
Calibration Activities
Sets 1 and 2:
Set 2 required if not successful
on Set 1
If not calibrated:
Supplemental Holistic
Rating Training
2015 Holistic
Final Online
Calibration Activity
Set 3
Ratings eCourse Prerequisite for
Coordinators
Online
Calibration Activities
Sets 1 and 2:
Set 2 required if not successful
on Set 1
29
General TEA Definitions of New and Returning Raters
Please note that Raters must have received training and calibrated
successfully within the last 3 years in order to be considered a “Returning”
Rater. If the Rater did not calibrate successfully within the last 3 years, s/he
is considered a New Rater and must complete the online Basic Training
course and calibration2015
activities.
Holistic Ratings eCourse Prerequisite for Coordinators
30
Key Holistic Rating Training Dates
2015 Holistic Ratings eCourse Prerequisite for Coordinators
31
Online Training Components
• Online Basic Training course (Required for New Raters)
o Applies to new Raters (and Raters who have not rated, calibrated successfully,
or participated in training within the last 3 years)
o Requires separate online Basic Training courses for Raters of K–1 and Raters of
grades 2-12
o Provides instruction on using the PLD rubrics and includes rating activities to
give Raters opportunities to practice applying the rubrics to each language
domain (Listening, Speaking, Writing, and Reading for K-1, and Listening,
Speaking, and Writing for grades 2-12)
o There is no passing score required for the online Basic Training course (no staterequired level of accuracy established). Raters are required to complete the
course
2015 Holistic Ratings eCourse Prerequisite for Coordinators
32
Online Training Components CONTINUED
• Online Calibration courses (Required EVERY YEAR for New and
Returning Raters)
o Separate calibration activities for grades K–1, 2, 3–5, 6–8, and 9–12
Important Note: If a returning Rater has not calibrated successfully
in 3 years they will need to complete the online Basic Training course
before beginning calibration.
• Assembling and Verifying Grades 2–12 Writing Collections course
o Required course for Verifiers. This is used to supplement Test
Administrator procedures (Test Security training and TELPAS
eCourses)
o Optional course for Raters and Coordinators
2015 Holistic Ratings eCourse Prerequisite for Coordinators
33
Training Courses Separated by Grade Clusters
• Coordinators must be certain that Raters know which assigned
grade cluster(s) they must complete before starting the online
training
Grade Clusters
Grades K–1
Grade 2
Grades 3-5
Grades 6–8
Grades 9–12
2015 Holistic Ratings eCourse Prerequisite for Coordinators
34
When and Where Do Raters Complete Online Training?
• Depending on campus arrangements, Raters may either complete
training and calibration during school hours, after school, or on
weekends
• The online training system allows Raters to access the training from
any computer that meets the minimum system requirements
• Coordinators inform Raters of the details during annual
administration procedures training
• Raters complete all online training on the Texas TrainingCenter
website https://texas.pearson.desire2learn.com/ New Raters must
self-register. Returning Raters use the same user id and password as
they have in previous years
• Remember – all online training for Raters occurs on the Texas TrainingCenter
website. All ratings entry and Reading test administrations occur on the
Texas Assessment Management System (TAMS) website.
2015 Holistic Ratings eCourse Prerequisite for Coordinators
35
Assisting Raters with Completing Online Training
• To complete training requirements, New Raters will self-register
at the Texas TrainingCenter website at
https://texas.pearson.desire2learn.com/
• Directions are provided in the “TELPAS Rater’s User Guide for
Online Holistic Rating Training” available at
http://tea.texas.gov/student.assessment/ell/telpas/manuals/
This document is part of the TELPAS Rater Manual. See pp.
55-76. Make sure your Raters review this portion of the Rater
Manual.
2015 Holistic Ratings eCourse Prerequisite for Coordinators
36
Texas TrainingCenter Self-Registration
2015 Holistic Ratings eCourse Prerequisite for Coordinators
37
Holistic Rating Calibration
Activities
Chapter 5
2015 Holistic Ratings eCourse Prerequisite for Coordinators
38
Preparing for Calibration Sets
• New Raters must complete the online Basic Training course before the calibration
course
• Returning Raters have the option to review the online Basic Training course
(which includes practice rating activities) before beginning calibration
• Raters affirm online that they will keep the contents of the calibration sets secure
and confidential. It is a violation of test security to share or discuss answers to
the rating practice activities. It is also a violation of test security to share or
discuss scored activities with individuals who have not yet completed the course
• Calibration activities are taken from a bank and randomized. Participants will rate
different sets of students
• Raters can work at their own pace, go back and review students, and change
ratings as they work
2015 Holistic Ratings eCourse Prerequisite for Coordinators
39
Online Calibration Activities
• Raters complete only as many sets as it takes to calibrate.
o Many Raters will calibrate on the first set of activities
o If Rater is not successful, s/he is advised to complete additional practice
activities before attempting the second set. Almost all Raters calibrate
successfully by the end of the second set. If you have Raters that are
unsuccessful with set 1 of the calibration activities, direct your Raters to complete
additional practice activities BEFORE attempting Set 2. Note that the manual
tells Raters that are not successful on Set 1 that they can immediately attempt
Set 2, but our district does not allow this
o If Rater is not successful on the second set, the Rater receives required, face-toface supplemental support training from Special Programs to prepare for the
final, third set of activities
o After completing Supplemental Support training, Raters are given the access code
to open the third set of calibration activities
2015 Holistic Ratings eCourse Prerequisite for Coordinators
40
Online Calibration Activities
CONTINUED
• Each calibration set contains 10 students to rate, and all
holistically assessed language domains are represented in each
set
o For K–1: Listening, Speaking, Reading, and Writing
o For 2–12: Listening, Speaking, and Writing
• A Rater needs to rate at least 70 percent (7 out of 10 samples) of
the students correctly to demonstrate sufficient calibration
• After submitting the ratings, the Rater will be able to view the
score, the students rated, and the annotations for each student
2015 Holistic Ratings eCourse Prerequisite for Coordinators
41
Why is Calibration Necessary?
• Calibration helps ensure that Raters have adequate training,
including ample practice and feedback, before they assess their
students
• Calibration ensures that Raters clear their heads and consider only
the elements of student performance included in the PLDs.
Remind Raters that assessing TELPAS domains does NOT use the
same criteria as assessing STAAR. Academic language proficiency
is not the same as academic achievement
• Calibration supports assessment validity and reliability and is an
important part of holistically scored assessment processes
2015 Holistic Ratings eCourse Prerequisite for Coordinators
42
Are Raters allowed to refer to any resources during
calibration activities?
• Yes, Raters should use their rating rubrics (PLDs) and refer to, as needed,
information from the:
o
Online Basic Training course
o
Holistic Rating presentations (ppt’s) produced by TEA and Student Assessment
o
TELPAS Manual for Raters and Test Administrators
o
Educator Guide to TELPAS
• Raters are NOT allowed to assist another Rater or receive assistance from
another Rater during the Calibration course. This is considered a test
security violation and must be reported to TEA.
• Any notes taken during the Calibration activities must be destroyed
(shredded) after completing the calibration course
2015 Holistic Ratings eCourse Prerequisite for Coordinators
43
Recap of Calibration Process
• 3 sets of 10 student samples – a score of 70% or better is required
• Raters who calibrate successfully on set 1 are complete
• Raters who don’t calibrate on set 1 complete additional practice and
then go on to set 2. Raters who calibrate successfully on set 2 are
complete
• Raters who don’t calibrate on set 2 receive supplemental training
• Raters attempt third and final calibration set
• Raters who calibrate successfully on set 3 are complete
• Raters who do not calibrate successfully on set 3 can still rate, but
must be provided support by a trained, calibrated Rater
Important Note: Individuals are not authorized by TEA to serve
as Raters unless they complete the state-required training and
calibration activities.
2015 Holistic Ratings eCourse Prerequisite for Coordinators
44
Training Raters With Multiple Grade Levels
• See p. T-6 in the 2015 DCCM, available at
http://tea.texas.gov/student.assessment/manuals/dccm/
• For Rater with students in multiple clusters in grades 2–12
o Rater required to train in the cluster with most ELLs
o As a best practice, Rater should review some online basic training course
practice activities in additional cluster(s)
• For Rater with students in multiple clusters including K–1
o Rater required to train in K–1 and one other cluster in grades 2–12
o Rater of K–1 who will rate more than one additional cluster within grades 2–
12 should train in the cluster (2, 3–5, 6–8, 9–12) with the most ELLs
o As a best practice, Rater should review some online basic training course
practice activities in other cluster(s)
2015 Holistic Ratings eCourse Prerequisite for Coordinators
45
Raters with Students in Multiple Grade Clusters that
Include Grades K–1
• Because of differences in the instructional content and rating
rubrics, these Raters must complete training and calibration
for K–1 and at least one other cluster in 2–12
• Raters with more than one additional cluster should train in
the cluster in which they have the most ELLs
• As a best practice, these Raters should also review online
basic training course practice activities in the additional
cluster(s)
Example: A grade 1–3 Bilingual Teacher has most of his ELLs in grade 2. He must
complete training and calibration in grades K–1 and 2. As a best practice, he
should review the online practice activities for grades 3–5 to check his readiness
to apply the rubrics appropriately for his 3rd grade students
2015 Holistic Ratings eCourse Prerequisite for Coordinators
46
Raters with Students in Multiple Grade Clusters
within Grades 2–12
• Raters are required to train and calibrate in the cluster in which they have
the most ELLs
• As a best practice, these Raters should also review online basic training
course practice activities in the additional cluster(s)
Example: A grade 2–4 ESL Teacher has most of her ELLs in grade 3. She must
complete training and calibration in grades 3–5. As a best practice, she should
review the online practice activities for grade 2 to check her readiness to apply
the rubrics appropriately for her 2nd grade students
2015 Holistic Ratings eCourse Prerequisite for Coordinators
47
Raters Changing from K-1 to 2-12 or Vice-Versa
• K–1 training components are separate from those of grades 2
and above
• Training for K–1 and 2–12 differ greatly due to the differences in the tested
components and rating rubrics (PLDs). One specific example is the
differences in the training for the Reading domain
• If a Rater completed training for rating students in grades K-1, but was then
required to rate students in grade 2 or above, the Rater would be required to
complete the online Basic Training course for the appropriate cluster in grades
2-12. (Clusters = gr. 2; gr. 3-5; gr. 6-8; gr. 9-12)
• The same rule applies if the opposite happened. If a Teacher was trained to
rate students in grade 2 or higher, and then was required to rate students in
grades K-1, the Teacher would have to complete the online Basic Training
course for K-1
• “Completed” means that the Rater participated in the online Basic Training
course.
• After completing the online Basic Training course, Raters would also be
required to calibrate successfully in the appropriate grade cluster
2015 Holistic Ratings eCourse Prerequisite for Coordinators
48
Monitoring Rater Training
Chapter 6
2015 Holistic Ratings eCourse Prerequisite for Coordinators
49
Assisting Raters with Training
• Testing Coordinators must determine which type of
training each Rater requires:
o New Rater – Online Basic Training and Calibration
o Returning Rater – Calibration
• Texas TrainingCenter Tools
o User Look-Up – Coordinator searches for each Rater individually
to view training history
o Rater Progress Reports – Coordinator runs reports showing
training history and progress for all Raters assigned to that
campus
2015 Holistic Ratings eCourse Prerequisite for Coordinators
50
Texas TrainingCenter – User Look-Up
• Enter the name of the Rater, click Search, click on name of Rater,
and view training history.
• See pp. 9-10 in the “TELPAS Coordinator’s User Guide for Online
Holistic Rating Training” at
http://tea.texas.gov/student.assessment/ell/telpas/
2015 Holistic Ratings eCourse Prerequisite for Coordinators
51
Training Certificates and Professional
Development Hours
• Training certificates are generated for Raters who
complete training courses and calibration activities
– Certificate of completion issued when a Rater completes the
online basic training course
– Certificate of successful completion issued when a Rater
demonstrates sufficient calibration (70 percent or better) on a
calibration set
• Five hours are awarded for each of the K–1 and 2–12
Basic Training courses
• Two hours are awarded (in all) for calibration
2015 Holistic Ratings eCourse Prerequisite for Coordinators
52
Online Basic Training Certificate
• Raters must complete the Basic Training course – no
pass/fail
Spring 2015
2015 Holistic Ratings eCourse Prerequisite for Coordinators
53
Calibration Certificate
• Raters must successfully complete the Calibration
course with a score of 70% of higher.
Spring 2015
2015 Holistic Ratings eCourse Prerequisite for Coordinators
54
Texas TrainingCenter - Reports
• Testing Coordinators must advise Raters of the training they
must complete and then they must monitor to ensure Raters
complete the course(s)
• Login to the Texas TrainingCenter at
https://texas.pearson.desire2learn.com/
• Scroll down to the blue panel “Access Your Reports”.
• Four Reports are available – all reports can be exported as an
Excel or .pdf document.
o Returning Rater Planning Roster – a detailed roster listing all Rater
training history since 2008-2009 (Coor. UG, pp. 12-13)
o Confidential Course Completion Roster – lists online Basic Training
Course completion and in-progress status and performance by user for
the current year (Coor. UG, p.14)
o At-a-Glance Training & Calibration Report – provides a comprehensive
list showing Basic Training course and calibration completions for all
registered users for the current year (Coor. UG, p. 15)
o Confidential Calibration Summary Report – shows Calibration summary
information for the campus by grade cluster, K-1, 2, 3-5, 6-8, 9-12,
(Coor. UG, p. 16)
2015 Holistic Ratings eCourse Prerequisite for Coordinators
55
Texas TrainingCenter – Reports CONTINUED
• Click on the report you
want. Export to Excel
or pdf.
• Save your reports for
reference. They will
assist you in completing
the required “Rater
Training Roster”.
2015 Holistic Ratings eCourse Prerequisite for Coordinators
56
Summary – Planning and Monitoring Rater Training
• To determine what type of training each Rater requires:
– Use the User Lookup tool to evaluate each Rater’s individual training
history
– Use the “Returning Rater Planning Roster” to see a list of training
history for all Raters attached to your campus. This shows courses
completed in previous years
– Ensure that each Rater is trained adequately for the grade levels s/he is
teaching and rating
• To monitor Raters’ progress with required training:
– Use the “Confidential Course Completion Roster” to see which Raters
have completed the online Basic Training course. This does not
include Calibration activities
– Use the “At-a-Glance Training & Calibration Report” to see which Raters
have completed Basic Training AND Calibration activities
– If a Coordinator wants to see a summary of Calibration activities by
grade cluster, run the “Confidential Calibration Summary Report”
2015 Holistic Ratings eCourse Prerequisite for Coordinators
57
Documenting Completed Rater Training
• To document that required training was completed by each Rater:
– Record on the “Rater Training Roster”:
– Rater’s name
– Training history
– Current grade level(s) to rate
– Type(s) of training course
– Date the course was completed
– Amount of time spent on the course
– This serves as an audit to confirm each Rater’s training was completed BEFORE
the Rater rates students in any domain
– This completed document must be submitted to Student Assessment by March 6
• A note about training history:
– Before 2010-2011, the terms for training courses were “Level 1”, (training course
for New Raters) “Level 2” (training course for Returning Raters), and
“Qualification” (equivalent to “Calibration)
– Beginning in 2010-2011 and beyond, the terminology for courses changed to
online “Basic Training Course” and “Calibration”
– Essentially the Level 1 and Level 2 trainings equate to Basic Training and
Qualification equates to Calibration.
2015 Holistic Ratings eCourse Prerequisite for Coordinators
58
PISD Rater Training Roster
• Raters must show Coordinators evidence of completing the Basic
Training Course and Calibrating successfully. Coordinators will
record who has completed training on the roster.
• Coordinators must know a Rater is eligible to rate and submit the
documentation to the Assessment Department BEFORE ratings are
completed and entered in TAMS.
• Until a Rater provides evidence of completed/successful training,
their TAMS account must remain locked.
2015 Holistic Ratings eCourse Prerequisite for Coordinators
59
Resources with More Details
• District and Campus Coordinator Manual
o Now available online at:
http://www.tea.state.tx.us/student.assessment/manuals/dccm/
o Paper versions arrive in early January
• TELPAS Rater Manual
o Now available at:
http://www.tea.state.tx.us/student.assessment/ell/telpas/manuals/
o Paper versions arrive in early January
• Online course titled Assembling and Verifying Grades 2–12 Writing
Collections
o Available online January 12 at
http://www.texasassessment.com/TexasTrainingCenter
2015 Holistic Ratings eCourse Prerequisite for Coordinators
TEA
60