Transcript CELLA - Miami-Dade County Public Schools

CELLA
2010 Comprehensive English Language Learning
Assessment
Test Chairperson Training Session
March 22 and March 24, 2010
Assessment, Research, and Data Analysis
Felicia Mallory, Executive Director
Denetra Collins, Staff Specialist
Program Overview
Comprehensive English Language Learning
Assessment (CELLA) is designed to meet the
requirements of Title III of the NCLB.
 A four-skill language proficiency assessment in
• Speaking
• Listening
• Reading
• Writing
 Administered to all English Language Learners
(ELLs) in grades K-12.
TAM, p.5
Standards for Measuring English Language Learners (ELLs)
Meeting Annual Measureable Achievement Objectives (AMAOs)
AMAO 1 is based on progress in English language acquisition as
measured in each of the three CELLA areas. Making progress is defined
as either increasing a proficiency level or staying within the “Proficient”
level in a specific area.
AMAO 2 is based on achieving English proficiency as measured by
CELLA. Achieving proficiency is defined as scoring within the proficient
level in all three domains: Listening/Speaking, Writing, and Reading.
AMAO 2 is established separately for four grade clusters: K-2, 3-5, 6-8,
and 9-12.
AMAO 3 is based on demonstrating proficiency in reading and
mathematics on the FCAT. Demonstrating proficiency is defined as
scoring at achievement level three or higher.
Administration Features
 Kindergarten
• Individual assessment recommended in all four modalities
 Grades 1-12
• Individual in Speaking
• Listening, Reading, and Writing are
group administered
TAM, p. 6
Training for Coordinators and
Administrators of CELLA
•
Speaking Administration
Training
Conducted by the Division of
Bilingual Education and World
Languages, Special Education,
and Charter Schools
•Group Administration Training
Conducted by Student Assessment
and Educational Testing (SAET)
Schedule of Activities
Activity
Date
One-on-One Test Administration Training
(Division of Bilingual Education and World
Languages and Charter Schools by region)
March 24 – April 9, 2010
One-on-One Test Administration Training for Special
Education
April 5, 2010
Delivery of the 2010 CELLA materials (including
PreID labels) to schools
April 7 – April 13, 2010
Individual CELLA Administration
April 19 – May 19, 2010
Group CELLA Administration
April 26 – May 19, 2010
Make-up Window for Group - Administered Sections
April 27 – May 19, 2010
Return all “To Be Scored”, “Not to Be Scored”,
and District Coordinator Envelope to Test
Distribution Center (TDC).
May 3 – May 19, 2010
Complete the 2010 CELLA Customer Satisfaction
Survey online at
http://www.fldoe.org/aala/CELLA.asp
Upon completion of testing
Score report delivery to schools.
July 2010– August 2010
Packet , p. 1
Students to be Tested
 All ELLs in grades K through 12 in membership as of
April 5, 2010
 All former ELLs who exited from the English for
Speakers of Other Languages (ESOL) program on or
after June 1, 2009
 ELL students enrolling in your school after April 5, 2010
must not be tested
 Pre ID labels provided for all eligible students in
membership on January 11, 2010
TAM, p. 7
CELLA Levels of Testing
 Booklet levels for the 2010 CELLA are as follows:
Grades K – 2
Level A
Grades 3 – 5
Level B
Grades 6 – 8
Level C
Grades 9 – 12
Level D
 All students will test on grade level in all modalities.
TAM, p. 6
Test Materials
Level A: Grade K - 2
Level B: Grades 3 - 5
Level D: Grades 9 - 12
Level C: Grades 6 - 8
TAM, pp. 8-9
CELLA Document Configuration by
Grade Level
Grade Level
Test Book(s)
Kindergarten (K) and Grades 1 & 2
Level A Student Test Book
Level A One-on-One Prompt Book
Grades 3, 4, and 5
Level B Listening & Speaking Test Book
Level B Reading & Writing Test Book
Level B, C & D Answer Sheet
Grades 6, 7, and 8
Level C Listening & Speaking Test Book
Level C Reading & Writing Test Book
Level B, C & D Answer Sheet
Grades 9, 10, 11, and 12
Level D Listening & Speaking Test Book
Level D Reading & Writing Test Book
Level B, C & D Answer Sheet
Materials shown in bold are answer documents.
TAM, p. 8
CELLA Materials for Students’ Use
Large Print/Braille Materials
 The Large Print version of CELLA has the same content
as the standard version of the test.
Large-Print Test Booklet
Large-Print Answer Sheet for recording responses
 The Braille version of CELLA differs from the standard
version of the test (Level A and some questions from other
levels have been omitted).
Braille Test Booklet
Levels B, C, and D Answer Sheet (standard version)
 Note: The Test Administrator will also need a standard
test booklet that matches the Braille level being
administered.
TAM, p. 9
Preparing for Testing:
Receiving Materials
 Verify that all materials indicated on the packing list
were received.
 Notify the District Coordinator immediately if any of the
materials on the packing list are missing.
 Should you need to order additional material, please call
TDC at 305-995-3743.
 Store materials in a secure access-restricted location.
 Retain ALL boxes in which materials were received for
return.
TAM, p. 35
School Packing List
TAM, p. 35
Shipment Summary List
TAM, p. 35
Box Content List
TAM, p. 35
Security Numbers
security number
TAM, p. 20
check number
TAM, p. 35
Retrieving the Pre-populated Administration
Record/Security Checklist
https://fl-servicepoint.questarai.com/Login.aspx
Select
“Click
Here”
TAM, p. 21
Retrieving the Pre-populated Administration
Record/Security Checklist
Choose
your
school
from the
dropdown
Choose
“Miami
Dade”
from the
dropdown
Click on Security Checklist
under School Files
TAM, p. 21
2010 CELLA ADMINISTRATION RECORD/SECURITY
CHECKLIST
Pre-populated version
TAM, p. 36
Preparing for Testing: Scheduling Test Sessions
 Schedule grade K testing and the Speaking section in
grades 1-12 for individual administration
• Individually administered sections may be
administered at anytime during the testing window
 It is recommended that CELLA group-administered sections
are given in the following order: Listening, Reading, Writing
• Group administration window April 26 – May 19, 2010
Administration Times for Grades K-2
Level A
Approx. Time
in Grade K
(individually)
15 min.
Approx. Time
in Grade 1
Approx. Time
in Grade 2
15 min.
15 min.
Listening
15 min.
15 min.
15 min.
Reading
15 min.
15 min.
35 min.
Writing
15 min.
15 min.
30 min.
Speaking (One-onOne)
Sections shown in bold require more time because they contain additional,
“extension” items only for grade 2 students.
TAM, p. 6
Administration Times for Grades 3-12
Level B, C, or D
Approx. Time
Speaking
10-15 min.
Listening
25 min.
Reading
45 min.
Writing
70 min.
TAM, p. 7
Preparing for Testing:
Training Test Administrators
Review the Test Administration Manual
Review the relevant sections from the Directions for
Administration (DFA )
Have test administrators familiarize themselves with the
Listening CDs and equipment for playing them
Remind test administrators of the State’s and District’s
security policies and procedures (including those
concerning electronic devices)
After the training, collect signed 2010 CELLA
Administration and Security Agreement forms
TAM, pp. 24-26
Preparing for Testing:
Accommodations for all ELLs
Review the list of accommodations in the DFA . The
following accommodations ARE permissible for all
ELLs:
 Flexible timing: CELLA is not a timed test,
sufficient time should be given to complete the
test.
 Assistance in heritage language: Directions may
be translated into heritage language on an
individual basis, if requested.
DFA , pp. 268-276
Preparing for Testing:
Accommodations for all ELLs
The following accommodations ARE NOT permissible for
any student:
No English-to-heritage language translation dictionary or
heritage language-to-English translation dictionary.
No help in the ELLs’ heritage language on specific test
questions NOR translate any part of the test other than the
directions.
Test Administrators may NOT translate directions to entire
classes.
DFA, pp. 268-276
Preparing for Testing:
Accommodations for SPED Students
Students with a current IEP or 504 plans are eligible for
accommodations based on the individual needs of each student.
 An accommodation for a student must be explicitly permitted
on the IEP or 504 plan.
• Presentation of Test Materials
• Responding to Questions
• Test Scheduling
• Test Setting
• Assistive Devices
 Refer to the Visually Impaired and Hearing Impaired section in
the DFA for allowable accommodations and/or exemptions.
DFA, p. 269-272
Preparation of Testing Materials
 Pre-ID labels are provided.
 Only the Test Chairperson or the person designated by
the site administrator may open the packages and affix
labels.
 Pre-ID labels should be affixed only to answer
documents; only one answer document per student:
Level A Student Test Book, or
Level B, C, & D Answer Sheet
TAM, p. 17
Preparation of Testing Materials
Level A Student Test Book
TAM, p.17
Levels B, C, D Answer Sheet
Preparation of Testing Materials (continued)
ALL of the following information MUST be correct for the
student label to be used:
1.
2.
3.
4.
5.
Student’s Last Name
Student ID Number
Grade Level
School Number (code)
District Name and Number
TAM, pp. 11-12
Pre-ID – Information to be Completed









Box 1
Box 2
Box 3
Box 4
Box 5
Box 10
Box 24
Box 25
Box 26
Student Name
Test Administrator Name
School Name
School Number
District Name (MDCPS) and Number (13)
Test Date
Test Level (record on B, C, D Answer Sheet)
Accommodations (if applicable)
Do Not Score(DNS) or Undo (if applicable)
TAM, pp. 12-16, Packet, p. 3
No Pre-ID: Information to be Completed
If a student has no pre-identified label, the following additional
information MUST be gridded on all student answer documents:
Students or school staff
 Boxes 1, 3, 4, 5, 6, 7, 8, 9, 10, 12, 13, 14, 15, and 24
School staff only
 Boxes 2, 11, 16, 17, 18, 19, 20, 21, 22, and 23
Student demographics provided on the student list are indicated in bold.
TAM , pp. 11-16
Student List for Gridding
Packet, p. 5
Gridding Demographic Information
Numeric values and letter codes are listed on the school list corresponding to item
choices on the answer sheet.
For example: Box 15 - Home Language
1=Arabic
2=Chinese/Zhongwen
3=French
4=Haitian Creole
…
11=Other
Fill in the bubble for the following fields as indicated below:
Box 16 – Primary Exceptionality
Box 17 – Length of Time Enrolled in ESOL
Box 18 - Title III
YES/NO
TAM, pp. 12-16 , Packet, p.5
Preparation of Testing Materials Non-Pre ID:
Other Fields
Fill in the bubble for the following fields as indicated below:
Box 22 Receives Special Services
 F/R Lunch if “Y” is indicated on the student list
Migrant if “Y”
Box 23 Program Participation
 ESOL if “Y” (do not mark if student is former ELL)
 Dual Language Program – determined by school
Packet, p.7
Test Security Policies and Procedures
 Florida Test Security Statute 1008.24 and Florida State
Board of Education – Test Security Rule 6A – 10.042
 M-DCPS: Standards, Guidelines, and Procedures for Test
Administration and Test Security
http://oada.dadeschools.net/TestChairInfo/29testsecurityma
nual.pdf
 The security of all test materials must be maintained before,
during, and after the test administration.
Under no circumstances are students permitted to handle
secure materials before or after the test administration.
TAM, pp. 59 - 61
Distribution and Tracking of Materials
 Distribute and collect all One-on-One test materials daily.
 Distribute all testing materials for group administration just
prior to test sessions, collect immediately afterwards, and
store in a secure location.
 Distribute copies of the 2010 CELLA Administration
Record/ Security Checklist
Distribution and Tracking of Materials
Administrators need:
Test Level/Grade
Student Material Needed
Teacher Material Needed
Level A / Kindergarten
(all four sections)
Level A Student Test Book
Directions for Administration
(DFA)
Test Administration Manual
(TAM)
One-on-One Prompt Book
Listening CD (Levels A & B)
CD Player/ computer with
speakers
Level A / Grades 1 – 2
(One-on-One)
Level A Student Test Book
DFA
TAM
One-on-One Prompt Book
Levels B-D / Grades 3 – 12
(Speaking)
Listening & Speaking Student DFA
Test Book (Appropriate level) TAM
Levels B,C, & D – Answer
Sheet
TAM, pp. 8 & 27-31
Recording One-on-One Responses for Level A
Student Test Book
Recording Speaking Responses –
Levels B, C, and D
ADMINISTERING LEVEL A
The Stopping Rule
 The Stopping Rule is ONLY applicable to individually
administered sections.
 IF the student cannot respond to several questions in
a row AND it is clear that the questions are above the
student’s proficiency level, the Test Administrator
should stop the administration of that section only.
DFA , pp. 7, 14, 21, & 27
Distribution and Tracking of Materials
Group Administration for Grades 1 – 12 (Listening)
Test Administrators need:
Test Level/Grade
Student Material Needed
Teacher Material Needed
Level A / Grades 1 – 2
Level A Student Test Book
Directions for
Administration (DFA)
Test Administration Manual
(TAM)
Listening CD (Levels A & B)
CD Player/ Computer with
speakers
Level B / Grades 3 - 5
Level C/ Grades 6 - 8
Level D/ Grades 9 - 12
Listening & Speaking
Student Test Book
(Appropriate level)
Levels B,C, & D – Answer
Sheet
DFA & TAM
Listening CD (Appropriate
Level)
CD Player/ Computer with
speakers
TAM, p. 8
Distribution and Tracking of Materials
Group Administration for Grades 1 – 12 (Reading and Writing)
Test Administrators need:
Test Level/Grade
Student Material Needed
Teacher Material Needed
Level A / Grades 1 – 2
Level A Student Test Book
Directions for
Administration (DFA)
Test Administration Manual
(TAM)
Level B / Grades 3 - 5
Level C/ Grades 6 - 8
Level D/ Grades 9 - 12
Reading and Writing
Student Test Book
(Appropriate level)
Levels B,C, & D – Answer
Sheet
DFA
TAM
TAM, p. 8
Administering the Test
 Rooms used for testing must:
 be free from distractions
 have comfortable seating
 have good lighting
 have adequate ventilation
 have sufficient workspace
 Remove or cover all visual aids in the testing rooms.
 Make sure that:
 test administrators have a copy of the TAM and DFA
 test scripts are read verbatim
 there is sufficient space between students so that students
cannot view other student’s answer sheets
 students and assessors record all answers using a #2 pencil
TAM, pp. 24 & 25
Marking Answer Responses-Level A
Correct
Incorrect
Administering the Test
 The Listening portion must be administered by playing
the Listening CD.
 Test administrators are required to actively monitor
students during a test session.
 Test administrators are required to maintain an accurate
2010 CELLA Security Log.
 Test administrators and proctors must sign the 2010
CELLA Administration and Security Agreement
TAM, pp. 8, 26 & 33
Security Log
TAM, pp. 26 & Appendix B
Test Invalidation Procedures
From Level B,C, & D
Answer Sheet
Box #20
DO NOT SCORE –
Contains DNS and
UNDO bubbles for each
test section
TAM, pp. 22 - 23
Test Invalidation Procedures
The appropriate DNS bubble MUST be gridded if:
1) Any of the following information on the PreID label is
INCORRECT and affixed to a USED document.
- Last Name
- Student ID Number
- District Name
- School Name
- School Code
- Grade Level
2) A student label has been placed over another label on a
USED document.
3) An answer document is defective and USED.
4) A student has an electronic device during testing.
5) A student is caught cheating or is disruptive during testing.
TAM, pp. 22 - 23
Test Invalidation Procedures
The appropriate DNS bubble MAY be gridded if:
1) A student becomes ill and is unable to complete the
session.
2) A student is not allowed sufficient time to finish.
Answer documents with gridded DNS bubbles
should be submitted with TO BE SCORED
materials.
TAM, p. 23, 31, & 38
Test Invalidation Procedures
It is not necessary to invalidate an answer document if:
1) The preidentified document belongs to a student who has
withdrawn before testing begins.
2) The preidentified document belongs to a student who has
been absent during the entire testing window.
3) The document is defective and UNUSED.
4) The preidentified information is incorrect and the document is
UNUSED.
TAM, p. 23
Test Invalidation Procedures
Defective Materials
 If a defective test book is found during testing, give the student
a replacement book.
 If the defective book is a Level A , upon completion of the test,
the student must (under supervision of a test administrator)
transfer the exact answers to the appropriate replacement
document.
 If the defective book is Level B, C, or D, the student will
continue using the Levels B, C, & D answer sheet.
If a test book becomes soiled, notify Student Assessment and
Educational Testing.
TAM, p. 24
Preparing Materials for Return
All 2010 CELLA materials must be returned to TDC as
follows:
 CHERRY return label – TO BE SCORED answer documents
 GOLDENROD return label – NOT TO BE SCORED materials
 District Coordinator Envelope
TAM, pp. 41 - 43
Preparing Materials for Return
Preparing TO BE SCORED Test Materials
 Verify that all distributed secure materials have been
returned by the test administrators.
TO BE SCORED materials include:
 Used Level A Test Books/Answer Sheets
 Used Levels B, C, and D Answer Sheets
 Documents with gridded DNS bubbles
TAM, pp. 38 - 41
Preparing Materials for Return
Preparing TO BE SCORED Test Materials
Complete the
Document Count Form
for TO BE SCORED
materials (PURPLE)
NOTE: Complete
one form per grade
level and be sure to
include documents
with gridded DNS
bubbles in your
counts.
TAM, pp. 38 - 41
Preparing Materials for Return
Preparing TO BE SCORED Test Materials
Complete the School
Return Summary for To
Be Scored materials
(RED)
NOTE: ONE PER
SCHOOL
TAM, p. 40
Preparing Materials for Return
TO BE SCORED Test Materials
 Place the School Return Summary on top of the
materials in Box 1.
 Affix the CHERRY label to the top of the box
 In the lower left corner of each CHERRY label, write
the number of the box and the total number of boxes of
TO BE SCORED materials that you are returning.
(Ex. 1 of X, 2 of X, 3 of X, etc.)
TAM, pp. 32, 42, & 45
Preparing Materials for Return
Preparing NOT TO BE SCORED Test Materials
NOT TO BE SCORED materials include:
 Unused Level A Test Books/Answer Sheets
 Unused Levels B, C, and D Answer Sheets
 Level A One-on-One Prompt Books
 Levels B, C, and D Listening & Speaking test books
(including Large Print and Braille)
 Levels B, C, and D Reading & Writing test books
(including Large Print and Braille)
 Levels A, B, C, and D Training CD’s for Speaking
 Levels A1 & B1 and Levels C1 & D1 – Listening CD’s
 Directions for Administration
TAM, pp. 32 & 42
Preparing Materials for Return
NOT TO BE SCORED Test Materials
 Place a copy of the CELLA Administration
Record/Security Checklist on top of the materials in Box 1.
 Affix the GOLDENROD label to the top of the box
 In the lower left corner of each GOLDENROD label, write
the number of the box and the total number of boxes of
NOT TO BE SCORED materials that you are returning.
(Ex. 1 of X, 2 of X, 3 of X, etc.)
TAM, pp. 32, 42 & 45
Preparing Materials for Return
Destroy at School Site
 Test Administration Manuals*
 Unused Paper Bands
 Unused Document Count Forms and School Return
Summaries
 Unused Questar Return Labels
*Keep test administration manuals until results have been provided, then destroy at
the school site.
TAM, p. 42
Preparing Materials for Return
District Coordinator ONLY Envelope
Items to include:
 Original CELLA Administration Record/Security Checklist
 Original CELLA Security Logs
 Copy of School Return Summary for the To Be Scored
Materials
 Copy of Document Count Form for To Be Scored Materials
by Grade
 Accounting for All 2010 CELLA Materials
 Train the Trainer manuals and Train the Trainer CD’s
On the front of the envelope write
“DISTRICT COORDINATOR ONLY”
Signed Administration and Security Agreements should be kept on file at your
school site.
TAM, p. 42, packet
Return of Test Materials
Materials should be returned May 3 - May 19, 2010
All test materials will be returned to:
Test Distribution Center
13135 SW 26 Street
Miami, FL 33175
305-995-3743
Return Hours: 7:30 am – 3:30 pm
Comment Form
2010 CELLA Customer Satisfaction Survey
Please access the following site after testing has been
completed.
http://www.fldoe.org/aala/CELLA.asp
One-on-One Test Administration Trainings
Region 1 – Doral Middle
April 8, AM/PM –Elementary
April 9, AM Secondary, PM Charter Schools
Region 2 – Andover Middle
April 7, AM/PM Elementary
April 8, AM Secondary, PM Charter Schools
Region 3 – Center for Professional Learning
March 24, AM/PM Elementary
March 25, AM Secondary, PM Charter Schools
Region 4 – TERRA Environmental
April 6, AM/PM Elementary
April 7, AM Secondary, PM Charter Schools
Region 5 – Robert Morgan Educational Center
April 7, AM/PM Elementary
April 8, AM Secondary, PM Charter Schools
Special Education – April 5
8:30 – 10:00 – Hialeah Middle School
1:30 – 3:20 – Arvida Middle School
Contact Information
STUDENT ASSESSMENT AND EDUCATIONAL TESTING
Felicia Mallory
[email protected]
Denetra Collins
[email protected]
305-995-7520
Fax – 305-995-7522