tac2011-Assessing-ELLs

Download Report

Transcript tac2011-Assessing-ELLs

Assessing ELLs with
STAARTM
Texas Assessment Conference
December 6, 2011

Silvia Alvarado-Bolek, Manager, STAAR Spanish
Megan Galicia, Manager, Language Accessibility
Student Assessment Division
Texas Education Agency
Disclaimer
 These
slides have been prepared by the
Student Assessment Division of the Texas
Education Agency
 If
any slide is changed for local use, please
remove the TEA footer at the bottom of the
slide
TEA - Assessing ELLs with STAAR
2
STAAR Assessment Program
General STAAR
STAAR Spanish
STAAR L
STAAR Modified
STAAR Alternate
TEA - Assessing ELLs with STAAR
3
STAAR



Grades 3–8: reading, writing, mathematics,
science, and social studies
EOC: English I–III, Algebra I, geometry, Algebra
II, biology, chemistry, physics, world
geography, world history, and U.S. history
ELLs take STAAR if they are not eligible for one
of the assessments on the slides that follow
TEA - Assessing ELLs with STAAR
4
STAAR Spanish

Available for students in grades 3–5
• Grades 3–5 reading and math
• Grade 4 writing
• Grade 5 science


Same grades and subjects are tested as
English
LPAC determines if STAAR Spanish test is the
most appropriate measure of student’s
academic progress
TEA - Assessing ELLs with STAAR
5
STAAR L
 Linguistically
accommodated versions of
STAAR grades 3–8 and EOC
• STAAR L is for math, science, and social studies
(EOC included)
• No STAAR L for reading and writing
TEA - Assessing ELLs with STAAR
6
STAAR L
Eligibility:
 Spanish-version test does not exist or is not
most appropriate measure of academic
progress for the student
 Student is in first 3 years in U.S. schools (unless
unschooled asylee/refugee, then first 5)
 Student has not yet reached advanced high
rating on TELPAS reading test
TEA - Assessing ELLs with STAAR
7
STAAR Modified and STAAR Alternate
 ELLs
receiving special education services who
meet participation requirements for STAAR
Modified or STAAR Alternate may participate in
these assessments
 More
information about STAAR Modified and
STAAR Alternate is available at
http://www.tea.state.tx.us/student.assessment
/special-ed/
TEA - Assessing ELLs with STAAR
8
STAAR, STAAR Spanish, and STAAR L Alignment
Common features:
 Same assessed curriculum
 Same item types
 Same STAAR blueprints for building tests
 Same achievement standard alignment
 Same focus on readiness for next grade level
or course and ultimately postsecondary
readiness
TEA - Assessing ELLs with STAAR
9
STAAR, STAAR Spanish, STAAR L Alignment
Differences have to do with language
accessibility:
 STAAR Spanish uses native language to help
students understand test
 STAAR L provides English-language
accommodations to help students understand
test
TEA - Assessing ELLs with STAAR
10
Linguistic Accommodations in
STAAR Program
 Linguistic
accommodations are not just for STAAR L
(Linguistic accommodations beyond testing in primary
language do not apply to STAAR Spanish)
TEA - Assessing ELLs with STAAR
11
Linguistic Accommodations–
STAAR
TEA - Assessing ELLs with STAAR
12
Linguistic Accommodations–
STAAR L
*Provided by test administrator in 2012; by computer in 2013
TEA - Assessing ELLs with STAAR
13
Linguistic Accommodations–
STAAR Modified
*Unique to STAAR Modified
TEA - Assessing ELLs with STAAR
14
Decision-Making Body



LPAC is responsible for obtaining teacher input and making
assessment and linguistic accommodation decisions for
ELLs
For ELLs served by special education, the ARD committee
and LPAC work in conjunction to make these decisions
More information about procedures for LPACs and ARD
committees to follow in making and documenting ELL
assessment and accommodation decisions will be available
from TEA ELL Assessments webpage
Linguistic accommodation and assessment decisions
are not “automatic;” they are made on an individual
student basis in accordance with TEA administrative
procedures
TEA - Assessing ELLs with STAAR
15
STAAR
TEA - Assessing ELLs with STAAR
16
STAAR Standard Setting Activities


Performance standards for EOC assessments
will be set in spring of 2012
Performance standards for grades 3–8 will be
set in fall 2012
TEA - Assessing ELLs with STAAR
17
STAAR Retests
 First
EOC retests will be in summer 2012
 First SSI retests will be in spring 2013
TEA - Assessing ELLs with STAAR
18
STAAR Annual Item Development Activities






Testing contractor develops items from assessed TEKS
curriculum
TEA curriculum and assessment staff review and revise proposed
items
Committees of Texas educators review and revise items before
field testing
Items are field-tested with large samples of Texas students
Field-test data are analyzed for reliability, validity, and possible
bias
Tests are built from the item bank to meet STAAR blueprint
specifications
TEA - Assessing ELLs with STAAR
19
Steps for Ensuring Transadaptability
STAAR Spanish
Math and science: Transadapted from English-version items
•New English items are reviewed by bilingual contractor and TEA staff
for linguistic and cultural appropriateness to support Spanish
transadaptability
•Bilingual educators review English and Spanish version items to ensure
transadaptations assess content comparably and are worded
appropriately
Reading and writing: Not transadapted; separately developed
•Contractor and TEA staff collaborate during item development, item
review, and test construction processes to ensure that test
specifications are interpreted same way
•Bilingual educators follow same process and guidelines to review
Spanish-version items as educator committees who review Englishversion items
TEA - Assessing ELLs with STAAR
20
Steps for Ensuring Language Accessibility of
STAAR L
STAAR L items are STAAR English-version items
 Contractor and TEA staff, including second
language acquisition specialists, collaborate
during item development and review processes to
create test items that are —
•grade-appropriate
•succinct and worded in a straightforward way
•accessible to diverse student populations

TEA - Assessing ELLs with STAAR
21
STAAR SAMPLE ITEMS

MATHEMATICS & SCIENCE
TEA - Assessing ELLs with STAAR
22
STAAR and STAAR L Grade 3 Math
Classify Geometric Figures
TEA - Assessing ELLs with STAAR
23
STAAR
STAAR Spanish
Spanish Grade
Grade 33 Math
Math
Classify geometric figures
TEA - Assessing ELLs with STAAR
24
STAAR and STAAR L Grade 5 Science
Boiling Point
TEA - Assessing ELLs with STAAR
25
STAAR Spanish Grade 5 Science
Boiling Point
TEA - Assessing ELLs with STAAR
26
STAAR SAMPLE ITEMS

READING & WRITING
TEA - Assessing ELLs with STAAR
27
STAAR Grade 4 Writing
Topic Sentence
TEA - Assessing ELLs with STAAR
28
STAAR Spanish Grade 4 Writing
Topic Sentence
TEA - Assessing ELLs with STAAR
29
STAAR Grade 5 Reading
Theme/Drama
TEA - Assessing ELLs with STAAR
30
STAAR Spanish Grade 5 Reading
Theme/Drama
TEA - Assessing ELLs with STAAR
31
STAAR L — 2013 and Beyond
TEA - Assessing ELLs with STAAR
32
STAAR L for 2013 and Beyond
 STAAR
L will continue to be for —
• grades 3–8 and EOC
• math, science, and social studies
 2013
and beyond – online testing program
• Clarification and read-aloud
accommodations provided by teachers in
2012 will be built into the online system
TEA - Assessing ELLs with STAAR
33
STAAR L Linguistic Accommodations
TEA - Assessing ELLs with STAAR
34
Preview of STAAR L 2013 and Beyond
TEA - Assessing ELLs with STAAR
35
Preview of STAAR L 2013 and Beyond

Examples of language to be clarified in online system
(as long as assessed content words not clarified):
•
•
•
•
•
•
•
•
Vocabulary including idiomatic language and colloquialisms
Long clauses and difficult conjunctions
Difficult prepositions or series of prepositional phrases
Complex verb tenses or difficult irregular verb forms
Passive voice
Complex question phrases
Difficult word order
Contexts that may be culturally unfamiliar or confusing
TEA - Assessing ELLs with STAAR
36
Preview of STAAR L 2013 and Beyond
Steps in development of STAAR L
Obtained input from grade-level and content area
teachers and specialists in second language
acquisition, large-scale assessment, and curriculum
(February 2011)
 Conducted cognitive lab/usability study to obtain
student feedback on effectiveness of
accommodations and usability of online system
(October 2011)

TEA - Assessing ELLs with STAAR
37
Preview of STAAR L 2013 and Beyond
Next steps



May 2012 larger-scale STAAR L online study of two high
school subjects to refine accommodation guidelines and
online interface
Review of read-aloud technology
Summer/fall 2012 educator review committees to review
STAAR L items online
TEA - Assessing ELLs with STAAR
38
ADDITIONAL RESOURCES
TEA - Assessing ELLs with STAAR
39
STAAR Resources Webpage
See information such as —
 Q & A
 Sample questions
 PowerPoint presentations
 STAAR assessment comparison chart
 STAAR brochures in English and Spanish
 STAAR dictionary policy for language arts tests
www.tea.state.tx.us/student.assessment/staar
TEA - Assessing ELLs with STAAR
40
STAAR Accommodation Information
Accommodation Resources webpage
 Information about
• accommodations for students with disabilities
(periodically updated)
• linguistic accommodations for ELLs (coming soon)
www.tea.state.tx.us/student.assessment/
accommodations
TEA - Assessing ELLs with STAAR
41
Recommendations for
Educator Review Committees

As part of test development process for the state
assessments, TEA convenes committees of educators
each year to review items for state assessment
programs

Committees assembled from database of recommended
educators

Need recommendations for educators who have
experience working with ELLs
Recommendation forms available at
http://www.tea.state.tx.us/student.assessment/
RecommendationEducatorCommittee.pdf
TEA - Assessing ELLs with STAAR
42
Contact Information
 Go
to www.tea.state.tx.us/student.assessment
and click on English Language Learner
Assessments
 E-mail
us at [email protected]
 Call
the TEA Student Assessment Division at
(512) 463-9536
TEA - Assessing ELLs with STAAR
43