Transcript ELPA Pre-ID and Demographic Update Process

MICHIGAN
ENGLISH LANGUAGE PROFICIENCY ASSESSMENT
Administering and Scoring
the ELPA Initial Screening
Fall 2006
Michigan Department of Education
1
Welcome
Marilyn Roberts, Director
Office of Educational Assessment
and Accountability (OEAA)
MICHIGAN
2
ENGLISH LANGUAGE PROFICIENCY ASSESSMENT
Welcome
To Download this Power Point,
Go to www.mistreamnet.com
MICHIGAN
3
ENGLISH LANGUAGE PROFICIENCY ASSESSMENT
Welcome
To order Videotapes or DVDs
Contact Brenda Hose
E-mail: [email protected]
Phone: 734-334-1437
MICHIGAN
4
ENGLISH LANGUAGE PROFICIENCY ASSESSMENT
Welcome
Questions?
E-mail: [email protected]
Fax: 734-334-1857
MICHIGAN
5
ENGLISH LANGUAGE PROFICIENCY ASSESSMENT
Part 1: ELPA Initial Screening
• First statewide administration
• Meeting Federal Requirements
• Which students are assessed
• Assessment Accommodations
MICHIGAN
6
ENGLISH LANGUAGE PROFICIENCY ASSESSMENT
Part 1: ELPA Initial Screening
• Administration Schedule
• Who can Administer the ELPA
• Security
MICHIGAN
7
ENGLISH LANGUAGE PROFICIENCY ASSESSMENT
Part 1: ELPA Initial Screening
First Statewide Administration
• Second step in improving
assessment of English language
learners (ELLs)
• Creates a more uniform
standards-based measure for
eligibility
MICHIGAN
8
ENGLISH LANGUAGE PROFICIENCY ASSESSMENT
Part 1: ELPA Initial Screening
Meeting Federal Requirements
• 3 Proficiency levels are linked to
required annual administration
• Based on state-adopted English
language proficiency standards
• Reporting of listening, reading,
writing, speaking, & comprehension
MICHIGAN
9
ENGLISH LANGUAGE PROFICIENCY ASSESSMENT
Part 1: ELPA Initial Screening
Meeting Federal Requirements
Title VI requires the use of the
Home Language Survey to
determine potential eligibility for
services at the time of
enrollment.
MICHIGAN
10
ENGLISH LANGUAGE PROFICIENCY ASSESSMENT
Part 1: ELPA Initial Screening
Meeting Federal Requirements
Home language survey—
1. Is your child’s native tongue a
language other than English?
2. Is the primary language used in
your child’s home or environment a
language other than English?
MICHIGAN
11
ENGLISH LANGUAGE PROFICIENCY ASSESSMENT
Part 1: ELPA Initial Screening
Meeting Federal Requirements
Home language survey—
If the answer to either question
is “YES”, the child is assessed
to determine eligibility of
services.
MICHIGAN
12
ENGLISH LANGUAGE PROFICIENCY ASSESSMENT
Part 1: ELPA Initial Screening
Which Students Are Assessed
• Student is assessed with English
language proficiency assessment—
ELPA Initial Screening
• Students scoring below proficient are
eligible for Title III services.
MICHIGAN
13
ENGLISH LANGUAGE PROFICIENCY ASSESSMENT
Part 1: ELPA Initial Screening
Which Students Are Assessed
• All students in grades K-12 who are
eligible for Title III services and were
not assessed with ELPA last spring.
• Public schools, charter schools, private
schools with public school assessment
agreements.
MICHIGAN
14
ENGLISH LANGUAGE PROFICIENCY ASSESSMENT
Part 1:ELPA Initial Screening
Assessment Accommodations
• All students with disabilities who are
potential ELLs are to be screened
• Refer to Assessment Accommodations
Summary Table for ELPA specifics
MICHIGAN
15
ENGLISH LANGUAGE PROFICIENCY ASSESSMENT
Part 1: ELPA Initial Screening
Assessment Accommodations
• Use of an accommodation is based
on documentation in school
record.
• Decision to be made on studentby-student basis
MICHIGAN
16
ENGLISH LANGUAGE PROFICIENCY ASSESSMENT
Part 1: ELPA Initial Screening
Assessment Accommodations
• Nonstandard accommodations
change construct being measured.
• Students using nonstandard
accommodations will not count as
being assessed for participation
MICHIGAN
17
ENGLISH LANGUAGE PROFICIENCY ASSESSMENT
Part 1: ELPA Initial Screening
Administration Schedule
• Continuous session for each part
or section
– Writing section has two parts
– Reading for K-2 has two parts
MICHIGAN
18
ENGLISH LANGUAGE PROFICIENCY ASSESSMENT
Part 1: ELPA Initial Screening
ELPA is untimed, numbers of
items provide guide for
administrative planning purposes.
MICHIGAN
19
ENGLISH LANGUAGE PROFICIENCY ASSESSMENT
Part 1:ELPA Initial Screening
Who can Administer the ELPA
• ELPA District Coordinator
• ELPA Building Coordinator
• ELPA Assessment Administrators
• ELPA Assessment Proctors
MICHIGAN
20
ENGLISH LANGUAGE PROFICIENCY ASSESSMENT
Part 1:ELPA Initial Screening
Security
• ELPA is a secure assessment.
• All ELPA materials must be kept
secure.
• All materials are to be returned to
MDE/ELPA in Lansing.
MICHIGAN
21
ENGLISH LANGUAGE PROFICIENCY ASSESSMENT
Plan: ELPA Initial Screening
Security
• ELPA Confidentiality and Security
Agreement
– For all involved in ELPA administration
process
– For everyone handling ELPA materials
MICHIGAN
22
ENGLISH LANGUAGE PROFICIENCY ASSESSMENT
Part 1: ELPA Initial Screening
To Download this Power Point,
Go to www.mistreamnet.com
MICHIGAN
23
ENGLISH LANGUAGE PROFICIENCY ASSESSMENT
Part 1: ELPA Initial Screening
Questions?
E-mail: [email protected]
Fax: 734-334-1857
MICHIGAN
24
ENGLISH LANGUAGE PROFICIENCY ASSESSMENT
Part 2: Preparing for the ELPA
ELPA Features and Materials
Mary Bowles, Assessment
Development Manager
Harcourt Assessment, Inc.
Marilyn Roberts, Director
Office of Educational Assessment
and Accountability (OEAA)
MICHIGAN
25
ENGLISH LANGUAGE PROFICIENCY ASSESSMENT
ELPA Features and Materials
• Manual for Building and District
Coordinators with Directions for
Administration and Scoring
• Audiotapes or CDs for Listening
MICHIGAN
26
ENGLISH LANGUAGE PROFICIENCY ASSESSMENT
ELPA Features and Materials
Manual for Building and District Coordinators with
Directions for Administration and Scoring:
• Table of Contents
• Part A Chart - Page 8
• Part B Chart – Page 9
• Sample Demographic Page – Page 16
• Will be linked on web site
MICHIGAN
27
ENGLISH LANGUAGE PROFICIENCY ASSESSMENT
Part 2: ELPA Initial Screening
Two Parts
Part A— Initial screening
Part B— Item Pilots
MICHIGAN
28
ENGLISH LANGUAGE PROFICIENCY ASSESSMENT
Features of the ELPA
Part A Sections and Items
Section
Items
• Listening
8-9
• Reading
8
• Writing
4-6
• Speaking
4
MICHIGAN
29
ENGLISH LANGUAGE PROFICIENCY ASSESSMENT
ELPA Features and Materials
Part A:
• Contains all four domains: Listening,
Reading, Writing and Speaking
• Contains existing items
MICHIGAN
30
ENGLISH LANGUAGE PROFICIENCY ASSESSMENT
ELPA Features and Materials
Part B:
• Short sections, or forms (you’ll
administer only one form per level)
• Will cover one, or possibly two,
domains
• Contains newly developed items
MICHIGAN
31
ENGLISH LANGUAGE PROFICIENCY ASSESSMENT
ELPA Features and Materials
LEVELS:
• Level I Pilot = for fall Kindergarten
students; Listening and Speaking
only
• Level I = for fall Grade 1 students
MICHIGAN
32
ENGLISH LANGUAGE PROFICIENCY ASSESSMENT
ELPA Features and Materials
LEVELS (contd):
• Level II = for fall students in Grades 2-3
• Level III = for fall students in Grades 4-6
• Level IV = for fall students in Grades 7-9
• Level V = for fall students in Grades 1012
MICHIGAN
33
ENGLISH LANGUAGE PROFICIENCY ASSESSMENT
ELPA Features and Materials
Part A - Levels I - II (Grades 1-3):
• Students write in Test Booklets
• Contains Demographic Page on back
of Test Booklet
• Separate Speaking booklets
(reusable)
MICHIGAN
34
ENGLISH LANGUAGE PROFICIENCY ASSESSMENT
ELPA Features and Materials
Part A - Levels I - II (contd)
• Speaking Test Scoring Form (in
Test Booklet)
• A box is provided at end of each
section for recording score
MICHIGAN
35
ENGLISH LANGUAGE PROFICIENCY ASSESSMENT
ELPA Features and Materials
Part A – Levels III-V:
• All 4 domains are in student Test
Booklet
• Students will write all answers
for Part A and Part B in Answer
Document
MICHIGAN
36
ENGLISH LANGUAGE PROFICIENCY ASSESSMENT
ELPA Features and Materials
Part A – All Levels:
• Answer Key (in Manual/DFA)
• Test Administrator will score all
sections
• Optional Student Record Sheet (in
Manual DFA)
MICHIGAN
37
ENGLISH LANGUAGE PROFICIENCY ASSESSMENT
ELPA Features and Materials
Part B – Levels I-II:
• Students write in Test Booklet
• Students take only one form
• Covers only one language domain
• Demographic Page on back
MICHIGAN
38
ENGLISH LANGUAGE PROFICIENCY ASSESSMENT
ELPA Features and Materials
Part B – Level III:
• Students take only one form
• Students write in corresponding
Answer Document
• Covers only one language domain
MICHIGAN
39
ENGLISH LANGUAGE PROFICIENCY ASSESSMENT
ELPA Features and Materials
Part B – Levels IV and V:
• Students take only one form
• Students write in corresponding
Answer Document
• May cover one language domain or
students may take a combination of
Listening and Speaking, or Reading
and Writing
MICHIGAN
40
ENGLISH LANGUAGE PROFICIENCY ASSESSMENT
ELPA Features and Materials
Answer Document:
• Use for Levels III - V
• Contains both Parts A and B
• Contains Table of Contents
• Contains Demographic Page
• Contains Rubrics for Writing and
Speaking, Part A and Speaking, Part B
MICHIGAN
41
ENGLISH LANGUAGE PROFICIENCY ASSESSMENT
ELPA Features and Materials
Manual for Building and District
Coordinators
• Student Record Sheet – Page 19
• Part A Answer Key – Page 20
• Specific Directions for Administering
include tabs
MICHIGAN
42
ENGLISH LANGUAGE PROFICIENCY ASSESSMENT
ELPA Features and Materials
Manual for Building and District
Coordinators
• Contains both Writing and Speaking
Rubrics for Part A
• Contains Speaking Rubrics for Part B
MICHIGAN
43
ENGLISH LANGUAGE PROFICIENCY ASSESSMENT
Features of the ELPA
Four Sections:
• Listening
• Reading
• Writing
• Speaking
MICHIGAN
44
ENGLISH LANGUAGE PROFICIENCY ASSESSMENT
Preparing for ELPA: Part 2
Questions?
E-mail: [email protected]
Fax: 734-334-1857
MICHIGAN
45
ENGLISH LANGUAGE PROFICIENCY ASSESSMENT
Part 2: Administering the ELPA
Scoring the Speaking Section
• Types of Speaking Responses
– Sentence Completion
– Storytelling
– Story Retell
MICHIGAN
46
ENGLISH LANGUAGE PROFICIENCY ASSESSMENT
Grades 9-12
MICHIGAN
47
ENGLISH LANGUAGE PROFICIENCY ASSESSMENT
Copyright 2006 by Harcourt Assessment, Inc.
Speaking Scoring Form
Example
MICHIGAN
48
ENGLISH LANGUAGE PROFICIENCY ASSESSMENT
Copyright 2006 by Harcourt Assessment, Inc.
Grades K-2
49
MICHIGAN
ENGLISH LANGUAGE PROFICIENCY ASSESSMENT
Copyright 2006 by Harcourt Assessment, Inc.
Part 2: Preparing for ELPA
Questions?
E-mail: [email protected]
Fax: 734-334-1857
MICHIGAN
50
ENGLISH LANGUAGE PROFICIENCY ASSESSMENT
Part 2: Preparing for ELPA
To Download this Power Point,
Go to www.mistreamnet.com
MICHIGAN
51
ENGLISH LANGUAGE PROFICIENCY ASSESSMENT
Part 3: Scoring and Reporting
Mike Konzman, Technical Consultant
Office of Educational Assessment
and Accountability (OEAA)
Phil Chase, ELPA Specialist
Office of Educational Assessment
and Accountability (OEAA)
MICHIGAN
52
ENGLISH LANGUAGE PROFICIENCY ASSESSMENT
ELPA Initial Screening
• Ordering Additional Materials
• Creating ELPA Screener Users
• ELPA Screener Entry Screen
• Changing ELPA Screener Information
• ELPA Screener Reports
MICHIGAN
53
ENGLISH LANGUAGE PROFICIENCY ASSESSMENT
Ordering Additional Materials
Determine which students are new at
your school. The OEAA secure site will
list students who have taken the ELPA in
the spring. The ELPA Initial Screening
will be used for students who are new to
your school and who have not taken the
previous ELPA.
MICHIGAN
54
ENGLISH LANGUAGE PROFICIENCY ASSESSMENT
Ordering Additional Materials
• Additional Assessment materials
– If additional materials are needed,
contact your ELPA Building
Coordinator.
– Specify the type and amount of
materials.
MICHIGAN
55
ENGLISH LANGUAGE PROFICIENCY ASSESSMENT
Creating an ELPA Screener User
In order to enter student scores or access reports, you
must be designated as an ELPA Screener User.
•
•
Click on Users from the menu at the left.
Click on the New button to the right.
MICHIGAN
56
ENGLISH LANGUAGE PROFICIENCY ASSESSMENT
Creating an ELPA Screener User
The fields in red are required. Type will be either district or
school depending on required access. User ID can be
alpha and/or numeric. Primary Role will be ELPA
Screener.
MICHIGAN
57
ENGLISH LANGUAGE PROFICIENCY ASSESSMENT
Creating an ELPA Screener User
After all red fields are completed, click on the SAVE button at
the top right. A message will display at the bottom. Either
the record was successfully added to the database or the
User ID already exists. If user ID already exists, you will
need to complete the screen again, using a different user
ID.
MICHIGAN
58
ENGLISH LANGUAGE PROFICIENCY ASSESSMENT
ELPA Screener Entry Screen
1. Log into the secure OEAA Web site.
2. Click on ELPA Screener
Entry on the menu at the left
(on top).
MICHIGAN
59
ENGLISH LANGUAGE PROFICIENCY ASSESSMENT
ELPA Screener Entry Screen
MICHIGAN
60
ENGLISH LANGUAGE PROFICIENCY ASSESSMENT
ELPA Screener Entry Screen
3. Enter student demographics.
MICHIGAN
61
ENGLISH LANGUAGE PROFICIENCY ASSESSMENT
ELPA Screener Entry Screen
4. Enter Score information for Part A. Use
the pull-down menus to enter in the raw
scores for each language domain.
Note: Make sure you have
correctly selected the
student’s grade level
before entering scores
for Part A.
MICHIGAN
62
ENGLISH LANGUAGE PROFICIENCY ASSESSMENT
ELPA Screener Entry Screen
5. Next, click the check-boxes for each
standard accommodation that you
provided to the student at the time of
testing.
MICHIGAN
63
ENGLISH LANGUAGE PROFICIENCY ASSESSMENT
ELPA Screener Entry Screen
6. Indicate whether this student completed a
Part B form.
7(a). If the answer is no, immediately save
this student data by clicking on the
“Save” button at the top of the screen.
MICHIGAN
64
ENGLISH LANGUAGE PROFICIENCY ASSESSMENT
ELPA Screener Entry Screen
7(b). If the answer is yes, the screen will
automatically refresh with a pull-down
menu so that you can enter the Part B
form number.
8. Select the correct form number.
MICHIGAN
65
ENGLISH LANGUAGE PROFICIENCY ASSESSMENT
ELPA Screener Entry Screen
The screen will automatically refresh,
showing one pull-down menu for every
item on the Part B form that your student
took.
Each pull-down menu is coded to accept a
letter answer choice or a numerical
rubric score.
MICHIGAN
66
ENGLISH LANGUAGE PROFICIENCY ASSESSMENT
ELPA Screener Entry Screen
Note: If your student completed a Writing
form for Part B, you will not enter in
scores. Instead, the screen will display
directions for sending in the Writing Part
B forms to the OEAA.
MICHIGAN
67
ENGLISH LANGUAGE PROFICIENCY ASSESSMENT
ELPA Screener Entry Screen
9. Enter in the student’s actual answer
choices for Part B. The pull-down
menus for Speaking forms will not be
multiple-choice letter options; they will
be numerical rubric scores for items that
are scored by the teacher at the time of
testing.
MICHIGAN
68
ENGLISH LANGUAGE PROFICIENCY ASSESSMENT
ELPA Screener Entry Screen
If a student did not answer an
item, use the “NR” (no
response) option for that item.
MICHIGAN
69
ENGLISH LANGUAGE PROFICIENCY ASSESSMENT
ELPA Screener Entry Screen
When you have finished
entering in all scores and
accommodations, save
student data by clicking on
the “Save” button at the top
of the screen.
The student is now registered
for the Fall 2006 ELPA
Screener test cycle.
70
MICHIGAN
ENGLISH LANGUAGE PROFICIENCY ASSESSMENT
ELPA Student Record Sheet
Page 19,
Directions for
Administration
MICHIGAN
71
ENGLISH LANGUAGE PROFICIENCY ASSESSMENT
ELPA Student Record Sheet
•
The Student Record Sheet is an optional
form that you may use if someone else is
going to enter in scores for your students.
•
One form should be photocopied for each
student. Teachers or test administrators
may then enter in Part A raw scores and
Part B answer choices or rubric scores on
the Student Record Sheet.
MICHIGAN
72
ENGLISH LANGUAGE PROFICIENCY ASSESSMENT
Changing ELPA Screener Info
1.
2.
Click on Student Search on the
menu at the left (on top).
Enter search information and click
the search button.
MICHIGAN
73
ENGLISH LANGUAGE PROFICIENCY ASSESSMENT
Changing ELPA Screener Info
3.
4.
Students matching the search criteria will be
displayed.
Select the student to be updated by clicking on the
student name link.
MICHIGAN
74
ENGLISH LANGUAGE PROFICIENCY ASSESSMENT
Changing ELPA Screener Info
5.
6.
Test cycles for the student selected will be
displayed.
Select the “Fall 2006 ELPA Screener – 2006” link.
MICHIGAN
75
ENGLISH LANGUAGE PROFICIENCY ASSESSMENT
Changing ELPA Screener Info
7.
The ELPA Screener page will be displayed and the
student’s information can be changed.
MICHIGAN
76
ENGLISH LANGUAGE PROFICIENCY ASSESSMENT
ELPA Screener Reports
1. Click ELPA Screener Reports from the
menu at the left.
2. Click Submit for reports and Download for a
csv file of student score data.
MICHIGAN
77
ENGLISH LANGUAGE PROFICIENCY ASSESSMENT
ELPA Screener Reports
Sample of
Individual
Student
Report for
the ELPA
Initial
Screening
MICHIGAN
78
ENGLISH LANGUAGE PROFICIENCY ASSESSMENT
ELPA Screener Reports
The Individual Student Report provides:
• an overall scale score for the student’s
performance
• number of points earned and total points
possible
• a letter code for the student’s proficiency
level.
MICHIGAN
79
ENGLISH LANGUAGE PROFICIENCY ASSESSMENT
ELPA Screener Reports
Also, a graphical representation compares
this student’s score with cuts for Basic (B),
Intermediate (I), and Proficient (P).
MICHIGAN
80
ENGLISH LANGUAGE PROFICIENCY ASSESSMENT
ELPA Screener Reports
The “cut score” is the minimum expected
score that a student would achieve if he
or she were Proficient in English at his or
her grade level.
Note that although it is not pictured here,
the Comprehension language domain
will also be reported.
MICHIGAN
81
ENGLISH LANGUAGE PROFICIENCY ASSESSMENT
ELPA Screener Reports
Sample of
Class
Roster
Report for
the ELPA
Initial
Screening
MICHIGAN
82
ENGLISH LANGUAGE PROFICIENCY ASSESSMENT
ELPA Screener Reports
The Class Roster Report provides:
• the same scale score data shown on the
Individual Student Reports for all
students in one class or group
• total of the number of students tested in
each group, grade, and school.
Note again that although it is not pictured
here, the Comprehension language
domain will also be reported.
MICHIGAN
83
ENGLISH LANGUAGE PROFICIENCY ASSESSMENT
Part 3: Scoring and Reporting
• Ending an Assessment Session
– ELPA is untimed (over when students
finish)
– Collect materials from students
individually
– Lock up materials between
ELPA sessions
MICHIGAN
84
ENGLISH LANGUAGE PROFICIENCY ASSESSMENT
Part 3: Scoring and Reporting
• After an Assessment Session
– One answer document per student
– Demographic information filled in
– Follow directions to provide scoring
MICHIGAN
85
ENGLISH LANGUAGE PROFICIENCY ASSESSMENT
ELPA Student Demographic Page
MICHIGAN
86
ENGLISH LANGUAGE PROFICIENCY ASSESSMENT
Part 3: Scoring and Reporting
• After an Assessment Session
– Return all completed assessment
materials to MDE/ELPA
– Return Security Compliance Forms
– Return Directions for Administration to
the ELPA Coordinator
MICHIGAN
87
ENGLISH LANGUAGE PROFICIENCY ASSESSMENT
Part 3: Scoring and Reporting
Returning Materials to MDE/ELPA
• Student Demographic Page
• Returning Materials
MICHIGAN
88
ENGLISH LANGUAGE PROFICIENCY ASSESSMENT
Part 3: Scoring and Reporting
• Save boxes for returning materials
• Labels: orange for scorable and green for
nonscorable
• Building and District Identification Sheets: Use
Identification sheets as cover sheets for banded
sets of returned materials
• Security Forms
MICHIGAN
89
ENGLISH LANGUAGE PROFICIENCY ASSESSMENT
Part 3: Scoring and Reporting
Returning Materials to MDE/ELPA
• Place an identification sheet on top of
each basic reporting unit
• Review packaging instructions in Test
Coordinator Manual
• No shipping fee
MICHIGAN
90
ENGLISH LANGUAGE PROFICIENCY ASSESSMENT
Packaging Diagram for Return
MICHIGAN
91
ENGLISH LANGUAGE PROFICIENCY ASSESSMENT
Part 3: Scoring and Reporting
Returning Materials to MDE/ELPA
OEAA Address
MDE/ELPA
Hannah Building, Upper Level 201S
608 W. Allegan Street
Lansing, MI 48933
MICHIGAN
92
ENGLISH LANGUAGE PROFICIENCY ASSESSMENT
Michigan ELPA Dates to Remember
• September 6-7, 2006
– Districts receive materials
• September 8-October 4, 2006
– Test administration window
• October 6, 2006
– Last day to receive materials
MICHIGAN
93
ENGLISH LANGUAGE PROFICIENCY ASSESSMENT
Resource Information
• Instructions for website usage can be
found on the login page of the secure
website, www.michigan.gov/meap-secure
by clicking on the pink link titled
Enhancement How-to Documents
• Help with accommodations can be found
at (517) 335-0471
MICHIGAN
94
ENGLISH LANGUAGE PROFICIENCY ASSESSMENT
Resource Information
• Administration Manual and Coordinators
Handbooks
• Call 877-560-8378 for assistance with the
OEAA secure Web site
• E-mail [email protected] for assistance
with the OEAA secure Web site for ELPA
MICHIGAN
95
ENGLISH LANGUAGE PROFICIENCY ASSESSMENT
Comments and Suggestions
Marilyn Roberts
[email protected]
(517) 335-0567
Phil Chase
[email protected]
(517) 335-3967
Michigan Department of Education
608 W. Allegan St.
P.O. Box 30008
Lansing, MI 48909
MICHIGAN
96
ENGLISH LANGUAGE PROFICIENCY ASSESSMENT
Thank You!
• Wayne RESA Technical Staff
• MAISA’s network of videoconference sites
MICHIGAN
97
ENGLISH LANGUAGE PROFICIENCY ASSESSMENT