Transcript DAC training for the COE

District Assessment Coordinator
Training for the COE
2014-15
Collection of Evidence
Office of Superintendent of Public Instruction
•
•
•
•
•
•
•
•
•
What’s new?
Calendar for 2014-15
DAC responsibilities and preparation
Policies
Test Security
Test Irregularities
Tools and manipulatives
Principal, teacher and student responsibilities
For Assistance
7/17/2015
Topics
2
Similar to the HSPE and EOC proctor training, the COE training is
designed to provide the critical information to appropriately
implement the COE assessment.
7/17/2015
COE Teacher Training
It is expected that all COE teachers participate in this training
prior to implementing the COE assessment. The District
Assessment Coordinator should communicate this expectation
to COE educators.
3
Teachers are expected to:
1. Utilize the COE Teacher Training Checklist to indicate the
completion date of the training items below
2. Read the Guidelines for the COE
3. Register for and participate in a COE webinar
4. Read, sign and date the Test Security Acknowledgement
5. Deliver the checklist and Acknowledgement Form to their
Building Administrator (to be retained in the educators file)
7/17/2015
Teacher Training
4
What’s New
Augmentation is no longer available - subsequent COEs are available to any
student who did not meet standard with their full COE.
DAC online page to:
• assist with tracking student eligibility
• approve subsequent submissions
• process test irregularities
7/17/2015
Students may access the COE after one attempt at the HSPE or EOC.
Teacher online page to:
• Add/remove students to groups
• Activate and move students within the system
Transition to COE based on Common Core standards
A “Basic” cut-score is available for use by students receiving special education
services, if determined appropriate by the IEP team
5
COE calendar for 2014-15
Submission
Date
Content
Who May Submit
January 28,
2015
Reading, Writing,
Mathematics and Biology
Students in the 2015 or earlier graduation cohort who have March 25, 2015
attempted the state assessment one time.
Reading, Writing,
Mathematics and Biology
All score appeals.
Subsequent submissions for students in the 2015 or earlier
graduation cohort
May 29, 2015
April 29, 2015
June 10, 2015 Reading, Writing,
Mathematics and Biology
All students who meet the eligibility requirements.
All score appeals.
Scores on WAMS
7/17/2015
Collection of Evidence Submission Dates 2014-2015
July 24, 2015- Reading and
Writing
August 14, 2015Mathematics and Biology
*COE augmentation is no longer available. A subsequent COE is available to any student who did not
meet standard with their original collection. Additional information can be found at:
http://www.coe.k12.wa.us/Page/124
6
Submission
SCORES ON WAMS
ISR and stipend reports
shipped to district
January 28, 2015
Reading, Writing,
Biology and Mathematics
March 25, 2015
April 24, 2015
April 29, 2015
Reading, Writing,
Biology and Mathematics
May 29, 2015
September 11, 2015
June 10, 2015
Reading and Writing:
July 24, 2015
Biology and Mathematics:
August 14, 2015*
September 11, 2015
7/17/2015
Post scoring
WAMS, Score and Stipend reports
7
Oversight of COE implementation in the district to include:
Initiate teacher training
Student access to COE
Data tracking of student participation
Approval of subsequent COEs
Test irregularity investigations
Test security investigations
‘Submitting your COE’ process
Shipping process for math COEs
Main OSPI COE contact
7/17/2015
DAC Responsibilities
8
DAC-Preparation for COE
• Know where the COE forms can be found
• Identify COE educators for each high school in the district
• Understand what the teachers need to learn and know about
the COE
7/17/2015
• Read the COE Guidelines and Policies
• Review the ‘Admin information’ page on the COE website
• provide the necessary support and learning time required
• Review the COE teacher training packet
• Ask each educator to attend the COE training prior to working
with students on the assessment
• Track teacher attendance for training
9
• Ensure that student data in your Student Information System
is up to date
• Identify students that are eligible for the COE
• Inform school of COE students
• Keep track of COE students’:
7/17/2015
DAC - Student Data
• Progress
• Submissions
• Score results
• Manage eligibility issues well ahead of the submission dates
• Process forms for Direct Access
• Log into COE system and approve ‘subsequent’ submissions
for students
10
EDS Log-in
Roles for eCOE:
• DAC must have eCOEDistrictAssessmentCoordinator and
eCOEDistrictAdmin
• Principal must have eCOESchoolPrincipal
• Teacher roles:
•
•
•
•
eCOESchoolAdvisorReading
eCOESchoolAdvisorWriting
eCOESchoolAdvisorBiology
eCOESchoolAdvisorMath
7/17/2015
District and School Personnel must have access to eCOE
roles in EDS (provided by the District Security Manager).
11
Make sure all students that should be submitting a COE, actually
have the COE submitted.
1. Log in to eCOE through EDS.
2. Click the “Status Summary” link on the top left.
3. This screen will show you the current status of every student
who is enrolled in COE.
4. If a student submission is complete, the status will be
“Submitted to OSPI”
5. If the status is “Teacher signature” or “Principal Signature”
then the work has not been submitted.
6. All approvals must be completed by 5:00 on the submission
deadline date.
7. To download the information to a spreadsheet, click the
“Export to Excel” button in the top right.
7/17/2015
DAC-Submission confirmation
12
1.
COE policies are revised each year
2.
COE policies can be found at:
http://www.coe.k12.wa.us/Page/124
3.
We will communicate revised or new policies through the
Washington Assessment Weekly and as a COE e-alert
7/17/2015
Policies
13
1.
2.
3.
4.
Any student who has attempted the state test one time
and not met standard
Transfer students who are eligible through the Direct
Access protocols
Students who have been authorized to complete a
subsequent COE
Students in the graduation cohort of 2015 or earlier
(winter submission is only for these students)
7/17/2015
Who can submit a COE ?
14
Students have an opportunity to submit a subsequent COE after not
meeting standard on a previous one. A subsequent COE must follow
similar protocols for submission as those for original COEs in terms of
using inclusion bank tasks, meeting sufficiency requirements and
submitting the collection during the submission windows published by the
state.
7/17/2015
Subsequent COE policy
Subsequent COEs do not qualify for the stipend and incur a $200 scoring
fee. District Assessment Coordinators must authorize the development of
a subsequent COE. Instructions can be found at:
http://www.coe.k12.wa.us/domain/53
15
If a student’s original COE score is above 50% of the proficient cut-score the student is
limited to a subsequent COE with exactly four new work samples. It is recommended
that at least one of the four new samples be completed as an on-demand task. If the
decision is not to include a new on-demand task, the student’s previous on-demand
tasks will be included in deriving a new total score. Sufficiency requirements are outlined
as follows:
7/17/2015
Standard Subsequent COE
Sufficiency requirements for Expanded Subsequent COE submission:
• Biology and Mathematics: Examples of every strand must be represented in the
collection.
• Reading: Two literary work samples and two informational (including functional text
and CTE options) work samples required.
• Writing: Two expository work samples and two persuasive work samples required.
16
An expanded subsequent COE may be submitted if the student’s full
collection has a score that is less than or equal to 50% of the proficient
cut-score for the content area (e.g., Year 1 Math proficient cut-score is 24
and the student’s submission is scored 12 or less). An expanded
subsequent collection contains 5 or 6 new work samples with two ondemand tasks required.
7/17/2015
Expanded Subsequent COE
Sufficiency requirements for Expanded Subsequent COE submission:
• Biology and Mathematics: Examples of every strand must be
represented in the collection.
• Reading: At least two literary work samples and two informational
(including functional text and CTE options) work samples required. At
least 2 on-demand work samples are required with at least one literary
and at least one informational included.
• Writing: At least two expository work samples and two persuasive work
samples required. At least two on-demand work samples are required
with at least one expository and one persuasive sample included.
17
7/17/2015
Authorizing a Subsequent COE
1.
2.
3.
4.
Log in to eCOE through EDS
Choose any school in your district from the list
Choose “Subsequent Submission” from the bottom left
A list of students who are eligible to submit a subsequent COE will
appear
5. Click the check box for students who are authorized to submit a COE,
then click the Approve button
6. Teachers will now have access to add those students to a group.
18
• Students with invalidated collections are not eligible to
submit a subsequent COE.
7/17/2015
Students with invalidated COEs
• These students must compile a full collection consisting
of entirely new tasks
• 6 – 8 samples
• Minimum of two on-demand
• Full strand coverage
19
The L2 cut-score for COEs and the ability of students to
meet standard at a ‘Basic’ level in a given subject in
accordance with IEPs are effective now.
7/17/2015
COE and Basic-Level 2
“Retro Basic” updates will be available to any students still
enrolled in the K-12 system, per concurrence of the IEP
team.
COE Cut Scores
Total Points
Proficient Cut
Level 2 Cut
Reading
96
72
64
Writing
24
17
13
Math Yr 1
32
24
21
Math Yr 2
24
14
11
Biology
56
41
30
20
As is the case with all other assessments, Retro Basic forms are
to be submitted by District Assessment Coordinators or their
designees, following this process:
7/17/2015
To submit a Retro Basic
Request for Level 2 COE
• The Retro Basic Request form can be found at this link:
http://www.k12.wa.us/TestAdministration/Data/default.aspx
• Fax the form to OSPI at: 360-725-6509
21
Mathematics:
Eligible to Compile: Students are eligible to work on a
mathematics year 1 COE if they have taken or are currently
enrolled in a high school algebra 1 or integrated mathematics
course. Students are eligible to work on a mathematics year 2
COE if they have taken or are currently enrolled in a high school
geometry or integrated 2 mathematics course.
Eligible to Submit: A student must have attempted and not met
standard on a mathematics EOC one time before being eligible
to submit a COE.
7/17/2015
Content specific submission
requirements
22
Content specific submission
requirements
Reading/Writing:
Eligible to Compile: Any high school student who has taken at
least two years of high school English.
Eligible to Submit: A student must have attempted and not met
standard on the reading and/or writing HSPE one time before
being eligible to submit a COE.
Biology:
Eligible to Compile: Students are eligible to work on a biology
COE if they have taken or are currently enrolled in a high school
biology course.
Eligible to Submit : A student must have attempted and not met
standard on a biology EOC one time prior to being able to
submit a COE.
7/17/2015
continued
23
• State Laws Governing Security
All test content including, but not limited to, the COE inclusion bank of
tasks and completed student work are confidential and must not be
reviewed except to the extent required as part of administration
procedures.
7/17/2015
Test Security
• Secure Testing Environment-Who and what can be in the testing room
• Trained educators only, not volunteers
• No media (i.e., journalists/press)
• Only approved electronic devices
• No internet access or outside sources are allowed when student’s are
working on actual COE responses
24
Test Irregularities
What happens?
Troubled child alert – district is informed of the alert to allow check-in
on the student’s safety/well-being
Evidence of inauthentic student work - Student scores are held.
Districts are notified and required to conduct an investigation and
report back to OSPI.
• The state makes final determination to release or invalidate scores,
based on available information from the investigation.
• No district response to the irregularity notification defaults to score
invalidation.
Please review the test irregularity section of the Guidelines found at:
http://www.coe.k12.wa.us/Page/130
7/17/2015
An irregularity is evidence discovered in a student’s COE during scoring
that is problematic for one of two different reasons: a troubled child
alert or evidence of inauthentic student work.
25
Other Test Irregularities
• Inclusion bank tasks, passages, scenarios, and prompts are not to be
used for instruction or curriculum.
• COE assessment materials are not to be used, in part or entirety, as a
template or sample for instruction; COE materials are for the assessment
only.
• Duplication of the COE materials for any purpose other than providing
students with the materials for responding to assigned tasks is not
allowed.
• The only acceptable printing of the COE materials are the tasks that will
be submitted in the final collection (where print format is the method of
submission). Tasks, passages, scenarios, and prompts may be printed one
per student for the sole purpose of student completion of assigned tasks
making up the student’s collection.
• All assessment materials must be secured between sessions, with access
by COE educators, only.
7/17/2015
Breach in test materials security
• Improper use of assessment materials by educators.
26
There are general guidelines for the appropriate tools and
manipulatives supporting assessments in mathematics.
7/17/2015
Tools and Manipulatives
Policy specific to the COE is covered in content area
information.
For general policy and guidelines for test administration
refer to the ACM which can be found at:
http://www.k12.wa.us/TestAdministration/Instructions/def
ault.aspx
27
Principal – Responsibilities
• Who are the teachers
• Who are the students
• Monitor overall COE pass rate for your school
7/17/2015
• Know appropriate implementation of the COE
• Keep a record of COE building implementation
• Ensure all COE educators have been trained per state
guidelines
• Provide support and time for teachers to learn how to
implement the COE
•
•
•
•
Read guidelines
Learn how to manage the electronic system
Prepare instructional materials
Organize classroom preparation and schedule computer time
28
Principal – Tracking students
• Are they eligible to submit
• Are they compiling a COE
• Did they submit as planned
• Principals MUST click each COE – this is the actual
electronic submission
• Be sure to check that the COE actually was submitted
• What were the student’s results
• Did they meet standard or do they need to compile a
subsequent COE
7/17/2015
Track all COE students’ status
29
• Review the COE website
7/17/2015
Principal Preparation
• Know the COE policies
• Create a system to track COE building level implementation
30
•
•
•
•
•
Participate in COE training
Know appropriate implementation of the COE
Develop plan for instructional intervention
Provide appropriate instruction to students
Communicate to principal if students are compiling a COE but
NOT eligible to submit
• Follow test security protocols
• Submit the COE on time
• Mail paper-based portion of math COE and Biology diagrams
• Inform the principal when electronic COE is ready to be
submitted (needs to be completed by principal) - reading, writing,
math and biology
7/17/2015
Teacher Responsibilities
31
• Students who are compiling a COE for a full submission can be
added to a group regardless of eligibility
• Students may only submit when their eligibility code is “Y”
and the submission window is open
7/17/2015
Adding students to groups
• Students who are compiling a subsequent COE must be
authorized by the district before they can be added to a group
• Students who are compiling a subsequent COE need to be
placed in a “Subsequent” group
32
Adding students to groups
continued
Full Elg?
• Possible codes: Y, N, A, W
•
•
•
•
Y = Yes, student is eligible
N = No, student is not eligible
A = Already met standard (not eligible to submit)
W = Not eligible for winter submission because not in the graduation cohort
group of 2015 or earlier; will be eligible for spring submission
7/17/2015
• Three columns relate to eligibility on the add/remove students page:
Subs Elg?
• Possible codes: Y, N
• Y = Yes, student may submit a subsequent COE with authorization
• N = Not eligible for subsequent COE
Subs Auth?
• Possible codes: Y, N
• Y = Yes, student has been authorized and can be added to a group
• N = No, student is not authorized. Contact your district assessment coordinator.
33
• Teachers, principals and DACs are now able to move students
into their school and/or activate students that are in an
inactive status
• On the Add/Remove students screen, look for the Search by
SSID box.
7/17/2015
Updating student records
34
continued
• Enter the SSID number then click Search.
• A dialog box pops up with the student information.
• If the student is listed in the wrong school, change the district
and/or school with the drop-down menus.
• Click “Activate” to save the changes or to update the student’s
record so he or she may submit.
7/17/2015
Updating student records
35
Know:
• the guidelines and policies
• how to use the COE online system
• Obtain login from your District Security Manager
• how to set-up your classroom
• test security procedures
7/17/2015
Teacher Preparation
Prepare for COE students by:
• developing plan for instructional intervention
• scheduling computer lab time for COE students
36
Student Responsibilities
• Complete each task - MUST be all individual student work
7/17/2015
• Attend COE class or scheduled COE development time
• Check all completed work
• Do not use any outside sources
• Review collection prior to submitting it to teacher
• Submit the COE to the teacher
37
• All students compiling a reading or writing COE should
watch the video clip on plagiarism
• sign the attached form attesting that they understand:
(1) the consequences of plagiarism, and (2) how to
appropriately show text-based evidence.
• The signed forms are to be retained by the school.
7/17/2015
Student preparation –
reading and writing
• Found at: http://www.coe.k12.wa.us/Page/283
38
To sign up to receive e-alerts:
7/17/2015
COE e-alerts
Contact COE Technical Support [email protected] and
request to be added to the mailing list
39
For Assistance
Lesley Klenk, ELA COE Specialist
[email protected]
(360) 725-6330
Kim Andersen, Mathematics COE Specialist
[email protected]
(360) 725-6237
7/17/2015
COE OSPI information, [email protected]
Scott Killough, Science COE Specialist
[email protected]
(360) 725-6316
Amanda Mount, COE Operations Specialist
[email protected]
(360) 725-6037
COE ESD 113 Technical Support
Monday – Friday 8am to 5pm
[email protected]
(360) 464-6708
40