Transcript Document

Oklahoma School Testing Program
Grades 3-8 and End-of-Instruction
Assessments
OCCT, OMAAP, and Acuity Benchmark
Annual District Test Coordinator Meeting
Location:
OKC Sheraton Reed Center – May 28, 2014
Agenda
Welcome and Introduction
Program Administration
Online Assessment System
Copyright © 2014 CTB/McGrawHill LLC.
Session Goals
Wrap-up
2
Welcome
Oklahoma State Department of Education
• Joyce DeFehr
• Executive Director, State Testing
• Sonya Fitzgerald
• Assistant Director of State Testing
• Craig Walker
• Monitoring and Science Assessments Director
• Amy Nicar
• ELA / History Assessment Specialist
Copyright © 2014 CTB/McGrawHill LLC.
• Lisa Chandler
• Assistant State Superintendent of Assessments
3
Welcome
• Katie Dunlap
• Oklahoma State Solutions Manager
• Joe Turbett
• Lead Architect, McGraw-Hill Education
• Brian Larkin
• Technical Product Manager
• John Miller
• Sr. Manager – Online Implementation Services
• David Needles
• Sr. Program Manager - Acuity
• Tracy Keith
• Sr. Program Manager – Oklahoma EOI
• Lindy Wienand
• Sr. Program Manager – Oklahoma Grades 3-8
Copyright © 2014 CTB/McGrawHill LLC.
CTB/McGraw-Hill
4
Welcome
Measured Progress & eMetric
• Jake Goldsmith
• Measured Progress Client Services Assistant Director
• Monique Ring
• Measured Progress Program Manager
• Sharman Lyons
• Measured Progress Program Assistant
• Abbie Currier
• eMetric Project Manager
Copyright © 2014 CTB/McGrawHill LLC.
• Tinamarie Skillings
• Measured Progress Lead Program Manager
5
Review Program
Administration
Successes and
Challenges
Provide Forum
for DTCs to
Express Testing
Successes and
Failures
Collect
Feedback to
Improve Delivery
of Future Testing
Programs
Copyright © 2014 CTB/McGrawHill LLC.
Session Goals
6
CTB Program Administration






Paper/pencil fulfillment & delivery
Communication
CTB Helpdesk
Additional material orders
Score reporting
Online readiness
Copyright © 2014 CTB/McGrawHill LLC.
Improvements
7
CTB Program Administration
 4/21 system interruption and testing suspension
 Faster communication
 Much fewer invalidations required
 No automatic invalidations
 Material retrievals
• 5/28 additional Grades 3-8 Two Week Reports
• 5/30 EOI English II/III Two Week Reports
Copyright © 2014 CTB/McGrawHill LLC.
Challenges
8
EOI Summer 2014 Administration
Test Window Closes
Monday
June 2, 2014
Friday
August 1, 2014
Bulk Upload Opens
Tuesday
May 27, 2014
Monday
June 9, 2014
Monday
June 23, 2014
Bulk Upload Closes
Friday
May 30, 2014
Friday
June 13, 2014
Friday
June 27, 2014
Testing Hours
Monday – Friday
7:00 am – 7:00 pm
Central Time
Student Data Available
Monday
June 2, 2014
Wednesday
June 18, 2014
Wednesday
July 2, 2014
Place paper test material orders now – July 30th
Copyright © 2014 CTB/McGrawHill LLC.
Test Window Opens
9
Copyright © 2014 CTB/McGrawHill LLC.
Questions?
10
Oklahoma State Department of Education
Acuity Benchmark Program
David Needles, Senior Program Manager - Acuity
May 2014
Purpose of Acuity Benchmark Program
 The purpose of the Benchmark tests and use of the Acuity item bank is
to help students transition to the new item types and rigor of the new
standards and to help guide instruction.
- ELA and math benchmark tests include short, constructed
response items.
- ELA also provides students practice with passage-based writing
prompts.
Copyright © 2014 CTB/McGrawHill LLC.
 Acuity Benchmark assessments are aligned to the College and Career
Standards in Math and English/Language Arts, which are to be fully
implemented and tested in 2014 – 2015.
- Grades 2 – 8 ELA and Math
- End-of-Instruction Algebra I, Algebra II, Geometry, English II/III
12
Acuity Benchmark Benefits
Acuity provided by the Oklahoma State Department of Education
- Online or Offline Testing
- Benchmark Assessments for Grades 2- 8 and EOI
- Online Reports within 48 hours
- Test Blueprints
- Instructional Activities
- Customized Test Feature (with Item Banks)
- Performance Task Feature
 Professional Development
- Regional Onsite Workshops
- Online Digital Library (Acuity Community)
- Live and Recorded WebEx
- On–Demand videos
- Reach Coaches
- Acuity Demonstration Events
- Vision 2020
Copyright © 2014 CTB/McGrawHill LLC.

13
2013-14 Acuity Benchmark Program
 Professional Development Support
- Regional Training in October and November
- WebEx for Introduction to Acuity
- Digital Library for “One Stop” Acuity Resources
 Grades 3-8 and EOI Test Windows Expanded
- 5 week window 2013
- 6 week window for 2014
Copyright © 2014 CTB/McGrawHill LLC.
 Grade 2 Benchmark Assessments
- 6 ELA diagnostic forms
- 6 Math diagnostic forms
- Instructional Activities
- Additional Items for Customized Assessments
- Open Test Windows
14
2013-14 OK Acuity Benchmark Program
EOI
Benchmark
Program
Grades 2* - 8
Benchmark
Program
Frequency of Test
Windows
Algebra I,
Algebra II,
Geometry
2
English II,
English III
2
Math
2
Reading
2
Purpose
Help students transition to
new item types, to the
rigor of the new standards,
and to help guide
instruction.
Help students transition to new
item types, to the rigor of the
new standards, and to help
guide instruction.
Item Types
Average of (35)
Multiple-Choice and
(3) Open-Ended.
Average of (20)
Multiple-Choice
items and (2) OpenEnded. Writing
Prompts for Grades
3-8.
Copyright © 2014 CTB/McGrawHill LLC.
Assessment Type and Subject
15
*Grade 2 has open windows and 6 Diagnostic tests.
2013-14 OK Acuity Benchmark Program
Benchmark Assessment
Grade 2 Diagnostic Math and ELA
Benchmark Grades
2013
NA
2
Open
Grade 3-8 Math and ELA
1
2
3-8
10/21 – 11/22
1/13-2/21
HS Algebra I & II, Geometry, English II & III
1
2
Note: EOI assessments can be used in lower grade levels.
9-11
10/21 – 11/22
1/13-2/21
2013-14 Acuity Benchmark Program Activity
G3-8 and EOI SUMMARY
Totals
Districts Participating In G3-8/EOI Acuity
236
Schools Participating In G3-8/EOI Acuity
519
Districts Testing Acuity
243
Number of Tests Assigned
397,656
Number of Tests Scored
270,695
Number of BM Writing Prompts
10,760
Custom Tests
42,172
Instructional Resources
13,774
Total Class Assessment Report Views
76,537
Copyright © 2014 CTB/McGrawHill LLC.
BENCHMARK 1-2
17
Copyright © 2014 CTB/McGrawHill LLC.
Acuity Benchmark Report Sample
18
Copyright © 2014 CTB/McGrawHill LLC.
Questions?
19
Afternoon session will start at 12:30pm
Copyright © 2014 CTB/McGrawHill LLC.
Break for Lunch
20
CTB Online Assessment System
OAS Architecture
Architecture set-up
How OAS functions
Solution
Test Delivery Client (TDC)
 User feedback
Test Administration System (TAS)
 User feedback
Copyright © 2043 CTB/McGrawHill LLC.



21
CTB Online Assessment System



Not Tested Codes & Other Demographics
Student testing experience
Other concerns
Copyright © 2014 CTB/McGrawHill LLC.
Item Tryouts & Transitional Client
22
Copyright © 2014 CTB/McGrawHill LLC.
Questions?
23
Copyright © 2014 CTB/McGrawHill LLC.
Thank you for your participation
and feedback!
24