Florida IBTP Overview

Transcript Florida IBTP Overview

Florida IBTP Overview Community of Practice

Lake Mary, FL May 28, 2014 2:45 - 4:15 p.m

Florida Department of Education Office of Race to the Top Assessments

Objectives

To provide an understanding of the Florida Item Bank and Test Platform, including:     Background, structure and purpose Content Resources Demo of navigating, searching, test-building, assigning, administration and viewing results 2

What is the IBTP?

     Bank of +90,000 assessment items Wide range of content areas for K-12 Aligned to the Florida Standards Varied item types and modes of assessment from selected response to performance tasks Includes range of cognitive complexity, difficulty for all standards

Bottom line:

The IBTP is designed to be a valuable resource for districts and classrooms to enrich lessons and units with high quality, standards-based, engaging assessment activities for diagnostic, interim or summative assessment.

IBTP

Statewide Technology-Based* System

Bank of Standards based items/tasks + Tiered access for security Diagnostic Interim Summative

* Computer or paper-based functionality

Test-builder tool – Build valid and reliable assessments Training modules for PD and support

Florida Educator Involvement

    Item writers and item reviewers Hard-to-Measure project led by districts CFAC contribution Functionality testing and Item Tryouts throughout the project  District Preview and feedback to the Item Bank 5

Content

English Language Arts

The IBTP Project

Grades

K-12 Mathematics Science K-8 and Algebra 1, Geometry, and Algebra 2 K-8 and Biology, Chemistry, Earth/ Space Science, and Physics Social Studies K-8 and World History, United States History, United States Government, and Economics Spanish Access Points Bands K-2, 3-5, 6-8, 9-12 Grades K-12, Science and Social Studies 6

Hard-to-Measure Project

for District-developed Assessments

Content Areas District Awardee

Physical and Health Education, K - 8 Physical and Health Education, 9 - 12 Performing Arts, Choral Performing Arts, Band and Orchestra Visual Arts World Languages Career and Technical Education Miami-Dade Hillsborough Polk Polk Miami-Dade Duval Hillsborough 7

Osceola County Project (CFAC)

Content

Mathematics Science

Courses

Trigonometry, Pre-Calculus, Probability & Statistics Environmental, Marine, Anatomy & Physiology Psychology, Sociology Social Studies AVID CTE JROTC Project Awarded in July 2013 8

IBTP Development

Passages developed & reviewed Items written & reviewed Items approved or rejected

 Development Summer 2012 through Spring 2014

Item tryouts IBTP available to districts, schools & classrooms Teachers can create diagnostic or interim assessments

  Educator training Winter/Spring 2014 Available to districts Summer 2014

Districts may use for local assessments

Tier 1 Tier 2 Tier 3 Tier 4 Tier 5

IBTP Item Distribution

• Differentiated Accountability & other state level programs • District level access • This tier will house the majority of items.

• School level access • Classroom teacher access • Public access • Sample items. Collection will grow over time.

•Tiers 1-4 will be password accessible to a limited group of people.

•Greatest security is employed for Tier 1 items, with wider access available at lower levels.

•As items are no longer used at an upper level, they will move to become available at the next level down. •At end of Year 2, the IBTP houses approximately 90,000 items.

Standards Alignment

IBTP assessment Items are written to Florida Content Standards.

Florida Standards

 English Language Arts  Mathematics  Social Studies (including Literacy Standards)  Science (including Mathematics and Literacy Standards)  Spanish  Hard-to-Measure (including Literacy Standards)

Number of Items

22,000 9,000 12,000 11,000 7,000 29,000 11

Item Types Developed for the IBTP

       Selected Response Short Response Gridded Response Constructed Response Extended Response Essay Response Performance Tasks 1 point 1 point 1 point 2 points 4 points 6 points 1-10 points 12

Other Item Types

On roll-out, the Item Bank will contain just the item types discussed here. However, the Test Platform will have the functionality for districts and teachers to create other types, including:  True/False  Matching  Technology Enhanced Items 13

Associated IBTP Resources

  Classroom Enrollment Tool (CET) allows districts to pre-populate classroom roster data; teachers will not need to manually enter student data; district may update the CET as frequently as desired; data format similar to FDOE (Survey 2).

Single Sign-On (SSO) provides access to the IBTP for district and school staff, teachers and students.

Training and Support

Training and reference materials will be available on CPALMs, including:  Training Workbook  Job Aids – Brief, step-by-step instructions detailing each IBTP functionality  Online self-study tutorials for administrators, teachers, and technical coordinators  The Student Experience – an overview to acquaint students with the IBTP online testing process 15

Office of RTTT Assessments

Directors [email protected]

; [email protected]

IBTP Project Manager [email protected]

HtM Project Manager [email protected]

ELA Specialist [email protected]

Spanish Specialist [email protected]

IBTP Systems Admin [email protected]

Questions?

Thank You

NOTE: These materials were developed under a grant from the U.S. Department of Education. However, the contents do not necessarily represent the policy of the U.S. Department of Education, and you should not assume endorsement by the Federal Government.

District-Developed Assessments for Hard-to Measure Content

Antionette Meeks, EdD, CPP, MCHES Project Manager, District Developed Assessments for Hard-to-Measure Content Spring 2014

Seven Hard to Measure Project Awards

Project Letter Content Areas District Awardee

A B C D E F G Physical and Health Education, K - 8 Physical and Health Education, 9 - 12 Performing Arts, Choral Performing Arts, Band and Orchestra Visual Arts World Languages Career and Technical Education Miami-Dade Hillsborough Polk Polk Miami-Dade Duval Hillsborough 20

Tasks

• • • • Develop item specifications based on identified Florida course descriptions and corresponding Florida standards Develop item development plan Create high quality, cognitively complex assessment items representing various item types Review items using three review levels at the project level 21

Challenges

• • • • Need to use temporary item bank Updating of standards Adjustments in course descriptions Early IBTP development issues 22

Tasks

• • • Participate in fall 2013 item try-outs – test the IBTP Participate in spring 2014 field test – – Test IBTP Gather item level data – Analyze data • • Accept, adjust, reject items Create new items to fill identified gaps – Submit field test report Submit final project report 23

Field Test

• • • Over 30 districts More than 38,000 independent responses Approximately 40,000 constructed response items 24

Field Test: Challenges

• • • • • Audio (resolved) Video (June update) Classroom Enrollment Tool (district dependent) File names (resolved; writer dependent) Florida Standards (resolved) 25

Thank you

Antionette Meeks, EdD Project Manager, District-Developed Assessments [email protected]

(850) 245-9953 Fall 2013 Office of Race to the Top Assessments Division of Accountability, Research, and Measurement Florida Department of Education 26

Central Florida Assessment Collaborative Update

Presented to the Community of Practice May 28, 2014 By Heather P. Wright Prepared by Heather P. Wright

63 CFAC Member Districts

Prepared by Heather P. Wright

• • • • •

Assessment Development Projects: Collaborating to Meet Legislative Mandates

Developing item banks using grant funds (48 courses) Developing item banks using district funds (71 courses) Sharing district-developed item banks (200+ courses) Developing test blueprints using item banks developed by Interim Assessment Item Bank project, CFAC project, & Hard to Measure projects (200+ courses) Developing test forms using item banks developed by Interim Assessment Item Bank project, CFAC project, & Hard to Measure projects (200+ courses) Prepared by Heather P. Wright

Benchmark Analysis

CFAC Assessment Development Process

Item Specification Development Test Blueprint Development Item Writing Field Test Form Creation Field Test Item Proofreading (Grant Only) Item Analysis Item Bias/Sensitivity Review Item Edits/Item Writing & Review Item Content Review Assessment Creation Prepared by Heather P. Wright

• • • • •

CFAC Grant-Funded Project: Project G

48 courses – Item bank available to ALL districts, regardless of CFAC membership Items authored in IBTP 7 Content Areas: 12,250 items total – Math – – – – – – Science ELA Social Studies CTE JROTC World Languages Grant awarded in July 2013/ Item writer accounts created September 2013 Summer workshops scheduled: – June 9-12: Tallahassee – – June 16-19: Ft. Lauderdale June 23-26: Orlando Prepared by Heather P. Wright

•

CFAC Project G: 48 Grant-Funded Courses Items Published As of May 13, 2014:

– Career/Technical Education: 1383 items – English electives: 1361 items – JROTC: 10 items – Math: 1623 items – Science: 1485 items – Social Studies: 1302 items – Total: 7164 Prepared by Heather P. Wright

• • • • •

CFAC District-Funded Project: Project D

71 courses – Item bank available ONLY to CFAC districts in good standing 7 Content Areas: 1,972 published items/105 submitted items (as of May 6, 2014) – Math – Science – ELA – Social Studies – CTE – – JROTC World Languages 100% District funded Items authored in Eduphoria Summer workshops scheduled (Districts may send participants at their expense): – June 9-12: Tallahassee – June 16-19: Ft. Lauderdale – June 23-26: Orlando Prepared by Heather P. Wright

Example - Osceola Total as of April 7, 2014: 995 Unique Courses, Not Including Pre-K and Pseudo-Courses 33 20 121 256 77 11 354 5 2 98 18 0 200 400 600 800 Assessment available, district cost Assessment provided, no district cost Blank Experiential course - SDOC will develop rubric Item bank provided, district must create tests OVS or PLATO Recommend for deletion 1000 Prepared by Heather P. Wright

• • • • •

CFAC Project H: District-Developed Item Banks

150+ Courses Gap-Gap Courses (not covered by any other projects or assessments) Items authored in Eduphoria or in districts’ own assessment platforms Plan to exchange items through IBTP using IBTP’s QTI 2.3 specifications Modified item development process: – Test blueprint development – Item authoring – Item review (may only be 1 content review) Prepared by Heather P. Wright

• • •

CFAC Project: Test Blueprinting & Test Development

Plans to build common test blueprints & assessments for courses with item banks only: – – Hard to Measure item banks Interim Assessment item banks – CFAC item banks CFAC member districts will have option to use or to modify tests created by collaborative Locations/Dates: – – Central Florida: September 2-5 South Florida: September 8-12 –

Contact Information

Heather P. Wright Research & Evaluation Specialist School District of Osceola County [email protected]

(407) 518-2903 CFAC Website: http://cfacteam.weebly.com/ Prepared by Heather P. Wright

Florida IBTP Overview

Transcript Florida IBTP Overview