Transcript 2012 Assessment Overview and Updates

Assessment
 FCAT 2.0
 End-of-Course Assessments
 Transition to Common Core Assessments (PARCC)
 RTTT - Item Bank and Test Platform
Assessment Transition
Current assessments measure student success on Next
Generation Sunshine State Standards
• FCAT 2.0 Reading
• FCAT 2.0 Mathematics
• FCAT 2.0 Writing – State Board to consider new school grade
standard
• New standards for FCAT 2.0 Science, December 2012
• New Standards for Florida Geometry, and Biology 1 End-ofCourse Assessments, December 2012
New assessments to measure Common Core State
Standards
• Move to PARCC common core assessments, Spring 2014-15
–
–
–
–
–
English Language Arts - grades 3 to 11
Math – grades 3 to 8
Algebra 1
Geometry
Algebra 2
Type of
Assessment
Year Administered to Students
Assessment Area 2010-11 2011-12 2012-13 2013-14 2014-15
FCAT
FCAT Writing
FCAT Science
FCAT Reading
FCAT 2.0
End-of-Course
Assessments
Partnership for
Assessment of
Readiness for College
and Careers (PARCC)
College Placement Test
Postsecondary
Education Readiness
Test (PERT)
FCAT Mathematics
FCAT 2.0 Reading
FCAT 2.0 Mathematics
FCAT 2.0 Science
FCAT 2.0 Writing
Algebra 1
Geometry
Biology 1
US History
Civics
English language Arts
Mathematics
Gr 4, 8, 10 Gr 4, 8, 10
Gr 5, 8, 10
Gr 10
Gr 3-10
Gr 3-8
Gr 5, 8
In Course
Gr 3-10
Gr 3-8
Gr 5, 8
In Course
In Course
In Course
Gr 3-10
Gr 3-10
Gr 3-8
Gr 3-8
Gr 5, 8
Gr 5, 8
Gr 4, 8, 10 Gr 4, 8, 10
Gr 5, 8
In Course
In Course
In Course
In Course
In Course
In Course
In Course
In Course
In Course
In Course
Middle School
Middle School
Gr 3-11
Gr 3-8
High School Math
EOCs (3 subjects)
In Course
Gr 11
Not in high
schools
Gr 11
Gr 11
Gr 11
Gr 11
Florida End-of-Course Assessments
2012-13
2013-14
Algebra 1
Geometry
Standards Set
Biology 1
Standards Set
US History
Baseline
Civics
2014-15
PARCC
Assessment
Standards Set
Baseline
Standards Set
Transition to Computer Based Assessments
2010-12
2012-13
FCAT Math
Retake
X
X
FCAT 2.0
Reading Retake
X
Grades
6, 10
FCAT 2.0
Reading
FCAT 2.0
Mathematics
2013-14
2014-15
X
X
X
Grades
6,7,9,10
Grades
6,7,8,9,10
PARCC ELA
Grades 3 to 11
Grade 5
Grades 5,6
PARCC Grades
3 to 8
Algebra 1
X
X
X
PARCC
Geometry
X
X
X
PARCC
Biology 1
X
X
X
X
X
X
X
X
X
US History
Civics
FCAT 2.0 Writing
• Continue more rigorous scoring criteria
– Increased attention to standard English conventions
– Increased attention to supporting details
• Provided training for district staff on writing scoring
conventions
• In 2013 increase the time available for the writing
assessment from 45 to 60 minutes
Standard Setting
• Fall 2012: FCAT 2.0 Science, Geometry, and Biology 1 Endof-Course Assessment
• Purpose: Identify the “cut points” that define the new
Achievement Levels
Five Achievement Levels, Four Cut
Points
Low
Level 1
Level 2
Level 3
Level 4
Level 5
High
2012 Educator Panels:
• Comprised of educators from around the
state representing, large, small, rural
and urban districts
• Experience with the achievement level
descriptions and the assessments
• 4 days of iterative rounds of judgment
– 4 rounds of judgment
Educator Panel Makes Four Rounds of
Judgments
• Round 1: Panelists make independent percent-correct judgments on each item,
for each cut point.
– Given the knowledge, skills, and abilities that are required in this question, what
percentage of “just barely” students at this Achievement Level should get this item
correct?
– Discuss individual and table-level cut scores.
• Round 2: Panelists will independently revise judgments as they see necessary.
– Discuss individual, table-level, and committee-level cut scores.
• Round 3: Panelists will independently revise judgments as they see necessary.
– Discuss individual, table-level, and committee-level cut scores; receive impact data
on the total Spring 2012 testing population for all grades.
• Round 4: Panelists will independently revise judgments as they see necessary.
• Wrap-up: Each committee will be shown its final proposed cut scores, as well as
the impact data based on the total population and by subgroup (e.g., gender
and ethnicity).
Reactor Panel
• Comprised of superintendents, teachers,
postsecondary faculty, business leaders,
community members, subject area experts
• Overview of standard-setting process
• Standard-setting debrief
• Review tests
• Discuss cut scores proposed by the
educators, as well as impact data
• Reactor panel feedback
Standard Setting Public Workshops
•
•
•
•
October
October
October
October
8 – Tallahassee
9 – West Palm Beach
10 – Lakeland
11 – Web ex
Cut Score Recommendation to State Board
• Commissioner reviews feedback from both
the educator panel, the reactor panel, and
public workshops
• Commissioner makes a recommendations
to the State Board of Education
– FCAT 2.0 Science – achievement level
standards
– Geometry – achievement level standards,
passing score, college ready score
– Biology 1 – achievement level standards,
passing score, college ready score
• December 2012 State Board Meeting
Past Experience - FCAT Science Standards
FCAT Science
by Achievement Level
Grade 5
90%
80%
70%
60%
50%
40%
38%
42%
37%
33%
43%
46%
49%
51%
35%
30%
20%
28%
29%
29%
29%
25%
23%
21%
10%
19%
19%
2010
2011
0%
2003
2004
2005
2006
2007
2008
Achievement Level 3 and Above (On Grade Level and Above)
2009
Achievement Level 1
13
Past Experience - FCAT Science Standards
FCAT Science
by Achievement Level
Grade 8
90%
80%
70%
60%
50%
40%
36%
36%
30%
20%
28%
36%
35%
33%
32%
28%
38%
40%
41%
27%
27%
43%
46%
31%
25%
23%
10%
0%
2003
2004
2005
2006
2007
2008
Achievement Level 3 and Above (On Grade Level and Above)
2009
2010
2011
Achievement Level 1
14
NAEP Results: Grade 4 and Grade 8 Science
(Percentage at or above Proficient)
45%
40%
35%
30%
25%
20%
15%
10%
5%
0%
Florida
Georgia
Massachusetts
Grade 4 NAEP Science 2009
Rhode Island
New York
Nation
Grade 8 NAEP Science 2011
15
Partnership for Assessment
of Readiness for College and
Careers (PARCC)
Governing Board States
16
Participating States
PARCC Assessments
• English, Language Arts/ Literacy
assessments in Grades 3-10
• Mathematics assessments in Grades 3-8;
• End-of-Course assessments (EOCs) in
Algebra 1, Geometry, Algebra 2.
17
PARCC Timeline
SY 2010-11
Launch and
design phase
SY 2011-12
Development
begins
SY 2012-13
SY 2013-14
First year
pilot/field
testing and
related research
and data
collection
Second year
pilot/field
testing and
related research
and data
collection
SY 2014-15
Full
administration
of PARCC
assessments
Summer 2015
Set
achievement
levels,
including
college-ready
performance
levels
18
Goal #1: Create High-Quality
Assessments
Flexible
Early Assessment
• Early indicator of
student
knowledge and
skills to inform
instruction,
supports, and PD
Summative
assessment for
accountability
Mid-Year
Assessment
• Performancebased
• Emphasis on hard
to measure
standards
• Potentially
summative
Formative
assessment
Performance-Based
Assessment (PBA)
• Extended tasks
• Applications of
concepts and skills
End-of-Year
Assessment
• Innovative,
computer-based
items
ELA/Literac
y
• Speaking
• Listening
19
19
Goal #2: Build a Pathway to College and
Career Readiness for All Students
K-2
formative
assessment
being
developed,
aligned to
the PARCC
system
K-2
Timely student
achievement data
showing students,
parents and educators
whether ALL students
are on-track to college
and career readiness
3-8
College
readiness
score to
identify who
is ready for
college-level
coursework
Targeted
interventions &
supports:
•
•
12th-grade
bridge courses
PD for educators
High
School
SUCCESS IN
FIRST-YEAR,
CREDIT-BEARING,
POSTSECONDARY
COURSEWORK
ONGOING STUDENT SUPPORTS/INTERVENTIONS
20
Goal #3: Support Educators in the
Classroom
INSTRUCTIONAL
TOOLS TO SUPPORT
IMPLEMENTATION
PROFESSIONAL
DEVELOPMENT
MODULES
K-12 Educator
TIMELY STUDENT
ACHIEVEMENT DATA
EDUCATOR-LED
TRAINING TO SUPPORT
“PEER-TO-PEER”
TRAINING
21
RTTT Assessments
• Florida participation in International Assessments
– TIMSS and PIRLS testing (grades 4 and 8) completed in
Spring 2011; results in Spring 2013
– PISA testing (for 15 year olds) in Fall 2012 (63 Florida high
schools); results in Spring 2014
• Interim Assessment Item Bank and Test Platform
• Item Development for “Hard-to-Measure” content areas
22
Florida Interim Assessment Item Bank and Test
Platform
• Competitive Procurement – Awarded to Pearson in June
2012
• Will include tiered-level access to standards-based
assessment items for
– Language Arts and Math (based on the CCSS)
– Science, Social Studies, and Spanish (based on Florida’s
NGSSS)
• Will include a “test platform” that will assist users in test
construction
• Will allow for both computer-based and paper / pencil tests
23
Florida Interim Assessment Item Bank and Test
Platform
• Items will be written by contractor and by Florida educators
• Contractor will provide training for writers, reviewers, and
users of the system
• System will include the ability for teachers and districts to
create and administer items that are not shared statewide
• Items (with tiered access) that are available statewide will
be reviewed and vetted
24
Florida Interim Assessment Item Bank and
Test Platform
• Access to Florida Item Bank (which can be used
by districts to create, review, and securely store
assessment items, as well as to view items in the
statewide bank) will be available for district
access in Spring 2013
• Access to the Florida Test Platform (which can be
used to create and administer Computer-Based
or paper/pencil tests) will be available for district
access in Spring 2014.
25
District Developed Assessments for
Hard-to-Measure Content Areas
• Seven awards to four school districts for three-year grants
• Items developed will be saved as part of the FL Interim
Assessment Item Bank and Test Platform
• Fiscal agent districts are recruiting educators from around
the state to participate as item writers and item reviewers
26
Questions?