Transcript A Unique Moment in Time: Common Core State Standards and

Update on the State-Led and State-Governed
Comprehensive Assessment Consortia:
PARCC and Smarter Balanced
Pascal (Pat) D. Forgione, Jr., Ph.D.
Executive Director, K-12 Center at ETS
Austin, TX
Presentation Outline
• Stimuli for the Development of Next Generation
Assessments
• The Comprehensive Assessment Consortia
• PARCC
• Smarter Balanced
• Key Similarities and Differences in Designs and
Approaches
2
Part One
• Stimuli for the Development of Next Generation
Assessments
• The Comprehensive Assessment Consortia
• PARCC
• Smarter Balanced
• Key Similarities and Differences in Designs and
Approaches
3
Game Changer #1:
Common Core State Standards Initiative
In 2009, NGA and CCSSO launched the Common Core State
Standards Initiative to, “provide a consistent, clear
understanding of what students are expected to learn, so
teachers and parents know what they need to do to help them.”
•
48 states joined the initiative in 2009-10
•
42 states, the District of Columbia, four territories, and the
Department of Defense Education Activity (DoDEA) have
adopted the Common Core State Standards*
National Governor’s Association and Council of Chief State School Officers. “Common Core State Standards Initiative.” www.corestandards.org/assets/Common-CoreState-Standards-March-2010.ppt March 2010.
* www.coresandards.org July 11, 2014
4
The Uniqueness of This Moment:
Inflection Point
•
Thomas Friedman in “The World is Flat” points
out the importance of “inflection points” in
history, such as the invention of the printing press.
•
The Common Core State Standards (CCSS) may become an
“inflection point” for American public education - establishing a
common foundation for building excellence and equity for all
students.
CA
NJ
CT
Interactive Digital Library
NC
IL
RI
State silos of cost, effort, expertise
Shared platform for collaboration, cost and effort
efficiencies, sharing of best practices
5
Game Changer #2:
RTTT Assessment Program
Groups of 15 or more states could apply for a grant to develop
online, next-generation assessment systems that:
•
Assess shared standards in mathematics and ELA/literacy for
college- and career-readiness
•
•
•
Measure individual growth as well as proficiency;
Utilize technology to the maximum extent appropriate; and
Provide information that is useful in informing:
 Teaching, learning, and program improvement;
 Determinations of school effectiveness and of principal and teacher
effectiveness for use in evaluations and support; and
 Determinations of individual student college and career readiness,
such as determinations made for high school exit decisions, college
course placement to credit-bearing classes, or college entrance.

Operational by 2014 – 2015 school year
(US Department of Education, 2010)
6
Membership
in Comprehensive
Assessment Consortia
Membership as of July 11, 2014
PARCC
Smarter Balanced
Both:
Neither:
14 states & DC*
22 states and USVI**
Pennsylvania
15 states
District of
Columbia
Hawaii
7
* Indiana and Pennsylvania have not been active of late. ** Pennsylvania has not been active of late.
Part Two
• Stimuli for the Development of Next Generation
Assessments
• The Comprehensive Assessment Consortia
 PARCC
 Smarter Balanced
• Key Similarities and Differences in Designs and
Approaches
8
The Partnership for
Assessment of
Readiness for
College and Careers
(PARCC)
9
PARCC Assessment System
English Language Arts/Literacy and Mathematics, Grades 3-8 and High School
4 week test window
4 week test window
PARTNERSHIP RESOURCE CENTER: Digital library of released items; formative assessments; model content frameworks;
instructional and formative tools and resources; student and educator tutorials and practice tests; scoring training
modules; and professional development materials
DIAGNOSTIC ASSESSMENT
Student results inform
instruction, supports, &
professional
development
Flexible timing
MID-YEAR ASSESSMENT
Mid-Year PerformanceBased Assessment
Flexible timing
Optional assessments
to inform instruction
Speaking/
Listening
Assessment
Flexible timing
Required for grades
3-8 and 11 but not used for
accountability
PERFORMANCEBASED
ASSESSMENT
• ELA/literacy
• Mathematics
END-OFYEAR/COURSE
ASSESSMENT
• ELA/literacy
• Mathematics
Retest option
Summative
assessment
for accountability
PARCC Summative Assessments:
Performance-Based Assessments
4 week test window
• Taken after at least 75% of instructional year
• 3 ELA/literacy tasks over 3 sessions
• 1 narrative writing task
• 1 literary analysis task
• 1 research simulation task
PERFORMANCE
BASED
ASSESSMENT
• ELA/literacy
• Mathematics
• 2 math test sessions with multiple tasks
• complex, real-world application problems
• emphasis on mathematical practices and modeling
• Electronic and distributed human scoring
• Results by end of school year
11
PARCC Summative Assessments:
End-of-Year Assessment
4 week test window
• Taken between 75% and 90% of instructional year
END-OF• Multiple item types including constructed
YEAR/COURSE
ASSESSMENT
response and technology enhanced
• Fixed-form, with multiple forms per grade level/course
• Will include items that measure the full performance
continuum
• Electronically scored
• High school: Also, available at end of 1st semester to support
block scheduling
12
PARCC:
Summative Components
4 week test window
4 week test window
• Timed, spread over nine testing sessions
• Estimated testing time, ELA + math:
8 hours in grade 3
9 hours in grades 4 - 5
9.5 hours in grades 6 – 8
9.5 - 10 hours in high school
PERFORMANCEBASED
ASSESSMENT
• ELA/literacy
• Mathematics
END-OFYEAR/COURSE
ASSESSMENT
• ELA/literacy
• Mathematics
• PT and EOY scores combined for accountability
• 1 Retest in 3 – 8 and up to 3 in HS, as State/locally approved
• Paper and pencil version as accommodation and for schools with
State DOE approval
13
PARCC:
Speaking/Listening Assessment
ELA/Literacy
• Speaking
• Listening
Flexible timing
• Available for grades K-12, and required in grades 3 - 11,
but not used for accountability
• Scored by classroom teacher using standardized rubric
• Scores may be used within students’ grades
14
PARCC Supports:
Interim Assessments
DIAGNOSTIC ASSESSMENT
MID-YEAR ASSESSMENT
Flexible Timing
• Optional Diagnostic Assessment, grades 2 – 8
• Two-stage adaptive assessment designed to inform
instruction
• Optional Mid-Year Performance Tasks, grades 3 – 11
• Designed to mirror summative Performance Tasks
• Scored by teachers
15
PARCC Supports:
The Partnership Resource Center
PARTNERSHIP RESOURCE CENTER: Digital library of released items, formative assessments, model content
frameworks, instructional and formative tools and resources; student and educator tutorials and practice
tests, scoring training modules; and professional development materials.
•
•
•
•
•
Online practice tests for each grade/course
Formative assessment items and tasks
Professional development materials – scoring, use of data
Instructional tools and resources developed by Partner states
Optional “ready-to-use,” instructionally embedded formative
tasks and tools for K-1
16
PARCC Assessment System
English Language Arts/Literacy and Mathematics, Grades 3-8 and High School
4 week test window
4 week test window
PARTNERSHIP RESOURCE CENTER: Digital library of released items; formative assessments; model content frameworks;
instructional and formative tools and resources; student and educator tutorials and practice tests; scoring training
modules; and professional development materials.
DIAGNOSTIC ASSESSMENT
Student results inform
instruction, supports, &
professional
development
Flexible timing
MID-YEAR ASSESSMENT
Mid-Year PerformanceBased Assessment
Flexible timing
Optional assessments
to inform instruction
Speaking/
Listening
Assessment
Flexible timing
Required for grades
3-8 and 11 but not used for
accountability
PERFORMANCEBASED
ASSESSMENT
• ELA/literacy
• Mathematics
END-OFYEAR/COURSE
ASSESSMENT
• ELA/literacy
• Mathematics
Retest option
Summative
assessment
for accountability
PARCC:
Supports and Timeline
Plans as of July 1, 2014, subject to change
2014 – 2015 school year
• College readiness tools released
• Partnership Resource Center launches
• Mid-Year and Summative assessments ready
2015 – 2016 school year
• K-1 formative tools ready
• Diagnostic and Speaking/Listening
assessments ready
18
The Smarter Balanced
Assessment Consortium
19
Smarter Balanced Assessment System
English Language Arts/Literacy and Mathematics, Grades 3-8 and High School*
12 week testing window
DIGITAL LIBRARY of formative tools, processes and exemplars; model curriculum units; educator training; professional
development tools and resources; and teacher collaboration tools.
INTERIM ASSESSMENT
Computer Adaptive
Interim Assessment
System
INTERIM ASSESSMENT
Computer Adaptive
Interim Assessment
System
Scope, sequence, number, and timing of interim
assessments locally determined
Optional Interim
assessment system.
PERFORMANCE
TASKS
• ELA /Literacy
• Mathematics
COMPUTER
ADAPTIVE
ASSESSMENT
• ELA/Literacy
• Mathematics
Re-take option available
Summative assessment
for accountability
•Summative and interim assessments for grades 3 – 8 and 11, with ability for states to create additional assessments for grades 9, 10, and 12.
20
Smarter Balanced Summative Assessment
Performance Tasks
12 week testing window
• One 12-week statewide testing window for
administration of both summative
components, extends up to last day of
PERFORMANCE
school
TASKS
• ELA /Literacy
• One ELA task and 1 math task per year,
• Mathematics
90 – 120 minutes per content area
• Focus on hard-to-measure standards
• Combination of machine and human scoring
• Results within two weeks, depending on state scoring
contract.
21
Smarter Balanced Summative Assessment
Computer Adaptive End-of-Year Assessment
Last 12 weeks of year*
12 week testing window
• Multiple item types including constructed
response and technology enhanced
• Adaptive delivery can, if needed, present items
above or below grade level to gain accuracy and
clearer profile of strengths and needs (most
students will see only grade-level items)
COMPUTER
ADAPTIVE
ASSESSMENT
• ELA/Literacy
• Mathematics
22
Smarter Balanced
Summative Components
12 week testing window
• Untimed, over multiple testing sessions
• Estimated testing time, ELA + math:
7 hours in grades 3 – 5
7.5 hours in grades 6 – 8
8.5 hours in grade 11
PERFORMANCE
TASKS
• ELA /Literacy
• Mathematics
COMPUTER
ADAPTIVE
ASSESSMENT
• ELA/Literacy
• Mathematics
Re-take option available
• PT and Computer Adaptive scores combined for accountability
• 1 Retake, if locally approved, for testing irregularities
• Paper and pencil version for 3 years; thereafter as
accommodation
23
Smarter Balanced Supports:
Optional Interim Assessment System
INTERIM
INTERIM
INTERIM
• Two Options:
– Interim Comprehensive Assessments use the same design as the
summative assessments, assess the same range of standards, and provide
scores on the same scale.
– Interim Assessment Blocks focus on smaller sets of related concepts and
provide more detailed information for instructional purposes. There are
between five and seventeen blocks per subject per grade
• Test questions are not secure, and there are no restrictions on the number of
24
times that teachers or students may access assessments
Smarter Balanced Supports:
The Digital Library
Last 12 weeks of year*
DIGITAL LIBRARY of formative tools, processes and exemplars, model curriculum units, educator training;
professional development tools and resources, and teacher collaboration tools.
• Created “by teachers, for teachers”, with some commissioned materials
• Assessment literacy modules
• Formative assessment process descriptions, exemplar instructional
modules, vetted and rated instructional resources and professional
learning resources
• Social media functionality allows teachers to rate materials and share
their expertise with educators across the state or across the country
25
Smarter Balanced Assessment System
English Language Arts/Literacy and Mathematics, Grades 3-8 and High School*
12 week testing window
DIGITAL LIBRARY of formative tools, processes and exemplars; model curriculum units; educator training; professional
development tools and resources; and teacher collaboration tools.
INTERIM ASSESSMENT
Computer Adaptive
Interim Assessment
System
INTERIM ASSESSMENT
Computer Adaptive
Interim Assessment
System
Scope, sequence, number, and timing of interim
assessments locally determined
Optional Interim
assessment system.
PERFORMANCE
TASKS
• ELA /Literacy
• Mathematics
COMPUTER
ADAPTIVE
ASSESSMENT
• ELA/Literacy
• Mathematics
Re-take option available
Summative assessment
for accountability
Summative and interim assessments for grades 3 – 8 and 11, with ability for states to create additional assessments for grades 9, 10, and 12.
26
Smarter Balanced:
Timeline
Plans as of July 8, 2014, subject to change
Summer 2014
•
Digital Library preview for teachers in all governing states (June
through September)
Fall 2014
•
•
•
Initial Achievement Level Setting performed
Comprehensive Suite of Software Applications launched (Digital
Library, Assessment Delivery, Item Banking, etc)
Interim assessments available (late Fall)
Spring 2015
•
Summative assessments available
27
Part Three
• Stimuli for the Development of Next Generation
Assessments
• The Comprehensive Assessment Consortia
• PARCC
• Smarter Balanced
• Key Similarities and Differences in Designs and
Approaches
28
Key Similarities
SUMMATIVE ASSESSMENTS
• Online assessments for Grades 3-8 and high school,
ELA/literacy and mathematics
• Use of a mix of item types including selected
response, constructed response, technologyenhanced and complex performance tasks
• Two components, both given during final weeks of
the school year
• Delivery supported on computers, laptops and
tablets and a limited variety of operating systems
29
Key Similarities (cont.)
OTHER ASSESSMENTS, RESOURCES, AND
TOOLS
• Online practice tests by grade/course
• Optional diagnostic/interim tests
• Professional development modules
• Formative items/tasks for classroom use
• Online reporting suite
• Digital library for sharing vetted resources and tools
• State ownership and control of all individual student
data, as is currently the case for state assessments
30
Key Differences
PARCC
Smarter Balanced
Grades Tested
3 – 11
3 – 8 and 11 (SEAs can create tests for 9
10, and 12)
End-Of-Year Assmt
Fixed form
Adaptive
Performance Tasks
3 ELA/Literacy tasks
2 Mathematics testing sessions,
multiple tasks
1 ELA/Literacy task
1 Mathematics task
Languages
Translations provided with costs
shared by States that need them
Spanish, Vietnamese, Arabic,
Tagalog/Ilokano, Cantonese, Mandarin,
Korean, Punjabi, Russian, Ukrainian and
American Sign Language
Retest Policy
State decision, but Consortium will
make available 1 retest for grades 3-8
and 3 for HS
State/local decision, but consortium will
make available 1 retest option for grades
3-8 and 11
31
Key Differences, continued
PARCC
SBAC
Human Scoring
SEA decision on trained educators
vs. vendor
Priority placed on teacher
involvement, after training
Test Delivery
System
Vendor’s system (TestNav) thru
2017-18; Then SEAs can
manage/contract using PARCC
delivery system; open-source
system to follow
Free open-source system made
available, but states are to either
manage or contract for delivery
* Based on review conducted by the Michigan Department of Education and published in “Report on Options for Assessments
Aligned to the Common Core State Standards”, Michigan Department of Education, December 1, 2013
Test Administration Windows
and Projected Testing Time
Grade
PARCC
From set of predetermined test windows,
states/districts choose two (1 for PBA and
one for EOY), each a max of 4 weeks
3
One state-defined 12 week* window
during which schools can schedule PBA
and EOY
(*window only 7 weeks for Grade 11)
8 hours
4
5
SBAC
9 hours 20 minutes
7 hours
6
7
8
9
10
11
9 hours 25 minutes
7 hours 30 minutes
9 hours 45 minutes
State decision and design
9 hours 55 minutes
8 hours 30 minutes
Performance Levels and
Assessment and Reporting Claims
PARCC
Performance/
Achievement Levels
ELA/
Literacy
Claims
Mathematics
SBAC
5 Levels
4 Levels
Overall Reading Claim
Overall Writing Claim plus 2 subclaims
• written expression
• knowledge of language and
conventions
Overall ELA Claim plus 4 subclaims:
• Reading
• Writing
• Speaking and Listening
• Research/Inquiry
Overall Claim plus 5 sub-claims:
• major content
• additional and supporting content
• reasoning
• modeling
• fluency (grades 3-6)
Overall Claim plus 4 subclaims:
• Concepts and Procedures
• Problem Solving
• Communicating Reasoning
• Modeling and Data Analysis
Current Memberships
and Initial Costs
PARCC
Smarter Balanced
14 states and DC
(IN and PA not active)
22 states
(PA not active)
$24.00
$22.50
Includes test delivery and
central scoring for
2014-15,
Excludes local technology
and bandwidth costs
Includes estimated costs
for test delivery and
scoring,
Excludes local technology
and bandwidth costs
Paper and Pencil version
Approx. $34.00
Approx. $33.50
Additional Per Pupil Cost for
Optional System Components
TBD
Summer 2014
$4.80
Total Per Pupil Cost for Online
Summative Assessments in
ELA/Literacy and Mathematics
35
www.k12center.org
Thank you.
Pascal (Pat) D. Forgione, Jr., Ph.D.
Distinguished Presidential Scholar and Executive Director
Center for K-12 Assessment & Performance Management at ETS
701 Brazos Street, Suite 500
Austin, TX 78701
E-Mail: [email protected]
Nancy Doorey
Director of Programs
Wilmington, DE
E-Mail: [email protected]