Transcript New Jersey PARCC ELC Conf_KeyNote

NJ Educator Leader Cadre’ PARCC Conference
June 6, 2014
A little Formative Assessment...
❖ What level are you most affiliated with?
➢ Elementary School
➢ Middle School
➢ High School
❖ What content area are you most affiliated with?
➢ Math/Science
➢ ELA/Social Studies
➢ Fine Arts
➢ Performing Arts
➢ Applied Technologies
➢ Business
➢ Physical Education
❖ How familiar are you with the resources that are currently available?
➢ Not Familiar (What’s PARCC?)
Presentation Topics
• Looking at how PARCC Assessments are connected
to Teacher Eval - and Grad Assessment
• News From PARCC - National Picture
• Building a Common Language - Working across
states and sharing information
• Being a PARCC and CCSS Storyteller
The PARCC Consortium
• Led by member state
Chief State School
Officers with
significant support
from SEA and LEA
staff
• PARCC, Inc., Project
Management Partner
Priorities
Determine whether students are
college- and career- ready or “on track”
Provide tools to assess student learning
and support instruction during the
school year
Generate data, including growth
metrics, for accountability uses
Report comparable data across schools,
districts and member states
Use technology to
create efficiencies
and engage students
in the testing process
Goals …
Develop tests
worth taking
Texts worth reading
Essays worth writing
Problems worth solving
Accessible to all students
Report results
worth using
Valid
Reliable
Timely
Actionable
Show me the EVIDENCE
Think of examples of why EVIDENCE is such a
relevant word in education today.
Evidence Centered Design can
inform a deliberate and systematic
approach to instruction that will
help to ensure daily classroom work
leads to all students meeting Ohio's
New Learning Standards.
Evidence-Centered Design (ECD)
in the Classroom - Start with the end in mind.
PARCC is using ECD to create the gr 3-11 assessments.
Learning Targets/Objectives
Classroom Assessments Formative/Summative
Design begins with the
inferences (claims) we
want to make about
students—should be
connected clearly to
Ohio's New Learning
Standards - What
should students be able
to DO or KNOW?
In order to support
claims, we must gather
evidence----what can
teachers point to,
underline or highlight
to show that students
are making progress
toward doing what we
claim they can do?
Classroom Activities
Classroom activities
(tasks) are designed to
elicit specific evidence
from students in
support of claims.
How Does it All Connect for
Student Achievement?
Comparison of PARCC OH/NJ
Teacher
Performance
On
Professional
Standards
Student
Growth
Measures
Surveys,
Reflection or
Peer Feedback
Graduation Requirements
● Pathway 1 - passing
scores on 7 EOC exams
including Alg 1,
Geometry, ELA 1 and
ELA 2
● Pathway 2 - remediation
free score on ACT or
SAT as a Junior or
Senior
● Pathway 3 - CTE EOC
exams, professional lisc.
exams.
● NOTE: Equivalent credit
given for AP, IB
coruses.
Comparison of PARCC OH/NJ
Tested
Non-Tested
As of now, the
NJDOE has not
decided what (if any)
PARCC
Assessments will be
used towards a
graduation
requirement.
Design of the Assessment System
Formative ToolsFor use during the school
year 2015-2016
Diagnostic Assessments
•
•
•
•
Mid-Year/Interim Assessments
Grades 2-8
Reading, Writing, Math
Computer adaptive
Designed to pinpoint students’
learning needs
•
•
•
•
•
K-1
Grades K-1 Tasks
Speaking & Listening Tools
•
• Reading and math
• Checklists, running records,
performance tasks
Grades 3-11
ELA/Literacy and Math
Computer- and paper-based
Built from released PBA tasks
Can be used for assessment at
individual, classroom, school levels
• Grades 3-12
• Performance-based activities
• Spontaneous oral response to oral
prompt; share findings of research in
an oral presentation
Summative AssessmentsMeasure and
report achievement and growth
Performance-Based
Component
(PBA)
ELA/Literacy
Writing essays drawing evidence
from sources, including multimedia, some comprehension
Math
Solving multi-step problems that
require reasoning and address real
world situations
COMBINATION Human/Machine
Scored
End-of-Year Component
(EOY)
ELA/Literacy
Demonstrating comprehension of
literary and informational texts
Math
Demonstrating understanding of
concepts and procedures and
carrying out short applications
MOSTLY MACHINE SCORABLE
Overall Score = Combination of PBA + EOY
PARCC’s Accessibility Features
Accessibility
Features for All
Students
Accessibility
Features
Identified in advance
Accommodations
IEPs and
504s
Selected features
• Highlighter
• Answer masking
• Line reader
• Color contrast
• Math text-tospeech
• ELA text-to-speech
• Scribe
• Extended time
Personal Needs Plan
Reporting Schedule
• The goal is to return results of the summative
assessments prior to the end of the school year
• Standard setting will occur in
Summer 2015, with year 1 results
reported in September
Performance Levels
• PARCC will report results of summative
assessments using 5 performance levels
• Allows for finer classifications of student
performance and supports reporting of
improvement and growth
• Performance level descriptors at
www.parcconline.org/plds
• Standard setting event will occur in
summer 2015
• K-12 and HE educators will serve on
standard-setting panels
English Language Arts & Literacy
Claims and Reporting Metrics
Claim
Sub-Claim
ELA/L
Performance Level
Scale Score
X
X
Sub-Score
X
Reading
Reading
Literary Text
X
Reading Informational
Text
X
Vocabulary
X
X
Writing
Written Expression
X
Knowledge of
Conventions
X
Understanding the Claims
Mathematics
Claims and Reporting Metrics
Claim
Sub-Claim
Math
Performance Level
X
Scale Score
Sub-Score
X
Major Content
X
Additional &
Supporting Content
X
Expressing
Mathematical
Reasoning
X
Modeling and
Applications
X
PARCC Toolkit for Assessment
Literacy
Evidence Tables
What students sound like, write like,
do math like, read like - when they are
doing/knowing what is detailed in the
standards.
Performance Level Descriptors
Rubric explaining specific evidence to
look for in student responses to
assessment items by score category.
PARCC Blueprints
Assessment plan details - what
standards will be assessed on PBA,
EOY. Related to Evidence Tables
PARCC Tutorials
Specific directions/practice on the
Pearson TestNav 8 platform.
PARCC Practice Tests - scoring
guide and standards alignment
ELA PBA and Math EOY Spring 2014
ELA EOY and Math PBA Fall 2014
Schools in 14 States & DC
Participated in the Field Tests
● Over 1 million students are
participating
● Nearly 16,000 schools
● 1-3 grades per school, 2
classrooms per grade
● 10,000 items covering 21
different tests.
● 75% was online
● 25% was paper/pencil
In Ohio:
Schools: 950
Districts: 430
Students: 172,753
In NJ (Approximately 75% Field Tested):
Schools: 1276
Districts: 445
Students: 10,000+ students
Technology
Number and Types of Devices
• Rule of thumb: In a school with 3
tested grades, at least one computer
for every 2 students in the largest
tested grade
• Desktop, laptop, netbook, and thin
client/VDI computers (Windows,
Mac, Chromebook), and tablets
• All devices must meet the established
hardware, operating system, and
networking specifications
http://www.parcconline.org/technology
• Technology purchases
should consider
instructional needs, not
only assessment
Field Test Research Studies
Study
Brief Description
Participating States
1. Mode Comparability
Can paper- and computer-based assessments
be reported on the same scale?
ALL
2. Device Comparability
Are assessment results of tablet and
desktop/laptop administrations comparable?
MA, AR, CO
3. Quality of Items and Tasks
Do the items measure what was intended to
be measured? Do any items show bias? Was
human scoring reliable?
ALL
4. Text-to-Speech Validity
Does the text-to-speech accommodation
provide desired differential boost to those
who need it?
MD
5. High School Math Comparability Can traditional and integrated EOC
assessments be reported on the same scale?
ALL
6. Quality of Test Administration
Do test administrators understand
administration protocols? Do students
understand test directions?
Surveys in ALL
Site observations in MD,
TN, OH, NM, IL
7. Feasibility of International
Benchmarking
What points on PARCC scale correspond to
benchmarks from PISA, PIRLS and TIMSS?
ALL
8. Psychometric Studies
Can assessment results be put on a vertical
scale? What is the best way to combine
results from the PBA and EOY?
ALL
Collaboration
● PARCC ELCs working
together to build new
assessments
● Educators sharing
lesson ideas
○ across the hall
○ across districts
○ across states
● Resources like the
EQuIP Rubrics and
Achievethecore.org site
Shifting From Aligning To
Implementing
2012-2014
● Provide feedback on test
development tools
● Build understanding of:
o What is PARCC?
o Goals of PARCC
o PARCC & CCSS
o Changing the way educators
view assessment
o Preparing for the technology of
PARCC & CCSS
● Collaborate with other educators on
how to make instructional shifts
● Use PARCC practice/sample items
and tutorials to gain a better
understanding of how to assess the
new standards in ELA/Math
2014-2015
● Rethinking our instructional time
during testing windows o project based learning
o collaborative learning
● Rethinking the way we assess
learning
o Assessment is a tool for
gathering evidence of
learning
o formative vs summative
assessment
● 20% project - applying
skills/learning to real world,
authentic tasks
Key Messages and Storytelling
● Tests meant to be a part of instruction, not a
separate, unrelated event
● Tests that are aligned to standards - and will
match instruction aligned to standards
● Valid and reliable - making a distinction
● Tests that are being developed by educators.
Educators will continue to have oversight of
the process.
● Showing is more powerful than telling
Thank You!
[email protected]
[email protected]
@edtechgirl
Please visit PARCC online at: www.parcconline.org
Or follow us on Twitter at:
@PARCCplace #PARCC