Transcript Test Specifications, Performance Tasks, Rubrics, oh My!

Rachel A. Aazzerah
Science and Social Sciences Assessment
Specialist
Oregon Department of Education
Email: [email protected]
AUDIENCE SURVEY
Raise your hand if:

You work in elementary grades K-5

You work in middle school 6-8

You work in high school

You are a TOSA

You work in the district office

You are a curriculum specialist

You are just interested
Using one hand (0-5), show your knowledge of:

Common Core Standards

Smarter Balanced Assessment in General

Smarter Balanced Assessment Performance Tasks
OVERVIEW
1. Introduction to Smarter Balanced
2. Claims
3. Targets
4. Test Specifications
5. Summative Assessment Item Types
6. Performance Tasks
7. Rubrics
8. Public Release of Sample Smarter Balanced Items
9. Resources
10. Questions
INTRODUCTION TO SMARTER BALANCED
OAKS-SMARTER BALANCED ASSESSMENT
TRANSITION TIMELINE
2011-2012
2012-2013
2013-2014
2014-2015
OAKS
OAKS
OAKS
Smarter
OAKS
Reading based on 2002 ELA Content Standards
Writing based on current scoring guide
Mathematics based on 2007/2009 Math Content
Standards
Smarter Balanced Assessment
Based on Common Core State Standards adopted by
Oregon in 2010
SMARTER ITEM DEVELOPMENT
SMARTER ITEM TYPES OVERVIEW
•Assess a broad range of content.
•Scoring is objective, fast, and inexpensive to score.
•Difficult to understand a student’s reasoning process and
to assess higher-order thinking skills.
TEXT
TEXT
TEXT
•Require the student to generate a response as opposed
to selecting a response.
•Include both short and extended responses.
•Allow students to demonstrate their use of complex
thinking skills consistent EXT
with the expectations for college
and career readiness.
TXT
•Require students to demonstrate ability to think and
reason, and produce fully developed products.
•Measure complex “assessment targets.”
•Provide evidence of college and career readiness.
CLAIMS FOR MATHEMATICS SUMMATIVE
ASSESSMENT
Claim
#1
Concepts & Procedures: “Students can explain and apply
mathematical concepts and interpret and carry out
mathematical procedures with precision and fluency.”
Claim
#2
Problem Solving: “Students can solve a range of complex wellposed problems in pure and applied mathematics, making
productive use of knowledge and problem solving strategies.”
Claim
#3
Communicating Reasoning: “Students can clearly and precisely
construct viable arguments to support their own reasoning and
to critique the reasoning of others.”
Claim
#4
Modeling and Data Analysis: “Students can analyze complex,
real-world scenarios and can construct and use mathematical
models to interpret and solve problems.”
SMARTER ELA CLAIMS
Claim 1
Reading
• Students can read closely and analytically to
comprehend a range of increasingly complex
literary and informational texts.
Claim 2
Writing
• Students can produce effective and wellgrounded writing for a range of purposes and
audiences.
Place text
here
• Students can employ effective speaking and
Claim 3
listening skills for a range of purposes and
Speaking & Listening
audiences.
Claim 4
Research
• Students can engage in research/inquiry to
investigate topics, and to analyze, integrate,
and present information.
SMARTER BALANCED ASSESSMENT TARGETS
For each of the different claims, Smarter Balanced has
developed assessment targets (i.e. assessable
content that will be on the summative assessments).
Math: Claim 1- By Grade Level (In Packet)*
Claim 2, 3, 4- Mathematical Practices
(Same for all grade levels)
ELA:
Targets by Grade Level for each Claim
SUMMATIVE ASSESSMENT TEST
SPECIFICATIONS
M AT H
ELA
*Computer Adaptive
Test (CAT) with SR, CR,
TE items
*Computer Adaptive
Test (CAT) with SR, CR,
TE items
*Performance Task(s)
*Performance Task(s)
Given last 12-15
weeks of school year
Given last 12-15
weeks of school year
SAMPLE MATH ITEMS
*Number Line
*Painting a Barn
*Soybean Field
*Julie’s Jackets
*Frogs and Flies
*All sample items are found in the presentation packet.
Additional Sample Items can be found on the Smarter Balanced
website: www.smarterbalanced.org (Assessments).
SAMPLE ELA ITEMS
*Excerpt from Summer on Wheels (ELA Selective Response
Item)
*Sojourner Truth (ELA Technology Enabled Item)
*Annie John (ELA Constructed Response Item)
*All sample items are found in the presentation packet
Additional Sample Items can be found on the Smarter
Balanced website: www.smarterbalanced.org
(Assessments).
GUIDELINES FOR DEVELOPMENT OF SMARTER BALANCED
PERFORMANCE TASKS
 Represent content that is relevant and meaningful to students
 Allow for demonstration of important knowledge and skills, including such 21 st
century skills as critically analyzing and synthesizing information presented in a
variety of formats, media, etc.
 Incorporate knowledge and skills of prior grades, even though the major focus is
on the standards for the current grade level.
 Allow for multiple points of view and interpretations.
 Are scored using multiple rubrics uniquely matched to the primary content claims
and targets identified by the task developer in the task forms.
 Be feasible for the school/classroom environment.
(From: Smarter Balanced Assessment Consortium: Performance Task Specifications,
April 16, 2012)
PERFORMANCE TASKS
Performance Tasks
The use of performance
measures has been found
•Extended projects demonstrate realworld writing and analytical skills
•May include online research, group
projects, presentations
•Require 1-2 class periods to complete
•Included in both interim and
summative assessments
•Applicable in all grades being
assessed
•Evaluated by teachers using
consistent scoring rubrics
to increase the intellectual
challenge in classrooms
and to support higher-quality
teaching.
- Linda Darling-Hammond and
Frank Adamson, Stanford
University
PERFORMANCE TASKS SUMMARY
Performance tasks:
 should incorporate real-world, college- and career-related skills that require students
to accomplish complex goals during multiple testing sessions.
 involve a significant interaction of students with stimulus materials leading to an
exhibition of the students’ application of knowledge and skills, often in writing or
spoken language.
 should be multi-stepped and allow for reflection and revision.
 are used because the ability to integrate knowledge and skills across multiple
content standards is a critical skill that cannot be assessed with selected response
or constructed response items.
MATH PERFORMANCE TASK PREVIEW
Sample Smarter Math Performance Task
Grade 5:
School Festival
You serve on a committee that is in charge of planning a school festival.
The following tasks need to be completed by committee members as part
of the planning for the school festival.
• Determine the budget for the festival.
• Choose the food and drinks for the festival.
• Determine amounts of supplies for making a dessert.
• Make a schedule of the different activities.
• Make some decisions on the games and prizes used during the festival.
* Details and rubrics are in the session packet. Up to two class sessions (90 minutes) are
suggested for this task, with no pre-teaching necessary.
ELA PERFORMANCE TASK PREVIEW
Sample Smarter English Language Arts Performance Task
Robot Pets
 Session 1 (60 minutes)
o Read 1 article and watch 2 brief videos on robots as pets, taking notes
o Respond to 3 constructed-response questions: 1 addressing reading
comprehension, 2 addressing research skills
 Session 2 (45 minutes)
o Read 1 article and watch 1 short video, taking notes
o Small discussion group work
 Session 3 (90 minutes)
o Compose full-length argumentative essay on robots as pets
o May use notes and refer back to articles
o Pre-writing, drafting, and revising will be involved
ELA PERFORMANCE TASK PREVIEW
Sample Smarter English Language Arts Performance Task
Robot Pets
 Video 1: Fujitsu’s cute teddy-bear robot shows what
it can do, May 2010.
http://www.youtube.com/watch?v=AwWeN1ARy74
 Video 2: Pleo: Robot, pet or both? December 2007
http://www.youtube.com/watch?v=F6LCEFr8SxQ
 Video 3: Maya’s Human Interaction
http://www.youtube.com/watch?v=9b4jx5RzqAk
SMARTER GENERIC WRITING RUBRIC
Five Attributes (4-point scale)
Statement of Purpose/Focus
Organization
Elaboration of Evidence
Language and Vocabulary
Conventions
Individual scores contribute to the overall score
on the summative assessment
RESOURCES
 Smarter Balanced Website
http://www.smarterbalanced.org/
 Smarter Sample Items and Performance Tasks
http://www.smarterbalanced.org/smarterbalanced-assessments/#item
 Smarter Item Writing and Review Materials
http://www.smarterbalanced.org/smarter-balanced-assessments/itemwriting-and-review/
 Common Core State Standards Toolkit
http://www.ode.state.or.us/search/page/?id=3430
 Common Core State Standards Assessment Resources
http://www.ode.state.or.us/search/page/?id=3298
PUBLIC RELEASE OF SAMPLE SMARTER
BALANCED MATH AND ELA ITEMS
*Smarter Balanced will release 60 Math and 60 ELA Sample items
(both Computer Adaptive Test items and Performance Tasks) for
all grade levels (3-8 and High School (11) on October 9, 2012
http://www.smarterbalanced.org/sample-items-and-performancetasks/.
*The public will be able to take a sample test, in which they can
score some of the questions to see if they answered it correctly
or not (rubrics included).
http://www.smarterbalanced.org/sample-items-andperformance-tasks-questions-and-feedback/.
QUESTIONS
Thank you for attending this presentation!
Rachel Aazzerah: [email protected]
Additional ODE ContactsMark Freed (Math): [email protected]
Ken Hermens (English): [email protected]
Derek Brown (Essential Skills): [email protected]
ODE Webpage: www.ode.state.or.us