Transcript ELA SBAC OWA Day 2

Smarter Balanced Writing
Performance Task
Stacey Murrell, Ed. D.
Interim Assessments Coordinator
Office of Assessment and Research
Smarter Balanced ELA Claims
ELA: Targets by Grade Level for each Claim
A writing performance task:
• Requires students to demonstrate the ability
to think and reason, and produce fully
developed products.
• Measures complex “assessment targets.”
• Provides evidence of college and career
readiness.
Performance task structure
• Consists of 3 components-
– Stimulus presentation- source documents and
prompt directions
– Information processing- student interaction with
stimulus materials- should advance the students’
understanding of the stimulus content or
assignment- constructed response items and
multiple-choice, note taking
– Scorable product or performance- essays
Who Completes Writing Performance
Task?
• 2014-2015
– WV students in grades 3-11
3 Sections of Performance Task
• First: Teacher-led standardized, classroom
activity
• Then: Part 1:
– Reading sources and answering constructed
response items and multiple-choice items
– Taking notes on scratch paper
• Part 2: Typing in an essay in a textbox on the
computer
Classroom Activity Purpose
• Introduces students to context of performance task, to
prevent disadvantage
• Gives understanding of setting or situation, potential
unfamiliar concepts (cultural, etc.), gives key terms/vocab
• Gets students interested in exploring topic more
• Designed for 30 minutes, complete in one session of time
• Non-secure and displayable materials (pictures, tables,
etc.), can use SmartBoard, etc.
• Script used by teacher to make standardized
•
http://sbac.portal.airast.org/wp-content/uploads/2014/03/Classroom-Activityand-Performance-Task-Administration-Guidelines.pdf
Performance Task Part 1
• Made up of:
–
–
–
–
Setting the Scenario
Reading the Sources
Answering Items
Taking Notes
• Teacher-student interaction will be standardized
(i.e., carefully scripted or described in the task
directions for fairness and security)
• Group work- none in ELA writing performance
task
Part 1: Scenario
• Set up a scenario for context, purpose, and
audience of the performance task
• This is not the source materials
• Scenario is short: 3-5 sentences at Grades 34; 5-7 sentences at Grades 5-8 and 11
• Does not tell the specific writing prompt, just
tells what the context, purpose, and audience
will be (writing an informational article about
being an astronaut for your teacher)
Part 1: Sources
• Vocabulary- definitions of specialized terms that
help students
• Sources should lexile below grade level when
reading is not being assessed
• Sources will be able to be read and re-read
• No Internet access- will use screenshots of
Internet pages
• http://www.smarterbalanced.org/wordpress/wpcontent/uploads/2012/05/TaskItemSpecifications
/EnglishLanguageArtsLiteracy/ELAStimulusSpecifi
cations.pdf
Part 1: Number of Sources
• Source Documents
– Number of documents dependent on grade level
Grade Span
Number of Sources
Grade 3
2 source documents
Grades 4-5
3 source documents
Grades 6-8
3-4 source documents
Grade 11
4-5 source documents
Part 1: Length of Sources
• Because students must read and integrate
multiple sources within a given amount of
time, the sources as a whole should not
exceed the maximum word counts below.
Grade Span
Maximum Words
Grade 3
1000 words
Grades 4-5
1400 words
Grades 6-8
2400 words
Grade 11
3400 words
Part 1: Items asking Questions about
Sources
• All Grades 3-11 will read the sources and
answer items before moving to the essay
writing.
• Number of items is the same regardless of
essay type and grade level:
– 2 constructed response items (hand scored)
– 1 other item type, i.e. multiple choice, hot
text(automatically scored)
How do students answer constructed
response items?
• Accuracy of answer is what matters
• Remember a person will score these using
criteria specific to the item
Sample Constructed Response Item
and Its Rubric
• The sources discuss <topic>. Explain what you have learned about
<topic>. Use one detail from each source to support your
explanation. For each detail, include the source title or number.
Score
points
Scoring Criteria
2 of 2
The response:
- Explains something learned and identifies one detail from Source 1 and one
detail from Source 2
- Gives the source title for each or uses Source 1 or Source 2 as labels.
1 of 2
The response:
- Explains something learned and identifies one detail from Source 1 or one
detail from Source 2
- Does not reference both source titles or Source 1and Source 2 as labels
0 of 2
The response either misinterprets the explanation and details from the sources
and provides no citation
Part 1: Taking Notes
• Students can take notes about the sources
which will be used to write the essay.
• They can:
– Use scrap paper and pencils
– Use Global Notes which is online note taking on
the computer
Part 2: Writing the Essay
• Tools for all students:
– English dictionary may be available
– Highlighter available
– Global Notes is online note taking page
– Spellcheck available, does not offer correct
spelling
–
From Smarter Balanced Assessment Consortium: Usability, Accessibility, and Accommodations Guidelines,
http://www.smarterbalanced.org/wordpress/wpcontent/uploads/2014/03/SmarterBalanced_Guidelines_091113.pdf
What does student writing look like?
• No student samples or exemplars exist at this
time.
• Look at the language in sample Smarter
Balanced Task for Grade 3 informational
article directions:
– “For Part 2, you are being asked to write an
informational article that is several paragraphs
long. Type your response in the box below. The
box will get bigger as you type.”
Part 2: Essay Scoring
• 10 point analytic rubric
– 4 points for organization/purpose
– 4 points for evidence/elaboration
– 2 points for conventions
• 5 different rubrics based on essay type and
grade level- no longer one rubric like WV
Writing Rubrics from WESTEST 2 Online
Writing
Smarter Balanced Writing Rubrics
(used on performance tasks essays)
Type of Essay
Grades
Narrative
3-8
Opinion
3-5
Argumentative
6-8 and 11
Informative
3-5
Explanatory
6-8 and 11
Analytic Trait Language
• Organization/Purpose (4 points)
– 4-clear and effective organization, 3- evident
organization, 2-inconsistent organization, 1-little or no
organization, NS- insufficient
• Evidence/Elaboration (4 points)
– 4-thorough elaboration, 3-adequate elaboration, 2uneven, cursory elaboration, 1- minimal elaboration,
NS- insufficient
• Conventions (2 points)
– 2-adequate command, 1- partial command, 0- little or
no command, NS- insufficient
Smarter Balanced Rubrics
• Find them here at the bottom of page:
• http://sbac.portal.airast.org/practicetest/resources/
Timing and Sequence
• Performance task has two sessions. SBAC recommends
two days.
– Classroom Activity (completed prior to sessions)
– Day 1/Part 1: Reading sources, notes, and constructed
response items and answers
– Day 2/Part 2: Writing essay
• Students unable to return to Part 1, once they begin
Part 2 (i.e., change a constructed response answer)
• Untimed sessions for Part 1 and Part 2.
• SBAC estimated times for Classroom Activity (30 mins),
Performance Task Part 1 and Part 2 (1:30-2 hours)
Practice Opportunities for
Students
Smarter Balanced Practice
• One ELA performance task per grade level
• Grades 3-8 and 11
• Here is how they are titled: Grade 3 ELA
Performance Task/Braille Performance Task [PDF]
• PDFs located here:
http://sbac.portal.airast.org/practicetest/resources/
Office of Assessment Practice
• WV teachers wrote the performance tasks using
Smarter Balanced item specifications in 2012.
• Grades 3-11 available, 9 and 10 grades also
• At least 3 practice tasks for each grade level
• Some are grade bands, such as grades 6-7
• Find them here: http://tinyurl.com/wvnxginterims
• We did not create Class Activity because we
made them prior to Class Activity being designed
ELA Smarter Balanced Practice and
Training Tests
Welcome
Smarter BalancedPractice Tests
Practice Tests are
about
content/standards.
• Experience a full grade-level assessment and
see what students will see on summative test
• Includes a variety of question types and
difficulty
• Approximately 30 items each in ELA and math
• Also has an ELA and math performance task
• Includes embedded universal tools,
designated supports, and accommodations for
IEP/504 students
Smarter BalancedTraining Tests
Training Tests are
about question types
and navigating the
site.
• Opportunity to learn software and navigational tools
• Available as grade bands:
– Grades 3-5
– Grades 6-8
– Grades 9-11
• 14-15 items, including these new technology enhanced
questions: matching tables, table fill-in, evidenced
based selected response
• No performance tasks
• Includes embedded universal tools, designated
supports and accommodations for IEP/504
How to Access Tests
• Quick Access (any users): Any Internet-connected
computer using a current Web browser including:
–
–
–
–
Mozilla Firefox
Google Chrome
Microsoft Internet Explorer 10
Apple Safari
• Advanced Access: Secure Browser can be usedlikely TIS would support this installation on the
computers.
Practice and Training Tests
User Guides
• Main Resources and Documentation Page:
http://sbac.portal.airast.org/practicetest/resources/
– Practice and Training Test User Guide (PDF):
http://sbac.portal.airast.org/wpcontent/uploads/2013/07/PracticeAndTrainingTes
t_UserGuide_021414.pdf
• Provides in-depth guidance on the practice and training
tests
• Step-by-step directions for using both tests
User Guide: Test Layout
Basic Rules:
• Unable to skip test items- Must mark for
review and return to it later.
• Answer all test items on page before going to
next page. May need to scroll vertically to see
all items.
• Marked for review items can be located using
Questions drop-down list at top of page.
Test Tools: All Tests
•
•
•
•
•
•
•
Highlight passages and questions
Zoom in and out
Mark for review
Make notes in notepad
View tutorials about item type
Strikethrough (cross out answer choices)
Access test instructions and Help screen
Test Tools: All
• Expand passage tool
– Left pane has reading passage
– Right pane has test questions on passage
– Click on icon in upper right corner of left pane to
expand passage
– Click on same icon to collapse passage
Audio Tools/Headphones
for Practice and Training Tests
Used in Tests
Accessed Via
Universal Tools
All students:
Students listen to recorded
speeches or texts using
headphones. They then
answer questions on the
audio passage.
Practice and Training Tests
website, using Chrome,
Mozilla
Designated Supports:
Students who have been
given supports such as ELL,
IEP, 504, and SAT plans.
Students have the
directions and test
questions read to them by
an embedded text-tospeech program.
Requires the Secure
Browser be downloaded to
the student’s computer
Accommodations:
Students who are
identified by an IEP or 504
plan as needing the
accommodation.
Students have the
directions, test questions,
and (optional) ELA reading
passages read to them by
an embedded text-tospeech program.
Requires the Secure
Browser be downloaded to
the student’s computer.
• ELA Training Test has
reading passage
capability, ELA Practice
Test DOES NOT.
Secure Browser Note:
Practice and Training Tests
• Text-to-Speech is only available in a secure browser. Here
are the Supported Secure Browsers for Text-to-Speech:
–
–
–
–
–
–
–
Windows Secure Browser 6.0 and 6.3
Mac Secure Browser 5.5 and 5.6
Mac Secure Browser 6.0 and 6.3
Linux Secure Browser 6.0 and 6.3
AIRSecureTest mobile secure browser for iOS
AIRSecureTest mobile secure browser for Android
AIRSecureTest mobile secure browser for Google
Chromebooks
Instructions for downloading the secure browsers are available on the
Smarter Balanced portal
(https://sbac.portal.airast.org/browsers/default.html) and in the Technical
Specifications Manual for Online Testing.
Practice Test Answer Keys
•
•
•
•
•
•
•
•
Grade 3 ELA/Braille [PDF]
Grade 4 ELA/Braille [PDF]
Grade 5 ELA/Braille [PDF]
Grade 6 ELA/Braille [PDF]
Grade 7 ELA/Braille [PDF]
Grade 8 ELA/Braille [PDF]
Grade 11 ELA/Braille [PDF]
http://sbac.portal.airast.org/practicetest/resources/#manuals
Smarter Balanced:
2013 Pilot Test Extra Practice
• These are PDFs which could be used as additional
practice for students (such as SmartBoard, group work,
etc.).
• Grade 3 ELA/Braille [PDF]
• Grade 4 ELA/Braille [PDF]
• Grade 5 ELA/Braille [PDF]
• Grade 6 ELA/Braille [PDF]
• Grade 7 ELA/Braille [PDF]
• Grade 8 ELA/Braille [PDF]
• Grade 11 ELA/Braille [PDF]
• http://sbac.portal.airast.org/practicetest/resources/#manuals
Office of Assessment:
ELA Cluster Assessments
• Claim 1 Literary Texts- available now grades 3-11
• Claim 1 Informational Texts- under construction,
available mid-Dec. grades 3-11
• Claim 2 Writing Performance Tasks- available now
grades 3-11
• Claim 3 Speaking and Listening- under
construction, available mid-Dec. grades 3-11
• Claim 4 Research- under construction, available
late Nov. grades 3-11
• Answer Key provided for each cluster
Question and Answers
Part 2:
Survey Questions and Answers
• Q: How to use tools
• A: The tools available in the practice and
training tests are explained in detail here:
http://sbac.portal.airast.org/wpcontent/uploads/2013/07/PracticeAndTrainin
gTest_UserGuide_021414.pdf
• Q: How will tests be scored?
• A: Smarter Balanced will soon be releasing the
proficiency score ranges for the tests. I will be
discussing scoring/score points possible on ELA
test questions in detail during Nov. 12 training.
• Smarter Balanced ELA item specifications provide
exact scoring points for each item type and task.
• Q: Are there samples of student writing available
as exemplars for writing performance tasks?
• A: At this time, student exemplars have not been
released to the public. I will share the websites
with county test coordinators once the exemplars
are shared.
• There are exemplar answers shown for the
constructed response items that students answer
before they write their essays.
• Q: For writing performance tasks, will the
sources be fictional, non-fictional, or both?
• A: Based on Smarter Balanced practice
performance tasks online, there were no fictional
texts used as sources.
• The SB sample Grade 6 performance task asks
students to write a narrative. This is the ONLY
sample of a narrative writing performance tasks
at any grade level.
• Q: How can we prepare our special education
students so they are not overwhelmed?
• A: Download the secure browser to their
computers and let them practice using the tools,
supports, and accommodations within the
practice and training tests.
• Additionally, the interim program replacing Acuity
will allow students the same experience in both
the interim program and the summative test.
• Q: Will Smarter Balanced be tailored to WV NxG
or Common Core standards?
• A: The practice and training tests are aligned to
Common Core. There is a crosswalk document
from the Office of Secondary Learning. The main
difference is the numbering system format;
however, WV did edit some of the language and
concepts.
• http://wveis.k12.wv.us/Teach21/public/ng_cso/E
LA_N.pdf
• Q: When will ELA teachers get more specific
trainings?
• A: Once the interim assessments program
(like Acuity) has been provided, then we will
begin offering RESA and county trainings.
• Q: How similar is the writing performance task to WV
Writes?
• A: Two points I want to share. First, the student writing in
WV Writes will have prepared us for the writing. Our
students can draft well-written essays. The challenge is
that they now read sources and must use the information
within the sources to support their own writing.
• Second, the essays written in the interim assessment
program will NOT be instantly scored by a computer. The
essays will have to be hand scored by teachers. The essays
for the summative performance task will be hand scored by
the assessment vendor.
• Q: Where can I find classroom activities to use as
models for creating my own in the classroom?
• A:
• Grade 3: Out of This World [PDF]
• Grade 4: Animal World [PDF]
• Grade 5: Working Together [PDF]
• Grade 6: Technology of the Future [PDF]
• Grade 7: Sleep [PDF]
• Grade 8: The Money We Use [PDF]
• Grade 11: Financial Responsibility [PDF]
• http://sbac.portal.airast.org/practicetest/resources/#manuals
• Q: Will grades 9 and 10 have an ELA test?
• A: Yes, we are planning on testing grades 9
and 10 in ELA. Smarter Balanced has items for
both these grade levels. They do NOT offer
practice tests; however, WVDE has practice
clusters for grades 9 and 10 and will be
providing additional practice clusters.
• Q: Will the reading and writing tests be scored
together or separately?
• A: Each student receives an overall ELA/literacy
score and four claim (Reading, Writing, Speaking
and Listening, and Research) scores or subscores
reported at the individual level.
•
http://www.smarterbalanced.org/wordpress/wpcontent/uploads/2014/05/ELA_Preliminary_-Blueprint-2014_04-30Final.pdf
Questions?
•
•
•
•
•
•
•
•
•
•
•
•
http://www.smarterbalanced.org/smarter-balanced-assessments/
Click here to view item specifications
English Language Arts/Literacy Item Specification
ELA CAT Item Specs Grades 3-5 (ZIP) (Update 2/4/14)
ELA CAT Item Specs Grades 6-8 (ZIP) (Update 2/4/14)
ELA CAT Item Specs Grades 9-11 (ZIP) (Updated 2/4/14)
ELA PT Item Specs Opinion Grades 3-5 (ZIP) (5/20/14)
ELA PT Item Specs Narrative Grades 3-5 (ZIP) (5/20/14)
ELA PT Item Specs Informative Grades 3-5 (ZIP) (5/20/14)
ELA PT Item Specs Narrative Grades 6-8 (ZIP) (10/27/14)
ELA PT Item Specs Explanatory Grades 6-8,11 (ZIP) (5/20/14)
ELA PT Item Specs Argumentative Grades 6-8,11 (ZIP) (5/20/14)