Transcript December 19, 2013 Next Generation Science and Science Assessment Updates DECEMBER 19, 2013 WASHINGTON NEXT STEPS D E C EM BER 2 013

December 19, 2013
Next Generation Science
and
Science Assessment Updates
DECEMBER 19, 2013
WASHINGTON NEXT STEPS
D E C EM BER 2 013
OUR TIME TODAY…
Welcome
Architecture of a Standard
Transition planning
Assessment Updates and NGSS Considerations
Resources
BEFORE WE START
A little polling…
Who is with us today?
Please use the text box to let us know what
questions you may have before we start.
NGSS STATE ADOPTION UPDATE
Rhode Island
Kentucky
Kansas
Maryland
Vermont
California
Delaware
Washington State
Washington DC
THE NGSS WERE BUILT ON THE PRINCIPLES OF
A FRAMEWORK FOR K-12 SCIENCE EDUCATION
 Children are born investigators
 Understanding builds over time
 Science and Engineering require both
knowledge and practice
 Science connects to students’ interests
and experiences
 Instruction focuses on core ideas and
practices
 Science learning standards promote
equity
NATIONAL CURRENT AND UPCOMING NGSS
PROJECTS THAT WILL BENEFIT WA STATE
 SciMath Assessment Items – January 2014 Sample Available
 Evidence Statements – January 2014
 Additional Model Course Maps – Winter 2014
 Science EQuIP – Winter 2014 Available Now
 State of Science Education Research – Winter 2014
 Publishers Criteria – Spring 2014 In Progress
 STEM Works – Late Spring/Early Summer 2014
 Alignment Institutes – Early Summer 2014
NGSS PERFORMANCE EXPECTATION EXAMPLE
LAYERS OF AN EARTH AND SPACE SCIENCE (ESS)
IMPLEMENTATION AND TRANSITIONS
Advice from Stephen Pruitt, Achieve
 Develop a thoughtful and deliberate implementation plan that
supports the overall education plan
 Focus
 Be patient
Moving forward in
the slow lane
Years 0 - 3: Awareness, State-wide Capacity Building
Study Appendices
Build PD modules
Identify best placement of
current instructional
materials
Determine policy shifts
Work with other programs
like CTE; Community-based
education partners
Consider all students all
standards -equity
Years 1 - 3: Phase in Practices and Crosscutting Concepts
Construct PD - Practices
and Crosscutting Concepts:
Asking questions and
defining problems ; Analyzing
and interpreting data;
Constructing explanations;
Engaging in argumentation
Patterns; Systems and
System Models; Scale and
Proportion;
Infuse MSP designed
curricula
Years 2 - 3:
Secondary pathways; Full
implementation
Construct PD - Practices
and Crosscutting
Concepts:
Develop and use models;
Plan and construct
explanations; Use
mathematics and
computational thinking;
Obtain, evaluate and
communicate information
Cause and effect; energy
and matter; structure and
function
Stability and change
PD = Professional Development
Community-Based Education Partners = Museums, Science Centers, etc.
SEPs = Science and Engineering Practices
CCCs = Crosscutting Concepts: DCIs = Disciplinary Core Ideas
2013–14
BUILDING EACH YEAR: YEAR ZERO
Professional
Learning
From the
Framework 
Standards: What
should teachers
know and be able
to do?
Equity
Best pedagogical
practices;
Community
resources;
Thinking thru
instructional
materials
Awareness and Capacity Building
Who/How; Messaging; Retuning the State
Science Leadership Team;
Collaboration with community-based
science educator providers
Policy shifts
PESB Teacher
competencies and
NGSS; Assessment
Considerations
Data to Inform
NAEP; TIMMS;
PISA; MSP; EOC;
Course-taking;
STEM career
choices (NCES)
2014–15
BUILDING EACH YEAR: YEAR ONE
Awareness and
Capacity
Building

Identify new
Professional
Learning; Focus
on Equity; SEPs;
CCCs
Each box represents work of different
entities: OSPI, ESDs; LASER; Districts;
Teachers
Instructional
Materials Work;
Best
Kit Placement;
Explore (e)
Innovations
Policy shifts;
Assessment;
Data
2015–16
BUILDING EACH YEAR: YEAR TWO
Awareness
and Capacity
Building

Continue
Professional
Learning;
Focus on
Appendices;
SEPs; CCCs
Instructional
Materials Best
Placement
Each box represents work of
different groups: OSPI, ESDs; LASER;
Districts; Teachers
Policy shifts;
Assessment
Design
Data
Updates
2016–17
BUILDING EACH YEAR: YEAR THREE
Professional
Learning
Designed; SEPs;
CCCs are in
place
DCIs are in
place
Awareness and Capacity Building
Continues
Policy shifts;
Assessment
piloting
(Test 2017–18)
Data Collection
Continues
How will the NGSS
impact me?
KEY SHIFTS IN NGSS
Focus: The NGSS are Focused on
deeper understanding and
application of science content
reflecting real-world
interconnectedness
Coherence: Science and engineering
Build Coherently across K–12.
Integration: Science and
Engineering are Integrated across
K–12 in the NGSS.
THREE DIMENSIONS INTERTWINED….
 The NGSS are written as
Performance Expectations
 NGSS will require contextual
application of the three
dimensions by students.
 Focus is on how and why as well
as what
INSTRUCTIONAL SHIFTS IN THE NGSS
1. Focus on big picture, not lessons
2. Learning Progressions
3. Science and Engineering
4. Evidence of learning
Equity
THE THREE DIMENSIONS
Home and
Community
Classroom
WASHINGTON
BIAS AND SENSITIVITY
PROCESS
School
Effective
Strategies
for Student
Engagement
We cannot miss the equity opportunities afforded by the
Next Generation Science Standards. Resources from the home
and community, school and classroom lead to effective
strategies for student engagement.
EFFECTIVE CLASSROOM STRATEGIES CAN INCLUDE…
• connecting science education to students’ sense of place,
applying their funds of knowledge, and cultural practices,
• using project-based learning,
• using culturally relevant pedagogy,
• capitalizing on community involvement and social activism,
• using role models,
• providing accommodations and modifications for students with
disabilities,
• adopting language support strategies,
• home language support, and home culture connections.
EFFECTIVE SCHOOL-BASED RESOURCES INCLUDE…
• Material resources – curricular materials, professional
development, supplies, and other expenditures.
• Human capital – content and cultural knowledge and
leadership.
• Social capital – norms and values surrounding
learning, teaching, and relating to others.
EFFECTIVE HOME AND COMMUNITY CONNECTIONS
CAN INCLUDE…
• identifying resources and strengths in the family and home
environments of non-dominant student groups,
• involving parents and extended family
• defining problems and designing solutions for community
projects in local neighborhoods
• focusing on science learning in informal environments.
WHY FOCUS ON EQUITY?
• Reaching out to all students to engage their interest in learning
science is the right thing to do.
• A few well-placed simple steps can make all the difference in the
world for reducing the opportunity gap in science.
• The NGSS represent a new opportunity to make science relevant,
interesting and meaningful for all students, their families and the
broader community, if implemented correctly.
• Implementing the NGSS in a bias-free and culturally sensitive
manner will help reduce the opportunity gap and increase interest
in science, technology, engineering and math-related careers.
Where can I find
additional NGSS
information?
WHERE DO WE GET MORE NGSS
INFORMATION?
Science Teaching & Learning:
 Ellen Ebert, Ph.D., [email protected]
 Amber Farthing, [email protected]
Environmental and Sustainability Education:
 Gilda Wheeler, [email protected]
Science Support Staff:
 Sultana Shah, [email protected]
NGSS OSPI Website: http://www.k12.wa.us/Science/NGSS.aspx
Report from Symposium on Science Assessment:
 http://www.k12center.org/rsc/pdf/bybee.pdf
Science Assessment Updates
Questions & Answers
about the Science
Exams
OSPI Science Assessment
Information Update
Session 4.4
30
Presenters
• Dawn Cope—Secondary Science Assessment
Specialist
o [email protected]
• Kara Monroe—Elementary Science Assessment
Specialist
o [email protected]
Science Assessment—WERA December 2013
Today’s Topics
•
•
•
•
•
•
•
Next Generation Science Standards (NGSS) update
Spring 2013 results
MSP/EOC overview
Biology EOC
Assessment resources available
Test development
Upcoming events
Science Assessment—WERA December 2013
Quick poll
• Who is in the room with us today?
o
o
o
o
o
Teachers
Administrators
High school
Middle school
Elementary
Science Assessment—WERA December 2013
Washington adopted the
NGSS…what happens to
our state exams?
Science Assessment—WERA December 2013
We keep giving them…
• If you hear “2014 is the last year of the MSP,” add
“except for science.”
• NCLB and state law require that we give a state
science exam once each in elementary, middle,
and high school
• We will continue to give our state exam (based on
2009 standards) until an exam based on the NGSS is
developed
Science Assessment—WERA December 2013
Next Generation Science Standards
Adopted:
June 2009
36
First assessed:
2011 (MSP)
2012 (EOC)
Adopted:
October 2013
Possible first
assessment:
2017 or 2018 (?)
What are the steps to
building a new assessment?
Develop item specifications from the standards
Determine the test map
Develop test items (including a pilot test)
Develop Performance Level Descriptors (PLDs) from
the standards
• Administer an operational test
• Set performance level standards (Standard Setting)
•
•
•
•
• For the 2009 standards, this process took 25 months
Science Assessment—WERA December 2013
WA’s NGSS Involvement & Process
Summer 2011 to Present
DEVELOPMENT
K-12 Framework for
Science Education
NGSS Drafting Process
Confidential Drafts
Summer 2011
WA INVOLVEMENT:
- WA Selected as NGSS
Lead State – Fall 2011
- Drafting Process – Fall
2011 – Spring 2012
- Statewide educator,
stakeholder input
REVIEW/INPUT
Public Review
Revision Process
ADOPTION
States have discretion to
voluntarily adopt NGSS
Final April 2013
WA INVOLVEMENT:
- Statewide educator,
stakeholder input
- Student input
- National input
- Comments on Final
Drafts
Science Assessment—WERA December 2013
WA STATUS:
- Comparisons
- Bias and Sensitivity
- SBE Presentations
- Adoption
October 2013
BUILD AWARENESS
& CAPACITY
State Collaboration and
Sharing
Focus on understanding
Science and Engineering
Practices
Crosscutting Concepts
Appendices
Examine Equity Case
Studies
Build PD modules
We are
here
TRANSITION &
APPLICATION
- Intentional transition
plans
- Best use and
placement of
instructional materials
and resources
-Identify community
resources
- Assessment system
adjustments
Still to be determined:
• Will the science tests be developed by
Washington or with a consortium of states?
• When and how will pilot and/or field testing
occur?
• What year will be the first year of operational
testing?
• If the high school test is comprehensive, will it
be administered at grade 10 or grade 11?
• Will the elementary test cover just grade 5
standards or a broader grade band of
standards?
Science Assessment—WERA December 2013
Engrossed House Bill 1450
• From 2013 legislature
• Legislature intends that
we transition to a new
high school science
assessment as is being
done with ELA and
Mathematics
•
http://apps.leg.wa.gov/documents/b
illdocs/201314/Pdf/Bills/House%20Passed%20Legisl
ature/1450.PL.pdf
•
http://www.k12.wa.us/assessment/Sta
teTesting/default.aspx
Science Assessment—WERA December 2013
11/6/2015
40
How do we prepare for
state exams in 2014-2016?
Will my state test scores go down if I shift my
instruction to the NGSS now?
Science Assessment—WERA December 2013
What are the key shifts
in the NGSS?
• Focus: The NGSS are focused on deeper
understanding and application of science content
reflecting real-world interconnectedness
• Coherence: Science and engineering build
coherently across K-12
• Integration: Science and engineering are
integrated across K-12
Science Assessment—WERA December 2013
What are the key shifts
in the NGSS?
• Focus: The NGSS are focused on deeper
understanding and application of science content
reflecting real-world interconnectedness
• Coherence: Science and engineering build
coherently across K-12
• Integration: Science and engineering are
integrated across K-12
Science Assessment—WERA December 2013
Embed the Science &
Engineering Practices
• ~50% of points on MSP/Biology EOC are from Systems,
Inquiry, and Application standards
Science Assessment—WERA December 2013
Grade 8 example
• Practice 2: Develop
and use models
• Crosscutting 2: Cause
and effect
• Crosscutting 3: Scale,
proportion and
quantity
• More?
• Core Idea 2: Life
science
• More?
• From 2014 Updates
Science Assessment—WERA December 2013
Grade 5 (et al) example
• Practice 6: Design
solutions
• More?
• Crosscutting 2: Cause
and effect
• More?
• Core Idea 1: Physical
sciences
• From 2012 Updates
Science Assessment—WERA December 2013
Biology EOC example
• Practice 6: Construct
explanations
• More?
• Crosscutting 2: Cause
and effect
• More?
• Core Idea 2: Life
science
• More?
• From 2013 Updates
Science Assessment—WERA December 2013
Biology (et al) example
• Practice 3: Plan and
carry out investigations
• Crosscutting 2: Cause
and effect
• More?
• Core Idea 2: Life
science
• More?
• From 2014 Updates (and
many others)
Science Assessment—WERA December 2013
Where do we get more NGSS
information?
• Science Teaching & Learning:
o Ellen Ebert, Ph.D., [email protected]
o Amber Farthing, [email protected]
o WERA session 5.2 at 12:45pm today
• Environmental and Sustainability Education:
o Gilda Wheeler, [email protected]
• Science Support Staff:
o Sultana Shah, [email protected]
• NGSS OSPI Website: http://www.k12.wa.us/Science/NGSS.aspx
• Report from Symposium on Science Assessment:
o http://www.k12center.org/rsc/pdf/bybee.pdf
Science Assessment—WERA December 2013
What were the 2013 spring
MSP and EOC results?
Science Assessment—WERA December 2013
Statewide Measurements of
Student Progress Results
Science Assessment—WERA December 2013
Statewide Biology
EOC Results
Science Assessment—WERA December 2013
State Report Card
Science Assessment—WERA December 2013
Test Overview—MSP
Test Length
Grade 5: Single session 75-90 minutes*
Grade 8: Single session 90-110 minutes*
*additional time needed for passing out materials and
reading directions
Test Window
April 23 to May 15 for paper/pencil tests
April 23 to May 30 for online tests
Online Testing
Voluntary in grades 5 and 8 in 2014
Science Assessment—WERA December 2013
Online Testing—MSP
Tutorial Videos
Online Tools
Training (OTT)
OTT Lesson Plan
•
•
•
•
•
•
•
•
•
•
•
Learn about the features of the test engine
Non-interactive
Installing test engine is not required to view
Requires test engine installation on computer
Interactive
Practice using features of the test engine
Versions A and B—version B was new in 2013
Available for grade 5
Uses version A of OTT
Flexible interaction for teachers and students
Guidance for leading students through login
and directions
• Suggestions for using specific features (tools)
of the test engine with specific items
• To be updated by January 13, 2014
Science Assessment—WERA December 2013
Online Testing—MSP
Science Assessment—WERA December 2013
Test Overview—EOC
Winter—January 2 to February 7
Test Window
Test Length
Spring—May 5 to June 20
Locally determined schedule, during last
3 weeks of the course
Three sessions: 50 minutes each
OR
Single session: about 150 minutes*
*additional time needed for passing out materials and
reading directions
Science Assessment—WERA December 2013
Test & Item Specifications
• Scenario formats
• Test map (item types
and percentages)
• Item specification
statements matched to
the standards
• Vocabulary lists
• http://www.k12.wa.us/Scien
ce/TestItemSpec.aspx
Science Assessment—WERA December 2013
Test & Item Specifications
Science Assessment—WERA December 2013
What about the
Biology EOC?
Science Assessment—WERA December 2013
Is the Biology EOC still a
graduation requirement?
• Yes. Remember the…
• Legislative intent regarding high school
science assessment (2013 Engrossed House
Bill 1450, Section 4 )
o Classes of 2015 and beyond must pass to graduate
o Biology EOC—Until NGSS are adopted,
implemented and assessed
o Comprehensive NGSS Test—When NGSS are
adopted, implemented and assessed
Science Assessment—WERA December 2013
Who and when?
• Winter (January/February) 2014
o Any student (2015+) who took the EOC previously and did
not meet standard
o Students completing a biology course mid-year
• Spring 2015
o Any student (class of 2015+) enrolled in a high school level
biology course
o All 10th graders who have not yet met standard
o
o
o
Meets the high school science testing requirement of NCLB
9th grade scores from 2012 were banked for NCLB reporting in 2013
9th grade scores from 2013 were banked for NCLB reporting in 2014
Science Assessment—WERA December 2013
Special Education and
ELL alternatives:
• Biology EOC available in 6 translation languages
o Spanish, Russian, Korean, Chinese, Vietnamese, and Somali
• IEP can designate Level 2 (Basic) to meet graduation
requirement
• Developmentally Appropriate Proficiency Exam(DAPE)
o ES DAPE and MS DAPE available fall 2013, spring 2014
• For more information:
o http://www.k12.wa.us/Assessment/AlternativeAssessment/default.aspx
o John Bresko Special Education Program Supervisor
[email protected]
o Lesley Siegel Alternate Assessment Coordinator
[email protected]
Science Assessment—WERA December 2013
CAA Options:
• Begins with students in class of 2015 (current 11th graders)
• GPA comparison—draft
o A student’s grades in science courses are compared with the grades of
students who took the same courses and passed the Biology EOC.
o Available to students in their 12th-grade year who have an overall gradepoint average of 3.2 or higher.
o Students must attempt the Biology EOC at least once before attempting this
CAA option.
• Advanced Placement (AP) score of 3 or higher:
o Biology, Physics, Chemistry, or Environmental Sciences
• International Baccalaureate(IB) score of 4 or higher:
o Biology, Physics, Chemistry
• For more information:
o http://www.k12.wa.us/assessment/CAAoptions/default.aspx
Science Assessment—WERA December 2013
CAA Options:
• Collection of Evidence (COE) available fall 2013
o Must take EOC twice
o First submission June 2014
o Independent work of students
o 6-8 tasks chosen from a bank of 16 Inclusion Tasks
o Completed under the supervision of a teacher
o Two tasks “On Demand”
o Cut scores will be determined in August 2014.
o Selected tasks must include items which assess each of the six
reporting strands (System, Application, Inquiry, LS1, LS2, LS3)
three-four times.
Task Matrix: http://www.coe.k12.wa.us/Page/303
Science Assessment—WERA December 2013
Biology COE Task Matrix
Science Assessment—WERA December 2013
Biology COE Resources
• ESD 113 http://www.coe.k12.wa.us/domain/49
o Guidelines, policies, and sufficiency requirements
o Generate staff and student groups and accounts, access and complete
tasks, submit collections
o Recorded webinars
o Task Matrix
o Brief description of the 16 tasks available
• Biology COE Moodle
http://moodle2.ospi.k12.wa.us/enrol/index.php?id=57
o
o
o
o
Forum
Task development information
Links to recorded webinars
Salmonberry Habitat Practice COE task (adapted from Bio EOC scenarioUpdates 2013)
• WERA session 5.5 at 12:45pm today
o Kim Andersen COE Mathematics & Science Specialist OSPI
Science Assessment—WERA December 2013
What resources are
available?
http://www.k12.wa.us/Science/Assessments.aspx
Science Assessment—WERA December 2013
OSPI Resources
Science Assessment—WERA December 2013
Science Assessment—Educator Resources
Updates for 2014
Science Assessment—WERA December 2013
Lessons Learned
Science Assessment—WERA December 2013
Short Answer Templates
Science Assessment—WERA December 2013
Released Item Documents (RID)
Science Assessment—WERA December 2013
Who develops and scores
the science assessments?
Science Assessment—WERA December 2013
Science Assessment Development Cycle
Develop
Test and Item
Specifications
Scenario & Item
Writing Committee
Scenario & Items
reviewed for
content by
OSPI/contractor
Content Review &
Bias/Sensitivity
Committees
Pilot
Range Finding
Committee
Scenario & Item
Pilot Testing
Items available for
Operational Testing
Operational
Rangefinding
Data Review
Committee
Pilot Scoring
Operational Scoring
What about scoring?
• Who are the scorers?
o Professionals; must have a college degree. Many are teachers.
• Trained before scoring by Scoring Director (SD):
o Scenario, item, and rubric
o Anchor and Practice sets
o Qualifying sets. Must be 90% correct to qualify to score that item.
• During scoring:
o Use the rubric and training sets to score live responses
o Team Leaders and SD available
• Statistics:
o Inter-rater reliability
o Validity papers
o If a scorer is unable to improve after retraining, they are removed
from project and ALL responses they scored are re-scored.
Science Assessment—WERA December 2013
Upcoming assessment events
Date
Event
Jan/Feb 2014
Biology EOC Exam Winter Administration
February 2014
Scenario and Item Writing Workshop
April 2014
Content Review
April/May 2014
MSP Administration
May/June 2014
Biology EOC Exam Spring Administration
July 2014
Pilot Rangefinding
Sept 2014
Data Review
Science Assessment—WERA December 2013
SALT and PEPPER Teams
• PEPPER
o PreSALTers Enthusiastically Promoting Powerful Educational
Resources
o Members include science educators throughout Washington
interested in receiving Science Assessment updates.
o Members receive invitations to participate in various events
such as Scenario Writing Workshops, Content Reviews, Range
Findings and Data Review.
• SALT
o Science Assessment Leadership Team
o PEPPERS who complete an application to participate in a
science assessment event become members of SALT.
Science Assessment—WERA December 2013
SALT Information:
http://www.k12.wa.us/Science/ProfDevelopment.aspx
Science Assessment—WERA December 2013
More questions?
• Science Assessment Contact Information
o [email protected]
• Dawn Cope, Secondary Science Assessment
• Kara Monroe, Elementary Science Assessment
• Jessica Cole, Administrative Assistant
• Cinda Parton, Director of Assessment Development
• Science Assessment Web Page
o http://www.k12.wa.us/Science/Assessments.aspx
Science Assessment—WERA December 2013