Problem Solving & Response to Intervention
Download
Report
Transcript Problem Solving & Response to Intervention
1
2
Participants will understand…
Use of common formative and summative assessments
to enhance Tier 1 data collection
Data Tracking of Assessments for Curriculum Alignment
with Standards
Different Data to Analyze Tier 1 Health
SBLT Process Responsibilities for Identifying and
Tracking Targeted At-Risk Student Populations
TDT Problem-Solving and Recommendations for Tier 1
and Tier 2 Services
IPST Process for Parent Request, Teacher Request, and
Re-Evaluation
3
WHY ARE YOU
HERE?
4
Consensus
Infrastructure
Implementation
5
6
1. Innovators/adopters: welcome change
2. Susceptibles: resent current practices;
feelings of dissonance
3. Nonsusceptibles: do not believe change is
needed
4. Resisters: sabotage change efforts
(Powell, 1988)
7
“Step 0” in problem-solving model = building foundation
for collaboration.
Steps:
Establish and maintain rapport among members.
Formulate sense of trust and respect (How?)
Clarify expectations for participation including roles and
responsibilities, shared accountability, legal and ethical
guidelines, preferred communication lines and so forth.
Establish understanding for problem-solving process.
8
RtI
How do we tie all of these initiatives together?
9
Brevard
Effective
Strategies for
Teaching
Professional
Learning
Communities
Response
to
Intervention
Student Achievement
10
Problem Identification
What does your
DATA say about
student
achievement?
What is the problem?
Evaluate
Problem Analysis
Did the plan work?
Why is it occurring?
Develop and Implement
Plan
What can we do about it?
11
Capacity to Problem-Solve
Capacity to Collect Data, and Make
Sense of it
Capacity to Display Data Over Time
Capacity to deliver instruction at
different intensities (Tiered-levels of
services)
12
13
Historical & Current
Academic Data
Formative Data
*Student data
*Class data
Summative Data
*Benchmark data
*Grade level data
Behavioral Data
Intervention Data
Progress
Monitoring
14
Analyze the past – How did we do? What can
we do better?
Plan for today, drive our instruction- What
should we do differently?
Diagnose-What specifically is the issue?
Progress Monitor-Is what we are doing
working?
Predict the future
15
Identify students early.
Ensure that students’ difficulties are not due to a lack of
alignment between the instruction, curriculum,
environment, and learner (I.C.E.L.).
Modify instruction and implement evidenced-based
interventions based on individual needs.
Make informed decisions about what resources are needed
to ensure student success.
16
INSTRUCTION
LEARNER
DATA
CURRICULUM
ENVIRONMENT
17
Formative and Summative
Created by teachers, in collaborative PLCs, to Inform
Tier 1 Instruction
The first school-leveled factor to increase student
achievement is to provide a guaranteed and viable
curriculum.
Has the most impact on student achievement
Is the combination of two interdependent factors
▪ Opportunity to learn (OTL)
▪ Time
▪ Marzano (2003) , What Works in Schools
Intended Curriculum
Implemented Curriculum
Attained Curriculum
Discrepancy between the intended
curriculum and the implemented curriculum
is where Opportunity to Learn (OTL) makes a
prominent factor in student achievement.
▪ Marzano (2003) , What Works in Schools
Action Steps - Increase OTL
Identify and communicate the intended
curriculum
Connect essential curriculum and instructional
time
Sequence and organize essential content
Ensure implemented curriculum
Protect the instructional time available
Students should all be exposed to the same
standards, knowledge, skills, and opportunity to
learn in each class
▪ Marzano (2003) , What Works in Schools
If all students are expected to demonstrate the
same knowledge and skills (attained curriculum),
regardless of the teacher to which they are
assigned, it only makes sense that teachers must
work together in a collaborative effort to assess
student learning.
and more importantly, learned !!!
Feedback is “information communicated to
the learner that is intended to modify his or
her thinking or behavior for the purpose of
improving learning”
▪ John Hattie & Helen Timperley, (2007), The Power of Feedback
Assessment is the most common form of
feedback
▪ Marzano, (2010), Formative Assessment & Standards-Based
Grading
23
Common Assessments are frequent and common
to all students in a class, grade, or content area.
Ex:
All English 1 Honors
Algebra II
7th Grade Integrated Science
10th Grade American History, etc.
(Fullan, 2005a;Hargreaves & Fink, 2006; Reeves, 2004; Schomoker, 2003; Stiggins, 2005).
One of the most
powerful,
high-leverage
strategies
for improving student learning
that is available to schools
is the creation of Common Assessments
in the content areas.
Frequent, common, high-quality formative
assessments help teachers inform instruction before
summative assessment occurs.
(Fix problems before failing).
Designed by teachers (experts) who are
collaboratively working together (PLC)
To help a group of students develop agreed-upon
knowledge and skills
FORMATIVE ASSESSMENTS
SUMMATIVE ASSESSMENTS
are assessments FOR
learning
are assessments OF
learning
measure a few things
frequently
measure a lot of things
once
FORMATIVE ASSESSMENTS
SUMMATIVE ASSESSMENTS
Answers the questions:
Answers the question:
Are students learning
what they need to
learn?
Which students learned
what was intended and
which did not?
Who needs additional
time and support to
learn?
FORMATIVE ASSESSMENTS
are timely, in-process
measurements that
inform teachers
regarding the
effectiveness of the:
core curriculum
instructional strategies
interaction of these with
the learner.
SUMMATIVE ASSESSMENTS
determine whether
students have met
intended standards by
a specific deadline.
FORMATIVE ASSESSMENTS
is like a physical exam
can provide both the “doctor”
and the “patient” with timely
information regarding the
patient’s well-being
can help with a prescription
for an ailing person
or assist a healthy person to
become even stronger.
SUMMATIVE ASSESSMENTS
is like an autopsy
can provide useful information
that explains why the ‘patient’
has failed or what has already
happened
but the information often
comes too late... at least from
the patient’s perspective.
Clearly defined goals related to learning and
assessment
help teachers provide descriptive feedback to
students
provides students with concrete information in
how to improve
This feedback is due to in-depth analysis of the
results.
The growth students experience helps to build
confidence as learners
The growth teachers experience helps to build
teacher efficacy and instructional skill set
32
Inform the practice of individual teachers.
provide teachers with a basis of comparison as
students learn, skill by skill
how the performance of their students is similar
to and different from other students who took the
assessment.
In terms of RtI, this is called peer comparison data
It also assesses the effectiveness of the
core curriculum
instructional strategies
learning environment (opportunities to learn)
learner interaction with these elements
34
•
Common formative assessments help identify
groups of students who need additional support and
time to ensure their learning.
•
Everything students might SAY, DO, or CREATE has
the potential to be formative because it can provide
information about how much they understand and
helps the teacher plan the next steps of instruction.
• Obtrusive Assessments – take instructional time
• Unobtrusive Assessments – do not take instructional time
• Student generated assessments
Teachers in common courses in a school …
◦ Are responsible for ensuring students acquire
knowledge and skills
◦ Will work together (it makes sense)
◦ Should divide responsibilities, No duplication of
effort (expensive!)
Teachers in common courses in a school …
◦ Use common data to inform and improve the
practice of individual teachers as well as teams of
teachers
◦ Use common data to build the capacity of the
team to achieve at higher levels
◦ Have a ‘Plan B’ essential to systematic
interventions when students do not learn.
37
1st 9 Weeks
Formative, Formative, Formative, Formative
(Determined by Teacher Teams)
Summative: 1st 9 Weeks Exam
2nd 9 Weeks
Formative, Formative, Formative, Formative
(Determined by Teacher Teams)
Summative: 2nd 9 Weeks Exam, End of
Semester Exam
3rd 9 weeks
Formative, Formative, Formative, Formative
(Determined by Teacher Teams)
Summative: 3rd 9 Weeks Exam
4th 9 Weeks
Formative, Formative, Formative, Formative
(Determined by Teacher Teams)
Summative: 4th 9 Weeks Exam, End of
Semester Exam or End of Course Exam
Start with the end in mind
◦ What do we want our students to learn?
◦ What are the standards? Strands?
◦ What are the assessments that we will use to
measure these standards? Strands?
Unpack the Standards, Map the Curriculum,
Assessments, Units, and Lessons
◦
◦
◦
◦
What curriculum will we use to teach these
standards and strands?
What lessons will we use to address the
standards/strands?
When will we measure?
What is our plan to address students who
need more time/instruction? (Plan B)?
43
As teachers analyze data, consider:
For each question or assessment item – how
many students got it right, how many students
got it wrong?
What does this tell you about the test question?
It is across all classrooms? Is the data different
across the classrooms?
As teachers analyze data, consider:
Did one teacher cover the material differently?
Does this reflect in the formative measures, also?
How can we address inclusion classes?
45
As teachers analyze data, consider:
For each test item, for the students who got it
wrong, what did they choose? Is there a pattern to
the ‘wrong’ answers chosen?
Did a lot of students choose answer B or are they
spread out across B, C, and D if the answer is A?
As teachers analyze data, consider:
Is it a possible bad test item that needs to be re-
written to assess the standard objective?
How will you determine this?
47
Using Data to Drive Instruction
What was required of teachers?
How did we get buy in?
Lessons learned.
50
Summative Assessments
Formative Assessments
51
Teacher Data Teams
Summer meetings
Determining strengths and
weaknesses
52
53
Essential that teachers understand that the data is
feedback, not an indictment.
Teachers will resist using data if they feel that the
information will be used against them for evaluative
or punitive purposes.
Leadership should facilitate school climates where it
is professionally and emotionally safe to look at
student data.
Teachers need to collaboratively examine
classroom-level data so that they can identify and
learn effective instructional techniques from each
other
54
Curriculum mapping
Formative assessments
Using the data to drive instruction
Reteaching – ensuring student
learning
55
Collaboration is the key
to success!
Looking Back…
•Summative Data
•Historical Data
57
Collection
What is collected and who collects it?
How frequently is it collected?
Organization
Disaggregated by grade, gender, race, language, SES?
Designed to answer specific questions (Tier 1/2
effectiveness?
Display-necessary to evaluate RtI
Goals/Benchmarks
Aimline
Trendline
Rate
58
Analyze the past –
How did we do?
What problems can we identify?
What can we do better?
59
60
Awesome Elementary FCAT Reading Data Trends
100
90
% Meeting
High
Standards
Reading
80
70
% Making
Learning
Gains Reading
60
50
% Lowest 25%
Making
Learning
Gains Reading
40
30
20
10
0
2006-07
2007-08
2008-09
2009-10
2010-11
2011-12
2012-13
2013-14
61
CORE REPORTS
62
Student Desk Top Data System
63
Problem ID
Several years of declining writing scores
Why is problem occurring?
Lack of consistency with curriculum and
instruction in each class
Lack of clear expectations for student behaviors
and performance
What will we do about it?
64
65
66
67
68
Use Data to:
Report Data to:
inform instructional strategies
measure growth over time
identify misunderstandings &
measure mastery
update parents, principals,
school
track student’s progress
Reward or consequence
students
69
70
Using A3 to Manage RtI Data
School Leadership Teams
Using CORE reports
71
Are we
meeting the
needs of our
SUBGROUPS?
Is the core meeting the needs of
80% of the students?
72
Look at the data
-What questions do you have?
- Do you have all the information you
need to make choices?
73
Look at the data
- As a diagnostic test, what choices
would you make?
- As a summative test, what choices
would you make?
74
Area of Concern
Observations
Set up/ record meetings
75
Click on name of student, hit enter, and scroll down the page to
Areas Of Concern (Tiers 1-2).
76
Scroll down the page to Areas Of Concern (Tiers 1-2).
77
Click on “Green Symbol”
to open new window to create Areas Of Concern.
* Note: Please add a new Area of Concern for each subject area (e.g. reading, math),
behavior, etc.
To DELETE an area of concern, click on the red X and then click on OKAY.
78
79
Select Learning Consideration by clicking on drop down box.
80
Enter information into Description Box and Comment Box. Click Okay to save
information.
81
Once the Area of Concern has been created, your next step is to create as many
interventions, progress monitoring updates, observations, assessments as
needed .
Click on Magnifying Glass
to enter information on the following areas:
Observations, Interventions, Progress Monitoring
Click on red X to DELETE an area of concern and then click OKAY.
82
ADDING OBSERVATIONS
Add OBSERVATIONS by clicking on the Green Plus sign
.
Then click Okay.
Update the OBSERVATION by clicking on the Magnifying Glass
.
To DELETE progress monitoring click on the red X and then click OKAY.
83
84
Parent Conferences and other meetings can
be documented in the MEETINGS section.
Add MEETING information by clicking on the Green Plus
sign
. Then click Okay.
Update MEETING info by clicking on the Magnifying
Glass
.
To DELETE meeting info click on the red X and then
click OKAY.
85
Roles and Responsibilities
School-based Leadership Team (SBLT)
Teacher Data Team (TDT)
Student Review System
Identifying AYP-driven priority students
Timeline
It’s not too late to start!
Review historical data from to discuss general
Tier 1 strengths/weaknesses and set priorities
for concern areas
Tier 1 – B.E.S.T. model for improvement
Tier 2 – Intervention reading and math
Targeted at-risk students - AYP-focused
▪ Grade level(s)
▪ Sub-group(s)
Student Review System
FAIR – Reading comp., MAZE, Word analysis
District Math and Science Assessments
G.P.A.
Attendance
Behavior
Teacher-directed
Decide on time and place to provide a
consensus survey with faculty
Paper survey
Online survey
Plan overview faculty training by RtI coach
15-20 minutes
Plan A3 faculty training by RtI coach
20 minutes in lab during plannings
Identify/Appoint Teacher Data Team(s)
Middle Schools
▪ MESH teams
High Schools
▪ Four teachers, Guidance, Literacy Coach
▪ All MESH and grade levels represented
Literacy Coach
Lowest 25%, L1 and L2 students
Works with reading teachers
RtI Coach
L3 or above
Guidance Counselor
Alert English teachers of identified students from
historical data for Tier 1 classroom supports
Student Review System is updated
RtI Coach and Literacy Coach
SBLT - prioritizes students for TDT review and
problem-solving
Guidance Counselor – contacts all teachers of
priority students for A3 observational input
TDT – meets to review and problem-solve
HOLDING EFFECTIVE
TEACHER DATA TEAM
MEETINGS
93
•
•
•
•
•
•
•
•
•
•
No agenda is prepared
Member sabotage with own agenda
No time schedule has been set for the meeting
No one is prepared
No facilitator is identified
No one agrees on anything
No action plan is developed
Everyone is off task
Negative tone throughout the meeting
Unclear who is responsible for what
94
PURPOSE
Student Achievement
Collaborate to problem
solve and plan interventions
both at Tier 1 and Tier 2 level
Monitor student progress
Learn from each other
95
Work with your team to develop a job
description for each of these Teacher Data
team roles and assign a school-based person
to each.
Facilitator
Timekeeper
Recorder
96
Problem Identification
What is the problem?
Evaluate
Problem Analysis
Did the plan work?
Why is it occurring?
Develop and Implement
Plan
What can we do about it?
What are the problems?
Individual and/or group
Why are they occurring?
ICEL – individual and/or group (focus on ICE)
Hypothesis
What are we going to do about it?
MESH Tier 1 classroom strategies
Is it working?
Review in December/January
Re-prioritize Student Review System
SBLT using semester and term data
Collect and disaggregate data
RtI Coach, Literacy Coach, Guidance
More observational data from teachers in A3
TDT Problem-solving
Recommendations to SBLT
Tier 2 intervention decisions
Who, what, when, where?
Priority students receive Tier 2 additional
interventions
Jefferson Middle School - 2010
Who: AP and ASP-funded proctor
What: Voyager computer-based program
When: Once a week during activity period
Where: Computer lab
SBLT - Is it Working?
Review Tier 1 and Tier 2 data
Begin planning for next year
▪ Instructional PD, curriculum mapping, school-wide
environmental issues
TDT
Review priority student Tier 2 data and make
MESH recommendations
Review problem-solving process for lessons
learned
Teacher-directed referral
▪ TBD
Parent-directed referral
▪ TBD
Re-evaluation
▪ TBD
102
Use of common formative and summative
assessments to enhance Tier 1 data collection
Data Tracking of Assessments for Curriculum
Alignment with Standards
Different Data to Analyze Tier 1 Health
SBLT Process Responsibilities for Identifying and
Tracking Targeted At-Risk Student Populations
TDT Problem-Solving and Recommendations for
Tier 1 and Tier 2 Services
IPST Process for Parent Request, Teacher Request,
and Re-Evaluation
103