Transcript Action Research Deployment Teams

Action Research
Deployment Teams
March, 2007
Agenda
 Team
reflection
 Completing the PDSA cycle
 Team planning for continuous
improvement
Reflection…
 Thinking
about PDSA as a
school improvement model this
year…
What has worked well?
 What did you learn?
 What would you do differently
next year?

Where did we
leave off again?
A quick review of
last session
Pre Planning: Identification of Need
1.
2.
3.
4.
Develop/Review Student Learning Expectations
Examine alignment of learning expectations with assessments
Review assessment data
Identify areas of need based on assessment
Plan:
1. Describe the current process for addressing the identified area of need (flow chart)
2. Review data to determine baseline performance in the specific area identified
(Run Chart/Pareto Diagram)
3. Identify potential root causes contributing to the identified area of need
(Cause & Effect Diagram, 5 Why’s, Relations Diagram)
4. Study research-based best practice/improvement theory addressing areas of need
Act:
1. Standardize the implementation of researchbased best practice (improvement theory) that
improved student learning (revise the flow chart to
reflect changes made to the system)
2. If improvement theory was unsuccessful continue
the PDSA cycle (try another improvement theory
based on the next identified root causes)
Action
Research
Overview
for
Professional
Learning
Communities
DO
1. Plan for implementation of improvement theory
(Force Field Analysis, Action Plan)
2. Implement research-based best practices
improvement theory based on root causes according to
the Action Plan
3. Monitor the implementation of research-based best
practice/improvement theory to insure integrity and
fidelity
4. Assess student learning
Study:
1. Examine student assessment results (compare to baseline)
2. Assess the impact of research-based best practice/improvement theory on student
achievement
Pre Planning: Identification of Need
1.
2.
3.
4.
Develop/Review Student Learning Expectations
Examine alignment of learning expectations with assessments
Review assessment data
Identify areas of need based on assessment
Plan:
1. Describe the current process for addressing the identified area of need (flow chart)
2. Review data to determine baseline performance in the specific area identified
(Run Chart/Pareto Diagram)
3. Identify potential root causes contributing to the identified area of need
(Cause & Effect Diagram, 5 Why’s, Relations Diagram)
4. Study research-based best practice/improvement theory addressing areas of need
Act:
1. Standardize the implementation of researchbased best practice (improvement theory) that
improved student learning (revise the flow chart to
reflect changes made to the system)
2. If improvement theory was unsuccessful continue
the PDSA cycle (try another improvement theory
based on the next identified root causes)
Action
Research
Overview
for
Professional
Learning
Communities
DO
1. Plan for implementation of improvement theory
(Force Field Analysis, Action Plan)
2. Implement research-based best practices
improvement theory based on root causes according to
the Action Plan
3. Monitor the implementation of research-based best
practice/improvement theory to insure integrity and
fidelity
4. Assess student learning
Study:
1. Examine student assessment results (compare to baseline)
2. Assess the impact of research-based best practice/improvement theory on student
achievement
Pre Planning: Identification of Need
1.
2.
3.
4.
Develop/Review Student Learning Expectations
Examine alignment of learning expectations with assessments
Review assessment data
Identify areas of need based on assessment
Plan:
1. Describe the current process for addressing the identified area of need (flow chart)
2. Review data to determine baseline performance in the specific area identified
(Run Chart/Pareto Diagram)
3. Identify potential root causes contributing to the identified area of need
(Cause & Effect Diagram, 5 Why’s, Relations Diagram)
4. Study research-based best practice/improvement theory addressing areas of need
Act:
1. Standardize the implementation of researchbased best practice (improvement theory) that
improved student learning (revise the flow chart to
reflect changes made to the system)
2. If improvement theory was unsuccessful continue
the PDSA cycle (try another improvement theory
based on the next identified root causes)
Action
Research
Overview
for
Professional
Learning
Communities
DO
1. Plan for implementation of improvement theory
(Force Field Analysis, Action Plan)
2. Implement research-based best practices
improvement theory based on root causes according to
the Action Plan
3. Monitor the implementation of research-based best
practice/improvement theory to insure integrity and
fidelity
4. Assess student learning
Study:
1. Examine student assessment results (compare to baseline)
2. Assess the impact of research-based best practice/improvement theory on student
achievement
Estimation Check Sheet
Weekly Class Errors
Strategy
Hour 1 - Mr. Albert
Total
1-6
1
2
3
4
5
6
12-Sep
19-Sep
29-Sep
3-Oct
10-Oct
17-Oct
Addition
2
2
1
1
0
0
6
Subtraction
2
2
3
1
2
1
11
Multiplication
7
8
7
8
7
7
44
Division
10
11
10
11
12
10
64
Application
11
11
10
11
12
12
67
Total Errors
32
34
31
32
33
30
192
Number of
Students
28
28
28
28
28
28
Week
28 students
Estimation Check Sheet
Hour 1 - Class Errors
40
Total Number of Errors
35
30
25
20
15
9/12
9/19
9/26
10/3
10/10
10/17
Estimation Check Sheet Skills
Weeks 1- 6
100%
97%
100%
91%
180
90%
160
80%
120
100
80
35%
60
40
20
70%
60%
50%
40%
30%
20%
10%
67
64
44
11
6
192
0
0%
Application
Division
Multiplication
Item
Subtraction
Addition
Total N
Percentage
Numbe of Errors
This bar represents the total (N) of your pareto.
68%
140
Pre Planning: Identification of Need
1.
2.
3.
4.
Develop/Review Student Learning Expectations
Examine alignment of learning expectations with assessments
Review assessment data
Identify areas of need based on assessment
Plan:
1. Describe the current process for addressing the identified area of need (flow chart)
2. Review data to determine baseline performance in the specific area identified
(Run Chart/Pareto Diagram)
3. Identify potential root causes contributing to the identified area of need
(Cause & Effect Diagram, 5 Why’s, Relations Diagram)
4. Study research-based best practice/improvement theory addressing areas of need
Act:
1. Standardize the implementation of researchbased best practice (improvement theory) that
improved student learning (revise the flow chart to
reflect changes made to the system)
2. If improvement theory was unsuccessful continue
the PDSA cycle (try another improvement theory
based on the next identified root causes)
Action
Research
Overview
for
Professional
Learning
Communities
DO
1. Plan for implementation of improvement theory
(Force Field Analysis, Action Plan)
2. Implement research-based best practices
improvement theory based on root causes according to
the Action Plan
3. Monitor the implementation of research-based best
practice/improvement theory to insure integrity and
fidelity
4. Assess student learning
Study:
1. Examine student assessment results (compare to baseline)
2. Assess the impact of research-based best practice/improvement theory on student
achievement
Identifying Root Cause!
• 3 Quality Tools
–Cause and Effect Diagram
–Relations Diagram
–5 Whys
Relations Diagram
Pre Planning: Identification of Need
1.
2.
3.
4.
Develop/Review Student Learning Expectations
Examine alignment of learning expectations with assessments
Review assessment data
Identify areas of need based on assessment
Plan:
1. Describe the current process for addressing the identified area of need (flow chart)
2. Review data to determine baseline performance in the specific area identified
(Run Chart/Pareto Diagram)
3. Identify potential root causes contributing to the identified area of need
(Cause & Effect Diagram, 5 Why’s, Relations Diagram)
4. Study research-based best practice/improvement theory addressing areas of need
Act:
1. Standardize the implementation of researchbased best practice (improvement theory) that
improved student learning (revise the flow chart to
reflect changes made to the system)
2. If improvement theory was unsuccessful continue
the PDSA cycle (try another improvement theory
based on the next identified root causes)
Action
Research
Overview
for
Professional
Learning
Communities
DO
1. Plan for implementation of improvement theory
(Force Field Analysis, Action Plan)
2. Implement research-based best practices
improvement theory based on root causes according to
the Action Plan
3. Monitor the implementation of research-based best
practice/improvement theory to insure integrity and
fidelity
4. Assess student learning
Study:
1. Examine student assessment results (compare to baseline)
2. Assess the impact of research-based best practice/improvement theory on student
achievement
Root Cause Identified
• Once root cause is identified…
it is time to select a researchbased improvement theory
• Consult books, articles, web
sites, Curriculum Facilitators
and other resources
What are we
doing today?
Completing the
PDSA Cycle
Pre Planning: Identification of Need
1.
2.
3.
4.
Develop/Review Student Learning Expectations
Examine alignment of learning expectations with assessments
Review assessment data
Identify areas of need based on assessment
Plan:
1. Describe the current process for addressing the identified area of need (flow chart)
2. Review data to determine baseline performance in the specific area identified
(Run Chart/Pareto Diagram)
3. Identify potential root causes contributing to the identified area of need
(Cause & Effect Diagram, 5 Why’s, Relations Diagram)
4. Study research-based best practice/improvement theory addressing areas of need
Act:
1. Standardize the implementation of researchbased best practice (improvement theory) that
improved student learning (revise the flow chart to
reflect changes made to the system)
2. If improvement theory was unsuccessful continue
the PDSA cycle (try another improvement theory
based on the next identified root causes)
Action
Research
Overview
for
Professional
Learning
Communities
DO
1. Plan for implementation of improvement theory
(Force Field Analysis, Action Plan)
2. Implement research-based best practices
improvement theory based on root causes according to
the Action Plan
3. Monitor the implementation of research-based best
practice/improvement theory to insure integrity and
fidelity
4. Assess student learning
Study:
1. Examine student assessment results (compare to baseline)
2. Assess the impact of research-based best practice/improvement theory on student
achievement
Research Based Strategies
• Research Based Strategies
• NCTM (National Council of Teachers of
Mathematics)
– Research & Standards
• Elementary and Middle School
Mathematics
– By John A Van De Walle
– Professor Emeritus, Virginia Commonwealth
University, Mathematics Education
Consultant
Implement the Improvement Theory
• If we… model and practice with contextual
estimation problems a minimum of 30
minutes a week
• Then we…. will see an increase in the
correct application of estimation skills
• As measured… by the weekly estimation
check tests
Implement the Improvement
Theory - Key Tools
Force field Analysis
• Driving & Restraining
Forces
• When opposing forces are
equal no change can
occur.
• Driving forces must be
stronger than restraining.
• For a desired change,
discuss ways to diminish
or eliminate the
restraining forces.
Force Field Analysis
Desired Change:
Driving Forces
Actions To Be Taken:
Restraining Forces
SMART Goal: During the 06-07 school year, students will accurately answer application estimation check
test questions correctly 95% of the time.
Action Plan
Status
Task/Activity
(complete or
in-progress)
Person
Responsible
Due Date
Call Bonnie Spaight regarding the GUESS boxes
John
Friday 10/20
Check Everyday Mathematics for contextual estimation problems
Carrie
Friday 10/20
Look through Math Boxes for the possiblity of using with a little
alteration
All
Create a bank of contextual application estimation problems
All
Friday 10/20
March 23rd and
ongoing
Develop to propose time schedule to include 30 minutes of practice
per week for purposes of discussion
Sue
Begin Improvement Theory
All
Resume Check tests
All
Friday 10/20
24-Oct
December 5th
Pre Planning: Identification of Need
1.
2.
3.
4.
Develop/Review Student Learning Expectations
Examine alignment of learning expectations with assessments
Review assessment data
Identify areas of need based on assessment
Plan:
1. Describe the current process for addressing the identified area of need (flow chart)
2. Review data to determine baseline performance in the specific area identified
(Run Chart/Pareto Diagram)
3. Identify potential root causes contributing to the identified area of need
(Cause & Effect Diagram, 5 Why’s, Relations Diagram)
4. Study research-based best practice/improvement theory addressing areas of need
Act:
1. Standardize the implementation of researchbased best practice (improvement theory) that
improved student learning (revise the flow chart to
reflect changes made to the system)
2. If improvement theory was unsuccessful continue
the PDSA cycle (try another improvement theory
based on the next identified root causes)
Action
Research
Overview
for
Professional
Learning
Communities
DO
1. Plan for implementation of improvement theory
(Force Field Analysis, Action Plan)
2. Implement research-based best practices
improvement theory based on root causes according to
the Action Plan
3. Monitor the implementation of research-based best
practice/improvement theory to insure integrity and
fidelity
4. Assess student learning
Study:
1. Examine student assessment results (compare to baseline)
2. Assess the impact of research-based best practice/improvement theory on student
achievement
Pre Planning: Identification of Need
1.
2.
3.
4.
Develop/Review Student Learning Expectations
Examine alignment of learning expectations with assessments
Review assessment data
Identify areas of need based on assessment
Plan:
1. Describe the current process for addressing the identified area of need (flow chart)
2. Review data to determine baseline performance in the specific area identified
(Run Chart/Pareto Diagram)
3. Identify potential root causes contributing to the identified area of need
(Cause & Effect Diagram, 5 Why’s, Relations Diagram)
4. Study research-based best practice/improvement theory addressing areas of need
Act:
1. Standardize the implementation of researchbased best practice (improvement theory) that
improved student learning (revise the flow chart to
reflect changes made to the system)
2. If improvement theory was unsuccessful continue
the PDSA cycle (try another improvement theory
based on the next identified root causes)
Action
Research
Overview
for
Professional
Learning
Communities
DO
1. Plan for implementation of improvement theory
(Force Field Analysis, Action Plan)
2. Implement research-based best practices
improvement theory based on root causes according to
the Action Plan
3. Monitor the implementation of research-based best
practice/improvement theory to insure integrity and
fidelity
4. Assess student learning
Study:
1. Examine student assessment results (compare to baseline)
2. Assess the impact of research-based best practice/improvement theory on student
achievement
Pre Planning: Identification of Need
1.
2.
3.
4.
Develop/Review Student Learning Expectations
Examine alignment of learning expectations with assessments
Review assessment data
Identify areas of need based on assessment
Plan:
1. Describe the current process for addressing the identified area of need (flow chart)
2. Review data to determine baseline performance in the specific area identified
(Run Chart/Pareto Diagram)
3. Identify potential root causes contributing to the identified area of need
(Cause & Effect Diagram, 5 Why’s, Relations Diagram)
4. Study research-based best practice/improvement theory addressing areas of need
Act:
1. Standardize the implementation of researchbased best practice (improvement theory) that
improved student learning (revise the flow chart to
reflect changes made to the system)
2. If improvement theory was unsuccessful continue
the PDSA cycle (try another improvement theory
based on the next identified root causes)
Action
Research
Overview
for
Professional
Learning
Communities
DO
1. Plan for implementation of improvement theory
(Force Field Analysis, Action Plan)
2. Implement research-based best practices
improvement theory based on root causes according to
the Action Plan
3. Monitor the implementation of research-based best
practice/improvement theory to insure integrity and
fidelity
4. Assess student learning
Study:
1. Examine student assessment results (compare to baseline)
2. Assess the impact of research-based best practice/improvement theory on student
achievement
Estimation Check Sheet
Weekly Class Errors
Strategy
Hour 1 - Mr. Albert
Total
1-6
1
2
3
4
5
6
28-Nov
5-Dec
12-Dec
19-Dec
9-Jan
16-Jan
Addition
0
0
0
0
1
0
1
Subtraction
0
0
0
1
2
0
3
Multiplication
1
0
1
0
0
2
4
Division
5
5
4
1
4
2
21
Application
6
6
5
2
4
3
26
Total Errors
12
11
10
4
11
7
55
Number of Students
28
28
28
28
28
28
Week
28 students
Estimation Check Tests
Hour 1
Total Number of Errors
40
Baseline
Sept-Oct
After implementation Improvement Theory Dec-Jan
34
32
32
31
33
30
Total Number of Errors
30
20
10
12
11
11
10
7
4
0
1
2
3
4
Check Test
5
6
Estimation Check Test Errors
5 Weeks Nov-Jan
70
Baseline
67
After 5 weeks of Improvement Theory
64
60
Number of Class Errors
50
44
40
30
26
20
21
10
11
6
0
1
Addition
3
Subtrac tion
4
Multiplic ation
Division
Applic ation
Pre Planning: Identification of Need
1.
2.
3.
4.
Develop/Review Student Learning Expectations
Examine alignment of learning expectations with assessments
Review assessment data
Identify areas of need based on assessment
Plan:
1. Describe the current process for addressing the identified area of need (flow chart)
2. Review data to determine baseline performance in the specific area identified
(Run Chart/Pareto Diagram)
3. Identify potential root causes contributing to the identified area of need
(Cause & Effect Diagram, 5 Why’s, Relations Diagram)
4. Study research-based best practice/improvement theory addressing areas of need
Act:
1. Standardize the implementation of researchbased best practice (improvement theory) that
improved student learning (revise the flow chart to
reflect changes made to the system)
2. If improvement theory was unsuccessful continue
the PDSA cycle (try another improvement theory
based on the next identified root causes)
Action
Research
Overview
for
Professional
Learning
Communities
DO
1. Plan for implementation of improvement theory
(Force Field Analysis, Action Plan)
2. Implement research-based best practices
improvement theory based on root causes according to
the Action Plan
3. Monitor the implementation of research-based best
practice/improvement theory to insure integrity and
fidelity
4. Assess student learning
Study:
1. Examine student assessment results (compare to baseline)
2. Assess the impact of research-based best practice/improvement theory on student
achievement
Pre Planning: Identification of Need
1.
2.
3.
4.
Develop/Review Student Learning Expectations
Examine alignment of learning expectations with assessments
Review assessment data
Identify areas of need based on assessment
Plan:
1. Describe the current process for addressing the identified area of need (flow chart)
2. Review data to determine baseline performance in the specific area identified
(Run Chart/Pareto Diagram)
3. Identify potential root causes contributing to the identified area of need
(Cause & Effect Diagram, 5 Why’s, Relations Diagram)
4. Study research-based best practice/improvement theory addressing areas of need
Next Steps?
Act:
Action
Research
Overview
for
Professional
Learning
Communities
DO
Continue improving math
estimation
1. Standardize the implementation of researchbased best practice (improvement theory) that
improved student learning (revise the flow chart to
reflect changes made to the system)
2. If improvement theory was unsuccessful continue
the PDSA cycle (try another improvement theory
based on the next identified root causes)
Or
1. Plan for implementation of improvement theory
(Force Field Analysis, Action Plan)
2. Implement research-based best practices
improvement theory based on root causes according to
the Action Plan
3. Monitor the implementation of research-based best
practice/improvement theory to insure integrity and
fidelity
4. Assess student learning
Select another area for improvement?
Study:
1. Examine student assessment results (compare to baseline)
2. Assess the impact of research-based best practice/improvement theory on student
achievement
Discussion Items - Planning
• SIP update process
– Gather information from SIP goal teams
– Update SMART goal/actions if needed
• Rotation of leadership team (BLT, QL,
ARDT)
• How to look at data?
– Over time
– Cohort groups
– Sub groups)
Growth in National Grade Equivalent
CoHort Group - Regular Education Students
ITBS Testing Fall of 2002-2003-2004
4.5
4
Expected growth is 2 years.
National Grade Equivalent
ITBS
3.5
3
2.5
2
1.5
1
0.5
0
Comprehension
Language Total
Math Total
Computation
Percent of Students Proficient
ITBS Reading Comprehension
Grade X 2002-2003-2004-2005
100
Percent Proficient ITBS
90
84.5
80
82.2
81.7
2002
2003
83.5
70
60
50
2004
2005
Reading Comprehension ITBS
Percent Proficient
District - Grade 3
Low SES
All Students
%o f Students Proficie nt
100
90
69.6
70.2
80
70
63.1
60.5
60
50
50.4
40
30
52.8
45.6
41.6
All Students
20
10
Low SES
0
2002-03
2003-04
2004-05
2005-06
High
Intermediate
Low
School Math Total ITBS
5th Grade
100%
90%
20.4
18.6
24.4
34.6
80%
% Proficient
70%
60%
51.9
52.5
50%
48.1
64.4
40%
30%
20%
27.8
28.8
17.3
10%
11.1
0%
2002
2003
2004
2005
Team Time
 Use
the
planning tool
 Determine next
steps
 Ready to
update the
SIP?
 Leave with a
plan!
Share Some Highlights…
 Be
prepared to share some of
the highlights of your team
discussion
Were there any particular items
that the team struggled with?
 Were there any “a ha” moments?
 How complete is your plan?

Next steps…
• Use the “Organizing and Planning for
Continuous Improvement” tool
• Prepare to update your SIP (next session
team time will be given)
• Set and communicate direction!
• Please complete the table evaluation for
today’s session