Transcript Document

Corrective Action
Programs
HSEEP
Homeland Security Exercise and
Evaluation Program
• Provides a common exercise policy and program
guidance that constitutes a national standard for
exercises.
• Capabilities and performance based program
• Vol. III – Exercise Evaluation and Improvement
Planning
2
HSEEP
Designing good exercises require:
•
•
•
•
Time
Effort
Resources
Strategy
Do we devote the same to following up?
3
Exercise Evaluation
Evaluation is the fundamental link to
improvement.
• Evaluation is analytical process to assess the
demonstration of capabilities:
– Task-level analysis
– Activity-level analysis
– Capability-level analysis
4
Exercise Evaluation
Benefits of a good evaluation:
•
•
•
•
•
•
Identify if exercise objectives were met.
Identify necessary improvements in the EM/BC
program.
Identify needed improvements in the plans,
procedures and policies.
Identify training and staffing deficiencies.
Identify needed equipment.
Identify need for continued exercise program.
5
Exercise evaluation
Exercise methodology
• Evaluation team structure
• Exercise objectives – SMART
• Evaluation tools
6
Exercise Evaluation
Observe exercise and collect data
• Evaluators
– Observe and document actions
– Remain unobtrusive
– Collect supplemental data
• Conduct player hot wash
– Provides for self-assessment by players
– ASAP
– Utilize feedback forms
7
Exercise Evaluation
Analyze data
• Critical to discover not only what happened, but
why events happened the way the did.
• Each task that did not occur offers an opportunity
to discover a root cause
• Begin to develop initial analysis of the exercise
– Is there a difference between observed and expected
actions?
– What is the consequence of that difference?
– What should be learned from that consequence?
– What improvements should be made?
8
AAR
AAR – After action report serves two
primary functions
• Captures the evaluation
• Makes recommendations for improvements
9
AAR
Develop draft AAR
•
•
•
•
Provides description of what happened
Describes best practices or strengths
Identifies areas for improvement
Provides recommendations for improvement
10
AAR
AAR format
•
•
•
•
•
•
•
•
Report cover
Administrative handling instructions
Contents
Executive summary
Exercise overview
Exercise design summary
Analysis of capabilities
Conclusion
11
AAR
AAR format
• Appendixes
–
–
–
–
–
–
Improvement plan
Lessons learned
Participant feedback summary
Exercise events summary
Performance ratings
Acronyms
12
IP
IP – Improvement plan identifies
corrective actions, responsibilities for
implementation and a timeline for
implementation
•
•
•
•
After action conference
Identify corrective actions for implementation
Finalize AAR/IP
Track implementation
13
AAR/IP
Final versions of the AAR and IP
should be released together.
The AAR/IP are critical as a tool to
establish consensus and buy-in on the
exercise program as an element of
preparedness
14
HSEEP
Benefits of consistent formatting
• Consistency provides for enhanced information
sharing (lessons learned) between entities.
• Consistency provides for better understanding of
roles and responsibilities between organizations.
• Consistency provides for a broader view of
overall capabilities.
• Consistency provides for better exercise-toexercise evaluation.
15
Should I Use HSEEP?
Government entities use HSEEP
Consistent with NFPA 1600 guidance
Check with regulatory and insurance
requirements
Does it meet my organizations needs?
16