Transcript Competence - Royal College of Surgeons of Edinburgh

Orthopaedic
Competence
Assessment
Project
Using the tools
David Pitts
[email protected]
OCAP – Mission
• Improve the quality of HST in
orthopaedics through the
introduction of a competence based
portfolio of coaching and
assessment tools
This Presentation
•
•
•
•
•
•
Overview of system & tools
Trainer profile
Learning Agreement
Procedure Based Assessments
Records
Coaching
Overview
Coaching, Assessment
& Recording Tools
Knowledge
Curriculum
Vitae
Trainer
Profile
Learning
Agreement
Procedures
Assessment
Evidence
Coaching
Features
Knowledge
Curriculum
Vitae
Trainer
Profile
Procedures
Features
Knowledge
Curriculum
Vitae
Trainer
Profile
Procedures
Features
Knowledge
Curriculum
Vitae
Trainer
Profile
Assessment
Learning
Agreement
Procedures
Evidence
Coaching
Overview
Knowledge
Curriculum
Vitae
Trainer
Profile
Assessment
Learning
Agreement
Procedures
Evidence
Coaching
Overview
Coaching, Assessment
& Recording Tools
Knowledge
Curriculum
Vitae
Trainer
Profile
Learning
Agreement
Procedures
Assessment
Evidence
Coaching
Meeting
3
Completed
PBA’s
• Only 3 pieces of
paperwork
• All will become
electronic in time
PBA
Meeting
2
PBA
Meeting
1
Trainer
Profile
Consolidation
Sheet
Learning
Agreement
Entire
process
driven by
trainee
Developing a Trainer Profile
Knowledge
Curriculum
Vitae
Trainer
Profile
Procedures
In
collaboration
with
Trainee
Supported by
Templates
One time
only!
What I do
(Procedures)
What you
need to
know about
what I
do
(Knowledge)
What you
need to
know about
me
(CV)
Tools in detail
• Procedures map
– Based on e-logbook
•
•
•
•
Template on CDROM
Add your name
Delete inapplicable
Add whatever’s
missing
– Comprehensive?
– Willing to teach?
• Save as new file
Trainer Profile 1:
Procedures
Tools in detail
Trainer Profile 2:
Knowledge
Knowledge map
• BOA syllabus
• Template on CDROM
• Add your name
• Delete inapplicable
– Delete rows,
backspace!
• Add anything missing
• Develop over time!
Tools in detail
Trainer Profile 3:
Mini-CV
• CV (brief)
•
•
•
•
•
– Build relationship
– Communicate
expectations of
Trainee’s performance,
behaviour, attitude…
Samples on CDROM
Add your name
Add photograph
Cut & paste
Save as new file
Using a Trainer Profile
Knowledge
Curriculum
Vitae
Trainer
Profile
Procedures
1. Using the CV
• Build relationship
• Communicate
expectations
– Performance
– Behaviour / conduct
– Attitude…
• “Being a surgeon is
more than doing
surgery”
2. Using the Procedures profile
1st year
trainee
4th year
trainee
3. Using the Knowledge profile
• 1 = Knows of
• 2 = Knows basic
concepts
• 3 = Knows generally
• 4 = Knows specifically
& broadly
• BOA syllabus
• Not the exam!
• To help trainee make
progress
• Guide reading/study
This Presentation
•
•
•
•
•
•
Overview of system & tools
Trainer profile
Learning Agreement
Procedure Based Assessments
Records
Coaching
Meeting
3
Learning
Agreement
PBA
End of
attachment
summary
Meeting
2
PBA
Meeting
1
Agenda
Setting
Progress
Review
Each meeting
20 minutes?
Meeting 1
• Review materials
completed by trainee
beforehand
• Tick boxes
• Sign form
• Length/depth of
discussion & how much
you write is up to you
Meeting
2
• Provide feedback
to trainee
• Review feedback
already given in
theatre or
assessments
• Tick boxes
• Agree actions
• Sign form
Meeting 3
• Trainee completes
reflection
beforehand (detail
up to you)
• Trainer & trainee
agree progress
• Tick boxes
• Sign form
This Presentation
•
•
•
•
•
•
Overview of system & tools
Trainer profile
Learning Agreement
Procedure Based Assessments
Records
Coaching
Meeting
3
PBA
Meeting
2
PBA
Meeting
1
Results entered
onto PBA
summary sheet
Individual sheets
signed and kept in
portfolio
Triggered by
Trainee or trainer
Agree which ones
(all or part) at first
meeting
Tools in detail
•
Current PBAs
Mini-PBA (DOPS)
– Closed mgt of #
– Clinic activity in T&O
– Debridement of wound
•
Hand
•
Knee
•
Foot
•
Hip
•
Spine
•
Generic
•
Trauma
•
In development
– Carpal tunnel decompression
– Digital and palmar fasciectomy
– Diagnostic arthroscopy & simple
arthroscopic procedures
– Total knee replacement
– 1st ray surgery
– Total hip replacement
– Lumbar discectomy
(01 03 05)
– template
– Compression hip screw
intertrochanteric fracture neck
of femur
– Hemiarthroplasty intra capsular
fracture neck of femur
– Application of limb external
fixator
– Operative fixation Weber B
ankle fracture
– Fixation by tension band wiring,
olecranon & patella
– Intramedullary nailing femoral or
tibial shaft
– Tendon repair
– Upper limb
– Paediatric
Tools in detail
Performance Based
Assessments
• Triggered
– Trainee or trainer
• Objective
– Passed / To be
improved
• Indicative
• Formative individually
• Summative as whole
collection
• Common format
– Consent
– Preoperative planning
– Preoperative
preparation
– Exposure & closure
– Intra operative
technique
– Post operative mgt
Users Guide on
website
Example:
THR
• Trainee has forms
beforehand (no surprises)
• Trainer agrees to the PBA
(patient, trainee etc)
• Trainee conducts
procedure observed by
trainer
• Usually scrubbed
• Trainee verbalises, explains
what intentions are
• Trainer steps in as/where
necessary
• Forms completed and
feedback given immediately
after procedure
This Presentation
•
•
•
•
•
•
Overview of system & tools
Trainer profile
Learning Agreement
Procedure Based Assessments
Records
Coaching
Learning Agreement
Tools in detail
PBA Consolidation
sheet
• For discussion at RITA
– Must be presented on request
• Compares scores across PBA’s
• Evidence of “Learning”
• Trainee updates as attachment
progresses
• Brings to meeting 2 & 3
Final summary: PBA Consolidation sheet
(2 sides)
Portfolio Checklist
1.
2.
3.
4.
5.
6.
7.
Weekly timetable for attachment SAC
Details of on call rota
Trainer CV (from trainer portfolio)
Procedures Profile (original, signed)
Knowledge Profile (original, signed)
Learning Agreement agendas (original, signed)
All individual assessments completed (original,
signed)
8. In-house educational programme (with note of
sessions attended)
9. Evidence of activity on audit/research project
10. Details of significant events (to include clinical and
professional incidents (and outcomes))
11. Details of absences from training post
This Presentation
•
•
•
•
•
•
Overview of system & tools
Trainer profile
Learning Agreement
Procedure Based Assessments
Records
Coaching
Personal Effectiveness
• Mindmap
• Viewer software free
via website
• Positive & negative
behaviours
• Facilitates feedback
This Presentation
•
•
•
•
•
•
Overview of system & tools
Trainer profile
Learning Agreement
Procedure Based Assessments
Records
Coaching
Overview
Knowledge
Curriculum
Vitae
Trainer
Profile
Assessment
Learning
Agreement
Procedures
Evidence
Coaching