Evaluation and Feedback

Download Report

Transcript Evaluation and Feedback

Resident Educator Development

The RED Program

A Residents-as-Teachers Curriculum Developed by Heather A. Thompson, MD

The RED Program

• Team Leadership • How to Teach at the Bedside • The Microskills Model: Teaching during Oral Presentations • How to Teach EBM • The Ten Minute Talk • Effective Feedback • Professionalism

Effective Feedback

Resident Educator Development (RED) Program

• Take a moment and think of a time when you received USEFUL feedback. What made it useful?

• Then take a moment and think of a time when you received UNHELPFUL feedback. Why was it not helpful?

Real Life Examples

• “I felt that the feedback was a little too ‘nice’. That is, it did not pinpoint and specifically target any of my weaknesses. Don't be afraid to be a little more blunt about weaknesses”.

Real Life Examples

“I received my evaluation at the end of the rotation and was shocked to find that I was rated as “below average” in medical knowledge, physical exam skills and on presentation. I have a problem with this. 1) I had no idea that my performance was anything but satisfactory. I was never told that there was a problem. When I asked, I was told I was doing fine.

2) Nobody EVER watched me perform a physical – how could I be rated on this? 3) how am I supposed to change what I’m doing now that the rotation is over – what’s the point of telling me now?

4) I don’t even know what I did that makes me below average.”

Objectives

• Discuss the important elements in the process of giving effective feedback, including the INSIGHT model • List the elements of the Pendleton Rules • Review the “ORIME” method • Practice giving feedback using videotape

Real Life

• E*value: In general, students rate our residents highly in terms of overall teaching skills • However, lower scores are consistently noted in the area of feedback; similar trends noted for attending physicians • Students and interns will often ask you “How am I doing?” • People need more than “Fine”

Effective evaluation and feedback

• Set it up correctly (you can’t evaluate what you don’t observe) • Watch and evaluate • Debrief (INSIGHT, ORIME, Pendleton process)

HOW to give effective feedback

• Comfortable for all involved (consider timing, location) • Elicit opinion of the person receiving the feedback • Establish joint goals and boundaries • Not too much feedback (2-3 suggestions at most) • Relate to specific behaviors, not the person “When you come in late, it disrupts the flow of patient care” NOT “You’re always late. You’re lazy.”

HOW to give effective feedback

• Make observations, not assumptions • Give reactions, not judgments • Use specific examples • Offer suggestions for improvement; be constructive • USE A SET ORDER OF DISCUSSION

“INSIGHT” Approach

InquiryNeeds Specific feedback InterchangeGoals Help Timing of follow-up session

INQUIRY

How does the learner think things are

going?

Listen to the learner’s needs in detail. – Listening attentively and thoroughly before commenting may be all you need to do, especially for minor/temporary problems.

?

NEEDS

What does the learner feel s/he

needs during this rotation?

– Ask the learner to define own learning needs. • Learners accept feedback better

when they feel the teacher has first understood their perspectives.

SPECIFIC FEEDBACK

Give your constructive feedback

as specifically as you can.

– Start with specific, positive feedback. – Learner-centered is better.

– Feedback “sandwich”: Positive/Negative/Positive • Verify the learner’s understanding

of the feedback you’ve given.

INTERCHANGE

How can you best balance the

learner’s needs with the team’s needs?

You may need to “think outside

the box” to reach a “win-win solution”.

GOALS

State any new goals you’ve just

reached, or review existing goals.

Verify that you both understand

and agree on these goals.

HELP

Do any serious problems merit a

“learning consultation”?

Chief residents Attending physicianProgram DirectorsClerkship DirectorsLearning specialist Employee assistance program Others

TIMING

OF FOLLOW-UP SESSION

Any final

questions or comments?

When would you

and the learner like to meet again to go over how things are going?

Pendleton’s Rules

1. Subject gives positive aspects 2. Observer gives positive aspects 3. Subject gives areas for improvement 4. Observer gives areas for improvement “Positive/Positive, Negative/Negative”

Why Pendleton’s Rules Work

1. Subject speaks first gives the person being evaluated a feeling of control 2. Positive comments first lessens anxiety 3. Subject often identifies exact same issues!

4. Conversely—if subject has no insight, outside help might be in order

ORIME

• O: Observer (passive) • R: Reporter (data gathering) • I: Interpreter (differential diagnosis) • M: Manager (formulates a treatment plan) • E: Educator (reads up on a topic, teaches the team) • Summarize where they are at, what it takes to get to the next level

Video Clip

• Watch the video: choose 1. The Rambling Med Student. This student gives a poorly organized oral presentation to the attending.

2. The Intern Interview. This intern takes a history from the patient with a less than caring bedside manner.

3. The Renegade Intern. This intern intubates a patient on call without discussing the case first with his supervising resident.

Video Clip

• Split into pairs.

• One will play the role of the senior resident, one the role of the medical student or intern.

• Practice giving feedback: what would you say to this person to help improve the situation?

• Try using ORIME, or Pendleton’s Rules.

Objectives

• Discuss the important elements in the process of giving effective feedback (INSIGHT) • List the elements of the Pendleton Rules • Review the ORIME method • Practice giving feedback