Transcript TSHP - Comparison of SP and Faculty Assessment in IPPE Poster 042613

Comparison of Standardized Patients and Faculty in Assessment of
Ambulatory Patient Screening, Influenza Immunization and Professionalism
Skills in IPPE for Second-Year PharmD Students.
Butch Habeger, RPh, MBA, Roland A Patry, MS, DrPH and Shanna D James, PharmD
Texas Tech University Health Sciences Center, School of Pharmacy
Introduction
Results
Discussion
In a previous study, the IPP-II course in AY2012
utilized standardized patients (SP’s), training
videos, and assessment rubrics with simulation to
train and assess second-year PharmD students in
ambulatory patient screening, influenza
immunization and professionalism skills.
Screening skills included blood pressure, blood
glucose and blood cholesterol. The major
limitation was the lack of faculty validation of SP
assessments. The course was continued in
AY2013 and was designed to address this
limitation.
• There is no statistically significant difference
between SP and faculty assessment scores.
Limitations to this study are:
• The possible difference between faculty using
video recordings versus actual assessments.
• The reliance on video recordings for faculty to
view and perform assessments.
• The sample size being relatively small.
• The use of commercial product videos for
training students and SP’s.
• Possible SP variation in the interpretation and
use of assessment rubrics.
Objective
• To compare SP and faculty assessments for
patient screening, influenza immunization and
professionalism skills for an identical student
cohort.
Methodology
• All SP assessments of students were video
recorded.
• A representative sample of SP assessment
videos was reviewed and scored by faculty.
• Faculty scores were directly compared to the SP
scores for each assessment video using the
Wilcoxon signed-rank test and Kendall’s
coefficient of concordance.
Statistics
Analysis of SP and Faculty Assessments
Related Samples
Kendall’s
Coefficient of
Concordance
p=
Skill Set
n=
Wilcoxon
Signed Rank Test
p=
Professionalism
19
0.130
0.127
Immunization Interview
20
0.221
0.225
Immunization Technique
20
0.115
0.090
Blood Pressure
20
0.265
0.206
Blood Glucose
20
0.284
0.248
Blood Cholesterol
20
0.813
0.827
Significance of difference is p = < 0.05
Acknowledgement: Other course team members are Jill Frost, PharmD, Mark Haase,
PharmD, Jeanie Jaramillo, PharmD, Molly Minze, PharmD, Sopia Mnjoyan, PharmD, Sherida
Nelson, RPh, Heather Wild, PharmD, Debbie Bryant and Amanda Hines.
Dr Patry is Professor and Chair, Clinical Practice and Management, Department of Pharmacy
Practice.
Conclusion
• There is no conclusive evidence to suggest that
faculty can assess student performance better
than well-trained SP’s.
Recommendations
Course improvements for AY2014 are:
• Continue to improve training of SP’s in the
interpretation and use of assessment rubrics.
• Faculty to produce its own videos for training of
students and SP’s.
• Faculty to make actual assessments to compare
to SP assessments.