How to pass the MRCPsych examination

Dr Bruce Owen

Outcomes

• By the end of this session, participants will be able to – recognise one model of medical skills and how they are assessed – Describe the structure, content and function of the different parts of the assessment system in psychiatry – Recognise the concept of learning styles and how to structure their learning for maximum effectiveness

“The most important things are not measured” W Edwards Deming

Two purposes of assessment

• Formative – ‘Assessment for learning’ • Summative – ‘Assessment of learning

Miller’s pyramid

Does Shows how Knows how Knows Performance Competence

Miller’s pyramid and assessment Performance Does Competence Shows how Knows how Knows WPBA = Workplace based assessment OSCE = Observed structured clinical examination WPBA 360˚ CEX DOPs CbD OSCE (CASC) Written tests MCQ/EMI

Outcomes

• By the end of this session, participants will be able to – recognise one model of medical skills and how they are assessed – Describe the structure, content and function of the different parts of the assessment system in psychiatry – Recognise the concept of learning styles and how to structure their learning for maximum effectiveness

The Assessment System

• Includes: – Standardised (national) exams – mainly summative – Workplace-based assessments – mainly formative – Integration – ultimately summative

National exams

• • • Paper 1 – Clinical topics at a basic level – Basic psychology – – Psychopathology Social sciences Paper 2 – Psychopharmacology – Neuroscience relevant – Epidemiology – Advanced psychology Paper 3 – Research and ebm – All psychiatry specialties

National clinical exam

• CASC – 8 single stations 7 mins – 4 double/linked stations 10 mins

Miller’s pyramid and assessment Performance Does Competence Shows how Knows how Knows WPBA = Workplace based assessment OSCE = Observed structured clinical examination WPBA 360˚ CEX DOPs CbD OSCE (CASC) Written tests MCQ/EMI

WPBA in psychiatry

• Lots of acronyms, only four methods

Four core methods 1

• Based on documents: – – Log book assessment Case based Discussion (Chart Stimulated Recall)

Four core methods 2

• Direct observation of a procedure – DOPS – DONCS – Teaching – – Case presentation Journal Club presentation

Four core methods 3

• Observed clinical encounters – Mini-Assessed Clinical Encounter – Assessment of Clinical Expertise

Four core methods 4

• Multi-source feedback (360 ° ) – Mini-Peer Assessment Tool

Integration – the tasks of the Annual Review of Competency Progression • • Assess the evidence – – Contained in Portfolio Formal assessments – Reports Make a decision based on the evidence – Summative pass/fail

Guide for ARCP panels

• • • Guides trainees and trainers as to what should be assessed how it should be assessed and at which stages

ARCP Guide for Core Psychiatry Training http://www.rcpsych.ac.uk/training/curriculum2010.aspx

ARCP decisions: -

1. Progress onwards 2. Need to develop within time 3. Need to develop additional time 4. Leave the programme 5. Incomplete evidence

Outcomes

• By the end of this session, participants will be able to – recognise one model of medical skills and how they are assessed – Describe the structure, content and function of the different parts of the assessment system in psychiatry – Recognise the concept of learning styles and how to structure their learning for maximum effectiveness

Learning/teaching activities

• • • • Instructional activity Simulation Workplace activity Reflection

Kolb’s Learning Cycle

Perform part of an interview contributing to risk assessment Active experimentation Concrete experience Watching your trainer perform a risk assessment Guided reading of psychiatric literature Abstract conceptualisation Reflective observation Discussion of observations in supervision Kolb (1984) Experiential learning: experience as the source of learning and development. Prentice Hall

Which type of learner are you?

• • • • Reflector – watch and feel – Watch, think and review Theorist – watch and think – Think a problem through Pragmatist – do and think – Likes to apply new learning Activist – do and feel – Likes to experience new things

Thank you!

Any questions?