Transcript Document

IAPT Commissioner Data Web-ex
Monday 23rd February 2015 1.30 – 2.30pm
Welcome Slide
• Due to the large number of attendees, all
microphones have been muted
• Please submit questions via the typed chat
window at any time
– Questions will be answered during the
presentation by HSCIC analysts or via email to all
participants after the WebEx
2
IAPT reporting – HSCIC data
Presented by: Will Adam
Background
• IAPT data set flowing since April 2012
• IAPT KPI collection retired at end 2012/13
• First annual report from dataset, January
2014 (2012/13)
• Second annual report September 2014
(2013/14)
• Monthly and quarterly reports from IAPT data
set evolved to cover data quality, activity and
more complex calculations
4
New HSCIC IAPT homepage
• Central location for all publically available
HSCIC IAPT content
• Links to all publications and reference
information
• www.hscic.gov.uk/iaptmonthly
• www.hscic.gov.uk/iaptreports
5
Current publications
• Monthly
– Data quality measures
– Basic activity by CCG
• Quarterly
– Range of activity measures by provider and
commissioner (including entering treatment and
recovery)
– Supplementary files
 Key measures for access and recovery by CCG, by
month
 Recovery by problem descriptor by CCG and provider
6
Scheduled new reports
• New monthly release from April 2015 (covering
January data)
– Quarterly supplementary file in monthly release (first
in July 2015)
• Q3 2014/15 will be the last quarterly release
(due April 16th)
• Provides full range of data in a more timely
manner, CCG/provider level data, including new
6 and 18 week waiting time measures.
• Covered by April WebEx
7
IAPT reporting –
Data processes and Data Quality
Presented by: Paul Ellingham
Route of Data
9
Mental Health and Community Care Processes
National Extract
from OpenExeter
Load to Data
Warehouse Holding
Tables
Append to Existing
Data
Process IC_
Derivations
DQ outputs
Process DQ Rules
Update Analysis
Tables
Analysis as per
Published
Constructions
Published Outputs
10
OpenExeter Bureau Service Portal
• Providers must have access to the portal
• Commissioners should apply for access
– Download post-deadline extracts
 Check counts of people, referrals, appointments
 Look at distinct providers submitting your CCG code as
ORGCODECOMM
 Using published measure and derivation constructions,
can closely replicate published figures
11
Sources and Timeliness of Data
12
Provider data to CCG vs published data
• Potential reasons for difference:
–
–
–
–
KPIs
Live System vs Snapshot
Data Quality
Suppression of publications
13
Data Quality
• How can Commissioners engage with their
providers around Data Quality?
– Request to see DQ notices
– Check published DQ information for your
providers
– Liaise with HSCIC
14
Provider Data Quality Notice
15
Core DQ Measures
• On-submission to Portal
– Rejections and Warnings
– Summary report
• From DQ Notice
–
–
–
–
DQM02 - Missing Appointment Table
DQM14 - Organisation Code of Commissioner field
DQM23 - Appointment Purpose field
DQM108 - Pathway Continuity (end dates should be
populated in a timely fashion)
DQM = Data Quality Measure – see help text on DQ Notice
16
New Product - PAVE
• Processing Exeter Extracts time consuming
• IC_ derivations are complex
• Provider Analysis Validation Extract
– Record-level extract with a flag for each of the
key measures
– Final data
– Easier for providers to match published figures
– Currently in development and testing
17
rg
an
is
M
BE
R
_N
U
ef
er
r
Va al_
lid Re
ce
_
Fi Pro ive
rs
t_ visi d_i
n_
on
as
Fi
rs ses al_ per
D
t_
s
m
ia iod
t
g
e
Ti rea
m
tm nt_ nos
e_
is
en in_
pe _re
t_
Ap in_
rio co
po day in_
rd
in
s_ per d
ed
t
R
ef me wa iod
ite
nt
er
s_
ra
d_
R
ef l_en in_p fro
m
er
d
e
r
ed
rio _re
Pa al_
_
d
fe
ire fini in_
rra
th
d_ sh
l_
e
ed
to
R
s
_
c
ef
p
_f
er ore _a_ er
irs
io
ra
s_
c
t_
d
ou
R
l
tre
_
f
ef
ha or_
r
s
at
er
e
s
P
m
_o
_m
ra
H
en
R
ov Q9 f_t
ef l_w
t
r
as
er
ed _a
ea
ra
_a
n
_
t
d_ me
of
R
l
_
t
ef
f_
ha _c
A
n
er
s_ as sic DS t_i
r
en
k_
re
M n_
R al_
th
p
es
ef
ha co
e_
er
s_ ay
s_ ve
pe
r
sh red at_
R al_
rio
ef
st
ha ow
d
er
a
s
rt
_r n_r
ra
R
e
ef l_ha lia elia
er
b
bl
ra s_n ly_
e
l_
de _im
ha o_r
te
pr
e
s_
r
l
o
sh iab iora ve
m
ow le_
te
en
d
n_ ch
t
an
re
ge
lia
bl
e_
re
co
ve
ry
R
IC
_C
C
IC G
_P
AT
H
W
AY
_I
D
IC
_U
SE
R
EF _P
R AT
EC H
D WA
AT
Y_
E
FL
AG
EN
D
D
AT
E
VI
C
EI
D
SE
R
O
R
D
PT
_R
EC
IA
Pe
rio
d_
En
d
at
io
BS
n_
P_
C
od
U
e_
N
I
Q
of
Fi
U
_P
le
E
_T
ro
_I
vi
D
yp
de
e_
r
of
Pe
_F
rio
in
al
d_
_D
St
at
ar
a
t
O
PAVE Sample
XXX11 00001 Refresh 01/10/2014 31/10/2014 123456789 AAAAA1 01X 100000001
y
06/10/2014
1
0
0
0
XXX11 00001 Refresh 01/10/2014 31/10/2014 123456790 AAAAA2 01X 100000001
y
30/04/2014
0
0
0
0
XXX11 00001 Refresh 01/10/2014 31/10/2014 123456791 AAAAA3 01X 100000001
y
25/06/2014
0
0
0
XXX11 00001 Refresh 01/10/2014 31/10/2014 123456792 AAAAA4 01X 100000001
y
11/11/2013 10/10/2014
0
0
XXX11 00001 Refresh 01/10/2014 31/10/2014 123456793 AAAAA5 01X 100000001
y
22/10/2014
1
0
1
0
0
0
0
0
0
0
0
0
0
50
4
0
0
0
0
0
0
0
0
0
0
0
31
4
0
0
0
0
0
0
0
0
0
0
0
0
200
3
0
0
0
0
0
0
0
0
0
0
1
0
5
0
0
0
0
0
0
0
0
0
0
18
Frequently asked questions - Reporting
Presented by: Will Adam
Recreating published figures
• Guide available on our web page
www.hscic.gov.uk/iaptmonthly
• Use Post-deadline extracts
– Available from Exeter BSP
• Recreate IC_Derivations
– Do not recommend using derivations on extracts
20
Derivations and Constructions
• Derivations are fields created by HSCIC to
aid processing
– Begin with “IC_”
• Constructions are the logic used to create
measures within reports
– List fields used, including derivations
• Recreate derivations before attempting
constructions
21
Key derivations - IC_PATHWAY_ID
• Allows a referral to be traced across
submissions
• All activity measures are a count of unique
IC_PATHWAY_IDs
• “Incremental value assigned to new SERVICEID
and IAPT_PERSON_ID combinations. If such a
combination has been received in a previous
reporting period the record is assigned the same
IC_PATHWAY_ID value”
22
Key derivations - IC_USE_QTR_REFERRAL_FLAG
• Identifies which records should be used for quarterly
figures - up to 3 referral records each month
• Uses most recent details
• “IC_USE_QTR_REFERRAL_FLAG = 'Y' where
RANKING = 1 (highest ranked referral instance
based on the following subset)
Partition referrals by QUARTER_ID and
A.IC_PATHWAY_ID and order by MONTH_ID
descending
The top ranked referral is assigned a flag”
23
IAPT_PERSON_ID
• Not listed in post-deadline extracts or as an IC
derivation
• Anonymisation that occurs on submission
• Tries to match person records on any of
following combinations:
– NHS number, (date of birth - 2 out of three element
match)
– Local patient ID and full DOB
– Postcode, date of birth
• If not matched, incremental number
24
Calculating access figures
• Government target is 15%
• Numerator is the number entering treatment
– Line 5 of quarterly reports
– Also available in monthly activity reports
• Denominator is prevalence figure calculated locally by
CCGs, based on 2000 Psychiatric Morbidity Survey
• Treatment appointment definition updated in version 1.5
– Used to be based on therapy type
– Now based on appointment purpose
25
Calculating access figures
COUNT of distinct IC_PATHWAY_ID
WHERE IC_USE_QTR_REFERRAL_FLAG = 'Y'
AND IC_DATE_FIRST_THERAPEUTIC_SESSION is
between the period start and end dates or is null
IC_DATE_FIRST_THERAPEUTIC_SESSION
• Earliest appointment in a referral which had an
appointment type of 02 - Treatment, 03 - Assessment
and treatment or 05 - Review and Treatment, and that
was attended (attendance code of 5 or 6)
26
Calculating waiting times
• Time in days between referral received and
entering treatment
• Reported as all referrals that entered
treatment in RP by
IC_DATE_FIRST_THERAPEUTIC_SESSION – REFRECDATE
• Grouped by <=29, 29-56, 57-90 and 90+
days
• Future reports <6 and <18 weeks
27
Calculating recovery…
• One of more complicated measures
• In simple terms:
referrals recovered / (referrals finished treatment –
referrals not at caseness)
OR
line 15 / (line 8 – line 16)
• Full detail is available in our FAQ guide
www.hscic.gov.uk/iaptmonthly
28
Connect with us
[email protected]
www.hscic.gov.uk
@hscic
www.slideshare.net/hscic
0300 303 5678