Transcript Document

OHA NP Conference Feb 19, 2001
VON NP Project Evaluation
VON NP
Evaluation
Framework
Janet Helmer
RN(EC)
Director of
Standards and
QM
About VON Canada
• Charitable, not-for-profit health care
organization
• Offers services in 1,300 communities across
Canada
• More than 15,000 volunteers and 8,000 staff
• Many programs respond to the needs of
disenfranchised, marginalized populations
• Community health programs based on the
community development model
The VON NP Evaluation Framework
VON Nurse Practitioner
Pilot Projects:
• Grey Bruce - Clinic, Outreach
• Porcupine - Clinic, Outreach
• Brant County- 4 agency- VON BNF
• Sudbury - Clinic, School, Outreach
• Eastern Counties - Clinic
• North Bay - partner - multi-agency
The VON NP Evaluation Framework
A Quality System
is one that can be
measured
The VON NP Evaluation Framework
VON
ACCOUNTABILITY
FRAMEWORK
HUMAN PERFORMANCE
SYSTEM
succession plan
retention
HR planning
reward & recognition
ATION
INNOV
recruiting
ev aluating
hiring
training & educatio n
orientation
INPU
TS
RESEARCH & INNOVATION
- customer input/feedback
- academic literature
- research activities
- external best practices
- experts in the field
LEADERSHIP SYSTEM
Mission
Vision
Strategic Planning
Implementation
Evaluation
s
e
dg
orm
Inf owle
kn
ta,
da
QUALITY
IMPROVEMENT
SYSTEM
P
A
D
C
DELIVERY SYSTEM
Operationalization
- business plan
- budget
- work plans
- best practices
Legend:
BS = balanced scorecard
PLM = program logic model
CVC = clinical valve compass
PA = performance appraisal
lts
su
Re
B) Accreditation
C) Benchm ark ing
Accfram2 (150800)
D) Branch Se lfAs sessm ent &
Peer Revie w
PERFORMANCE
MEASUREMENT
SYSTEM
(A)
Perform ance M e as ures
(indicators) in 3 spheres:
structure , process,
outcom e
i) Organizational le vel (BS)
ii) Program level (PLM )
iii) Team le vel (CVC)
iv) Individual level (PA)
The VON NP Evaluation Framework
Accountability is where objective
information is gathered, analyzed and
shared so that all partners can be held
accountable for their actions….
and…..
decisions are informed by facts:
evidence-based decision making
(EBDM)
The VON NP Evaluation Framework
Why strive to develop a common
VON Evaluation Framework?
* Create common approaches / tools
* Ability to roll-up data
* Supportive VON NP network
* Address common issues/challenges
* Learn form each other
The VON NP Evaluation Framework
Key Criteria for VON Evaluation
Framework
1. Support/augment provincial NP data
collection and reporting requirements
2. IT database to support reporting and
analysis
3. User-friendly - NPs
4. Applicable across the breadth of
programs
5. Create IT/IM solution to support
program administrative functions
6. Provide data to support individual
Branch pilot evaluations
The VON NP Evaluation Framework
Evaluation Components
• Client Encounter data collection tool
• Client Satisfaction tool
• Client Perception of Health - SF 12
The VON NP Evaluation Framework
Client Encounter Data Collection
Tool
Development
• Exploration of existing tools- paper based
and software (Purkinje)
• Software solution eliminated -cost prohibitive
although there were many potential
benefits
• Client Data Collection tool (Mary Bear et al)
utilized as basis (adaptation) for VON
tool development
•VON tool Web-based application with
database currently being developed and
tested
The VON NP Evaluation Framework
Strengths of the Client Encounter
tool
• Database supports pilot-specific reporting
• Breakdown of NP service- preventative
care, episodic, management of chronic
health problems
•Supportive/Counseling Interventions: 3
broad areas of intervention
i) health information (cognitive)
ii) affect support
iii) goal setting
The VON NP Evaluation Framework
Client Satisfaction Tool
•Adapted from Mary Bear et al Client
Satisfaction tool
• Measures client perspective on quality
dimensions such as accessibility,
responsiveness, system competency,
involvement in decision making, health
information
• limited to one-to-one encounters
The VON NP Evaluation Framework
Client’s Perception of
Health
SF-12
- given permission to use tool
- ideally to be used at 2 points
along the NPs continuum
of care with a client
The VON NP Evaluation Framework
CHALLENGES
with Evaluation of VON NP Projects
• Lack of funding for NP project
administrative functions- NPs are
required to multi-task
• Timing of program evaluation in
connection with the pilot project
start-up and data-collection
methodology
• Lack of clarity for indicators which will
ensure continuance of funding non-pilot status
The VON NP Evaluation Framework