Transcript Specials Conference

2.00 pm 2B Information Evaluation
Halls B/C
Quality Criteria Models Used to
Evaluate Health Websites
June Anderson
Quality Criteria Models Used
to Evaluate Health Websites
June Anderson
Sue McKemmish
Rosetta Manaszewicz
School of Information
Management and Systems
Monash University
Specials’2003
CURRENT MODELS OF
QUALITY CRITERIA
Specials’2003
• Health on the Net – HonCode of Conduct
(1997)
• American Medical Association – Guidelines for
Medical & Health Information Sites on the
Internet (2000)
• Health Internet Ethics – Hi-Ethics (2000)
• European Community – Quality Criteria for
health-related websites (2001)
• DISCERN (2000)
• OMNI – Organising medical networked
information (1999)
• Internet Health Coalition – Ehealth Code of
Ethics (2000)
CONTENT QUALITY
CRITERIA
•
•
•
•
•
•
•
•
•
•
Specials’2003
Authorship
Accuracy
Source
Comprehensiveness
Currency
Review process
Purpose
Balance
Language
Disclosure
Quality Models
MODEL
A
U
T
H
O
R
A
C
C
U
R
A
C
Y
S
O
U
R
C
E
Discern
*
*
*
*
*
*
*
*
*
AMA Guidelines
OMNI Gateway
eEUROPE
Quality
Criteria for
Health
Related
Websites
Specials’2003
Health on the
Net
(HonCode)
*
*
Hi-Ethics
*
*
*
*
Internet health
Coalition
C
O
M
P
R
E
H
E
N.
C
U
R
R
E
N
C
Y
R
E
V
I
E
W
P
U
R
P
O
S
E
*
*
*
*
*
*
*
*
*
*
*
*
*
D
I
S
C
L
O
S
E
B
A
L
A
N
C
E
*
*
*
*
*
*
*
*
What is Breast Cancer
Knowledge Online (BCKO)?
• A research project to develop an
intelligent interface or gateway to
information resources about breast
cancer to meet the diverse needs of
women, their families and friends
affected by the disease.
• Funded by ARC Linkage Grant (2002-3)
– Industry Partners:
Specials’2003
• BreastCare Victoria
• Breast Cancer Action Group (Vic.)
One Size Does Not Fit All
• Information needs change along
the breast cancer trajectory
• Information needs vary with age,
life style, ethnicity, and location
• The “need to know” varies greatly
• Information presentation and
format preferences also vary
widely
Specials’2003
Diverse and Dynamic
Information Needs
Specials’2003
Patient Empowerment
• “Consumers’ access to information and
the ability to make decisions about
their own health and well-being are
important rights. In addition, there is a
growing body of evidence to support
the argument that greater consumer
participation in health care improves
clinical outcomes”
•
Specials’2003
National Health Information Advisory Council, 1998
An Intelligent UserSensitive Portal
User Profiles
Portal
Metadata Repository of User Centric
Resource Descriptions
Specials’2003
Australian Government
Locator Service (AGLS)
• AGLS is a standard set of 19 descriptive
elements that have been recommended for
use by government departments and
agencies to improve visibility and
accessibility of their services and
information provision over the internet.
• AGLS was published as Australian Standard
AS5044 by Standards Australia in
December 2002
National Archives of Australia,
http://www.naa.gov.au/recordkeeping/gov_online/agl
s/summary.html, 2003
See also Better Services, Better Government: The
Specials’2003
Federal Government's e-Government
Strategy).
BCKOnline
Metadata Schema
Based on AGLS
Specials’2003
•Creator
•Publisher
•Date
•Contributor
•Description
•Format
•Title
•Language
•Type
•Relationship
•Subject
•Source
•Availability
•Audience
•Identifier
•Rights
BCKOnline Extensions to
AGLS
Type Encoding Scheme = medical, supportive,
personal
Subject Encoding Scheme = BCKOnline
Disease Trajectory
Audience Qualifiers = Age, Disease Stage,
Information Preference,
User Type, Location of User
Quality Element and Qualifiers
Specials’2003
BCKOnline Audience
Qualifiers
• Age group = under 40, 40-49, 50-70,
over 70
• Disease stage = pre-diagnosis, recently
diagnosed, early breast cancer,
recurrent breast cancer, advanced
breast cancer
• Information preference = plain,
scientific, detailed, brief
• User type = self, partner/spouse,
friend, parent, child
• Location of user = urban, rural, both
Specials’2003
User Profile
Quality Element and
Qualifiers (1)
• Credentials of Creator/Publisher/
Contributor = lay author(s), clinician(s),
researcher(s), consumer group,
commercial body/group, educational
institution, government body, medical
organisation or cancer organisation
• Currency = current, non-current
Specials’2003
Quality Element and
Qualifiers (2)
• Review Process = editorial board, peer
review, editorial process, no review
• Evidence Based = meta-analysis,
randomised clinical trial, case/cohort
study, consensus or personal opinion
• Purpose = educational/informative,
commercial, reportage of results,
discussion forum
• Balance = controversial issue – noted,
controversial issue – not noted, noncontroversial issue
Specials’2003
HOTMETA SOFTWARE*
To build metadata repository of
resource descriptions and match
them to user needs as expressed
via the portal interface
*Supplied by Distributed Systems Technology
Collaborative Research Centre:
http://www.dstc.edu.au/Products/metaSuite/
Specials’2003
BCKOnline INPUT SCREEN
Age
Under 40
40 - 49
50 - 69
70 +
Disease
Stage
Early
Advanced
Recurrence
User
Type
Information
Preferences
Specials’2003
Friend
Child
Scientific
Plain
Partner/Spouse
Detailed
Enter Term:
Self
Brief
Search
BCKOnline OUTPUT SCREEN
1.
2.
Identifier
Title
Subject
Description
Type
Medical
Locality
Identifier
Title
Subject
Description
Type
Supportive
Locality
Urban
Quality
Rural
Quality
3.
Identifier
Title
Subject
Description
Type
Personal
Locality
Specials’2003
Both
Quality
Significance and
Innovation
Specials’2003
• “Patient empowerment” via
– Delivery of relevant and timely information
to support critical health and life style
decision making
– Delivery of information to support user
assessment of accuracy and reliability of
resources
– Metadata model for user-centred resource
description
– Potential portability of user-sensitive
intelligent portal approach
• Research as model for consumer instigated
research and collaboration between
researchers, government and user community
Project Team & Sponsors
Professor Sue McKemmish, Dr Kirsty Williamson,
Associate Professor Frada Burstein, Associate
Professor Julie Fisher and Ms June Anderson, Monash
University
Ms Rosetta Manaszewicz and Ms Sue Lockwood, Breast
Cancer Action Group
Research Students Chan Cheah, Jane Moon, Pooja
Malhotra
Programmer Sergio Viademonte Da Rosa
Project funded by the Australian Research Council
Linkage Scheme, BreastCare Victoria and the Breast
Cancer Action Group
http://www.sims.monash.edu.au/research/eirg/bcko.html
Specials’2003