Transcript Slideshow for Responsible Conduct of Research

Responsible Conduct
in Research
Clinical & Translational
Research Seminar
May 17, 2010
David A. Crouse, PhD
Associate Vice Chancellor for Academic Affairs
Executive Associate Dean for Graduate Studies
Responsible Conduct in Research
Why does integrity in all aspects
of research matter?”
2
Responsible Conduct in Research
 Protects research subjects and assets.
 Maintains integrity of scientific process.
 Reinforces public support of science
and medicine.
 There is no room for misconduct in the
search for “TRUTH”.
3
Responsible Conduct in Research
So, What is
Responsible Conduct in Research?
4
“Rules of the Road”
5
From ORI website
Research Misconduct?
“Lying?”
“Cheating?”
“Stealing?”
“Copying?”
“Misrepresenting?”
“Fudging?”
“Cleaning Up Data?”
6
Research Misconduct Defined
“Research misconduct is defined as
fabrication, falsification, or plagiarism
in proposing, performing, or reviewing
research, or in reporting research
results.”
Office of Science and Technology Policy,
Federal Policy on Research Misconduct, 2000
DHHS Public Health Service Policies
on Research Misconduct, 2005
7
Terms Defined
Fabrication is making up data or results and recording or
reporting them.
Falsification is manipulating research materials, equipment,
or processes, or changing or omitting data or results
such that the research is not accurately represented in
the research record.
Plagiarism is the appropriation of another person’s research
ideas, processes, results, or words without giving
appropriate credit.
8
Research misconduct does not include:
 Honest error or differences of opinion
 Authorship disputes
 Misallocation of resources
Evidentiary Standards
“A finding of research misconduct requires that:
1. There be a significant departure from
accepted practices of the relevant research
community; and
2. The research misconduct be committed
intentionally, or knowingly, or recklessly; and
3. The allegation be proven by a preponderance
of the evidence.”
9
The Possible Range of Events
“Honest Error”  “Negligent Error”  Misconduct “Error”
10
 variability
 haste
 intentional or
knowing or
reckless
 instrument
 carelessness
 FFP
 technique
 inattention
 NO EXCUSE
What is NOT
Research Misconduct?
Authorship disputes
Determine conditions of authorship ahead
of time
Dispute resolution is the responsibility of
the home institution
Self-plagiarism --but watch out for
copyright restrictions!
Journal editors hold universities
accountable
11
But Research Misconduct Rules:
DO NOT apply to authorship
except for plagiarism.
Plagiarism and falsification can be
INCLUDED IN:
Misrepresentation
of personal credentials
(i.e., the C.V.)
12
Misrepresentation* of Authorship Among
Applicants to Training Programs
#
# with # pubs
Applicants pubs
total
% pubs
invalid
Discipline
Year
Pediatrics1
‘95
404
147
401
19.7
Radiology2
‘92-95
201
87
261
15.0
Gastroenterology3
‘95
236
53
92
30.2
Emergency Medicine4 ‘96
350
113
276
20.4
Orthopaedics5
‘98-99
213
64
138
18.0
Internal Medicine6
’02-03
497
234
634
25 - 1.8
Emergency Medicine7 ’02-03
173
47
13.3
•Non-existent or unverifiable journals or books; non-existent articles/chapters; abst, not paper;
“in press” but never appeared; inaccurate author position. Ref#6 used different methods
1. Acad Med 73:532, 1998 2. Am J Radiol 170:577, 1998 3. Ann Int Med 123:38, 1995
4. Ann Emerg Med 27:327, 1996 5. J Bone & Joint Surg 81A:1679, 1999
6. Ann Int Med 138:390, 2003 7. Acad Emerg Med 9:992, 2004
13
Institutional Responsibilities
 Appoint a Research Integrity Officer (RIO)
 Maintain a Research Misconduct Policy
 UNMC Policy 8003 “Research Integrity”
 Provide policy education to all researchers
 Respond to allegations
 Conduct an Inquiry and Investigation as
appropriate and report to federal funding
sources
 The Omaha VA also has a RIO (Dr. Fred
Hamel) and parallel policies
14
Reporting & Responding to Suspected
Research Misconduct at UNMC
 Contact Research Integrity Officer (RIO)
 May informally discuss concerns
 RIO determines if suspected misconduct
falls within definition; if yes
 RIO sequesters research records
 RIO notifies respondent of specific allegations
in writing
 Inquiry conducted – initial fact-finding to
determine whether allegation warrants an
investigation
15
 RIO may appoint committee that includes
subject matter experts
Reporting & Responding to Suspected
Research Misconduct at UNMC
 Inquiry report created containing
recommendations to Deciding Official (Vice
Chancellor for Academic Affairs)
 End proceeding or,
 Proceed to Investigation
 Investigation: determine if misconduct has
occurred, and if so, who is the responsible
person and how serious the misconduct is
 Notify any federal funding sources (Office of
Research Integrity [ORI] for Public Health
Service grants)
16
Reporting & Responding to Suspected
Research Misconduct at UNMC
 Investigation report created with recommended
findings to Deciding Official who:
(1) determines if the institution accepts the report; and
(2) determines appropriate institutional actions in
response to the findings
 Final investigation report submitted to federal
funding agencies (ORI for PHS grants)
17
ORI Review
 Determines if proceedings were conducted in
accordance with regulation
 May conduct additional analyses & develop
the evidence
 Decide whether research misconduct
occurred, and if so, who committed it
 No: case closed
 Yes: Make settlement recommendations to HHS
 Respondent can contest HHS charges &
request a hearing through the Administrative
law process
18
Disposition of Allegations
Received by ORI 2008
Allegations made to ORI
201
No action possible now or no action
113
Pre-inquiry assessment of allegations by ORI
54
Referred to other federal agencies
13
Handled by agency (NIH)
16
Received by agency (NIH) & referred to ORI
19
5
Types of Allegations in Closed Cases 2008
Allegation
Inquiry
Fabrication
0
0
0
Falsification
0
10
6
Falsif./Fabric.
0
7
7
Plagiarisim
0
0
0
TOTAL
0
17
13
20
Investigation
ORI
findings
Research Misconduct References
Federal Guidelines:
NIH (Federal Register 70(94):28370-28400, May 17, 2005
42 CFR Parts 50 and 93 – Research Misconduct
UNMC Research Integrity Policy #8003
(2/11/2005):
See UNMC Intranet: Policies and Procedures
Applies to ALL faculty, Staff and Students
UNMC Research Integrity Officer at 559-6767
21
22
Responsible Conduct in Research
Are there requirements
for RCR instruction?
23
NIH Requirement for Instruction in
the Responsible Conduct of Research
 NOT-OD-10-019
 Published November 24, 2009
 “This policy will take effect with all
new and renewal applications submitted
on or after January 25, 2010, and for all
continuation (Type 5) applications with
deadlines on or after January 1, 2011. ”
24
Requirement Applies to:
All trainees, fellows, participants, and scholars
receiving support through any NIH training, career
development award, research education grant, and
dissertation research grant.
Includes: D43, D71, F05, F30, F31, F32, F33, F34,
F37, F38, K01, K02, K05, K07, K08, K12, K18, K22, K23,
K24, K25, K26, K30, K99/R00, KL1, KL2, R25, R36, T15,
T32, T34, T35, T36, T37, T90/R90, TL1, TU2, and U2R.
This policy also applies to any other NIH-funded
programs that require instruction in responsible conduct
of research as stated in the relevant funding opportunity
announcements
25
Format:
 Substantial face-to-face discussions among the
trainees/fellows/scholars/participants;
 A combination of didactic and small-group
discussions (e.g. case studies); and
 Participation of research training faculty members in
instruction in responsible conduct of research are
highly encouraged.
 While on-line courses can be a valuable supplement
to instruction in responsible conduct of research,
online instruction is not considered adequate as the
sole means of instruction.
26
Subject Matter (1):
There are no specific curricular requirements for
instruction in responsible conduct of research but
the following topics have been incorporated into
most acceptable plans for such instruction:
1. conflict of interest – personal, professional, and
financial
2. policies regarding human subjects (IRB), live
vertebrate animal subjects in research (IACUC), and
safe laboratory practices (IBC and more)
3. mentor/mentee responsibilities and relationships
4. collaborative research including with industry
27
Subject Matter (2):
5. peer review
6. data acquisition and laboratory tools;
management, sharing and ownership
7. research misconduct and policies for handling
misconduct
8. responsible authorship and publication
9. the scientist as a responsible member of society,
contemporary ethical issues in biomedical
research, and the environmental and societal
impacts of scientific research
28
Duration of Instruction:
Instruction should involve substantive contact hours
between the trainees/fellows/scholars/participants and
the participating faculty.
Acceptable programs generally involve at least eight
contact hours.
A semester-long series of seminars/programs may
be more effective than a single seminar or one-day
workshop because … learning will be better
consolidated, and the subject matter will be
synthesized within a broader conceptual framework.
29
Frequency of Instruction:
 Instruction should recur throughout a
scientist’s career:
 Undergraduate
 Post-Baccalaureate
 Pre-doctoral
 Post-doctoral
 Faculty
 At least ONCE in each career stage
 Not less than ONCE every FOUR years
 Faculty, Senior Fellows and K awardees
may fulfill the requirements by participating
as instructors
30
CITI RCR Modules
Research misconduct
Responsible authorship
Mentoring
Peer review
Data acquisition & monitoring
Conflict of interest
Collaborative relationships &
collaborative science
31
Responsible Conduct in Research
Examples of misconduct in research
32
Image Manipulation
Journal of Cell Biology 116:11-15, 2004
 Blots & Gels:


Gross misrepresentation
Subtle manipulation
(brightness, contrast, bkgd, splicing lanes)
 Micrographs:



Enhancing a specific feature
Linear vs nonlinear adjustments
Misrepresentation of a microscope field
 Resolution
A new research field: Digital Forensics
33
Image Manipulation
Gross manipulation of blots.
(A) Example of a band deleted
from the original data (lane 3).
(B) Example of a band added
to the original data (lane 3).
34
Journal of Cell Biology 116:11-15, 2004, Figure 1
Image Manipulation
Misrepresentation of image data.
Cells from various fields have been
juxtaposed in a single image,
giving the impression that they
were present in the same
microscope field.
A manipulated panel is shown
at the top. The same panel,
with the contrast adjusted by
us to reveal the manipulation,
is shown at the bottom
35
Journal of Cell Biology 116:11-15, 2004, Figure 6
Image Duplication
Hwang et al:
Science 308:1777-1783,
2005 (duplicate in paper)
Article Retracted
Verfaillie et al:
Nature 418:41-49,
2002 (Fig 1b)
Exp Hematol 30:896-904,
2002 (Fig 2)
Corrigendum in Nature
447:880-881, 2007
36
Déjà vu database
 Database created by Southwest Medical
Center researchers
 Searches Medline for potential duplicate
articles --- 1,000s listed beginning in early
’90’s
 Interpretation:



37
Appropriate duplication of own work with
publisher approved reuse of data?
Self-plagiarism?
Outright plagiarism of another author’s work?
Duplicate Publications - Déjà vu Project
38
http://discovery.swmed.edu/dejavu/
Déjà vu Project
39
http://discovery.swmed.edu/dejavu/
Déjà vu Project
Nature
451:397-399
2008
Figure 2
40
Cartoon from Nature
“A Tale of Two Citations”
“It is the best of times, it is the worst of times”
41
Recent ORI Enforcement
 Robert Fogel, MD, Harvard Medical
School (March, 2009)
 Falsified & fabricated baseline data from
a sleep apnea study in severely obese
patients
42

Falsified half of the physiologic data

Fabricated 20% of data from CT images

Falsified 50-80% of other anatomic data

Falsified 50% of sleep data
Other Recent Cases
 Aug 24, 2006: Dr. Kui Zhu, Cleveland Clinic
 Fabricated/falsified data
 Debarred from contracting with U.S. Govt
 University of Iowa Anesthesia Researchers
 Regional Anesthesia and Pain Medicine journal
allegations
 University of Iowa found no misconduct
 Dr. Eric Poehlman, University of Vermont
 Fabricated/falsified data from 1992-2002
 21 Journal articles retracted
 1 year prison sentence; debarment
43
“10 Easy Ways to Commit Research Misconduct
& Create Havoc in the Lab”
By: Chris Pascal, Director of Office of Research Integrity
1) Don’t review the raw data prior to publication; accept
summary data or prepared tables and graphs instead.
2) On a project where expected results have not been
achieved over several months, demand significant
results to meet a publication deadline.
3) Hire a new post-doc, but leave him/her without
guidance or supervision.
4) Tell your staff to do the right thing, but do the
convenient thing when it is expedient.
44
5) Publish results of a team research project, but leave
out two members who made substantive contributions.
6) Provide no guidance or standards for keeping
laboratory data.
7) Tell your lab members to ask questions, but don’t make
yourself available because you are too busy.
8) Have a large lab of junior scientists and provide little
guidance or supervision.
9) Drop data points in order to “clean up” your graph or
table without a clear rationale.
10) Tell your lab tech what results you expect from
the experiment and that you need them now.
45
The Bottom Line:
“Whatever the rationalization is,
in the last analysis
one can no more be a little bit dishonest
than one can be a little bit pregnant.”
Honor in Science, p 14
Sigma Xi, The Scientific Research Society
1997
46
Time to Volunteer
You receive a telephone call from the UNMC
Research Integrity Officer (RIO) asking you to
participate on a research misconduct inquiry
committee
A prominent journal editor called the Dean
with concerns about fabrication of an image
in a recent submission by a post doc,
Dr. Jim Newby
47
Dr. Newby’s Interview (1)
Dr. Newby tells the committee he completed a set of
experiments characterizing the receptor for a new class
of hormones. During the course of his work, he studied
binding characteristics and normal responses in tissue
culture and in vitro, utilizing gels to characterize the
molecular weights of receptor variants.
His mentor asks him to prepare an abstract for an
upcoming meeting and a paper for journal submission
on his work.
Adapted from SG Korenman & AC Shipp. Teaching the Responsible Conduct
of Research Through a Case Study Approach. Washington DC, AAMC, 1994.
48
Dr. Newby’s Interview (2)
As Dr. Newby examined the data, he noted that some of
the cell culture plates failed to respond to the hormonal
stimulus and that there was considerable variability in
the dose response relationship. Furthermore, on
reexamination, he noted that several gels were not very
“clean”, yet he was sure they demonstrated the
molecular weight, agonist binding and subunit
characteristics of the receptor.
He mentioned his distress to Dr. Pam Pro, a more senior
Post-doc, who suggested that it was OK to “clean up the
data.”
Adapted from SG Korenman & AC Shipp. Teaching the Responsible Conduct
of Research Through a Case Study Approach. Washington DC, AAMC, 1994.
49
Dr. Newby’s Interview (3)
Dr. Pro suggested that several outlier points could be
dropped because the cultured cells were probably dead.
She also showed him how easy it was to use Photoshop
to clean up messiness in some of the gel files by cutting
and pasting the nicer experimental lanes with the best
control lanes.
She did not think it really altered the results and it
certainly made the distinction between the groups more
clear.
Adapted from SG Korenman & AC Shipp. Teaching the Responsible Conduct
of Research Through a Case Study Approach. Washington DC, AAMC, 1994.
50
Dr. Newby’s Interview (4)
 Dr. Newby took Dr. Pro’s advice & cleaned
the images up and dropped a couple of
outlier data points.
 Dr. Newby drafted a journal article, with
himself, Dr. Pro, and his mentor as authors
 All 3 researchers reviewed the article &
images prior to submission.
Adapted from SG Korenman & AC Shipp. Teaching the Responsible Conduct
of Research Through a Case Study Approach. Washington DC, AAMC, 1994.
51
The Dr. Newby Case
 Was there research misconduct in
this scenario?
 If so, who committed it?
 Who could be harmed if this is
misconduct?
 Who maintains stewardship of the
research data?
Adapted from SG Korenman & AC Shipp. Teaching the Responsible Conduct
of Research Through a Case Study Approach. Washington DC, AAMC, 1994.
52
Review - Conflict of Interest
 When an individual’s private financial
interests either conflict with or create the
appearance of conflicting with UNMC’s
public interests
 “Individual” includes family members
 UNMC Policy 8010
 Business COI Procedures
 Research COI Procedures
 COM Relationships with Healthcare
Vendors Policy
 Effective July 1, 2008
53
Research COI
 Researchers complete a conflict disclosure
form upon grant submission
 Reviewed by COI officer
 Significant COIs reviewed by UNMC COI
committee
 Management plans developed for all COIs
 Management plans forwarded to the IRB if
Human Subject Research
 Must identify all conflicts when submitting
articles to journals
54
Senator Grassley - Iowa
“After questioning about 20
doctors and research
institutions, it looks like
problems with transparency
are everywhere, the current
system for tracking financial
relationships isn’t working.”
55
Source: NY Times October 3, 2008
http://www.nytimes.com/2008/10/04/health/policy/04drug.html
Depression expert at Emory pulls out
of research projects
NIH freezes grant money; Emory to begin
monitoring potential conflicts of interest
By GAYLE WHITE, CRAIG SCHNEIDER
The Atlanta Journal-Constitution
Tuesday, October 14, 2008
Emory psychiatry professor Dr. Charles B. Nemeroff is
stepping down from university research projects
funded by the National Institutes of Health, as the
federal agency cracks down on the school’s handling of
potential conflicts of interest, university officials said.
The NIH has frozen funds for a $9.3 million project on
depression led by Nemeroff, acknowledged Ron
Sauder, a university vice president. The project had
been under way for two of its proposed five years.
56
Being “Conflicted” is Not a
DSM - IV Diagnosis
You are a member of the UNMC COI
committee and have been presented with
the following:
Dr. Jones, a UNMC pioneer in Neurology
research has invented a control system to
automatically regulate Parkinson’s disease
patients’ medication --- the HELP device
(Home-based Empowered Living for
Parkinson’s Disease)
57
COI Committee Information
The HELP device administers the exact
dose of medication required by the patient
according to his/her level of activity. The
portable infusion pump is based on a
combination of accelerometers and
gyroscopes and can be integrated into a
patient’s everyday clothing. This noninvasion device should eliminate the
adverse effects of medication overdoses.
58
COI Committee Information
Dr. Jones has submitted a Phase I clinical
protocol to test the HELP device on
Nebraska Medical Center patients, listing
himself as the PI
Any potential conflict of interest issues to
consider???
59
Further Reading:
1. “Complainant Issues in Research Misconduct: The Office of
Research Integrity Experience”, Chris B. Pascal, Department of
Research Integrity, U.S. Department of Health & Human Services
2.
“Truth and Consequences”, Jennifer Couzin, Science, Vol. 313,
September 1, 2006
3. “Integrity in Scientific Research: Creating an environment that
promotes responsible conduct”, Institute of medicine – National
Research Council, The National Academies Press, Washington
DC, 2002.
60
4.
“ORI Introduction to the Responsible Conduct of Research”, NH
Steneck, DHHS – PHS, ORI, 2003.
5.
“On Being a Scientist”. National Academy of Sciences, National
Academies Press, Third Edition, 2009.
6.
The Office of Research Integrity: http://ori.dhhs.gov/