Transcript Slide 1
James R Miner MD John H. Burton, MD Research Director Chair Department of Emergency Department of Emergency Medicine Medicine Hennepin County Medical Center Carillion Clinic Its easy to think of good research questions in Emergency Medicine Usually emerge based on the findings of previous work “Although a fresh perspective can sometimes be useful by allowing a creative person to conceive new approaches to old problems, lack of experience is largely an impediment” Steven Hulley MD Scholarship is an important part of good research Research that does not recognize previous work in the area that applies to is very likely to be poorly done The mastery of a subject also entails participating in meetings and building relationships with experts in the field Have a skeptical attitude about prevailing beliefs Remember that the application of new technologies often generates new insights and questions about familiar clinical problems Attend conferences and listen to things you don’t agree with Carefully Observe your patients Teach Be Creative in your approach to old questions Have Tenacity: Don’t give up on things that “can’t be done” Everyone in Academic EM can claim slides #4-6 FINER ◦ ◦ ◦ ◦ ◦ Feasible Interesting Novel Ethical Relevant Number of subjects Technical expertise Available time and money Manageable in scope To the investigator ◦ Is this a logical and important step in building a career or in getting to the truth of an important scientific matter? To everyone else ◦ Will anyone care to read this if its written up? Can be determined by reviewing the literature and the CRISP database Confirmatory studies are only necessary ◦ To determine if a new methodology can be reproduced ◦ to measure external validity in a different setting ◦ to avoid weaknesses noted in previous studies This is a whole other lecture, but usually you don’t need a degree in ethics to tell Most important aspect How will the various possible outcomes of a study advance knowledge, guide further research, or change clinical practice Idea Summary Be Warren Buffett: Choose Your Investments/Ideas Wisely Methods The question is not feasible ◦ Too broad Narrow the question ◦ Not enough Subjects available Expand inclusion criteria Decrease the sample size you need ◦ Methods beyond the skills of the investigator Collaborate Review the literature Learn the skills ◦ Too expensive Decrease sample size and simplify measurements Not Novel ◦ Modify the research question Not Ethical ◦ Modify the research question Not relevant ◦ You can’t fix this Too Vague ◦ Write the research question first ◦ Stick to the question Many studies have more than one question One question needs to drive the study ◦ Multiple questions don’t work for statistics as they are designed today ◦ If you ask 20 random questions with random data and use the same test on all of them, one will be statistically significant The 4 elements of Well-built clinical Questions (PICO) ◦ ◦ ◦ ◦ Patient or problem Intervention (independent variable) Comparison (measurement device) Outcome (dependent variable) What is the best treatment for acute asthma exacerbations? Is continuous albuterol better than intermittent albuterol for the treatment of acute asthma exacerbations? Is continuous albuterol better than intermittent albuterol for the treatment of adult ED patients with acute asthma exacerbations? Does continuous nebulized albuterol (10 mg/hr) results in better outcomes than intermittent nebulized albuterol (2.5 mg q 30 min) for the treatment of ED adult patients (18 – 40yrs.) with acute asthma exacerbation Does continuous nebulized albuterol (10 mg/hr) result in better outcomes, in terms of increased PEFR and admission rates at four hours, than intermittent nebulized albuterol (2.5mg q 30 min) for the treatment of ED adult patients (18 – 40 yrs) with an acute asthma exacerbation of less than 8 hours and presenting with a PEFR of <200, after one 2.5 mg albuterol treatment? Funding Cheaper is better! It will take years to establish funding: ◦ ◦ ◦ ◦ ◦ Department Discretionary Funds Hospital/University Internal Grants/Funds Local Organizations/Foundations National Foundations Government/NIH Methods Summary Focus Research Design Know the basic types Know the pros and cons of each Look to the literature for good examples of each Use reference texts Research Question Design Study Plan Implementation Actual Study errors Truth in the Universe Truth in the Study inference inference Findings in the Study Errors in research design cause errors in the application of information from the study to reality (inference) Appropriate Designs yield information that can be inferred to clinical practice Inappropriate designs yield data Design Summary You are a person of many great ideas… Hail Mary Passes are Rarely Caught Study Execution Clinical research is always a form of a “natural” experiment as it involves trying to make measurements in the “real world” Clinical research is always imperfect and limited by the lack of full control over study subjects The ED environment is particularly difficult and presents unique challenges Lack of control over patients how present Lack of control over patient care resources Less time for staff to correctly apply I/X criteria Usually less staff knowledge about the specific study subject area Conception is easier than birth The “birth” is often problematic if not planned There is usually a honeymoon period when the project has the affection of the staff Enthusiasm quickly wanes After 6 months no one remembers its name 2 years later the data forms languish in a drawer Question should be interesting and relevant to the staff Modify the question until its feasible ◦ Realistic numbers of patients to answer the question ◦ Adequate resources and time to complete Don’t try to get more data than is necessary to answer the study question ◦ When you ask for more you often get less Field test the project before it is implemented Don’t start the study until its ready (call it a pilot study first) Get most of the work done at the beginning Remind everyone frequently Keep the machinery working Embrace Failure Investigators lead by example Modify the protocol as needed Eliminate data or steps that are not working as planned Send out notices when the study has ended Publish the results – that’s the next lecture Its easier to repeat a project with improvements than publish a bad study Study Execution Summary If a senior investigator yells at you when you present your research you’re onto something good Its amazing what you can get done when you don’t worry about whose going to get the credit for it You’re a CLINICAL researcher, don’t let funding stand in your way