Scrutinizing Data Collection Methods

Professor Lisa High University of Windsor

Existing Data vs. New Data

First data collection decision

: - Use existing data New data gathered How will the researcher generate data?

Methods of Collection

Historical research Secondary analysis Records

Data Collection Methods

When existing data is not available Developing a data collection plan = 3 types of approaches used most frequently: (1) (2) (3) Self-reports Observation Physiologic measures

Dimensions of Data Collection Methods

Four Dimensions

: (1) Structure (2) Quantifiability (3) Obtrusiveness (4) Objectivity

Self-report Methods

Direct questioning

Unstructured Reports

: Completely unstructured interviews Focused or semi-structured interviews Focus group interviews Life histories Diaries

Self-report Methods

Structured self-report - formal means of collection – written document = instrument Instrument is the “ interview schedule ” “ questionnaire ” or ( face to face or telephone)

QUESTION FORMS

: (a) - dichotomous, multiple choice, cafeteria, rank order and forced question (a) Closed-ended questions or fixed alternative Open-ended questions

Instrument Construction

Outline of the instrument ’ s content Monitor for: wording, clarity, sensitivity of the respondent ’ s psychological state, freedom from bias, and reading level Draft instruments Critically reviewed Pre-test/pilot -tested Borrowed or adapted from other instruments

Interviews vs. Questionnaires

-

Questionnaires

less costly -

Interviews

face-to-face interviews = good response rates Less time and effort to administer Feasible for most people Complete anonymity Questions less likely to be misinterpreted Absence of interviewer = no biases can produce additional information through observation

Scales & special Forms of Structured Self-Reports

Social-psychological scales response bias (social desirability, extreme response, acquiescence response) Counterbalancing?

Vignettes Projective techniques Q-sorts

Evaluation of Self-Report Methods

Strengths: Behaviors can be observed Yields more information Most commonly used in nursing

Weakness

: Validity and accuracy Social desirability Unstructured = time consuming and demanding

Critiquing Self-Reports

What to look for: Degree of structure Interview or questions uses Composite scale administered How instruments administered Response rate

Observational Methods

Alternative to self-reports Broad applicability

Researcher flexibility to several dimensions

: (1) (2) (3) (4) Focus of the observation Concealment Duration of observation Method of recording observations

Unstructured Observational Methods

Permits the researcher to see the world as the study participants To develop a rich understanding and appreciation of the phenomena Extract meaning form events and situations Grasp the subtleties of cultural variation What is participant observation?

Gathering Unstructured Observational Data

Consider the following

: (a) (b) (c) (d) (e) (f) The physical setting – where questions The participants – who questions Activities – what questions Frequency and duration – when questions Process – how questions Outcomes – why questions

Positioning Approaches

(1) Single Positioning (2) Multiple Positioning (3) Mobile Positioning

Recording Unstructured Observational Data

Log Field notes Observational notes Theoretical notes Methodologic notes Personal notes

Structured Observational Methods

Differs from unstructured observational Advance preparation Accurate categorizing, recording and encoding the observation and sampling Checklist Rating scales

Observational sampling includes

: (a) Time sampling (b) Event sampling

Evaluation of Observation Methods

Have an intrinsic appeal to capture Suited for people who are unable to describe their own behaviors Provides in-depth and diverse information Humans are used as the measuring instruments Shortcomings – ethical difficulties, reactivity, observational bias Unstructured – yield richer data

Biophysiologic Measures

Use of biophysiologic and physical variables (1) (2) (3) (4) (5)

Five classes

: Basic biophysiologic processes Nursing actions = outcomes Evaluation of specific nursing procedures/interventions Evaluate & improve the measurement & recording of biophysiologic information Antecedents and consequences of biophysiologic indicators = possible treatment modes

Types of Biophysiologic Measures

Includes:

“ in vivo measures ” or “ in vitro measures ”

IN

vivo measures

– living organisms performed directly within or on IN

vivo instruments

– to measure all bodily functions and technological advances IN

vitro measures

– data gathered from participants extracting some biophysiological material from them In

vitro measures

– chemical, microbiologic, cytologic and histologic means

Types of Biophysiologic Measures

-

Evaluation of Biophysiologic Measures: Accurate and precise Measures are objective Valid measures of the targeted variables Cost usually low or nonexistent

-

Disadvantages: measuring tool may affect the variable Normally interferences that create artifacts Energy must be applied – avoid damaging cells

Critiquing Biophysiologic Measures

Critiquing Biophysiologic Measures:

-

most important consideration – the appropriateness of the measures for the research question

-

Review: Box 11-4 – p. 293 – 1 st edition Box 13.5 – p. 308 – 2 nd edition