Transcript Qualtrics and Mturk Workshop

Qualtrics and Mturk Workshop
Matthew W. Baldwin &
Lucas A. Keefer
https://sites.google.com/site/mwbaldwinku/tools
Qualtrics
• What is Qualtrics?
– An intuitive, online utility for data collection with
a variety of options
• Why use it?
– Online data collection is…
– Fast
– Easy
– Allows you to selectively sample
– Allows you to have more diverse samples
Before you can begin…
• Go to kuclas.qualtrics.com
• Make an account using your KU e-mail address
• Log-in (either from the home page or from the
KU portal)
Front Page
• When you log in, you will have a complete list
of your surveys (if you have made any)
• Plus tabs to
– Create a new survey
– Edit an existing survey
– Distribute
– Look at your data, and more
Piped text allows you to use text given in a previous response
The Rich Text Editor allows you to change font,
text size, bold/italicize/underline, etc. any text
Just write choices in here
Change type of question
(e.g. how many responses)
and appearance
(e.g. vertical v. horizontal
Types of items in the
matrix and appearance
options, like MC Items
If you want a running sum to total
some fixed number (e.g. 100)…
Number of Items
and Labels
If you don’t want
numbers on top
How many items
people rank
Just write the things you want people to rank
Number of statements
and columns
Side by Side items let you put two scales
together (e.g. Y/N & How certain are you?)
Write any items
or group names
to left,
determine how
many of each on
the right
“Participant Defined” allows
participants to create their
own category labels
Other Item Types
• There are many, many other options for items as
well. For example,
• Heat mapping allows participants to click
anywhere on an image and records where people
click
• Qualtrics can time how long Ps stay on any page
(in seconds)
• Qualtrics can allow you to use parts of images as
response items (or use images as responses to
MC questions)
Under Survey Flow, you can
determine the order in which
items are presented to Ps.
Block labels are important for
keeping track of item placement.
Add new blocks to Survey Editor
Add a branching path to the survey flow
(e.g. different versions for M/F)
Randomize the
presentation of blocks
The Randomizer function
allows you to effectively
create online experiments
For long term data collection (e.g. diary studies)
you can create e-mail lists for surveys
Qualtrics gives you an anonymous link
composed of random letters/numbers
Qualtrics is also wellintegrated with a number
of social networking
platforms, if you would
like to distribute your
survey that way
List of individual responses (with completion times)
You can click here to download your data
General reports
on data (e.g. item means)
and open-ended responses
Completion statistics
You can select only a subset of items or responses
When you are done, your data will
be available anywhere with an internet connection
in either .csv or .sav (SPSS) format
Qualtrics
• Key things to remember:
– Browse the list of item types…you’ll find
something to fit your needs
– Label Blocks AND Questions. Block labels are
useful for Flow and Question Labels are used in
your data file
– Collaborate to get feedback from others
Qualtrics
• Key things to remember:
– Build a survey library with measures you
frequently use
– Online survey research must be short
– What we gain in sample, we lose in control!