Transcript SLIDES: Pulling off a field experiment as a young economist

Pulling off a field experiment as a
young economist
Robert Metcalfe
University of Chicago
Personal experience
1. The right ask
2. The right implementation and project
management
1. The right ask
1. You should an expert in something that they are
not (exp design)
2. Understand the politics & incentives of what you
are competing against
3. Understand the constraints
4. Top-down vs. bottom up?
1. Use examples from previous research
The right ask
6. Have a good answer to “It’s not ethical to give some
people a different treatment than others”
7. Have a good answer to “How large does the sample
need to be?”
8. Think about ways to reduce the sample size
9. Do not always think that the first experiment will be
the best
10. Be an enjoyable person to talk to
2. The right implementation &
management
11. Provide a range of treatments
12. Always offer to do the randomization and analysis
13. Always be responsive to phone calls and/or emails
14. Be professional and provide quick feedback
15. Be realistic with your expectations and don’t put all
your eggs in one basket