Transcript A New User-centric Approach to Impact Assessment. Research Session 3:

Research Session 3:
Case studies in Living Lab application domains
A New User-centric Approach to Impact Assessment.
Case Express to Connect -project
Anne Äyväri
Laurea University of Applied Sciences, Finland
The 4th ENoLL Living Lab Summer School
27th-30 August 2013
Manchester School of Arts
E2C project
The overall objective
to develop, test, and deploy digital storytelling games.
These games
stimulate and facilitate social
among older adults,
thus prevent loneliness.
EU AAL JP, 1.3.2010—28.2.2013
http://www.express2connect.org/
2
2
connectedness
STORYVILLE GAMES
http://www.storyvillestudios.nl/
3
4
5
www.storyvillestudios.nl
6
MISSION IMPOSSIBLE 1
7
How to evaluate the long-term impacts of the new
service on an individual’s life – during the service
development process?
8
A new approach to impact
assessment was needed.
9
The Impact Assessment on the Individual Level
Desired
outcomes
based on the
ethnographic
studies
10
Identifying the
questions linked
with the desired
outcomes in the
well-known
measures of
quality of life
and social
connectedness
New
questionnaire
for the E2C
concept testing
= evaluation
criteria based
on the
desired
outcomes
Let’s imagine the impacts!
Question:
Let’s assume that you have utilised the service for some
years. Please, assess if the usage of the service has had
any impact on your life and your wellbeing. Be free to use
your imagination!
Scale:
1. YES, the usage of the service has had some impact in this
respect.
2. The usage of the service has had NO impact in this respect.
3. Don’t know.
11
Ties between family –> to be close and have space;
examples of new items
 It is easier for me to keep in contact with my close
ones when I feel like it.
 I’m less worried how my nearest next-of-kin
(children, grandchildren) are doing, and they are less
worried how I am doing.
 The feeling of closeness between family members
has grown stronger.
12
Feedback to designers:
does the usage of the new service
enhance chances of reaching the
desired outcomes?
13
Anticipated long-term impacts, 2011, % of Yes, TOP 5 (N=16)
0%
10%
20%
30%
40%
50%
60%
70%
80%
I am able to better outline the life I have lived so
far by reminiscence.
81%
I perceive the joy of learning and the feeling of
being capable more often than before.
75%
The feeling of being related to other people has
become stronger.
69%
I'm able to tell and share memories of my life,
especially of those persons who have been
important to me.
69%
The feeling of closeness between my close ones
has grown stronger.
14
90%
56%
Anticipated long-term impacts, 2012, % of YESanswers, TOP 5
Age group: 50 years or older (N=107)
0%
10%
20%
30%
40%
50%
60%
70%
1. I am at peace with myself and with the current
state of my life.
3. I feel that I am of importance to somebody.
5. The feeling of closeness to people important to
me has grown stronger.
6. A sense of belonging has grown stronger
between me and my friends/peers.
9. I get more new experiences and my life is
richer.
15
80%
77%
65%
61%
61%
59%
90% 100%
MISSION IMPOSSIBLE 2
16
How to convert the anticipated impacts on
social connectedness into monetary terms?
17
Portraits
Kauko
Trudie
”The Family Amateur”
”The Globetrotter”
Kirsten
”The Professional Human
Being”
18
Scenarios: what will happen within a year?
… when the risks of falling
into loneliness come true
effects on the
physiological,
psychological, and social
wellbeing
19
…when Storyville gaming
works as a trigger for
strengthening
connectedness
effects on the
physiological,
psychological, and social
wellbeing
Next: Identify the chain of effects
Beneficial impacts
for Kauko
Opens up,
starts to
talk more
Feels himself
appreciated
Beneficial
impacts for
family members,
close ones
The quality of his
life is improving
Becomes
more
active
His wife feels
herself needed.
Grandparents take
care of
grandchildren
Goes out more
often (mobility
increases)
Takes better care of
himself
Pain in his back
eases
The risk of
depression
disappears
Becomes active in
societal issues,
politics
His relationship with
his wife becomes
better.
He talks to his wife
more.
Joint interests with
children and
grandchildren,
something to share
20
Feels himself
needed
The risk for divorce
becomes smaller.
Children (busy with
their jobs) feel less
stressed.
The risk of his wife
becoming
depressed
decreases.
Costs
related to
depression
and pain in
his back
decrease
Kauko, Scenario A. Loneliness effects Kauko's health (Danish experts)
Slipped disk
Physiotherapist
Side effects
Physician
Problems with
his back and
pain
Medical practice
minimum 2
times a year
Special Physician
Rehabilitation
And then:
put the price tag on the effects on
the life of one person
22
Kauko (FI): Savings during the 1. year
Visiting a doctor at the local health centre
twice a year.
Doctor refers to a physiotherapist. Five visits a
year.
Medication:
Extended use of pain killers: 352 tablets
in a year.
Stomach-protective drug (needed for
painkillers): 352 tablets in a year
Wife’s consultation to couple’s therapist.
TOTAL
* Panadol 500mg, Burana 800mg, University Pharmacy
** Somac 40 mg , University Pharmacy
23
Costs for
society
Costs for the
individual/ family
142 €/ visit
-> 284 €
13,80 €/visit
-> 27,60 €
70 €/visit
-> 350 €
7,50 €/visit
-> 37,50 €
-
84 €*
17,60 €
42 €**
-
100 €
651,60 €
291 €
Kauko (FI): Costs related to gaming during the 1. year
Costs for
society
24
Costs for the
individual/ family
iPad
500 €
Refreshments
-Grandchildren’s visits
-Football matches
100 €
Tickets and travelling expenses
100 €
TOTAL
700 €
Trudie (DK): savings during the 1. year
Costs for
society
Costs for the
individual/ family
2.950 €
Transportation costs
How to cope with diabetes -course at the local
healthcare centre
147 €
Transportation costs
Medicine (when the costs exceed 490 €, society
covers the rest of the costs)
314 €
490 €
Multiple dose injection (MDI) therapy (follow
up, care devices, insulin), further training on self
care activities
3.400 €
Transportation costs
-
10 x 107 = 1.070 €
A 3 day stay at hospital due to high blood sugar
to adjust the level of medicine (nutrition
therapist’s consultation and lab tests included)
Psychotherapy 10 times/year
+ transportation costs
TOTAL
25
6.811 €
1.560 € + transport
Trudie (DK) - Costs related to playing during the 1. year
Costs for
society
Costs for the
individual/ family
iPad
375 €
Refreshments for the next door neighbours
during the gaming sessions
150 €
525 €
26
MISSION IMPOSSIBLE 3
27
How to scale up?
28
Thank you for inspiring us to reach for new usercentric approaches to impact assessment!
29
[email protected]
30
30