Transcript Guidelines for the Evaluation of Mobility Management

Timo Finke
Guidelines for the
Evaluation von
MM Programmes
Guidelines for the
Evaluation of Mobility Management Programmes
EvaMM
RUTH
EvaMM
Timo Finke
Department of Traffic Management
City of Düsseldorf
ECOMM 2009
San Sebastián
Timo Finke
Guidelines for the
Evaluation von
MM Programmes
EvaMM
Aim of EvaMM
Set up guidelines for practitioners to evaluate MM
programmes
• to demonstrate success of MM to programme provider,
sponsors, critics and public
• to support the programme manager in daily work
• to include all facets of MM into its evaluation (e.g.
awareness campaigns, MM services)
• to sum up programme costs for comparison with
alternative measures
• to allow comparison of success between programmes
by standardised evaluation
• to document your success!
RUTH
2
ECOMM 2009, San Sebastián
Timo Finke
Definition Mobility Management
Guidelines for the
Evaluation von
MM Programmes
[EPOMM, 2008]
EvaMM
Mobility Management (MM) is a concept to promote
sustainable transport and manage the demand for car use
by changing travellers' attitudes and behaviour.
At the core of MM are „soft“ measures like information and
communication, organising services and coordinating
activities of different partners.
„Soft” measures most often enhance the effectiveness of
„hard“ measures withing urban transport (e.g. new tram
lines, new roads and new bike lanes). Mobility Mangement
measures (in comparison to „hard“ measures) do not
necessarily require large financial investments and may
have a high benefit-cost ratio.
RUTH
3
ECOMM 2009, San Sebastián
Timo Finke
Guidelines for the
Evaluation von
MM Programmes
EvaMM
Phases of Behaviour Change
Pre-Contemplation
Contemplation
Decision
Preparation
Initiation
Action
and
Maintenance
RUTH
4
ECOMM 2009, San Sebastián
Timo Finke
Guidelines for the
Evaluation von
MM Programmes
Assessment Levels of EvaMM
Pre-Contemplation
EvaMM
A Awareness raising – problems + solutions
Contemplation
B Acceptance of personal responsibility
Decision
M1 Intention to change behaviour
C Use of MM-Services
Preparation
D Satisfaction with MM-Services
E General acceptance of travel alternatives
Initiation
Action
and
Maintenance
RUTH
5
M2 Start of alternative travel behaviour
F Alternative individual travel behaviour
G Satisfaction with travel alternatives
ECOMM 2009, San Sebastián
Timo Finke
Guidelines for the
Evaluation von
MM Programmes
EvaMM
Assessment levels of EvaMM
A Awareness rising - problems + solutions
Are the target groups aware of the problems their
current travel behaviour creates?
Are the target groups familiar with the offered MM
measures and travel alternatives?
RUTH
6
Indicators
Measurable target
Method of
data collection
Number/share of tourists
who are aware of problems their car journey
causes at the destination
Problem awareness
at 50%
of all tourists until 2010
survey
Number/share of
employees who know the
PT-ticket or carpool offer
50% awareness one
year after setting up
a company mobility plan
survey
Number/share of citizens 25% awareness amongst
who know the
citizens 2 years after
Mobility Center.
opening
survey
ECOMM 2009, San Sebastián
Timo Finke
EvaMM step by step
Guidelines for the
Evaluation von
MM Programmes
I
EvaMM
Evaluation
Plan
Formulate mission statement
II Name and describe target groups
III Specify MM-measures
IV Specify indicators & measurable targets
V Record input and output
Monitoring
VI Record framework conditions
VII Assess impacts
Evaluating
VIII Evaluate success
Evaluation Report
RUTH
7
ECOMM 2009, San Sebastián
Timo Finke
Guidelines for the
Evaluation von
MM Programmes
EvaMM
Evaluation
Plan
IV Specify indicators and measurable targets
Fact sheet
Description
of Indicator
Awareness for the daily congestion caused by the employees and the limited number of
company's parking spaces.
Knowledge of the MM measures offered to solve these problems
Assessment
Level
Target group
A
Awareness rising through MM
Employees
Description of Indicator and its relevance for the
assessed MM-Programme
Basis for a behaviour change is the awareness of problems and knowledge of solutions offered. Company's
MM should make sure that employees are aware of the daily congestions in the proximity of the company and
the limited number of parking spaces that lead to illegal parking on public streets. At the same time, it should
show measures to solve these problems.
The higher the share of employees that are aware of these problems and solutions offered by the MM
programme the more successful measures of awareness rising could be assessed and the more likely a
success of the MM programme will be.
How is success measured?
What is
assessed?
Assessed is the current awareness of the addressed problems and offered solutions
amongst employees and its past development.
What data are
required?
Number of employees, who developed an awareness for the addresses problems and
offered solutions.
How are data
collected?
Interview of employees:
„Do you know the company's Mobility Coordinator?
If YES, How did you learn about him/her?
What is his/her task?
Do you know about the measures of the company' MM programme?
If YES, please name those measures you know.“
Target value and
time frame
X % awareness of problems and solutions amongst the employees after 1 year,
Y % awareness of problems and solutions amongst the employees after 3 years.
What data are
available?
-
Former development of indicator
A former survey of the staff council addressed problems of the company's accessibility for staff, customers,
visitors and suppliers. Can results be used?
What else should be taken into account?
RUTH
10
Note
Give employees the chance to report their own view of problems additionally to what is
addressed by the MM programme.
Background
information
Due to residents' protests paid parking is planned in the company's proximity. This will
lead to an increased use of public transport.
ECOMM 2009, San Sebastián
Timo Finke
Evaluation
Plan
Guidelines for the
Evaluation von
MM Programmes
A Awareness raising – problems + solutions
EvaMM
B Acceptance of personal responsibility
IV Specify indicators and measurable targets
80% of employees know
problems and solutions
80% of those who developed
an awareness for the problems
50% of those who accepted
personal responsibility
M1 Intention to change behaviour
80% of those who plan to change
their travel behaviour
C Use of MM-Services
D Satisfaction with MM-Services
90% of users are satisfied
E General acceptance of travel alternatives
120 employees accept the
offered alternatives
100 employees start to change
their travel behaviour
M2 Start of alternative travel behaviour
F Permanent alternative travel behaviour
55 employees change permanently
90% of those who changed their
travel beaviour are satisfied
G Satisfaction with travel alternatives
RUTH
11
Traffic impacts to be achieved:
reduced motorised trips: 11.000 p.a.
= reduction of 50 parking lots
Set target:
Reduction of CO2
emissions: 40 tons p.a.
ECOMM 2009, San Sebastián
Timo Finke
Guidelines for the
Evaluation von
MM Programmes
EvaMM
V Record input and output
Monitoring
Input
Record of all ressources used based on the principles of
cost and activity accounting.
Output
Other
Reservation
Sale
Consulting
Information
Record of all measures and products provided.
Kind of service provided
X
X
X
X
X
RUTH
12
Start-time
End-time
PT info
08 : 15
08 : 17
Bike rental
08 : 19
08 : 23
Railway ticket
08 : 24
08 : 27
Carsharing
08 : 31
08 : 46
Lost properties
08 : 47
08 : 49
__ : __
__ : __
ECOMM 2009, San Sebastián
Timo Finke
Guidelines for the
Evaluation von
MM Programmes
EvaMM
Monitoring
VI Record framework conditions
1. Record initial situation:
as basis for the development of MM programme
2. Distinguish between:


Changes as result of MM
... demonstrate MM's success.
Changes based on factors outside MM programme
... can not be influenced by MM priogramme, but might
have influence on the MM programme.
Identify causality between trigger and behaviour change in
surveys.
RUTH
13
ECOMM 2009, San Sebastián
VII Assess impacts
Timo Finke
Evaluating
Guidelines for the
Evaluation von
MM Programmes
A Awareness raising – problems + solutions
EvaMM
B Acceptance of personal responsibility
Share of those who are aware of
problems and offered solution.
Share of those who accept
their own responsibility.
Share of those who intend to
change their own travel bahaviour.
M1 Intention to change behaviour
Share of those who use
MM services.
C Use of MM-Services
D Satisfaction with MM-Services
Share of those who are
satisfied with MM services.
E General acceptance of travel alternatives
Share of those who accept
the offered alternatives.
Share of those who start
a new travel behaviour.
M2 Start of alternative travel behaviour
Share of those who practise new
travel behaviour permanently.
F Permanent alternative travel behaviour
G Satisfaction with travel alternatives
RUTH
14
Share of those who changed their travel
behaviour and are satisfied with it.
Impacts achieved by MM:
- transport related
- ecological
- individual
ECOMM 2009, San Sebastián
Timo Finke
Guidelines for the
Evaluation von
MM Programmes
EvaMM
Evaluating
VIII Evaluate success
Effectiveness
• Collection of achieved impacts
• Comparison of measurable targets and achieved
performance (target-performance comparison) for
Output
 Impacts

Efficiency
• Collection of consumed ressources
• Comparison of available ressources with measurable
targets
• Evaluate achieved results vs. consumed ressources for
Output (costs per service unit)
 Changes in framework conditions
 Impacts (costs per impact unit)

RUTH
16
ECOMM 2009, San Sebastián
Timo Finke
EvaMM step by step
Guidelines for the
Evaluation von
MM Programmes
I
EvaMM
Evaluation
Plan
Formulate mission statement
II Name and describe target groups
III Specify MM-measures
IV Specify indicators & measurable targets
V Record input and output
Monitoring
VI Record framework conditions
VII Assess impacts
Evaluating
VIII Evaluate success
Evaluation Report
RUTH
17
ECOMM 2009, San Sebastián
Timo Finke
Guidelines for the
Evaluation von
MM Programmes
EvaMM
Guidelines for the
Evaluation of Mobility Management
Programmes
EvaMM
Thank you!
Timo Finke
Department of Traffic Management
City of Düsseldorf
RUTH
20
ECOMM 2009, San Sebastián