Transcript Document 7338944

Institute for the Promotion of Innovation
By Science and Technology in Flanders
Instituut voor de Aanmoediging van Innovatie
door Wetenschap en Technologie in Vlaanderen
BEHAVIOURAL ADDITIONALITY
Evaluation Beyond the Linear Innovation Model
Research and the Knowledge Based Society –
Measuring the Link
European Conference on good practices in
research evaluation and indicators
Galway, May 24 th 2004
Jan Larosse, IWT-Flanders
Behavioural Additionality : Overview
Behavioural Additionality
home >
sitemap >
1. Why Behavioural Additionality?
2. R&D Subsidies in 'interactive mode'
3. BA in many dimensions
4. Traditional vs Behavioural Additionality
5. IWT practice: 'internalised' additionality
6. Challenges for evaluation methodoloy
3
Behavioural Additionality: Why?
Behavioural Additionality
home >
sitemap >
1. Need for 'systemic' evaluations
- Different nature of knowledge as production factor
- Social return=
(Private Return + Spillovers)*Additionality
- Additionality: role of governments
- Behaviour catches interaction effects in innovation
system
2. Need for ‘bridging’ concept:
- Bridging different traditions of evaluation
- Micro-foundation of systemic evaluation
- Theory has to catch-up on policy practice
4
Government
Policy
Objectives.
I
W
T
Follow-up
R&D
International
and local
environment
Innov.
Effect
Interaction
deze pagina is voorbehouden voor grote schema's
Input
Milestones
Budget
C
L
I Project
E Design
N
T
Criteria
Firms
Spillovers
Contract
sitemap >
Sector
Cluster
Partner
Publicity
S
Y
S
T
E
M
home >
Application
I
N
N
O
V
A
T
I
O
N
Proces
Output :
Impact
Projects
succeeded
Evaluation
Others
Research Infrastructure
Intermediaries
Framework Conditions
Complementairy
Impacts
5
home >
Budget
Government
Policy
Objectives
Follow-up
Milestones
Contract
Criteria
Intake
Awareness
Firms
C
L
I Project
E Design
N
T
Application
sitemap >
I
W
R&D
Innov.
Effect
INTERACTION
Evaluation
Impact
Input
Proces
Output
Projects accomplished
T
6
home >
Behavioural Additionality in many dimensions
sitemap >
Organisational
level
home >
sitemap >
Process level
Input
Project
Company (Strategy)
System
Behavioural Additionality
Scale
Time
Risk
R&D-budget
Knowledge spillovers
Portfolio composition
Throughput
Internal
Project management Innovation management
External
IPR behaviour
Synergy with proj.
family
Cooperation
Alliances
Networking / clustering
Strategic autonomy
Relations with
VC/financiers
Quality label
Output
Proces innovation
Localisation
Strengthen core or
Product innovation
Differentiation
Spec. knowledge /
know-how
Training
Improvement
environmental impact
Human Capital
7
Traditional Additionality vs Behavioural Additionality
Behavioural Additionality
home >
sitemap >
1. Linear model:
Input Add. proxy for
innovation outcome
1. Non-linear model
Interactivity key to
innovation performance
2. Behaviour of applicants
as 'black box‘
3. Allocation behaviour as
sufficient theoretical
foundation)
2. Behaviour of applicants is
focus
3. Different kinds of behaviour
(markets, hierarchies,
networks) in innovation
system
4. ‘Real world’ as reference
4. 'Optimality' of
allocations as reference
8
Traditional Additionality vs Behavioural Additionality
Behavioural Additionality
home >
sitemap >
6. Focus on evalution of
impact on the firm
6. Shift to evaluation of
spillovers to the system
7. Evaluation of single
instruments
7. Evaluation of
complementarity of
instruments (leverage)
8. Impact assessment is
main challenge
8. Policy learning is main
challenge (improving policy
design)
9. Problem of
counterfactual analysis
(finding identical control
groups)
9. Problem of comparative
analysis
(similar situations, never
alike)
9
Traditional Additionality vs Behavioural Additionality
Behavioural Additionality
home >
sitemap >
10. Money transfer is
central :
Redistributive role of
government
10. Interaction is central:
Additionality versus
‘crowding out’
= negative connotation
Additionality as ‘value added’
Catalyser role of government
= positive connotation
10
home >
sitemap >
home >
sitemap >
Bottom-up
IWT
R&D
Additionality?
Stimulation
Instrument
Target
Objective
Motivation
Incentive
Value-Add
Basic research
More
Underinvestment
(uncertainty)
50%
(vs 25%)
Portfolio
(Programme
financing
Eureka
(Internat Co-op)
More
Coordination
cost
+ 10%
EU Contact
Point
Networking
More
Coordination
cost
+ 10%
Platforms
(Thematic
Clusters)
SME
More
Barriers
+ 10%
Innovation
trajectory
Behavioural Additionality
11
home >
sitemap >
home >
sitemap >
Bottom-up
IWT
R&D
Additionality?
Behavioural Additionality
Stimulation
Instrument
Target
Objective
Motivation
Incentive
Value-Add
SME
Doubling of
SME
applications
Specific
needs
(Feasibility
Studies)
Specific
costs
(80%)
Capabilities
(Innovation
Management)
Sustainable
Techn.Dev.
Share in IWT Negative
Priority
portfolio
Externalities arrangement
above 16%
+ 10%
Start-ups
Access to
Capital
capital
market
market (near- failure
capital)
Combination of
instruments
(consistency in
time)
Subordinated Support VC
loans (up to
Capital
75%)
(missing link)
12
Evaluation of Effectiveness with BA :
Beyond the Linear Innovation Model
Behavioural Additionality
home >
sitemap >
1. Traditional evaluation (linear model)
- Innovaton performance = mechanical result
(output follows input)
- Market failure : government can correct
underinvestment by innovating firms
- Input additionality (proxy for output
additionality)
2. Systemic evaluation (interactive model)
- Innovation performance = result of interaction
(mutual adaptation)
- Systemic failures : government as a co-actor
- Behavioural additionality (micro-foundation for
systemic evaluation of role government)
13
Evaluation of Effectiveness with BA :
Policy Learning
Behavioural Additionality
home >
sitemap >
1. Is Additionality (still) a useful concept?
- ‘making the difference’!
- learning versus optimality
2. What adaptations are needed to evaluation
methodologies?
- complexity as a solution?
- comparative vs counterfactual method?
3. How to use the evaluation of BA in policy
learning
- include behaviour of agencies!
- policy mix is implied!
14
Evaluation of Effectiveness with BA :
Taking it Further
Behavioural Additionality
home >
sitemap >
1. Research Agenda
- Conceptual clarification
- Measurement as occasion for learning (not only
legitimising)
- Comparative research as (international) policy
learning
2. How to organise learning
- Communities of practice of evaluators
- Communication with policy makers
3. Integration in broader agenda’s
- Oecd-TIP / TAFTIE / EU
15
Institute for the Promotion of Innovation
By Science and Technology in Flanders
Bischoffsheimlaan 25
B-1000 Brussels
Tel.: +32 (0)2 209 09 00
Fax.: +32 (0)2 223 11 81
E-mail: [email protected]
www.iwt.be