Transcript JR-Explorer
Issues, Particularities and potential Pitfalls
6 CP Spring Workshop 2007, Dublin
INNOVATION aus TRADITION
The Regional Dimensions of Evaluation
JOANNEUM RESEARCHInstitute for Technology and Regional Policy
Christian Hartmann
[email protected]
[email protected]
JOANNEUM RESEARCH Forschungsgesellschaft mbH, Steyrergasse 17, A-8010 Graz, Austria, e-mail: [email protected], web: http:// www.joanneum.at
zert
ISO
9001
ISO9001
zertifiziert
Wolfgang Polt
1
Overview
Recent trends in Evaluation
The Regional Dimension
The „typical“ regional Evaluation Project
zert
ISO
9001
ISO9001
zertifiziert
Particularities and potential Pitfalls
JOANNEUM RESEARCH Forschungsgesellschaft mbH, Steyrergasse 17, A-8010 Graz, Austria, e-mail: [email protected], web: http:// www.joanneum.at
2
Recent Trends in Evaluation
Increased emphasis on impact assessment
ex-ante ( priority setting, links to foresight)
ex-post ( economic effects, behavioural additionality)
Widening the scope: IA of basic research
‚Concept evaluations‘ (ex-ante, interim)
Checking the rationale and early implementation
‚Systemic evaluations‘
OECD (CSTP Oct 2006, Seoul) asked countries to „improve the capacity to
carry out ‚Systemic evaluations‘“
Addressing Innovations systems as a whole (TrendCHART;
ERAwatch, EIS, OECD STI Scoreboard,..)
Addressing the ‚Policy Mixes‘ of countries
Asking for the impossible..?
JOANNEUM RESEARCH Forschungsgesellschaft mbH, Steyrergasse 17, A-8010 Graz, Austria, e-mail: [email protected], web: http:// www.joanneum.at
zert
ISO
9001
ISO9001
zertifiziert
Addressing portfolios RTDI policy instruments (e.g. direct vs indirect
support for private R&D)
3
zert
ISO
9001
ISO9001
zertifiziert
Evaluation in the policy cycle
JOANNEUM RESEARCH Forschungsgesellschaft mbH, Steyrergasse 17, A-8010 Graz, Austria, e-mail: [email protected], web: http:// www.joanneum.at
4
Evaluation needs a systemic (mulit-actor, multi-level)
perspective
international
national
zert
ISO
9001
ISO9001
zertifiziert
regional
JOANNEUM RESEARCH Forschungsgesellschaft mbH, Steyrergasse 17, A-8010 Graz, Austria, e-mail: [email protected], web: http:// www.joanneum.at
5
zert
ISO
9001
ISO9001
zertifiziert
The Regional Dimension
JOANNEUM RESEARCH Forschungsgesellschaft mbH, Steyrergasse 17, A-8010 Graz, Austria, e-mail: [email protected], web: http:// www.joanneum.at
6
Why does the regional dimension of evaluation
matter?
Regional Innovation Systems
Globalisation leads to a growing importance of localized
innovation capabilities, that are hard to copy / to transfer
The growing importance of regional innovation systems in the
economic literature (Asheim et al. 2003, Cooke 2003, Malmberg
and Maskell 2002) leads a stronger focus on the regional level in
the policy domain
The concept of regional innovation systems offers effective (low
cost) roads for policy delivery
Devolution of (innovation) policy competencies in some EU
countries (e.g. France, England)
Growing interest in RTDI policy at regional level in federal
provinces or autonomous regions in EU countries
Growing importance of regional RTDI policy at EU-Level (i.e.
RIS/RITTS, Regions of knowledge)
JOANNEUM RESEARCH Forschungsgesellschaft mbH, Steyrergasse 17, A-8010 Graz, Austria, e-mail: [email protected], web: http:// www.joanneum.at
zert
ISO
9001
ISO9001
zertifiziert
Regionalisation of RTDI Policy
7
Strategic Policy Intelligence in the Regional
Dimension
Different Levels of Development among European
Regions
While some European regions already have a long existing
practice (like Styria, Basque Country, etc.)…
…in particular regions in the NMS are just at the beginning to
develop respective structures and processes.
Different Degrees of Freedom for SPI in European
Regions
Size of the region and corresponding capacities for SPI
i.e. Catalunya vs. Burgenland
Degree of regional autonomy for RTDI policy
zert
ISO
9001
ISO9001
zertifiziert
i.e. Friuli Venezia Giulia (IT) vs. South-Transdanubia (HUN)
JOANNEUM RESEARCH Forschungsgesellschaft mbH, Steyrergasse 17, A-8010 Graz, Austria, e-mail: [email protected], web: http:// www.joanneum.at
8
zert
ISO
9001
ISO9001
zertifiziert
The „typical“ regional Evaluation
Project
JOANNEUM RESEARCH Forschungsgesellschaft mbH, Steyrergasse 17, A-8010 Graz, Austria, e-mail: [email protected], web: http:// www.joanneum.at
9
Is there such a thing as a “typical” regional
evaluation project?
How typical is “typical” - regional evaluation projects do
actually cover a wide range of issues and policy
areas
Regional Evaluation is often Evaluation of Regional Policy (i.e.
Structural Funds)
Evaluation in the regional dimension does often mean:
Evaluation of small and medium sized programmes with
regional funding
Regional Cluster Initiatives
Regional/Municipal Economic Programmes
Evaluation of regional strategic projects
Key projects in the framework of Community Initiatives
JOANNEUM RESEARCH Forschungsgesellschaft mbH, Steyrergasse 17, A-8010 Graz, Austria, e-mail: [email protected], web: http:// www.joanneum.at
zert
ISO
9001
ISO9001
zertifiziert
Regional Innovation Infrastructures (i.e. Technology / Science Parks)
10
Are “typical” regional evaluation projects following
the general trends?
“Typical” regional evaluation projects do reflect general
trends in evaluation - but with varying degrees of
intensity
Concept evaluations do already play a big role on the regional
level
Structural Funds
Increasing emphasis of impact assessments on regional level
Regional RTDI Programmes
Strategic Projects
zert
ISO
9001
ISO9001
zertifiziert
Systemic evaluations are at the moment not (yet) of relevance
JOANNEUM RESEARCH Forschungsgesellschaft mbH, Steyrergasse 17, A-8010 Graz, Austria, e-mail: [email protected], web: http:// www.joanneum.at
11
The „typical“ regional evaluation project and
Strategic Policy Intelligence
No (complete) policy cycle for RTDI policy in most
European regions
Reluctance to confront the past
Evaluations are often motivated by the necessity to
letigimate the past
Evaluations as tools in regional political games
There are “natural constraints” for SPI corresponding
to the Size and political status of the Region
Lack of policy capacities
zert
ISO
9001
ISO9001
zertifiziert
Lack of degrees of freedom for SPI
JOANNEUM RESEARCH Forschungsgesellschaft mbH, Steyrergasse 17, A-8010 Graz, Austria, e-mail: [email protected], web: http:// www.joanneum.at
12
zert
ISO
9001
ISO9001
zertifiziert
Potential Pitfalls
JOANNEUM RESEARCH Forschungsgesellschaft mbH, Steyrergasse 17, A-8010 Graz, Austria, e-mail: [email protected], web: http:// www.joanneum.at
13
Potential Pitfalls of evaluation at the regional level
Roughly the same that face evaluations on all levels, but
more accentuated:
Lack of capacity to carry out evaluations – and to
absorb and implement the results of evaluations
Difficulties of ‚role delineation‘: the evaluator as policy
maker? Too close to policy
Potential to influence the evaluation results because
of closeness of policy makers to stakeholders
zert
ISO
9001
ISO9001
zertifiziert
Expectations too high (especially with respect to
impact assessment)
JOANNEUM RESEARCH Forschungsgesellschaft mbH, Steyrergasse 17, A-8010 Graz, Austria, e-mail: [email protected], web: http:// www.joanneum.at
14