Transcript Microsoft PowerPoint Presentation (97KB)

VERITE – evaluation process
Alasdair Reid,
[email protected]
Berlin, 22 February 2002
Points addressed
Role and scope of the evaluation
Logical framework
Coherence of the objectives
Expectations of members;
Gauging network effects
Indicators (targets and process)
Next steps
22 February 2002
VERITE - Evaluation process
2
Role and scope of the
evaluation
Examine and analyse progress and the
qualitative results:


Articles on database, level and quality of
discussion, etc.
Informed opinion on level of networking
Should facilitate adjustments to work
programme & orientation of networking
Management tool, "resource light" and
process oriented.
22 February 2002
VERITE - Evaluation process
3
VERITE – simplified
logical framework
Workshops
Increased
awareness
Access to
providers
Portal
Discussion
group
Exchange
know-how
Database
Access to
knowledge
Activities / Outputs
Results
22 February 2002
New IMT
schemes
VERITE - Evaluation process
Sustainability
of networking
/
Impacts
4
Coherence of the objectives
Attaining the objectives implies a number of
assumptions:


That there is a complementarity of know-how and
experience;
That the tools and activities are pertinent to
members;
Unless the incentives are there to maximise
"networking effects", achieving "results" will
not lead to a sustainable impact.

Project assumes members of the network are
active beyond the time allocated to specific tasks.
22 February 2002
VERITE - Evaluation process
5
Typology of members:
Co-ordinators, Disseminators* & Learners
Type
National
Regional
Sub-regional
Lorraine Region
Mantova Province
TEKES*
FUNDECYT
LEIA*
Jozef Stefan
Archimedes Foundation
Public
authority
Innovation
intermediary
Agropolis*
Tech Tyrol*
(MWMEV) ZENIT*
University
centre
URENIO*
Cardiff Uni*
Thessaly Uni*
Development /
business org.
Centro Svillupo
RDA S-W Oltenia
Pro Novum
Nicosia CCI
22 February 2002
VERITE - Evaluation process
6
How to gauge network
performance ?
Pertinence of networking activities:


Satisfaction of participants : IT tools, workshops…
Level of networking activity (quantitative indicators);
Efficiency of network management:


Process assessment – views on barriers and drivers
to networking;
Quality of organisation of events, effective operation
of IT tools as networking interface;
Network effects


Valued added with respect to baseline knowledge &
activities in field of IMT;
Extension and sustainability of network.
22 February 2002
VERITE - Evaluation process
7
Indicators targets & process
Network members interaction (inter-regional):


Quantitative (n° of messages, articles, etc.)
Qualitative (types of interaction generated);
Take-up at regional level (intra-regional):


Quantitative (n° of users of DB per region, etc.)
Qualitative (Feedback from dissemination)
Networking effects (impact):


Quantitative (n° of new IMT schemes implemented
at regional level, enlarged participation, etc.)
Qualitative : Types of new co-operation between
members, sustainability (new projects, etc.)
22 February 2002
VERITE - Evaluation process
8
Next steps
Preparation of a short "baseline situation"
questionnaire and distribution to partners
(before Easter);
First evaluation report (September 02);
Support to WS organisers for a
satisfaction/quality participants survey;
Participation at 2-3 network events
(workshops);
Second "evolution of knowledge"
questionnaire (June 03)
Second evaluation report (September 03)
22 February 2002
VERITE - Evaluation process
9