Transcript Document

Technology Programme Autumn 2005
Assessment Criteria
Autumn 2005 Competition
Dr Alastair McGibbon
TUV NEL Ltd.
Technology Programme Autumn 2005
TSB Strategic Criteria
 UK Capacity to Develop and Exploit the Technology:
 significant research capability/capacity to exploit opportunities,
 Potential for Impact and Timescale:
 further research and innovation with significant impact in right
timeframe,
 competitive activity – key benchmark for right things at the right
pace.
 The Size of the Global Market Opportunity:
 create value added in UK, taking account of the global market
potential.
 A Clear Technology Strategy Board Role:
 add value identifying and addressing barriers, critical policy
challenges, lever in other public funds, raise engagement, crossgovernment co-ordination - a clear basis for business to engage
in the agenda.
Technology Programme Autumn 2005
The Ideal Project
 An industrially driven consortium with a clear commercial
opportunity and objective within 5-7 years
 An element of market failure which prevents autonomous
progress
 An technically innovative project which will overcome the market
failure in 2-4 years
 Achievable market exploitation and spill-over benefits
Technology Programme Autumn 2005
Project Positioning
Added
Value
Competitive
Advantage
Productivity
TP Projects
Applications
Technology
Technology Programme Autumn 2005
Assessors
Assessors are experienced, independent
professionals with:
 Experience of collaborative technology
development projects.
 Usually some relevant experience and a general
understanding of your proposal area.
Most assessors will:
 Have previous experience of assessing projects.
 Be assessing several projects for this call.
Technology Programme Autumn 2005
The General Do’s and Don’ts
Do:
 Get the basics right – avoidable mistakes and poor
presntation detracts from what you are tryng to say
(sic).
 Be relevant to the question you are being asked
 Be clear, concise and accurate
 Be as quantitative as possible – substantiate your
statements
Don’t:
 Assume that the assessor will read between the lines
 Assume that you will get the benefit of the doubt
 Use throw-away statements
Technology Programme Autumn 2005
Outline Assessment Process
Your Application will be assigned to at least
three independent assessors.
Your Application will be
downloaded from a secure
server only by the
assessors assigned to it.

Assessors will have
signed confidentiality
undertakings and will not
assess your Application if
there is a conflict of
interest.

Technology Programme Autumn 2005
Assessor Guidelines
Each assessor will then assess
your Application in relation to the
criteria and questions. The three
headline criteria are:-
Project
overview
and
relevance to
the call
Potential
Impact and
Risk
Project
Organisation
and
Management
Technology Programme Autumn 2005
Assessment Criteria Weightings
Criteria 1: Project Overview & Relevance to the
Competition for Funding
(4 questions, 50 points)
Criteria 2: Potential Impact and Risk
(5 questions, 45 points)
Criteria 3: Project Organisation & Management
(3 questions, 30 points)
Total
12 questions, 125 points
Technology Programme Autumn 2005
Criteria 1: Project Overview & Relevance to the
Competition for Funding
Question 1 - Does the Application align with the specific Technology
Priority?
(5 points)
Question 2 - What is innovative about this project?
(15 points)
Question 3 – What Technical Approach will be adopted?
(15 points)
Question 4 – Why is Technology Programme funding required?
(15 points)
Technology Programme Autumn 2005
Question 1 - Does the Application align with the
specification for Technology Priority ?
(5 points)
Applicant Guidance
Applicants should provide an overview of the scope of the proposed
overall project.
It should clearly state what the objectives are and indicate how they are
relevant to the requirements stated in the specification for the Technology
Priority
Assessor Guidance
What is the clear “centre of gravity” of the Application and is it aligned
with the specification for the Technology Priority?
Does the Application address the research objectives and topics it claims
to address?
Technology Programme Autumn 2005
Question 2 - What is innovative
about this project?
(15 points)
New
Leverage
Radical
Evolutionary
Substitution
Market
Existing
Existing
New
Technology
Applicant Guidance
Applicants should provide a detailed description of the technical approach
and methods to be employed to deliver the project results, clearly identifying
the innovative aspects of the project.
Applicants should describe the level of this innovation and how far it will
push the boundaries and knowledge past current leading edge work.
Alternatively, how does the project apply existing technologies to new
areas? For example this should include details of the technical breakthrough
being sought.
Assessor Guidance
To what degree is the project innovative? For example, does it push
boundaries over and beyond current leading-edge world science and
technology, or is it looking to apply existing technologies in new areas?
Technology Programme Autumn 2005
Question 3 - What Technical Approach will be adopted?
(15 points)
Applicant Guidance
Applicants should provide an overview of the technical approach including
the main objectives of the work and methods to be employed to deliver
the overall project results.
Assessor Guidance
Is this technical approach appropriate to the needs of the project and are
the innovative steps achievable through the proposed approach?
Technology Programme Autumn 2005
Question 4 - Why is Technology Programme funding
required? (15 points)
Applicant Guidance
Applicants should identify the difference DTI support will make.
This is commonly termed “Additionality” within Government and seeks to
understand the impact DTI funding will have on the activity to be undertaken and
the anticipated outcome.
For example, why funding is critical to project initiation; quality of results; scale
and timing of potential benefits?
What is it about the relevant market that makes DTI support necessary?
What missed opportunities might there be if the DTI does not support the project?
Assessor Guidance
Does the application identify the difference Technology Programme support will
make?
For example, what is the criticality of the funding requirement with respect to
project initiation; quality of results; scale and timing of potential benefits?
What is the nature of the market failure occasioning the need for Technology
Programme support?
What is the missed opportunity if the Technology Programme does not support
this project?
Technology Programme Autumn 2005
Question 4 - Why is Technology Programme funding
required? (15 points)
Applicant Guidance
Applicants should identify the difference DTI support will make.
This is commonly
termedbe
“Additionality”
within Government
seeks
Projects could
allocated scores
in declining and
order
of to
understand the impact DTI funding will have on the activity to be undertaken and
attractiveness:
the anticipated
outcome.
 Without
Government
this
projectquality
wouldofnot
go ahead
For example,
why funding
is criticalfunding
to project
initiation;
results;
scale in
and timing
potential
benefits?
anyofshape
or form,
What is it about the relevant market that makes DTI support necessary?
 Government
funding
allows
applicant
increase
scope
What missed
opportunities
might there
bethe
if the
DTI doestonot
support the
the project?
of the project or carry out the project earlier,
Assessor
Guidance
 Government
funding has not altered the scale or timing of the
Does the application identify the difference Technology Programme support will
make? project but has affected the way the project will be carried out
For example,
what is the criticality
of the
funding
requirement with respect to
(e.g. collaboration
with the
science
base).
project initiation; quality of results; scale and timing of potential benefits?
What is the nature of the market failure occasioning the need for Technology
Programme support?
What is the missed opportunity if the Technology Programme does not support
this project?
Technology Programme Autumn 2005
Recapping…
Do:
 Explain why the project is innovative
 Explain your technical approach so that the assessor
knows what it is you are actually going to do
 Understand what ‘additionality’ is
Don’t:
 Skew a project to fit the call
 Dress up the project to be something it isn’t – the
assessors will find you out!
Technology Programme Autumn 2005
Assessment criteria weightings
Criteria 1: Project Overview & Relevance to the
Competition for Funding
(4 questions, 50 points)
Criteria 2: Potential Impact and Risk
(5 questions, 45 points)
Criteria 3: Project Organisation & Management
(3 questions, 30 points)
Total
12 questions, 125 points
Technology Programme Autumn 2005
Criteria 2: Potential Impact and Risk
Question 5 - What are the expected project results, and how do they
align with industrial and commercial needs?
(5 points)
Question 6 - What are the economic benefits of this project and who is
likely to benefit?
(15 points)
Question 7 - How will the project results be exploited?
(10 points)
Question 8 - What are the environmental and social impacts of
undertaking the project, and how significant are they relative to the
economic benefits?
(10 points)
Question 9 - What are the specific risks with regard to the successful
outcome of this project?
(5 points)
Technology Programme Autumn 2005
Question 5 - What are the expected project results, and
how do they align with industrial and commercial needs?
(5 points)
Applicant Guidance
Applicants should provide a brief overview of the expected project results,
including the deliverables of the project, and identify their relevant merits
(e.g. scientific, technological, commercial, knowledge, or a combination of
these).
Applicants should indicate the industrial and commercial relevance of the
proposed project and highlight the scale of change/impact this project may
have..
Assessor Guidance
Are the project results and deliverables industrially and/or commercially
relevant?
Is there the potential for broader use?
Have the applicants indicated the likely scale of change and is it
reasonable?
Technology Programme Autumn 2005
Question 6 - What are the economic benefits of this
project and who is likely to benefit?
(15 points)
Applicant Guidance
Applicants should indicate the potential direct and indirect beneficiaries of
the project. Consider both those internal and external to the project, e.g.
consortium members, users (intermediaries and end), suppliers, industrial
markets and the UK.
Indicate the likely benefit to each beneficiary and the potential scale of
benefits in relation to the total expenditure of the project, including
associated risks and uncertainties.
Technology Programme Autumn 2005
Question 6 - What are the economic benefits of this
project and who is likely to benefit? (15 points)
Assessor Guidance
Have the applicants distinguished between the economic benefits that will accrue
to them and the consortia from the project, as distinct from the economic benefits
that may accrue to others in the wider community?
How have the estimates of economic benefit been expressed?
Are the risks, or uncertainties, made clear, and are they reflected in the
estimates?
-Basic research applications. Have the applicants indicated the breadth and
scale of potential economic benefits? Would these economic benefits justify the
project costs? How far have the applicants been able to quantify potential
spillovers? Are ranges included?
-Applied research applications. Have the applicants indicated the balance of
project costs and benefits across the proposed markets and market
opportunities, including wider benefits and spillovers?
- Experimental development applications. Have the applicants estimated the
market potential of the project, including economic returns and profitability?
Has a Net Present Value (NPV) been included?
Technology Programme Autumn 2005
Question 6 - What are the economic benefits of this project and who
is likely to benefit? (15 points)
Projects should score highly if:
– Technology is path-breaking - success opens up entirely new
areas of technology development; or,
– Proof of concept that would point the way for other researchers to
try related areas in other applications: or,
– Technology is infrastructural – i.e. other researchers are likely to
be a market for the new technology; or,
– Technology will lead to the redesign of multiple distinct systems
using that technology.
Projects should score less highly if:
– It leads to an incremental improvement to an existing technology
which will have a large negative profit impact on another firm or
firms whose technology will be made obsolete; or,
– Project applicants have special technical expertise that would
position them to be the most likely developer of many of the follow
on technologies.
Technology Programme Autumn 2005
Question 7 - How will the project results be exploited?
(10 points)
Applicant Guidance
Applicants should demonstrate the possible commercial exploitation of
the project and the potential transferability of the results e.g. possible
applications / markets / processes or products.
Applicants should also provide information on how the results will be
disseminated to the wider community.
Technology Programme Autumn 2005
Question 7 - How will the project results be exploited?
(10 points)
Assessor Guidance
To what extent does the application demonstrate a possible commercial
application of the project results? How do the applicants intend to
disseminate or exploit the results?
-Basic research applications. Have the applicants indicated many
potential applications to a range of markets, processes or products?
-Applied research applications. Have the applicants indicated a limited
range of applications focusing on specific markets and market
opportunities, together with remaining technological integration issues?
- Experimental development applications. Have the applicants indicated
the clear use and commercial exploitation of the project’s results,
together with clear routes to market based on product, process or
service developments
Technology Programme Autumn 2005
Question 8 - What are the environmental and social
impacts of undertaking the project, and how significant
are they relative to the economic benefits? (10 points)
Applicant Guidance
Sustainable development balances economic growth with protection of
the environment and social impact.
What are the environmental and social impacts of undertaking the project,
and how significant are they relative to the economic benefits?
Will the project have any impacts on the environment – either positive or
negative?
What can be done to mitigate negative impacts?
Will the project have any social impacts – either positive or negative?
What could the results of the project mean for other members of society
or social groups?
What is the balance between the environment and social benefit and
economic benefits?
What are the inter-relationships and where might any trade-offs exist?
Technology Programme Autumn 2005
Question 8 - What are the environmental and social
impacts of undertaking the project, and how significant
are they relative to the economic benefits?
(10 points)
Assessor Guidance
Have the applicants demonstrated that they have assessed the
environmental and social impacts? Is their assessment realistic?
If adverse environmental or social impacts are anticipated, how does the
project mitigate these? Is this realistic?
Technology Programme Autumn 2005
Question 9 - What are the specific risks with regard to the
successful outcome of this project? (5 points)
Applicant Guidance
Applicants should identify the high-risk elements and uncertainties of the
project and provide an overview of the technical, commercial and
managerial risks as well as uncertainty associated with the project.
The main risks should then be rated as High/Medium/Low (H/M/L).
Applicants should state how the project will mitigate these risks.
Assessor Guidance
Have applicants clearly identified the elements within the project that have
high uncertainty and the associated level of risk?
Are the risks soundly based? Are they reasonable and logical for the
proposed project objective, for example?
Have the applicants clearly identified the technical, commercial and
managerial risks associated with the project?
Technology Programme Autumn 2005
Recapping…
Do:
 Demonstrate a reasonable understanding of how,
where and when the output will reach the
marketplace.
 Spell out risks or negative impacts and how you
would mitigate them.
 Demonstrate a clear understanding of the
environmental and social impacts.
Don’t:
 Give unsubstantiated data – market or otherwise.
 Give the impression that you have just thought up
the answers!
Technology Programme Autumn 2005
Assessment Criteria Weightings
Criteria 1: Project Overview & Relevance to the Competition
for Funding
(4 questions, 50 points)
Criteria 2: Potential Impact and Risk
(5 questions, 45 points)
Criteria 3: Project Organisation & Management
(3 questions, 30 points)
Total
12 questions, 125 points
Technology Programme Autumn 2005
Criteria 3: Project Organisation and Management
Question 10 - What are the benefits of creating the proposed consortium?
(15 points)
Question 11 - How will the proposed consortium partners be organised and
what arrangements are proposed for the duration of the project?
(10 points)
Question 12 - What is the financial commitment required for this project?
(5 points)
Technology Programme Autumn 2005
Question 10 - What are the benefits of creating the
proposed consortium?
(15 points)
Applicant Guidance
Applicants should explain what benefits will be gained from working
collaboratively as part of the consortium. What is driving the formation of
the consortium and how does that relate to the project objectives?
Assessor Guidance
Do the consortium members have the right mix of skills and experience to
be able to deliver the project successfully?
Are the consortia formation objectives clear and would it have been
formed without Technology Programme funding?
Is extra benefit demonstrated from the collaboration, for example
increased knowledge transfer?
Technology Programme Autumn 2005
Question 11 - How will the proposed consortium
partners be organised and what arrangements are
proposed for the duration of the project? (10 points)
Applicant Guidance
Applicants should explain the relationships between the partners,
indicate which partner will lead the consortium, and nominate a single
point of contact.
The application should explain the formal arrangements, proposed or in
place, between the consortium members.
Assessor Guidance
Are there any existing formal arrangements in place between the
consortia partners? If not, have the Applicants identified the future
arrangements?
Have they provided an overview of how potential benefits from the
project will be shared between the consortia partners?
Technology Programme Autumn 2005
Question 12 - What is the financial commitment required
for this project? (5 points)
Applicant Guidance
Applicants should indicate the anticipated project cost and the level of
funding required from the DTI and (where applicable) Research Councils
for this specific application for funds.
This must be consistent with the category of research being undertaken
within each work package.
Any actual or indicative financial support from other sources independent
of this application should also be detailed e.g. Devolved Administrations /
Regional Development Agencies / Research Councils, other Government
Departments.
Technology Programme Autumn 2005
Question 12 - What is the financial commitment required
for this project? (5 points)
Assessor Guidance
Have the applicants provided a detailed budget breakdown? Is it
inclusive of all anticipated costs throughout the duration of the project?
Where appropriate, are capital and depreciation costs clearly identified?
For example, new equipment. Is the budget realistic for the scale and
complexity of the project?
Does the financial support required from the DTI fit within the limits set by
the specific Technology Priority?
Is a financial commitment from other sources demonstrated for the
balance of the project costs?
Technology Programme Autumn 2005
Recapping…
Do:
 Show how the consortium can reach the end markets
 Show that each member has a clear, defined and
significant role within the project
 Give evidence of experience and capability
 Make sure there are project decision points and gates
 Give accurate and correct financial information – do
your homework
Don’t:
 Create artificial consortia
 Add partners just to increase the numbers
 Forget to accommodate change in the plan
Technology Programme Autumn 2005
After the Assessment
Assessment Score
Sheets are then
Uploaded via secure
server and collated by
the Programme Manager
Technology Programme Autumn 2005
Post-Assessment
After the assessment process is complete, you will be informed
of the outcome of your Application.
Successful
You will receive a
confirmation of success, with
details of how to take your
application forward.
Unsuccessful
You will receive a short
written summary of the
reasons why the Application
was unsuccessful.
Technology Programme Autumn 2005
Contact
 [email protected]
 Tel No
01355 272155
Questions & Answers