Transcript Slide 1
Developing Digital Literacies Evaluation Logic Model Template INPUTS What we invest/do & OUTPUTS (PROCESS) RESULTS (OUTCOMES) Immediate outputs/ deliverables Tangible, measureable intermediate benefits IDENTIFIED AS KEY INDICATORS DEFINED IN THE PROJECT PROPOSAL USUALLY DEFINED & PROJECT PLAN IN THE PROJECT OBJECTIVES DEFINES WHAT OUTCOMES WILL LOOK LIKE MAY BE DIFFERENT FOR DIFFERENT GROUPS & DIFFERENT STAKEHOLDERS DATA GATHERING & ANALYSIS CAPTURES THE EVIDENCE ASSUMPTIONS: that developing digital literacies helps progress towards strategic vision/goals, e.g. improves student employability Emerging EVIDENCE Longer term impact A journey /transformation DEFINED IN THE PROJECT indicated by AIMS/GOALS/VISION changes in awareness, behaviour, activities, processes, skills, learning, practices, systems, that evidence progress towards strategic Project aims/goals boundary ENVIRONMENTAL FACTORS: defines the current ‘variable’ context and challenges influencing what we do and what we achieve Evaluating PROCESSES & OUTCOMES from the Logic Model Inputs show what is invested (by the institution, by JISC, others) and RESULTS (outputs & outcomes) indicate the ‘worth’ or ‘value (for money)’ of doing it. An output – is a product/result/deliverable of the project’s activities (cf. Project Plan) (e.g. workshops run, surveys undertaken, reports/websites/resources produced, a prototype service, a tool, a protocol, a standard, a strategy/policy) >> PROCESS EVALUATION looks at the approaches and efficacy of what is done, to whom and how that was experienced (by stakeholders usually) (relates to questions about ‘how well we worked?’ & ‘lessons learned’) An outcome – is a valued change short term (e.g. enhanced awareness or skills gained), medium term (e.g. Improved behaviour, activities, processes, and long term (e.g. strategic impact/success) Different outcomes would be recognised and valued by different external stakeholders and will therefore require different approaches and messages for dissemination. >> OUTCOMES EVALUATION looks at what resulted, gathers data concerning intended (and unexpected) outcomes and maps to key indicators identified for those outcomes across an appropriate timeline (e.g. institutional/group/individual ‘journeys’). Projects need to be able to explain the logic of the relations between their outputs and outcomes and to say how they plan to help other people/agencies transform project outputs into desired outcomes.