Transcript Slide 1
What Does it Take to Make a Difference? Demonstrating the Outcomes Joint PDI / STRADA MASTERCLASS Purpose of Today “PDI has made a significant contribution to the voluntary sector’s response to the needs of children and young people in the context of family and community, from the specific areas of drug and alcohol misuse. It is clear from the data surveyed that a much more holistic, strengths based perspective has been taken by the projects, than just what drugs and alcohol do to young people and families. In some respects this perspective has been ahead of its time. The measurement of outcomes has been to some extent pioneered by the PDI approach. PDI understands that what we measure should not be limited to that which we can measure. PDI is assisting in the development of how we show to both voluntary and statutory funders that the reporting of the ‘soft’ outcomes, the ‘distance travelled’ for many families and young people affected by drug and alcohol misuse depends upon more complex interpretation than quantitative data can provide.” Continuation Study of Practice Issues Evidenced in Projects Funded through PDI; STRADA (June 2010) PDI Journey • What is an outcome • What is an indicator Reports provide outcome detail Reports provide information on the positive changes • Measuring the indicators • Building in the numbers • Reflecting on the outcomes being achieved • Understanding what it takes to achieve outcomes Recognition of the importance to reflect and develop outcomes Achieving an Outcome Focus on helping projects understand what realistic outcomes they can support and how this can help contribute to the longer journey Offer ongoing guidance, support and training to help think through how outcomes and evaluation significantly impacts on delivery and planning Understanding the importance of the soft measures, how they contribute to the ‘hard outcomes’ The Outcomes Improved health and well-being Increased confidence and self-esteem Increased coping skills Improved parenting capacity Increased safety of children Improved educational/employment attainment Reduced or abstained substance use The Indicators Increased attendance at school Improved family relationships Parents setting routines and boundaries Parents ensuring children access dental/health appointments Parents understanding the impact of their substance use Children have improved behaviour Children are more able to make friends Families are accessing community activities Families have improved involvement with statutory services Parents are accessing employment training opportunities Increased identification of children at an earlier stage Young people are involved in less risky behaviours Progressing Change Abstaining from drug misuse Re-engaged with school Accessing community volunteering Improved self-esteem Improved family relationships Seeking support from other services Engaging with service Attending appointments on a regular basis Understanding the impact of substance use RELATIONSHIPS THROUGHOUT Knowing this works Parents setting boundaries and routines Families involved in community activities Worker Observation Outcome Action Plan Star Chart completed by child/parent Counting! number of times family regular attend community activity children are more able to make friends Feedback from school Relationship Map with Child Knowing this works Relationship is key, using the experience and skills – observation. workers Strengths based approaches isn’t just for assessment, an effective tool to be used to measure change. It isn’t a form filling exercise – outcomes are about seeing the difference. self-evaluation can work as long as it is robust and genuine understanding of how it helps. Seeing the results Reported Core PDI Outcomes (33 projects – Apr 2012) Seeing the results Reported Indicators of Self-esteem and confidence (33 projects – Apr 2012) Seeing the results PDI OUTCOME LOGIC MODEL – FUNDING TO PROJECTS Core Types of PDI Funded Approaches Indicators of Change (first steps) Parents and young people have improved their engagement with statutory services Family/Parent ing Capacity work Intensive Support for young people Parents and young people have an increased understanding of the impact of their substance use Parents are now ensuring children attend and access health and education appointments Children, young people and parents have identified and accessed positive alternative activities Children, young people and parents are identifying specific goals that will support their progress Children and young people have increased awareness of the risks associated with substance issues Indicators of Change (Project outcomes) Children are either/on or off the register, supervision or statutory measure High Level PDI Outcomes PDI Core Outcomes Improved parenting skills Parents and young people have made positive changes to their substance use Reduction or abstinence in drugs and alcohol Parents, children and young people are engaging well with other services (including diversionary activities) Parents, Children and young people have improved coping skills Children, young people and parents are reengaged or regularly attending nursery, school, or employment volunteering opportunities We have improved the life chances for children, young people and families at risk Increase in the safety of children Parents have developed structured routines and boundaries Improved confidence, self-esteem and resilience National Outcomes Increase in the health and well-being for children and young people Improved aspirations and opportunities for children and young people We live longer and healthier lives Our children have the best start in life and are ready to succeed Our young people are successful learners, confident individuals, effective contributors and responsible citizens Increase in attainments in education, employment Assumptions: This is not an extensive list of project outcomes, but encompasses the key components of reporting outcomes by projects The national outcomes are contributing factors to the Scottish Government’s strategic objectives, Healthier, Smarter, Safer and Stronger This logic model focuses on the primary outcomes relating to PDI work (see Weaver’s Triangle in Evaluation Framework and Work Plan) So what next? We don’t know it all!! We need to improve our support and learning to: Improving awareness of IT skills and database systems Continual PDI self-development Better ways of effectively and supportively involving children in evaluation Become over complacent in a world of outcomes Additional Information Lloyds TSB Foundation for Scotland: www.ltsbfoundationforscotland.org.uk Evaluation Support Scotland: www.evaluationsupportscotland.org.uk Partners in Evaluation: www.pievaluation.co.uk Outcome Star: http://outcomesstar.org.uk/