Transcript Sinéad Marron

Measuring the impact and
outcomes of local financial
inclusion initiatives
Sinéad Marron, Toynbee Hall
Outline of Talk
1.
2.
3.
4.
5.
6.
7.
Where’s this project based?
Why are we doing it?
Who are you working with?
How did we develop the Tool?
What exactly will it measure?
What do we hope it will achieve?
What will it look like when it’s finished?
Followed by time for questions and discussion...
Toynbee Hall
• Community-based organisation
• Vision:
“to eradicate all forms of poverty”
• Current Projects include:
–
–
–
–
–
–
–
–
Free Legal Advice Centre
Youth work
Older-people’s services
ESOL
Work with street-prostitutes
Volunteering & employment
Community Engagement
Time-banking
Advice & FI @ Toynbee Hall
•
•
•
•
•
Services Against Financial Exclusion (banking, 1:1 work etc.)
Debt advice (Capitalise operator)
MacMillan advice
City advice
East End Energy Fit
•
•
•
•
•
Financial Well-being measurement
Transact
Money for Life
Financially Inclusive Tower Hamlets
Local research
Measuring Impact: 6 observations...
Excellence
...build on
• Organisations with
existing
rigorous impact
practice
measurement
systems
Poor national data
...create a
• Don’tnational
know what
we’re comparing
database
results with
Lack of expertise and
resources
...prevent
• Many organisations
multiple wheel
lacking the
inventions
capacity,
resources
or expertise
Output based
...be an
funding
independent
• No reliable,
way of
independent way
measuring soft
of demonstrating
soft outcomes
outcomes
No single language
...create a
• No language
means ofto
valid
comparison
talk about
impact
Tailored snapshots
...create the
• e.g.opportunity
Debt advisors
for holistic
looking
at financial
capability
assessment
Many of these observations came from local practice at Toynbee Hall
MAP Tool
Money, Access and Participation Tool
AIM:
Develop a national financial well-being
measurement tool
ETHOS:
Stakeholder led design process (by sector, for
sector) facilitated by independent experts
Partners and Funders
• Citi Foundation have funded a
2 year development and rollout phase (June 2011 – May
2013)
• Partnered with National
Centre for Social Research
(Questionnaire Testing and
Development Hub)
• Transact
Steering Group
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
Bristol University (PFRC)
Centre for Responsible Credit
Centrepoint
Citizens Advice
Department for Work and Pensions
Financial Inclusion Centre
Friends Provident Foundation
Hyde Housing Group
Liverpool John Moores University (RUFI)
Money Advice Service
Money Advice Trust
National Audit Office
Northern Rock Foundation
Southern Housing Group
University of Birmingham (CHASM)
Pilot Organisations
•
•
•
•
•
•
•
•
•
•
•
•
•
•
2Shires Credit Union (PS1)
Fabrick Housing Group (PS1)
Bromley by Bow Centre (PS1 & PS2)
CHS Group (PS1 & PS2)
Civil Service Benevolent Fund (PS1 & PS2)
Coastline Housing (PS1 & PS2)
Hyde Housing Group (PS1 & PS2)
Knowsley Housing Trust (PS1 & PS2)
Regenda Ltd (PS1 & PS2)
The Hillcrest Group (PS1 & PS2)
Wolverhampton Homes (PS1 & PS2)
Wrexham County Council (PS1 & PS2)
Advice NI (PS2)
City Save Credit Union (PS2)
•
•
•
•
•
•
•
•
•
•
•
•
•
Community Housing Cymru (PS2)
Housing 21 (PS2)
Kirklees Citizens Advice Bureau (PS2)
London Borough of Camden (PS2)
Money Advice and Community Support (PS2)
NHS Dumfries and Galloway (PS2)
North Liverpool Citizens Advice Bureau (PS2)
Sandwell Citizens Advice Bureau (PS2)
Sandwell Homes (PS2)
South Yorkshire Credit Union (PS2)
Wales & West Housing Association (PS2)
Waltham Forest Community Credit Union
(PS2)
Women’s Employment Enterprise and
Training Unit (PS2)
Development Plan
1. Steering group
2. Analysis of current impact evaluation
3. Stakeholder consultation
4. Develop and test initial questions
5. Pilot 1 – 5 weeks
6. Analysis & re-design
7. Pilot 2 – 6 months with ongoing revisions
8. Further consultations (including weighting)
9. Analysis and redesign
10. Move to web-based platform
What is financial well-being?
Building components
Bank Account
Type of Account
Bank Account Refusal
ID/Address Verification
Debit Card
Overdraft
Direct Debits
Savings
How Saving
Not Saving
Reasons for Not Saving
Insurance
Retirement Provision
Digital Inclusion
Access to the internet
Confidence/ability using the
internet
Information on what financial
FINANCIAL PRODUCTS
AND SERVICES
products and services the
individual is currently using and
how they are using them. Useful
for identifying gaps and
addressing issues of inclusion.
9 Component Areas
•
•
•
•
•
•
•
•
•
Demographics
Financial Products and Services
Income and Expenditure
Debt
Capability
Resilience
Attitudes
Well-being
Goals
• Vulnerability (composite area)
• Barriers (flagged throughout)
Purpose and scope
• Policy
Nationally
Sector
Funder
Organisation
Client
• Lobbying
• Sharing
information
• Impact & demand
• Impact
measurement
• Needs assessment
• Trigger to find
help, make
changes and keep
on track
What’s it actually going to look like?
The Tool itself
Flexibility
• Web-based access
• Questionnaire format
• Components are flexible
• Adaptable for different projects
Completing the Tool
• On paper, online
• Needs assessment output
Repeat completions
• Revised needs assessment
• Summary of distance travelled
Impact assessment
• Aggregated individual impact
• Facility to review and manipulate data
Data sharing
• Facility to share and compare data
• Anonymised national dataset (tool and survey data)
Any Questions?
Potential discussion points...
• Opportunities of the MAP Tool?
• Risks of the MAP Tool?
• Should a client be able to take their record
from one organisation to another?
• What would sharing data allow organisations
to do?
• What are the potential uses of the national
data?
Thank you!
We always welcome comments, thoughts or
suggestions or questions.
Email me at:
[email protected]
Let me know if you want to be put on our mailing
list or join Transact for regular updates.