As financial pressures grow, it is increasingly important that investment is targeted at policies and programmes which will result in the greatest impact. Unfortunately, as resources become scarcer - and demands on them increase - it can become increasingly difficult to fully support evidence-informed decision-making. The IS has a dedicated evaluation team that can help.
Why evaluate?
Essentially, evaluation aims to provide answers to key questions about activities. Did it work? Should we keep doing it or do something else instead? What was the value of what we did - both socially and economically? Can we get better value for money?
Evaluation offers systematic analysis and assessment, using set criteria, of the extent to which an activity will deliver the intended results. It enables us to identify what’s working... and equally importantly what isn’t. This allows evidence-based decisions to be made about what is required to improve performance. Any evaluation undertaken needs to be proportionate and a reasonable balance struck between ‘doing’ and ‘proving’.
Evaluation support to external organisations can take place at varying levels. The extent to which assistance is provided will determine whether or not the service is freely available or there is a charge.
For an informal discussion please contact Karen Carrick, Evaluation Manager at karen.carrick@improvementservice.org.uk
How we can help
Evaluations can focus on the processes used to deliver activities or the impact created or a combination of both. The evaluation team has wide-ranging experience with all aspects of evaluation. The starting point is to look at the main purpose of the evaluation and to develop and agree a plan which will set out how this will be achieved.
Examples of the types of evaluation that the IS has delivered with local authorities include:
Social return on investment analyses
The IS, in partnership with NHS Lothian, Dundee City Council and Granton Information Centre, carried out a Social Return on Investment analysis on co-location of advice workers in medical practices.
In partnership with City of Edinburgh Council, NHS Lothian, Edinburgh HSCP, Capital City Partnership and Community Health Initiative, the IS carried out a Social Return on Investment analysis of the Maximise! Project in Edinburgh. Maximise! offers access to schools to welfare rights and employability advice alongside family support.
Process and outcomes evaluation
The IS is currently evaluating the effectiveness of the Place Based Investment Programme across all 32 Scottish local authorities. A reporting framework gathering both quantitative and qualitative data has been established and support sessions on its application are planned.
We are managing the delivery and evaluation of the Welfare Advice and Health Partnerships. This seeks to assess the effectiveness of the programme and the potential for rolling out the approach nationally (process) and the impact on key stakeholders including service users (outcomes).
General evaluation support and guidance
A wide range of assistance to design and prepare activities to influence and inform evidence-based decision-making can be offered. These include the following examples:
- Audit, review and report – e.g. gathering information from all 32 local authorities on the impact of the pandemic on local authority funded money and welfare rights advice services.
- Logic models and theory of changes - e.g. delivering tailored support and engagement sessions to develop a logic model for service planning in North Lanarkshire Council.
- Independent evaluation for partners – e.g. we are currently working with Public Health Scotland to identify the barriers and enablers to delivering a community pharmacy project.
- Acting as a critical friend and participating in reference groups
The first evaluation report of the Place Based Investment Programme (PBIP) – direct allocation to local authorities has been published today.
The report covers financial years 2021-22 and highlights how local authorities have used the investment from Scottish Government to support the Place Principle. In tackling some of our biggest challenges around climate change mitigation and improving economic outcomes through job creation, projects funded by PBIP have demonstrated positive contributions. At local authority level, PBIP has been used as a catalyst to lever in additional investment, aligning with other place-based funds.
PBIP projects have demonstrated great diversity in the type of national outcomes achieved and the level of investment. For example, they have ranged from a £3,000 landscaping project undertaken by Bannockburn Community Council to contributing almost £920,000 to Midsteeple Quarter’s £7.2 million redevelopment of Dumfries town centre. The flexible nature of using PBIP funding to address local needs and priorities has been widely welcomed by local authorities.
A further report covering financial years 2022-23 will be published early next year.