5 things to consider if you’re interested in using creative evaluation methods
We had feedback from amazing partner organisations doing great things that they often struggle to capture learning and showcase their impacts using traditional evaluation methods like surveys. There are lots of different reasons for this. For example they can feel tedious and extractive, leading to disengagement or lack of interest. Then there are practical issues like literacy challenges and language barriers. Sometimes traditional methods just aren’t appropriate.
So, in January 2024, Lightbulb Trust with support from Dr Jami Dixon and Dr Jen Dyer, launched a pilot project, supporting 5 organisations to test and embed creative evaluation methods, helping them get feedback and understand the difference they’re making.
Our support included:
- An in-person workshop where we introduced and used creative methods such as maps, timelines and voting with sticky dots. We spent time exploring where, why and how they might want to use these methods.
- Tailored one-to-one support to explore their specific contexts asking questions like: What do you want to learn? What data is needed? What methods might work? Who needs to be involved?
- A final online workshop to share learning and reflections between the organisations and, of course, to evaluate the support.
Here are 5 things we learnt:
- People often overestimate the resource requirements and complexity of using creative methods. They don’t think they have the time, space or expertise for it, and it can put them off trying. Yet using creative methods doesn’t have to be complicated – voting using sticky dots for example can be a quick way to get real-time feedback.
- You need to get the right people involved in designing the approach. For example, a mix of those who can make decisions within the organisation (to ensure things can happen) and those who work directly with their community (to ensure methods are relevant) is useful. It may be useful to involve anyone else who has an interest in the information generated, such as those involved in marketing or communications.
- Learning from peers can spark ideas and build confidence. If you know other organisations who are using creative methods, it may be worth reaching out to them to see what they do.
- Having a combination of group and 1-2-1 support offers a space for organisations to ask questions, reflect and apply to their own context. The flexibility of the 121 support meant that we could provide tailored guidance, building knowledge and confidence over time.
- Don’t let perfect be the enemy of good. All evaluation methods have strengths and weaknesses, and it’s the same with creative methods. Some may work well the first time you use them, others you may need to tweak. And it’s likely to take a bit of time for both your team collecting data and your community to get used to them. But don’t let this stop you trying.
Dr. Jami Dixon, Bright Impact
Dr. Jen Dyer, Nifty Sustainability
5 things to consider if you’re interested in using creative evaluation methods
We had feedback from amazing partner organisations doing great things that they often struggle to capture learning and showcase their impacts using traditional evaluation methods like surveys. There are lots of different reasons for this. For example they can feel tedious and extractive, leading to disengagement or lack of interest. Then there are practical issues like literacy challenges and language barriers. Sometimes traditional methods just aren’t appropriate.
So, in January 2024, Lightbulb Trust with support from Dr Jami Dixon and Dr Jen Dyer, launched a pilot project, supporting 5 organisations to test and embed creative evaluation methods, helping them get feedback and understand the difference they’re making.
Our support included:
- An in-person workshop where we introduced and used creative methods such as maps, timelines and voting with sticky dots. We spent time exploring where, why and how they might want to use these methods.
- Tailored one-to-one support to explore their specific contexts asking questions like: What do you want to learn? What data is needed? What methods might work? Who needs to be involved?
- A final online workshop to share learning and reflections between the organisations and, of course, to evaluate the support.
Here are 5 things we learnt:
- People often overestimate the resource requirements and complexity of using creative methods. They don’t think they have the time, space or expertise for it, and it can put them off trying. Yet using creative methods doesn’t have to be complicated – voting using sticky dots for example can be a quick way to get real-time feedback.
- You need to get the right people involved in designing the approach. For example, a mix of those who can make decisions within the organisation (to ensure things can happen) and those who work directly with their community (to ensure methods are relevant) is useful. It may be useful to involve anyone else who has an interest in the information generated, such as those involved in marketing or communications.
- Learning from peers can spark ideas and build confidence. If you know other organisations who are using creative methods, it may be worth reaching out to them to see what they do.
- Having a combination of group and 1-2-1 support offers a space for organisations to ask questions, reflect and apply to their own context. The flexibility of the 121 support meant that we could provide tailored guidance, building knowledge and confidence over time.
- Don’t let perfect be the enemy of good. All evaluation methods have strengths and weaknesses, and it’s the same with creative methods. Some may work well the first time you use them, others you may need to tweak. And it’s likely to take a bit of time for both your team collecting data and your community to get used to them. But don’t let this stop you trying.
Dr. Jami Dixon, Bright Impact
Dr. Jen Dyer, Nifty Sustainability
Latest News
On the morning of November 27th, Lightbulb Trust hosted its annual breakfast with our partners, both longstanding and newly welcomed,
Salary: £160 per day (£20 hourly rate) Hours: 2-3 days per month (flexible hours, with the possibility of increasing the number
The Integration Challenge – West London Zone and Earls Court Youth Club In summer term 2023, through the support of
The photographs on the easels are striking: a girl reaches beguilingly out to the lens, pulling you in with her
