Author: Sanah Sheikh and Shama Sarwar
Institution: The Office for Public Management (OPM)
Full reference: Sheikh, S., Sarwar, S. (2012) Evaluation of Sacred Spaces Programme (Newcastle: Creativity, Culture and Education)
The Office for Public Management (OPM) were commissioned to conduct an evaluation of Sacred Spaces, a pilot programme run by Curriculum Enhancement for the Common Era (CE4CE) and funded by Creativity, Culture and Education (CCE). The programme *aimed to deliver creative and cultural learning in supplementary school settings*.
The programme was delivered in four supplementary school settings in London and Leicester, and consisted of four different elements:
1. Training for educators from each setting.
2. Artist-led learning modules including workshops and site visits.
3. An inter-faith celebratory event.
4. The Bronze Arts Award.
Evidencing impact – young people:
The evaluation model hypothesised that three elements of the programme – creative and cultural learning in the classroom, cultural and creative visits to other sites and an inter-faith celebration event – would, through a series of change mechanisms, result in the following outcomes:
1. Increased enjoyment of supplementary school provision:
Strong evidence was observed here, and this was partly due to the different learning environment the young people had been exposed to.
2. Increased confidence and raised aspirations around craft and arts based skills:
Strong evidence again, with young people from across all sites feeling that the arts-based learning had been most responsible for helping them develop their creative skills. Involving parents and others also provided the young people with opportunities to showcase their learning.
3. Increased ability to express ideas around faith and heritage:
There is mixed evidence about the extent to which the Scared Spaces programme has resulted in the participants developing an increased ability to express ideas around faith and heritage. On the one hand, young people at some sites felt that they had learnt a lot about their own faith. On the other hand, young people at one site felt that they had not in fact learnt very much about their own faith and that their project had focused more on learning about other faiths.
4. Increased appreciation of commonalities between faith groups:
There is some evidence for this with some young people reporting that they had learnt a lot about the rituals, traditions and history of different faiths and about the similarities and differences between religions.
5. Increased demonstration of creative learning habits:
Good evidence, with many young people able to demonstrate a capacity for inquiry and critical thought.
Evidencing impact – educators:
The evaluation model hypothesised that four elements of the programme – creative and cultural learning in the classroom, cultural and creative visits to other sites, an inter-faith celebration event and training provided by CE4CE – would, through a series of change mechanisms, result in the following outcomes:
1. Understanding of and ability to articulate the benefits of on-going use of creative and cultural learning:
Strong evidence was observed, with one educator commenting that, ‘The course has really opened my eyes to understanding exactly how much the children benefit from this and how important it is to get them to do new things’.
2. Increased expertise around how to implement creative and cultural learning:
Mixed evidence: Those educators that had some experience of using creative approaches or a background in the arts were better able to identify specific ways in which they would try and implement creative and cultural learning in their supplementary school.
3. Increased willingness to support inter-faith understanding in their teaching:
Some evidence found, with some educators reporting that now they had participated in the project they felt more confident about talking about other faiths in their sessions with the young people.
Summary and conclusions
Success factors and barriers
A number of factors have contributed to the success of the programme as a whole:
A number of factors that may have limited the success of the Sacred Spaces programme.
Researchers note that many of these are a reflection of the ambitious nature of the project which sought to achieve a lot in a very short time frame
OPM adopted a theory of change approach to this evaluation which is widely used in theory based evaluations of policy programmes.
Fieldwork included structured observations of reflection sessions with educators and young people, an educators’ training session at two sites, and interviews with artists and educators.
The data collected from all three groups of stakeholders (young people, artists and educators) was subjected to thematic analysis to assess both extent and type of impact, and identify “how” impact has been created. The researchers used the theory of change model as a broad framework for analysis as it includes the hypotheses and change mechanisms that this evaluation has tested.