Username or Email Address
Lost your password?
International association for the measurement and evaluation of communication
Campaign title: Mental Health First Aid Training for Schools
Client/Entering Company: Department of Health and Social Care (DHSC)
The UK Government has pledged to improve mental health services and protect and support those living with mental health problems. A key part of this agenda is the early identification of symptoms in young people.
To support this, DHSC announced initial funding to provide mental health first aid training to 1,000 secondary school teachers. No spend communications aimed to ensure training places were filled, while demonstrating value for money invested in internal resource through a novel approach to ROI.
From June 2017, teachers in secondary schools around the country took part in a new training programme to help them identify and respond to early signs of mental health issues in children. In the first year of this programme, DHSC announced initial funding of £200,000 to fund the mental health first aid (MHFA) training of 1,000 secondary school teachers. Teachers will receive practical advice on how to deal with mental health issues including depression, anxiety, self-harm and eating disorders. The training programme is delivered by partner charity MHFA England and
sign up to the training was serviced through their website.
Our primary aim was to support the business objective to deliver on the commitment for a MHFA- trained teacher in every secondary school in England. This was to be achieved by promoting and raising awareness of the programme and encouraging teachers to sign up.
This project was identified as an important but small scale piece of communications on which to experiment and test an innovative approach to no spend return on investment (ROI) and demonstrate the value communications provides.
This led us to the following objectives:
OBJECTIVE 1: generate interest in MHFA training among secondary school teachers measured by the average number of visitors per day to the MHFA schools programme webpage, with a target of increasing visitors to the page five-fold in the three days after the announcement (inclusive).
OBJECTIVE 2: increase sign ups to MHFA training by school teachers by 5.5 times in the three days after the announcement (inclusive) – equating to filling 10 percent of training places.
OBJECTIVE 3: achieve a comms to service spend ratio of 0.25 for all training places filled within the three days following the announcement (inclusive) leading to a return (of training budget realised) on investment (in comms) of 300 percent.
Our key audience for these comms was clearly defined as secondary school teachers, so the strategy was focused on raising awareness of the MHFA training offer among this audience and driving them to the MHFA website to sign up to training. The multichannel approach covers three core areas:
We worked with No. 10 to arrange a Prime Minister’s (PM) visit to a school and placed an exclusive op ed from the Secretary of State for Health and Social Care on his personal experience of MHFA training. This was to build broad awareness of the initiative, but also to position the Prime Minister and Secretary of State for Health as leaders in supporting young people’s mental health.
Targeted regional press work around visits and in areas of early adoption of the MHFA training programme. All media was tracked through in-house media analysis, based on data sourced through DHSC’s media cuts service and manual analysis. Links to the MHFA England website were included in all briefings for online news to track traffic to the website.
Based on previous comms experience in mental health, we knew offline media activity was going to drive online searches and the MHFA England website appeared top of organic search results for both “mental health first aid” and “Mental health first aid course”. This provided a key link between offline activity and the online sign up.
To measure this link, Google search traffic was tracked through Google Trends as a proxy measure of conversion.
A social media tool kit was distributed to key teaching and education stakeholders to encourage more organic voices to raise awareness of the MHFA programme to teachers. Schools were also encouraged to spread awareness of the MHFA programme through the social media toolkit and regional press releases.
In house measurement was used to track the use of the social media toolkit on social media using manual analysis and Brandwatch.
Owned digital channels were used to promote the programme to DHSC, DfE, Number 10 and UK Government’s core audiences using engaging videos and gifs, with measurement tracked through native social media analytics. All content included a link to the MHFA England Schools Programme page of their website to ensure traffic was directed to this page. We worked with MHFA England to ensure data collection on web traffic was set up well in advance of the announcement, so data could be effectively collected on both web traffic and sign ups to the training.
In order to demonstrate ROI we needed to understand the internal resource invested in communications work, so all those working on the project tracked their time spent supporting this work.
The overarching evaluation approached focused on measuring the effectiveness of our comms in taking secondary school teachers from the point of viewing content on MHFA, to taking action on it and finally signing up for training. This was done using the GCS evaluation framework of outputs, outtakes and a focus on outcomes – sign-ups to MHFA training.
To calculate ROI of this no spend work we took a novel approach, calculating the ratio of comms spend to realised training budget and ROI directly. The approach to this was:
N.B. a key assumption made in this calculation was that the training places would not have been filled without our communications. Due to the spike seen in sign ups around the communications work and previous low-levels of sign ups, we believe this to be a reasonable assumption.
The execution of the communications built on DHSC’s extensive experience in handling mental health announcements. The following learnings, in particular, were key:
Communications were focused around the announcement of the funding, briefing key national and trade outlets in advance of the announcement and following up with regional media:
The campaign was effective against the key communications objectives set out:
RESULT OBJECTIVE 1: an average of a 5.7 fold increase in visitors to the webpage over the three days with a peak of a 8.5 fold increase (1010 visitors over three days vs baseline of 50 per day)
RESULT OBJECTIVE 2: a 6.3 fold increase in teachers signing up to the MHFA England training programme over the three days following the announcement, equating to 11 percent of training places filled
RESULT OBJECTIVE 3: achieved a comms to service spend ratio of 0.205 for the 110 training places filled within the first three days of the announcement, resulting in a return of realised training budget on the communications resource committed to this work of 387 percent
Calculating ROI of no spend communications work in this way is a novel approach in government communications and scarce across the private sector. ROI was calculated as follows:
This ROI work will support planning for further announcements in this space by ensuring resource is effectively allocated and that we have clear baselines from which to measure future work.
The broader evaluation followed the GCS framework:
This trial of no cost communications ROI was effective in demonstrating the value of the communications effort and tax payers’ money spent on internal resource. This has also allowed us to set benchmarks for future communications in this space and to develop this as an area of evaluation in government. The results show:
Overall, the communications were effective in supporting the Department’s business objective of providing MHFA training to secondary school teachers. Critical to this success was targeted media and stakeholder work centred on driving teachers to the MHFA England webpage to sign up, resulting in a 6.3 fold increase in teachers signing up to MHFA training and 11 percent of training places filled within three days.
Click on the different category headings to find out more. You can also change some of your preferences. Note that blocking some types of cookies may impact your experience on our websites and the services we are able to offer.
These cookies are strictly necessary to provide you with services available through our website and to use some of its features.
We provide you with a list of stored cookies on your computer in our domain so you can check what we stored. Due to security reasons we are not able to show or modify cookies from other domains. You can check these in your browser security settings.
We also use different external services like Google Webfonts, Google Maps, and external Video providers. Since these providers may collect personal data like your IP address we allow you to block them here. Please be aware that this might heavily reduce the functionality and appearance of our site. Changes will take effect once you reload the page.
Google Webfont Settings:
Google Map Settings:
Vimeo and Youtube video embeds: