Username or Email Address
Lost your password?
International association for the measurement and evaluation of communication
Category: Best measurement of a not-for-profit campaign
Client/Entering Company: Isentia
Campaign title: White Ribbon 2016
Company Name: White Ribbon Day
White Ribbon Day is held annually on 23 November and aims to end violence towards women. It relies on grants, funding and donations to run its events and awareness programmes. Isentia has a longstanding partnership with White Ribbon to help it demonstrate the effectiveness of the campaign each year to ensure resources are well directed for the next campaign. In 2016 it worked with Isentia to use the AMEC Integrated Evaluation Framework to plan its campaign and its subsequent measurement.
The core brief for the White Ribbon Trust is having an overview of the return of their communications strategy and activity during the campaign period (November). As a charitable trust, the small budget available increases the need to communicate via low (or no) cost channels such as traditional and social media.
Similarly, the topic of domestic violence is complex, so requires a more detailed view and sensitive analysis than lowcost tools can provide. In 2017, the Trust needed to know:
Isentia has been working with White Ribbon since 2009, when the purpose of the project was to show potential partners and sponsors the benefit of being associated with the campaign. While the campaign steadily improved its favourability and reach over time, the 2015 campaign was marred by controversy. Following on from two separate incidents in which headline ambassador and NZ Prime Minister John Key appeared to make light of the topic of rape, public outcry over the campaign’s continued use of Key as a representative snowballed, culminating in sustained criticism of the organisation on social media, and the presentation of a public petition with over 11,000 signatures demanding Key be dropped by the campaign. The effects of this reaction were borne out in Isentia’s postcampaign analysis for 2015 – which signalled a sharp decline in average favourability across both traditional media and public social platforms year-on-year, and overall one of the poorest campaign performances in recent years.
As a result of these findings, White Ribbon and Isentia worked collaboratively on setting new objectives for the 2016 campaign. Reviewing the previous year, a key weak point was identified in the fact that whilst previous frameworks had listed outputs and outcomes for social media audiences, these channels were largely used to amplify existing traditional media coverage, or to direct traffic back to owned White Ribbon assets such as the campaign website. Use of the new integrated framework approach in planning for the 2016 campaign challenged organisers to differentiate their approach, and to consider unique content and messaging for traditional and social media, and for paid, earned, shared and owned platforms, and in turn the evaluation of these efforts.
As the campaign has a very limited budget, continuing to examine traditional earned media as a way to start conversations and convey key messages at no cost remained important. The approach for the measurement of the 2016 campaign was to continue to qualitatively analyse print, broadcast and online news, as well as public social media posts about White Ribbon over a three-month period (October–December 2016). In order to more effectively look at how content was being discussed and shared on Facebook, this year Facebook Topic Data was introduced to the dataset. The data collected from Facebook focused on the wider topic of domestic violence during October– December, to determine how influential White Ribbon and its partnerships had been at generating discussion and engagement with a complicated, and traditionally quite avoided, topic.
The campaign was analysed using two different datasets and methodologies:
Content was gathered from two proprietary databases based on the keywords “White Ribbon” across traditional media and social media.
A total of 868 traditional media items and over 1,000 social media posts were collected and individually analysed using the CARMA qualitative methodology (see supporting materials, page 1). Content was analysed for the presence of spokespeople, detractors, tone, language and messages. Message analysis was central to the campaign due to the emotive and complicated topic of domestic violence, the analysis therefore tracked broader messages regarding consent and attitudes towards violence (see supporting materials, page 2). The campaign also utilised ambassadors, usually male celebrities or family members from high-profile domestic violence cases, to convey messages across all media types. Each ambassador was tracked and their ability to convey the key campaign messages analysed.
Facebook Topic Data:
Facebook Topic Data was collected through a partnership between Isentia and Datasift. Datasift is able to collect aggregated, anonymised data across from all of Facebook, regardless of privacy settings. While individual posts cannot be analysed, users’ demographic data, link and hashtag shares, and the key topics they have engaged with are able to be collected.
For White Ribbon, the Facebook Topic Data research was set up so that all mentions of domestic violence from New Zealand Facebook users were included in the dataset. A Facebook Topic Data analysis can be used as a guide on how Facebook users discuss a topic without directly interacting with a public group or brand. We compared the tone and concerns reflected of users in the Facebook Topic data to those of traditional media coverage, to further determine if the concerns expressed in traditional media coverage represented the wider views of the public or not, and to examine how Facebook users interacted with the topic of domestic violence as a whole.
The demographic-led analysis of conversations about domestic violence on Facebook evaluated both private user feed conversations and conversations taking place on public pages, which were aggregated and anonymised to protect and maintain individual user privacy. This totalled nearly 71,000 interactions. This analysis provided insights into the age and gender demographics of New Zealanders who discussed the topic, what content they engaged with and shared, and the impact that the White Ribbon campaign had on the wider topic in this sphere.
The research conducted demonstrated three key outcomes for the White Ribbon campaign:
Ultimately the measurement of the 2015 campaign encouraged a change in focus to gain a better understanding of how social media can be better utilised to create engagement and as a way to direct an audience to the back to the primary resource (the White Ribbon website). The 2016 evaluation demonstrates that this change in frame has resulted in more conversations and interactions with White Ribbon and its messages. It also helped to flesh out the knowledge of the current audience for White Ribbon and how to consider engaging with the desired target audience in 2017.
The ongoing evaluation of the campaign and the encouragement to plan content strategy based on strong data led to an increase in favourable coverage and social media interactions.
“Isentia are always pushing me to measure more and go out of their way to find additional data that will help us understand audiences and encourage engagement. We have learned from this research the benefit of our social partnerships and the need to invest further in our digital content for 2017. This information directly informs how we allocate resources and determine our strategy on a very limited budget for next year.” Rob McCann, White Ribbon Campaign Manager
Isenta White Ribbon – supporting materials
Click on the different category headings to find out more. You can also change some of your preferences. Note that blocking some types of cookies may impact your experience on our websites and the services we are able to offer.
These cookies are strictly necessary to provide you with services available through our website and to use some of its features.
We provide you with a list of stored cookies on your computer in our domain so you can check what we stored. Due to security reasons we are not able to show or modify cookies from other domains. You can check these in your browser security settings.
We also use different external services like Google Webfonts, Google Maps, and external Video providers. Since these providers may collect personal data like your IP address we allow you to block them here. Please be aware that this might heavily reduce the functionality and appearance of our site. Changes will take effect once you reload the page.
Google Webfont Settings:
Google Map Settings:
Google reCaptcha Settings:
Vimeo and Youtube video embeds: