AIA Thinkwell + Pledgewell

EEG sensors, voice AI inspire a commitment to health + wellness.

  • Sydney, NSW
  • Melbourne, VIC
  • Brisbane, QLD

AIA Vitality is the world’s largest health and wellness program. For their annual conference,  we created two interactive digital marketing experiences to support audiences in their commitment to healthy living. With members using an EEG sensor to calm an ocean with their mind in AIA Thinkwell, and data from AI voice recognition visualising the cumulative effect of health pledges in AIA Pledgewell, the experiences served as an experiential marketing activation point for the conference’s focus on ‘living well’.

Visualise wellbeing

The Idea

Humans are generally terrible at articulating our feelings, doubly so in a professional conference setting.  AIA needed a way to entice attendees of their Vitality Summit to engage in conversations about wellbeing in the workplace. The idea was to visualise the wellbeing of attendees in two ways, both designed to drive engagement and start conversations.

Conference attendees at AIA Vitality Summit wear EEG sensors as part of the AIA Thinkwell experiential marketing activation.

The first activation – AIA Thinkwell – would use an EEG sensor to visualise invisible brain activity data as attendees attempted to calm their mind – and an ocean visualisation – in just 90 seconds. At the end of those 90 seconds, audiences would have a greater appreciation of how focused meditation can change our mental state.

The second activation – AIA Pledgewell – used a novel and theatrical implementation of speech to text and natural language processing. Using this technology, the experiential marketing activation saw members speak a health pledge into a microphone, which was then translated into a growing data visualisation. Here, the visual categorisation of pledges sparked conversation around the similarities and differences of attendee’s pledges.

Mechanics + metaphor

Creative Development

Wellbeing can be subjective and intensely personal, so we knew that recognisable and relatable metaphors would be key to engaging AIA’s diverse audience. Visualising EEG data for AIA Thinkwell challenged us to ask how we internally visualise clarity and chaos.  Initial creative development focused on the concepts of change – day to night, winter to spring – relying on nature as the metaphor for relatable changes in states.

Screenshot shows concept imagery for the initial creative direction by digital marketing agency S1T2 for AIA Thinkwell.

However, continued prototyping returned unsatisfying results. The realism of nature and detail lost much of the ethereal nature of our mood. Artistic abstraction also proved unrelatable and confusing during early testing. Our most pleasing results were in the use of the ocean. Its perpetual motion and recognisable changes had the fluidity we needed for the metaphor and proved evocative and relatable in testing.

Screenshot shows a stormy sea real-time data visualisation from AIA Thinkwell.
Screenshot from the AIA Thinkwell real-time visualisation shows a calm ocean.

Meanwhile, AIA Pledgewell needed to remain fun and playful enough to entice people to experiment and make a vocal pledge in public. For this, we chose a minimalist and bold art direction which relied on animation and symbolism to give context and meaning to each attendee’s pledge within the larger experiential marketing visualisation.

Yellow 3D visualisation of a cloud for the think well pillar of AIA Pledgewell.

Experiments with biometric sensors

Prototyping Sensors

In the initial development of AIA Thinkwell, we needed to prototype and test a range of EEG sensors. Working with biometric sensors in an experiential marketing activation is a balancing act. On one hand, you need to set up the experience – in this case, fitting the headset – on a range of users so that data can be captured accurately. On the other, you need to ensure that this process doesn’t take too long or disrupt the user experience.

A collection of biometric EEG sensors headsets currently on the market.

Conferences are by no means laboratory environments and, similar to many VR activations, there may be a need to pump hundreds or thousands of people through the activation each day. With this in mind, we knew that while the integrity of the creative is important, it had to be balanced with the practicality of the installation.

Data from a biometric EEG sensor headset gathered by digital marketing agency S1T2 during prototyping for AIA Thinkwell.

Biometric data visualisation

EEG Data
Brand ambassador explains to an AIA Vitality Summit conference attendee how EEG sensor data relates to the real-time data visualisation of AIA Thinkwell.

We ended up working with the Muse headset for two reasons. First, the licensing was more commercially viable for a single headset. Second, and more importantly, this headset gave us a stable reading with the quickest install time. With this headset, we would be able to gather data from four electroencephalography (EEG) sensor points on the user. This meant that it was easy to see if we weren’t getting a clear reading via static interference, and the device was also simple to adjust when this was the case.

Speech to text

Voice AI

For AIA Pledgewell, we used Google Speech-to-Text to convert visitors' spoken pledges to text, capitalising on their neural network powered API. This process would transcribe spoken words captured through a microphone podium. Then, a cloud-based natural language processing pass would determine which of the four categories the visitor’s pledge fell into.

Diagram explains how artificial intelligence speech-to-text algorithm works.

Our main fear with AIA Pledgewell was pining our creativity to the performance of Google's speech to text and natural language processing suite. This fear was compounded by the fact that the experiential marketing activation would be implemented in a public environment, with the added complexity of attendees with multiple backgrounds and accents.

Final visualisation of the four pillars in the AIA Pledgewell experiential marketing activation: think well, eat well, plan well, move well.

While the usual response to this kind of problem is to create subjective or ‘hand wave’ responses to voice data, such as colour and mood, we knew early on this wouldn’t be an option. AIA Pledgewell was about individual pledges, so we’d need to accurately define each and every pledge. With some testing and iteration, we were able to achieve an acceptable performance rate, while the tone of the digital marketing activation accommodated for the occasional edge case.

Screenshot of python code that controlled the AIA Pledgewell voice AI.

An ever-changing visualisation

Sentiment Analysis

Throughout the activation, we expected hundreds of variations in visitors’ pledges. From ‘Doing fifty push ups every morning’, to ‘Meditating for five minutes after work’. Each spoken pledge needed to be visualised, categorized and contextualised in real time while visitors were standing at the microphone.

Relying on python and Google sentiment analysis APIs, we used Unreal Engine to create a dynamic global illumination visualisation for each of the four categories. In this system, each pledge would generate a new physics asset, which would in turn populate a dynamic scene created for that category. The result was four dynamic animations which would change and evolve throughout the day.

Conversations across the country

Results

Initially scoped for a single event, the AIA Thinkwell and AIA Pledgewell activations proved durable and successful enough that they have been rolled out across the country. The success of these digital marketing activations was not in the electromagnetic data collected, nor the database of individual pledges. Instead, their success came through the fact that both approaches provided a tangible experience which AIA delegates could use to have meaningful conversations with attendees.

Women wears an EEG sensor, whose data is used to control a real-time data visualisation in AIA Thinkwell.
An AIA Vitality Summit attendee wears an EEG sensor as part of the AIA Thinkwell experiential marketing activation.
Render of ocean and sunlight.

Stay in the loop

Subscribe to our newsletter to receive updates and insights about AIA Thinkwell + Pledgewell and other S1T2 projects.

Welcome to the party