Overview Research objectives Milestone 1 - Understanding users Milestone 2 - Evaluating the current state experience Milestone 3 - Comparing the current and future state experience Reflection
CIBC - Life Insurance

Using generative and evaluative research to inform the design direction of CIBC's reimagined online Life Insurance quote experience.

role: lead researcher in a team of 2 designers, 1 strategist, and 1 project manager

methods: Surveys, A/B Testing, Unmoderated usability testing

software: Feedback Loop, UserTesting, Figma

timeline: February - June 2022

To comply with my non-disclosure agreement, I have omitted and obfuscated confidential information in this case study. All information in this case study is my own and does not necessarily reflect the views of CIBC.

Project Overview

Partnering with CIBC's life insurance business, my focus was on optimizing the end-to-end life insurance policy buying experience, and I spearheaded the effort by developing the research plan, executing research methodologies, and synthesizing findings into a report tailored to executive audiences. Collaborating with cross-functional stakeholders, from product to legal, I co-created innovative solutions using insights from market research, user research, and design thinking workshops. My efforts culminated in pitching findings to high-level stakeholders, ranging from Vice Presidents to C-suite, that resulted in driving strategic business decisions.

Overall, two surveys, and 2 rounds of usability tests were conducted over a 4 month period.

The Challenge: Reimagine the digital end-to-end Life Insurance quote and purchasing experience.

Research Objectives

The User Experience Research plan for this engagement revolved around 3 key milestones:

Milestone 1 (Generative):

Getting a general view of Canadians’ perspective about life insurance.

Milestone 2 (Evaluative):

Evaluate the current state CIBC experience of searching for life insurance, navigating the website, and obtaining a quote.

Milestone 3 (Evaluative):

Compare the proposed experience with the current experience based on usability, support, and likelihood to apply for a quote.

Milestone 1: Understanding users

When the Life Insurance team came to us, they didn’t have any artifacts for us to reference in regards to the target segment for the business. As such, a key outcome of this engagement was to create foundational artifacts for the Life Insurance business, such as personas and journey maps.

Why a survey

Reach a large audience quickly to inform persona creation, focusing on communication preferences, experience expectations, and overall perceptions of life insurance.

What we learned

Overall, we learned that Canadians feel they are somewhat confident with their life insurance knowledge. They think the most important information to know is the specific benefits they can realize if they were to get a life insurance policy.

Most preferred format for education about life insurance is through online articles or videos where they can learn at their own pace.

294

total survey participants

Canadians between the age of 18-60

recruitment criteria

If I were to do this research over again, I would incorporate a segmentation question to filter survey responses depending on if they currently do or do not have a life insurance policy.

Guiding principles moving forward

Based on the findings from the survey, I identified guiding principles for the team to ground ourselves in as we worked towards designing the ideal future state. Additionally, I used these key learnings to begin informing the usability testing plan to validate the accuracy of these findings.

Timer icon

Timely communication that clearly outlines next steps and expectations for prospective life insurance buyers.

Resources icon

Empower clients with educational resources so that they can make informed decisions.

Benefits icon

Emphasize the specific and personalized benefits CIBC insurance purchasers will receive.

Milestone 2: Evaluating current state

In this milestone, our goal was to evaluate the current state experience of getting a quote and applying for a policy. To accomplish this, I decided unmoderated usability testing would be a suitable methodology because it would allow us to unobtrusively observe users in a realistic setting, and because it was a live site, I didn't have to worry about participants being stuck with the potential technical difficulties of using a prototype.

Our goal was to observe how people:

Search for cibc life insurance.

Arrive at the life insurance page.

Complete the quote obtaining experience.

10

usability participants

Canadians between the age of 18-60, who do not currently have life insurance

recruitment criteria

The reason I recruited participants who do not currenlty have a life insurance policy is because I wanted to get to know the experience of someone who has presumably never explored life insurance before. Their perspective would provide the insight of a net new customer, instead of someone who may be considered an expert user and is already familiar with life insurance websites and how to navigate them.

Usability testing plan

Participants were given a scenario to imagine themselves in and set the context for the session.

The main prompt was:

"“Imagine your goal is to get a life insurance quote from CIBC. You want to know which life insurance policy will best suit your needs, why that policy is suitable for you, and how much it will cost (per month and in total)."

Image of screenshot from usability testing session.
Participants were also prompted to use the think-aloud method so that when the team watched the recordings back, we would get glimpses into the participant’s thought process, feelings, and reactions to the experience.

After they had received a life insurance quote, they were then asked 6 follow up questions to learn more about their experience, evaluate if they were able to find key information, and learn about their expectations for next steps. Lastly, participants were then asked to fill out a SUS survey to quantitatively measure the perceived usability of the current state experience. Using this score I would then be able to compare it with the SUS score of the future state experience later.

What we learned

Overall, participants said:
  • The current experience was simple, easy, and intuitive.
  • 5 participants correctly guessed that after they got the quote they would then be prompted to apply for the policy. The respondents who didn’t guess correctly thought they might receive an email receipt of the quote, or would be contacted by an agent to proceed with the application.
And participants actions showed us:
  • All 10 participants were able to find the support contact information if they ran into any issues or needed help getting a quote.
  • 7 participants did not notice the coverage calculator tool, but all 10 said they think such a tool would be useful.

Recommendations moving forward for design direction

Based on these findings, my top 3 recommendations for the design team focused on:

Scroll icon

Setting user expectations for what happens after obtaining a quote using clear, easy to understand language.

Shoes icon

Ensuring error pages and messages provide users with clear steps on how to resolve the error.

Differentiate icon

Improving discoverability and clear design differentiation between the quote obtaining and coverage calculator experience.

Milestone 3: Comparing the current and future state experience

In this final milestone, the goal was to compare how users felt about the current versus proposed future state experience of getting a life insurance quote. The approach I took was two-fold:

Method 1: A/B survey testing

Reach a large audience quickly and quantitatively measure which qualities of the two designs had the most impact on respondent preference. The key qualities presented to respondents were divided into visual appeal or clarity of content.

Method 2: A/B unmoderated usability testing

Uncover qualitative findings comparing the usability of the current and future state experiences. To facilitate the A/B test, I turned the current live site into a Figma prototype to control the medium bias they might experience by going from a live site to a prototype (or vice versa). Additionally, usability testing participants were shown the prototypes in an alternating pattern (AB or BA) to address potential order bias. This helps to ensure that any differences in the results are due to the variables being tested and not due to the order in which they were presented.

114

survey respondents

12

usability participants

Canadians between the age of 18-60, who do not currently have life insurance

recruitment criteria

The reason I recruited participants who do not currenlty have a life insurance policy is because I wanted to get to know the experience of someone who has presumably never explored life insurance before. Their perspective would provide the insight of a net new customer, instead of someone who may be considered an expert user and is already familiar with life insurance websites and how to navigate them.

User Experience Considerations - What did users like?

The results from both methods indicated that the majority of usability testing participants and survey respondents preferred the proposed experience. When we uncovered why, three key themes emerged:

Scroll icon
Optionality

People liked the future state experience because they were presented with recommended life insurance policies. They liked that they were given just enough options to not feel overwhelmed, but also felt that they were not forced or pressured to sign up for a policy at that very moment.

Scroll icon
Visual appeal

Both groups also liked that the information in the future state experience was displayed in a way that was visually pleasing. The categorization of the information, clear headers that separated chunks of content, and use of diverse multimedia (videos, icons, buttons, tabs) made the content easier to digest.

Scroll icon
Quicker experience

Usability testing participants also said that the future state experience felt easier because it required less clicks to get to their end goal of receiving a quote. This is supported by the fact that the design team was able to reduce the experience from 6 steps down to 3.

The previous version of the Life Insurance landing page.
The current (now previous) version of the Life Insurance landing page.
The team's proposed version of the Life Insurance landing page.
The team's proposed version of the Life Insurance landing page
The current (live) version of the Life Insurance landing page.
The current (live) version of the Life Insurance landing page

Metrics to measure the success of our proposal

Although I am unable to present quantitative metrics at this time, the project's success can be contributed to the fact that other life insurance products, such as Accident Protection Plan and Guaranteed Acceptance Life Insurance, have also been updated following our recommendation. In order to evaluate the success of our project, some key metrics that I would look for include: change in conversion rate, time spent on specific pages of the site, and heat maps for where users are clicking the most.

Strengthening my research planning and rationale

Reflecting on this project emphasizes the importance of having a clearly defined research plan upfront and signed off by stakeholders early in the process. During the executive showcase, an executive audience member had asked questions about how and why we recruited participants for the usability testing, and questioning the statistical significance of our findings. Since I had received alignment from our project sponsors early on, I was able to confidently explain the rationale, and our Life Insurance partners also chimed in with their support.