SigmaDev

Uncovering critical usability issues in WorkPoint Express 365 email management.

UX research

Project outcome

Only 33% of users could successfully save attachments or save emails with attachments. The research identified the root causes and produced clear recommendations to fix the most critical usability issues.

Qualitative UX research, research planning, user interviews and usability testing

I helped uncover a critical usability issue in the new WorkPoint Express 365: the majority of users could not successfully save attachments or save emails with their attachments. In usability testing with 15 participants, only 33% completed these core tasks successfully.

Working closely with the product team, we aligned early on business goals, focused the research on the highest risk actions, and delivered clear, actionable recommendations to improve the product.

The research

The mandate

Stakeholders wanted to test the following case scenarios:

  • Save an email
  • Save email attachments
  • Create a new document
  • Move a document
  • Rename a document

After several alignment meetings with stakeholders, we narrowed the focus to the three most important actions: saving attachments, journalizing emails, and sharing emails. We put heavier emphasis on saving attachments because, after reviewing the prototype, I was concerned the save attachment icons were confusing and lacked clear labels.

PhaseActivities
Kick-off
  • Create Figma files
  • Create a UX repository
Understand
  • Collect data about WPE
  • Analyze the data
  • Consult with stakeholders
Prepare
  • Pick use cases for testing
  • Prepare material for product review
  • Pilot testing
Recruit
  • Get leads
  • Reach out to them
  • Get confirmation
  • Schedule the testing session
Test
  • Conduct moderated usability studies
  • Gather and analyze data
  • Present findings to stakeholders

Generating questions to understand targeted persona

I organized a brainstorm session with some team members and stakeholders to come up with questions. The main reason was to ask questions from different perspectives, because a designer and a developer will always have different types of questions for a user.

#Question
01Have you ever used WPE before?
02How would you describe your job?
03What do you think makes a good product? Functionality, look and feel, or something else?
04Do you find it easy to adapt to new technologies?
05How many years of experience do you have regarding Microsoft 365?
06How often are you using Microsoft 365 products?
07What is your overall experience using WPE as an add-in within Outlook?

Asking these questions gave us a clearer picture of our users: how they describe their work, how they use Microsoft 365 day to day, and where friction shows up in email heavy roles. That shared understanding helped us shape a primary persona we could design and test against.

Persona portrait of Erick Wright

Primary persona

Erick Wright

IT Manager and Business consultant at Microsoft

Age35
LocationLiverpool, England
Marital statusMarried
Background

Erick works as an IT manager and business consultant at Microsoft from 2020. He previously worked as a document controller at Orange for 5 years.

Erick mostly plans, follows up, documents, and maintains the status of any project he is involved in, ensuring there is a high level of transparency. Outside of work, he is a dad to two kids.

Goals

Erick’s goal is to stay open to learning and integrate that into how he views the world. He wants to progress in his career.

Technology usage

Erick has a positive attitude towards technology. He likes to keep himself updated with the latest news in the IT world, and he likes to use every system available to him.

Personal traits

Erick is more system oriented than goal oriented. He is always open-minded and ready to learn and accept new things. He likes to stay organized because his job requires a lot of organization and having everything ready and prepared. He is also a team player, open to collaborating with anyone and always ready to help.

Frustrations
  • Microsoft feels confusing
  • Usability issues with Microsoft Teams
  • It takes time to learn and make automations work
  • He needs to remember things for 20 people and remind them what they should get done
  • Lack of time
Situations

When managing a big team, Erick gets a lot of emails from team members about project updates, upcoming meetings, and any news related to the project he is in charge of. Sometimes he gets too many emails and forgets to respond to some. When that happens, he does not cater to every team member’s needs, which can make them feel like they are not part of the team.

Skills
  • Organization
  • Leadership
  • Outlook
  • Excel
  • Microsoft Teams
  • IT management
  • Business

Issues with recruiting participants

Finding external users who already used WorkPoint Express 365 proved difficult.

I suggested we recruit internal employees who matched the target profile: people who manage a high volume of emails and had not seen the new prototype. Whether they had used older versions was less important. The product would also meet first time users, so testing that first time experience was actually an advantage.

Pilot testing

The final pieces were coming together and I was slowly getting ready to conduct the studies.

But before I did, I had to make sure how the sessions would go. So I had a pilot session with two team members, who gave valuable feedback about some parts of the prototypes that could be fixed, which made the upcoming sessions easier, and some corrections on the test in general.

It was time to be a recruiter.

Usability sessions begins

I’ve engaged with 12 participants. I had participants who use WorkPoint Express every day, participants who use it once or twice during the week, and participants who used it before, but stopped using it.

The sessions lasted from 40 to 60 minutes. The meetings were recorded, so I don’t miss any useful insight.

How to actually know if someone successfully completed a task? I followed this rule:

The participant was not being blocked doing the process, which required support of the moderator to continue

What the usability study revealed

Task success rates

Percentage of participants who completed each task successfully

  • Save email about a contract

    66.77%

  • Critical

    Save attachments

    41.56%

  • Create new document

    75%

  • Move a document

    75%

  • Edit a document

    83.33%

Insights from research

#Insight
01Participants had a hard time locating the save email icon
02The icon for saving emails was confusing
03They’ve noticed the lack of a quick access icon for saving attachments
04The whole process of saving attachments was an overkill for some participants
05Creating a new document option was not obvious
06Participants tried to drag and drop when saving attachments

The drag and drop pattern

WeAreSolar - Supplier Contract Agreement

SN

John Smith <js@sender.com>

To: You

Thu 05/10/2023 12:26

Supplier Contract

Description

Supplier Details

Description

Hi Peter

I trust this email finds you well.

When a drag fails, Express shows a side-panel modal that points users to the action icon instead of failing silently.

The intended way of saving attachments

EXPRESS
SM

Sunny Meadows Solar P…

Project Documents
Search in table
Documents
Name

Proposals

Data · Data

Client Contracts

Data · Data

Litigation Logs

Data · Data

Corporate Governance

Data · Data

Renewable Energy Investment…

Data · Data

Artificial Intelligence in Bankin…

Data · Data

International Market Entry Stra…

Data · Data

Real Estate Portfolio Expansion…

Data · Data

To save attachments, users first had to open the Documents ··· menu, then choose Save attachments. That path was easy to miss.

Ideas and recommendations

Inspired by Nir Eyal's Hook Model, this loop reframes saving attachments as a clear habit path from need to confirmation.

Proposed save attachment loop

A Hook Model inspired loop for turning the urge to save into a clear cue, a guided action, and a confirming reward.

  1. 01 · Internal trigger

    User wants to save an attachment

  2. 02 · External trigger

    Provide visual cue

    • How Might We design a system that recognizes when the end-user wants to save an attachment?
    • How Might We design a trigger that is clear enough for the user to take action of correctly saving attachments
  3. 03 · Action

    The modal shows how to save the attachment

    • How Might We design the notification modal in a way that is clearly describes how to save an attachment
  4. 04 · Action

    User saves the attachments

    • How Might we design a confirmation screen that provides enough information for a user to take action?
  5. 05 · Reward

    Confirmation screen for the save attachment

    • How might we design the confirmation modal in a way that it delivers correct information and delivers the sense of accomplishment to the user?

Cycle repeats with the next save need

Guiding the action inside Express

When a user tries to drag and drop an attachment, guidance appears inside the WorkPoint Express side panel — not as a full-screen takeover.

Proposed drag response

WeAreSolar - Supplier Contract Agreement

SN

John Smith <js@sender.com>

To: You

Thu 05/10/2023 12:26

Supplier Contract

Description

Supplier Details

Description

Hi Peter

I trust this email finds you well.

Instead of a silent failure, Express shows a panel modal that points users to the action icon for saving attachments.

The whole process of saving attachments was an overkill for some participants

It was reasonable that users saw the new way of saving attachments as an overkill due to the hidden option. So the solution was to add a quick action icon.

EXPRESS
SM

Sunny Meadows Solar P…

Project Documents
Documents