Uncovering critical usability issues in WorkPoint Express 365 email management.
UX researchProject outcome
Only 33% of users could successfully save attachments or save emails with attachments. The research identified the root causes and produced clear recommendations to fix the most critical usability issues.
Qualitative UX research, research planning, user interviews and usability testing
I helped uncover a critical usability issue in the new WorkPoint Express 365: the majority of users could not successfully save attachments or save emails with their attachments. In usability testing with 15 participants, only 33% completed these core tasks successfully.
Working closely with the product team, we aligned early on business goals, focused the research on the highest risk actions, and delivered clear, actionable recommendations to improve the product.
The research
The mandate
Stakeholders wanted to test the following case scenarios:
- Save an email
- Save email attachments
- Create a new document
- Move a document
- Rename a document
After several alignment meetings with stakeholders, we narrowed the focus to the three most important actions: saving attachments, journalizing emails, and sharing emails. We put heavier emphasis on saving attachments because, after reviewing the prototype, I was concerned the save attachment icons were confusing and lacked clear labels.
| Phase | Activities |
|---|---|
| Kick-off |
|
| Understand |
|
| Prepare |
|
| Recruit |
|
| Test |
|
Generating questions to understand targeted persona
I organized a brainstorm session with some team members and stakeholders to come up with questions. The main reason was to ask questions from different perspectives, because a designer and a developer will always have different types of questions for a user.
| # | Question |
|---|---|
| 01 | Have you ever used WPE before? |
| 02 | How would you describe your job? |
| 03 | What do you think makes a good product? Functionality, look and feel, or something else? |
| 04 | Do you find it easy to adapt to new technologies? |
| 05 | How many years of experience do you have regarding Microsoft 365? |
| 06 | How often are you using Microsoft 365 products? |
| 07 | What is your overall experience using WPE as an add-in within Outlook? |
Asking these questions gave us a clearer picture of our users: how they describe their work, how they use Microsoft 365 day to day, and where friction shows up in email heavy roles. That shared understanding helped us shape a primary persona we could design and test against.
Primary persona
Erick Wright
IT Manager and Business consultant at Microsoft
| Age | 35 |
|---|---|
| Location | Liverpool, England |
| Marital status | Married |
Background
Erick works as an IT manager and business consultant at Microsoft from 2020. He previously worked as a document controller at Orange for 5 years.
Erick mostly plans, follows up, documents, and maintains the status of any project he is involved in, ensuring there is a high level of transparency. Outside of work, he is a dad to two kids.
Goals
Erick’s goal is to stay open to learning and integrate that into how he views the world. He wants to progress in his career.
Technology usage
Erick has a positive attitude towards technology. He likes to keep himself updated with the latest news in the IT world, and he likes to use every system available to him.
Personal traits
Erick is more system oriented than goal oriented. He is always open-minded and ready to learn and accept new things. He likes to stay organized because his job requires a lot of organization and having everything ready and prepared. He is also a team player, open to collaborating with anyone and always ready to help.
Frustrations
- Microsoft feels confusing
- Usability issues with Microsoft Teams
- It takes time to learn and make automations work
- He needs to remember things for 20 people and remind them what they should get done
- Lack of time
Situations
When managing a big team, Erick gets a lot of emails from team members about project updates, upcoming meetings, and any news related to the project he is in charge of. Sometimes he gets too many emails and forgets to respond to some. When that happens, he does not cater to every team member’s needs, which can make them feel like they are not part of the team.
Skills
- Organization
- Leadership
- Outlook
- Excel
- Microsoft Teams
- IT management
- Business
Issues with recruiting participants
Finding external users who already used WorkPoint Express 365 proved difficult.
I suggested we recruit internal employees who matched the target profile: people who manage a high volume of emails and had not seen the new prototype. Whether they had used older versions was less important. The product would also meet first time users, so testing that first time experience was actually an advantage.
Pilot testing
The final pieces were coming together and I was slowly getting ready to conduct the studies.
But before I did, I had to make sure how the sessions would go. So I had a pilot session with two team members, who gave valuable feedback about some parts of the prototypes that could be fixed, which made the upcoming sessions easier, and some corrections on the test in general.
It was time to be a recruiter.
Usability sessions begins
I’ve engaged with 12 participants. I had participants who use WorkPoint Express every day, participants who use it once or twice during the week, and participants who used it before, but stopped using it.
The sessions lasted from 40 to 60 minutes. The meetings were recorded, so I don’t miss any useful insight.
How to actually know if someone successfully completed a task? I followed this rule:
The participant was not being blocked doing the process, which required support of the moderator to continue
What the usability study revealed
Percentage of participants who completed each task successfully
Save email about a contract
66.77%
Critical
Save attachments
41.56%
Create new document
75%
Move a document
75%
Edit a document
83.33%
Insights from research
| # | Insight |
|---|---|
| 01 | Participants had a hard time locating the save email icon |
| 02 | The icon for saving emails was confusing |
| 03 | They’ve noticed the lack of a quick access icon for saving attachments |
| 04 | The whole process of saving attachments was an overkill for some participants |
| 05 | Creating a new document option was not obvious |
| 06 | Participants tried to drag and drop when saving attachments |
The drag and drop pattern
WeAreSolar - Supplier Contract Agreement
John Smith <js@sender.com>
To: You
Thu 05/10/2023 12:26
Supplier Contract
Description
Supplier Details
Description
Hi Peter
I trust this email finds you well.
When a drag fails, Express shows a side-panel modal that points users to the action icon instead of failing silently.
The intended way of saving attachments
Sunny Meadows Solar P…
Proposals
Data · Data
Client Contracts
Data · Data
Litigation Logs
Data · Data
Corporate Governance
Data · Data
Renewable Energy Investment…
Data · Data
Artificial Intelligence in Bankin…
Data · Data
International Market Entry Stra…
Data · Data
Real Estate Portfolio Expansion…
Data · Data
Ideas and recommendations
Inspired by Nir Eyal's Hook Model, this loop reframes saving attachments as a clear habit path from need to confirmation.
A Hook Model inspired loop for turning the urge to save into a clear cue, a guided action, and a confirming reward.
01 · Internal trigger
User wants to save an attachment
02 · External trigger
Provide visual cue
- How Might We design a system that recognizes when the end-user wants to save an attachment?
- How Might We design a trigger that is clear enough for the user to take action of correctly saving attachments
03 · Action
The modal shows how to save the attachment
- How Might We design the notification modal in a way that is clearly describes how to save an attachment
04 · Action
User saves the attachments
- How Might we design a confirmation screen that provides enough information for a user to take action?
05 · Reward
Confirmation screen for the save attachment
- How might we design the confirmation modal in a way that it delivers correct information and delivers the sense of accomplishment to the user?
Cycle repeats with the next save need
When a user tries to drag and drop an attachment, guidance appears inside the WorkPoint Express side panel — not as a full-screen takeover.
Proposed drag response
WeAreSolar - Supplier Contract Agreement
John Smith <js@sender.com>
To: You
Thu 05/10/2023 12:26
Supplier Contract
Description
Supplier Details
Description
Hi Peter
I trust this email finds you well.
Instead of a silent failure, Express shows a panel modal that points users to the action icon for saving attachments.
The whole process of saving attachments was an overkill for some participants
It was reasonable that users saw the new way of saving attachments as an overkill due to the hidden option. So the solution was to add a quick action icon.
Sunny Meadows Solar P…