User Research is the Foundation of a Great Design
User Research replaces assumptions with evidence. Without good evidence, we’re just guessing what users want or need. Too often that leads to expensive rework or to websites and mobile apps nobody uses.
A Hard Lesson
Early in my career as a UX architect, my client refused to pay for any user research. We were designing a complex customer-facing website where users select and buy home and auto insurance from different providers. I did my best to make the case for user research. Once the client understood that we at least needed user feedback, he insisted that he would be the user. You see, he assumed without any evidence that all insurance customers were just like him.
I am sorry to tell you that that project initially failed. Technical challenges were the main reason for the failure. (The client was trying to transform an internal customer-service green screen app into a self-service customer-facing website.) Those challenges forced the application developers to change the UI design. They did so without consulting the design team, and those changes were never tested with actual users. Not surprisingly, the website app failed user acceptance. Two years and millions of dollar later, the application was finally successfully deployed. But it cost the client and my employer time and money they didn’t have.
User research should have been integrated into the design and development process from the first day. That integration would have avoided all these problems.
The Key Benefits of User Research
From the above example, you can see why user research is a non-negotiable.
- Validates Problems: It ensures you are solving a real pain point for actual people. You are not just building a feature because it “sounds cool” or someone on the team likes it.
- Reduces Development Costs: Fixing a usability issue during the design phase costs roughly $1 to $10. Fixing that same issue after the product has launched can cost up to $100 or more.
- Increases Revenue & Conversions: Better user experience (UX) research leads to an optimized user journey. This reduces friction and encourages users to finish purchases. Research-driven companies see an average of 2.3x better business outcomes, and research-savvy teams experience higher conversion rates—sometimes by as much as 400%.
- Improves Customer Retention: When you understand what your users truly need, you build products that foster loyalty. This approach reduces churn and increases Customer Lifetime Value (CLV).
- Removes Bias: User research shifts the conversation from subjective opinions to data-driven insights. Instead of saying “I think this looks better,” teams rely on “The data shows users struggle here.” This helps teams make impartial decisions.
- Builds Empathy: It helps designers and stakeholders understand the user’s context, limitations, and mental models, leading to more intuitive interfaces.
- Identifies Opportunities: Observing users often reveals “workarounds” or needs they haven’t voiced, which can spark innovation.
In short, user research separates an application that people won’t use from one that works for people.
Three Examples
The “$300 Million Button” (Major Retailer)
User research helped one major e-commerce site increase purchases by 45%. They achieved this result simply by changing the checkout process. Research revealed that forcing users to “Register” before buying made them feel “forced” and frustrated. The solution? Replacing the “Register” button with a “Continue” button—which allowed them to buy without creating an account. This single change resulted in an extra $15 million in revenue in the first month alone.
Virgin America’s Revenue Boost
Virgin America conducted a research-backed website redesign that focused on improving the user journey. The result was a 14% increase in conversion rates and a 20% reduction in customer support calls. By simplifying how customers found information and booked flights, they enhanced customer satisfaction while reducing operating costs.
Bank of America’s Online Enrollment
Bank of America sought to improve its online banking enrollment. Through prototyping and testing various design solutions with actual users, they successfully identified the sticking points in their process. After implementing the research-driven changes, they doubled the percentage of customers completing the enrollment process.
Types of User Research: The Three-Dimensional Framework
Ten years ago there were 20 different user research techniques available. Today there are many more. As UX professionals, our challenge is to decide which approaches to use in our projects and when to use them.
Christian Rohrer has provided a useful framework for analyzing the different kinds of user research. He did this work for the Nielsen Norman Group (NN/g) and it is available online for anyone to study. What follows is a brief summary of the framework.
Christian proposed a three-dimensional framework to help teams choose the right research method for the right time. Instead of just picking a tool, this taxonomy asks you to look at what you should measure and why.
The Attitudinal vs. Behavioral Dimension
This dimension addresses the difference between what people SAY versus what they actually DO.
- Attitudinal: Focuses on what people say, their beliefs, and their feelings (e.g., Surveys, Focus Groups).
- Behavioral: Focuses on what people actually do when using a digital channel (e.g., Usability Testing, Eye Tracking).
The Qualitative vs. Quantitative Dimension
This dimension distinguishes WHY people do what they do versus HOW OFTEN they do it.
- Qualitative: Generates data about WHY a problem exists or how to fix it. Qualitative data are best for discovery and understanding context (e.g., Field Studies).
- Quantitative: Provides data in numbers, usually FREQUENCY or TIME SPENT. Quantitative data are best for benchmarking, prioritizing, and proving “how much” (e.g., A/B Testing).
The Context of Use
How and where is the participant interacting with the digital channel?
- Natural use: Observing users in their own environment with minimal interference.
- Scripted use: Giving users specific tasks to finish (classic usability labs).
- Not using: Researching concepts or brand perception without real users being involved.
- Hybrid: A mix, like a diary study where users record their own natural behavior.
How this Framework Helps
By mapping our research onto these three dimensions, we can avoid certain common traps. One trap is using a survey to predict behavior when surveys do not do that. Another trap is using a small usability test to prove a statistical trend. Trends typically become clear only over a large number of observations.
How User Research Techniques Fit into the Three Dimensional Framework
Below are 30 different user research techniques organized by the type of research they deliver.
What Users Do: Field Observations
These Behavior Observation techniques focus on direct observation of user actions to understand problems and mental models.
- Direct Observation: Watching users interact with a product without intervening, often used in field studies.What Users Do: Usability Tests
- Contextual Inquiry: This method is a hybrid of an interview and observation. The researcher watches the user work and asks questions to understand the context.
- Ethnographic Field Studies: Researchers observe users in their natural environment at home or work. They watch to see how users use a product in real life.
What Users Do: Analytic Research
These Analytic techniques use automated tools to collect large-scale data on how people interact with a site or app.
- Search-Log Analysis: Reviewing what users type into a site’s search bar to understand their needs and terminology.
- Clickstream Analytics: Analyzing the sequence of pages or screens users visit to find common paths or drop-off points.
- Eyetracking: Using special hardware to record exactly where a user’s eyes are looking on a screen.
What Users Do: Usability Testing
These Direct User Testing techniques are often conducted in a laboratory setting. But they can also be conducted in other ways, including remotely and online.
- Moderated Usability-Lab Testing: Participants are brought into a lab and given specific tasks while a moderator observes and asks questions.
- Unmoderated Usability Testing: An automated study where participants complete tasks on their own while software records their screen and audio.
- Usability (UX) Benchmarking: Running highly scripted usability tests with many people. These tests yield precise performance metrics. Such metrics include “Time on Task”, number of errors, and number of clicks.
- First-Click Testing: Measuring where a user clicks first when trying to carry out a specific task on a static image.
- Think-Aloud Protocol: Users verbalize their thoughts while performing a task, allowing researchers to see their internal process.
- Retrospective Think-Aloud: Users complete a task silently. Then, they watch a video of their actions. During the video, they explain what they were thinking.
- Guerrilla Usability Testing: Informal, fast testing done in public places (like coffee shops) with random people.
- Remote Moderated Usability Testing: A usability study conducted over video call where the researcher and user are in different locations.
- A/B Testing: Comparing two versions of a design. The goal is to see which one performs better based on a specific metric like clicks or conversions.
- Multivariate Testing: Like A/B testing but tests many variables at the same time to find the best combination.
What Users Say
These Qualitative techniques focus on understanding user beliefs, motivations, and perceptions.
- User Interviews: One-on-one conversations to uncover a user’s background, motivations, and feelings.
- Focus Groups: A moderated discussion with 3–12 participants about their opinions and attitudes.
- Participatory Design: Give users design elements, like paper cutouts. Ask them to build their ideal solution. This helps to learn what they value.
- Concept Testing: Sharing a rough sketch or value proposition of a new product to see what users say in response.
- Diary Studies: Users record their experiences and thoughts in a log over several days or weeks.
- Card Sorting: Asking users to group topics into categories to help design an intuitive information architecture.
- Stakeholder Interviews: Talking to internal team members to understand business goals and technical constraints.
- Desirability Studies: Show users different visual designs. Ask them to choose from a list of adjectives. This helps describe their emotional response.
Hybrid: What Users Do and Say
These Hybrid (qualitative-quantitative) techniques quantify user opinions or perceptions across a large group.
- Surveys: A digital list of questions used to gather data on user satisfaction, demographics, or attitudes.
- Tree Testing: A way to test an information architecture by asking users to find an item in a text-only hierarchy.
- Five-Second Test: Showing a page for 5 seconds and asking what the user remembers to test “above the fold” clarity.
- Semantic Differential Scales: Asking users to rate a product on a scale between two opposing words (e.g., “Boring” vs. “Exciting”).
- Preference Testing: Asking a large group of users which of two or more visual designs they prefer.
- True-Intent Studies: This involves intercepting live visitors on a site. We ask them what they came to do and if they were successful.
The Right User Research at the Right Time
A key insight is that the right user research approach changes as you progress through the application life-cycle. In the beginning, the appropriate research techniques are generative (finding out what to design and build). Later, they turn evaluative (finding out if what you built works as expected).
Discovery
The goal is to understand the “problem space,” user needs, and market gaps before any designing begins.
- User Interviews: One-on-one deep dives to uncover motivations, pain points, and current workflows.
- Field Studies / Ethnography: Watch users in their natural environment. See how they solve problems without your new or redesigned application.
- Stakeholder Interviews: Align with internal business leaders to define technical constraints and business goals.
- Diary Studies: Having users record their interactions over time to capture long-term habits and context.
Design
Once a direction is set, these techniques help structure the solution and confirm preliminary concepts.
- Card Sorting: Ask users to group information into categories to inform your app’s navigation and information architecture.
- Tree Testing: Show users a text-only representation of content organization. Ask users where in the organizational structure they expect to find specific content or features. This approach lets you assess how intuitive your menu and navigation system is without visual hints or distractions.
- Concept Testing: Show users rough sketches or storyboards to users to see if the core value proposition resonates.
- Early Usability Testing: Work with users as they interact with preliminary wireframes. Then as the design evolves, have users interact with clickable low fidelity prototypes.
- Usability Testing (Moderated): Watch users interact with a working high-fidelity prototype. The goal is to confirm the design before coding begins.
- Think-Aloud Protocols: During a usability test, ask users to “think out loud” as they interact with a prototype. Doing so lets the researcher see how well users understand the design. And it lets the researcher ask follow-up questions when users are confused.
Build
During development, research focuses on refining the interface and catching usability issues early.
- Feature-Based Usability Testing: When the application is being developed in feature-based sprints, do usability testing on each feature. This approach also lets you detect issues that emerge only after a new feature is added to the existing features. Test each feature and its side effects before it is delivered and deployed.
- Accessibility Testing: Use tools like screen readers to see if the application is usable for people with disabilities.
- First Click Testing: Measure where users click first. This test helps assess whether the user interface is intuitive.
Deployment & Post-Deployment
After launch, the focus shifts to measuring performance, satisfaction, and long-term adoption.
- A/B Testing: Comparing two live versions of a feature to see which one performs better based on real conversion data.
- Digital Analytics: Monitoring click-paths, drop-off points, and active usage through tools like Google Analytics or ContentSquare (formerly HotJar).
- Surveys (NPS/CSAT): Collecting quantitative feedback on user satisfaction and likelihood to recommend the your business.
Why This Matters for Your Bottom Line
User Research is critical to building a successful digital channel for your business. It’s the only way to know you are building what your customers want and need. Without it, you wind up just guessing, getting it wrong, and then having to try again. User Research makes you money by helping you to avoid the digital trial-and-error loop, and then delivering user experiences that win new customers and keep existing ones./.
Ready to Get Started?
In a 20-minute consultation, we will review how user research can help you build a more profitable digital presence.
