UI/UX Design Basics for MarketersTesting with users and iterating · Lesson 19 of 21
Running lightweight usability tests
Video lecture
Running lightweight usability tests
The narrated lecture is in production
Every chapter is scripted and ready. Browse the chapters and read the full transcript now — the video will appear here when it’s published.
Chapters
Transcript of the narration, chapter by chapter.
0:00 Running lightweight usability tests
Here's the fastest way to humble a marketing team. Sit them down and let them watch one real customer try to use their website. Just one. Within five minutes, someone will whisper, but it's right there! And someone else will realize the customer doesn't know what our key product term even means. Usability testing is watching real people try to complete real tasks. It's the most reliable way to learn why people struggle, and it doesn't need a lab or a big budget. In this lecture, you'll learn how many people to test, how to plan and write tasks, how to facilitate, recruit ethically, and turn observations into fixes.
0:47 Why it matters
Why does this matter? Because analytics can tell you that sixty percent of mobile visitors leave at step two. It can't tell you why. Usability testing tells you why. Maybe they can't find the delivery date. Maybe they think the price is per month when it's per year. Here's an analogy. Analytics is a smoke alarm. It tells you there's a problem somewhere in the building. Usability testing is walking into the room and seeing what's actually burning. You need both, but only one tells you what to fix.
1:26 How many participants?
How many people? A widely cited guideline from usability research is that testing with around five users per round reveals many of the most common problems, especially for one fairly similar audience. The key idea is small, repeated rounds, not one big study. Test five, fix what you find, then test again. If you have distinct audiences, like customers in different countries or languages, test a few people from each group. Five people is enough to find problems. It isn't enough to measure percentages precisely, so don't report it as a statistic.
2:06 Plan the test
Planning. Write a one-page plan. The goal: what do we want to learn, like can mobile users book a consultation. The prototype or page, and the device. Participants: who, how many, how you'll recruit them, and the incentive. Three to five realistic tasks. The metrics: task success, time, errors and a confidence or ease rating. The method, moderated or unmoderated, remote or in person. Consent and data handling. And the schedule. Sessions of twenty to forty-five minutes are typical. Then write a screener, a short set of questions to confirm people match your audience without revealing the right answers.
2:49 Writing good tasks
Writing good tasks is where most tests succeed or fail. Tasks should be realistic scenarios that don't give away the answer. Poor: click the pricing link in the menu. Better: you're considering this service for your salon, find out how much it would cost for three staff members. Notice the better version doesn't use the word pricing. If your task uses the exact words on the interface, you're testing whether people can match words, not whether they understand your site. Give people a reason, a context, and a goal, and then let them find their own way.
3:31 Facilitating well
Facilitating well. Ask participants to think aloud, saying what they're thinking as they go. Stay neutral. Don't help, and don't defend the design. If someone asks should I tap here, answer, what would you do if I weren't here? Probe gently: what did you expect to happen? What made you choose that? Focus on behavior over opinions. What people do matters more than I like it. And take structured notes, ideally with a second person as note-taker, so you can focus on the participant. The hardest part for most marketers is silence. Let people struggle for a moment. That's where the learning is.
4:16 Recruit ethically
Recruiting, ethically. Good sources: existing customers, email subscribers and social followers, screened to match your audience. Paid recruitment services for specific profiles. Friends and colleagues only for very early checks, because they aren't your audience, and they'll be polite. Offer a fair incentive, like a voucher or payment, and respect people's time. Get informed consent for recording, and explain how you'll store and use the data, in line with privacy laws. And include people with disabilities and a range of devices when you can. Moderated or unmoderated? Beginners should start with moderated remote tests over video calls.
4:58 Worked example 1: salon software
Worked example one, simple. A salon booking software company tests its pricing page with five salon owners over video calls. Task one: find out what it would cost for three staff members. Four of five can't work it out. One says, is this per salon or per user? Two people scroll past the book a demo button because a sticky banner covers it on their phones. Two ask what happens if it doesn't work for them. The fixes: a worked price example for three staff, the button moved higher with better contrast, and a refund FAQ right beside pricing.
5:41 Worked example 2: tutoring service (illustrative)
Worked example two, a business scenario with illustrative details. An online tutoring service in Karachi tests its sign-up flow with five parents on their own phones, over video calls. Three findings. Parents don't understand the difference between two plans. Most miss the free trial class option entirely. And for one parent, the WhatsApp contact button opens a broken link inside a social app's browser. The team fixes all three within a week: plan names based on outcomes with a one-line comparison, the free trial as the primary button, and a working WhatsApp link. A second round with four parents confirms the improvements.
6:25 Watch me do it: remote moderated test
Watch me do it. I send a four-question screener to newsletter subscribers and book five thirty-minute calls. In each session, I read the intro script: we're testing the website, not you, please think aloud, may I record? I wait for a clear yes. I give task one as a scenario. After each task, I ask how easy was that, from one to five. My colleague fills in the note sheet: participant, task, time, observation, verbatim quote, success and a severity guess. Within an hour of the last session, we list the top three issues. Then I paste the anonymized notes into an approved AI assistant for a first summary, and verify every quote against the recordings.
7:15 Common mistakes and measures
Common mistakes. Testing with colleagues instead of target users. Leading tasks that give away the answer. Helping participants the moment they hesitate. Reporting five-person results as percentages. And the worst: collecting findings and never acting on them. How do you measure success? Compare rounds. The same tasks after fixes should show higher success, fewer high-severity issues and better ease ratings. Then look for the matching live signals: higher completion on the relevant step, and fewer support questions on the same topic.
7:50 Recap and try this now
Let's recap. Watch real people try realistic tasks. Run small rounds of about five participants, fix what you find, and test again. Write scenario tasks that don't give away the answer. Stay neutral, use think aloud, and focus on behavior. Recruit representative people ethically, with consent and fair incentives. And turn every observation into a prioritized fix. Try this now. Write a test plan with three scenario tasks for one of your pages. Recruit three to five people from your audience, run the sessions remotely, and complete a findings table with severity and fixes.
Watch people use it
Usability testing means observing real people as they try to complete realistic tasks with your page, prototype or product. It is the single most reliable way to find out why people struggle — and it doesn't have to be expensive.
How many participants?
A widely cited guideline from usability research is that testing with around five users per round reveals many of the most common problems in a design, especially for a single, fairly homogeneous audience. Rather than one big study, run small rounds, fix issues, and test again. For distinct audiences (for example, customers in different countries or languages), test a few people from each.
Planning a test
Usability test plan
Goal: What do we want to learn? ("Can mobile users book a consultation?")
Prototype/page: Link, device, version
Participants: Who (match target audience), how many, recruitment, incentive
Tasks: 3–5 realistic scenarios
Metrics: Task success, time, errors, confidence rating
Method: Moderated/unmoderated, remote/in person
Consent: Recording consent, data handling
Schedule: Dates, durations (often 20–45 min)Writing good tasks
Tasks should be realistic scenarios that don't give away the answer:
- Poor: "Click the 'Pricing' link in the menu."
- Better: "You're considering this service for your salon. Find out how much it would cost for three staff members."
Avoid using the exact words on the interface in the task; otherwise you test word-matching, not understanding.
Moderated vs unmoderated
| Type | How | Strengths | Limitations |
|---|---|---|---|
| Moderated (live) | Facilitator observes, asks follow-ups (in person or video call) | Rich insight, can probe "why" | Time-intensive |
| Unmoderated | Participants complete tasks alone, recorded by a tool | Fast, scalable | No follow-up questions; quality varies |
Both can be remote. For beginners, moderated remote tests over video calls with screen sharing are a practical start.
Facilitating well
- Think-aloud: ask participants to say what they're thinking as they go.
- Stay neutral: don't help, don't defend the design. If asked "Should I click here?", respond "What would you do if I weren't here?"
- Probe gently: "What did you expect to happen?" "What made you choose that?"
- Observe behavior over opinions: what people do matters more than "I like it".
- Take structured notes — or have a second person take notes.
Recruiting participants
- Existing customers, email subscribers, social followers (screen to match your target audience).
- Friends and colleagues only for very early checks — they aren't your audience and may be polite.
- Paid recruitment services for specific profiles.
- Offer a fair incentive (voucher, payment, free product), and respect participants' time.
- Obtain informed consent for recording and explain how data will be stored and used, in line with privacy laws.
- Include people with disabilities and a range of devices when possible.
Analyzing results
- List every observed issue per participant.
- Group similar issues.
- Rate severity (how many participants, how badly blocked).
- Note positive findings too (what worked well).
- Recommend fixes; prioritize by severity and effort.
Findings table
Issue Participants Severity Evidence (quote/behavior) Fix
Couldn't find price per staff 4/5 High "Is this per salon or per user?" Show per-staff pricing example
Missed 'Book' button on mobile 3/5 High Scrolled past sticky banner Move CTA higher; contrast
Unclear refund policy 2/5 Medium "What if it doesn't work?" Add refund FAQ near pricingWorked example: a Karachi-based online tutoring service
Five parents tested the sign-up flow on their phones via video call. Findings: parents didn't understand the difference between two plans, missed the free trial class option, and the WhatsApp contact button opened a broken link in one in-app browser. Fixes were made within a week, and a second round with four parents confirmed improvements.
Common mistakes
- Testing with colleagues instead of target users.
- Leading tasks that give away the answer.
- Helping participants during the test.
- Collecting findings but not acting on them.
Unmoderated testing tips
If you use an unmoderated testing tool, write tasks even more carefully because nobody can clarify them. Add a short warm-up task, ask participants to rate how easy each task was, and include one open question at the end. Watch every recording rather than relying only on completion rates, and remove sessions where participants clearly did not attempt the tasks seriously.
Hands-on: run a remote moderated test this week
Kit: a video-call tool with screen sharing and recording, your prototype or staging link, a consent script, a note-taking sheet and a small incentive.
1. Screener (send before booking). Three to five questions that confirm the person matches your audience without revealing the "right" answer:
1. Which best describes you? (Salon owner / Salon employee / Freelance stylist / Other)
2. How do you currently manage bookings? (Paper / WhatsApp / Booking app / Other)
3. Which device do you mostly use for work tasks? (Phone / Laptop / Tablet)
4. Are you available for a 30-minute video call this week? (Yes / No)2. Session script (about 30 minutes).
Intro (3 min): "We're testing the website, not you. There are no wrong answers.
Please think aloud. May I record the screen and audio? (wait for a clear yes)"
Warm-up (2 min): "Tell me how you handle bookings today."
Tasks (18 min): T1 "You're considering this for your salon. Find out what it would cost for three staff."
T2 "You'd like to try it before paying. See how you'd do that."
T3 "You have a question about WhatsApp reminders. Find the answer."
After each task: "How easy or difficult was that, from 1 (very difficult) to 5 (very easy)?"
Wrap-up (5 min): "What, if anything, would stop you signing up?" "Anything confusing?"
Close (2 min): Thank them; explain the incentive; stop recording.3. Note-taking sheet (one row per observation, filled live by a second person if possible):
Participant | Task | Time | Observation (what they did/said) | Quote (verbatim) | Success (Y/P/N) | Severity guess4. Debrief within the hour. List the top three issues while memories are fresh, then complete the findings table from this lesson after all sessions.
Using AI to speed up analysis
Transcription tools (many video-call platforms now include them) and AI assistants can draft summaries. Paste only anonymized notes or transcripts into approved tools and ask for verbatim quotes and counts; then verify each against the recording before you share. Never let a summary replace watching at least the key moments yourself.
Metrics worth recording
- Task success rate: successes ÷ attempts per task (partial success counted separately).
- Time on task: useful for comparing rounds on the same task, not across different tasks.
- Ease rating: the 1–5 question after each task (a simplified form of the widely used Single Ease Question).
- Issue count by severity: total and per round.
How to measure success
Compare rounds: the same tasks after fixes should show higher success, fewer high-severity issues and better ease ratings. Then look for the matching live signals: higher completion on the relevant funnel step and fewer support questions on the same topic.
Summary
Run small, frequent rounds with around five representative participants, write realistic scenario tasks, stay neutral while facilitating, recruit and record ethically, and turn observations into prioritized fixes.
Key takeaways
- Small rounds with around five representative users reveal many common problems.
- Write realistic scenario tasks that don't give away the answer.
- Stay neutral, use think-aloud and focus on behavior over opinions.
- Recruit representative participants ethically, with consent and fair incentives.
Check your understanding
Quick questions to lock in the lesson. They don’t count towards your certificate.
Put it into practice
Write a test plan with three scenario tasks for one of your pages, recruit three to five target users, run the sessions remotely, and complete a findings table.
Enrol for free to save your progress
Reading is always free. Enrol to keep your place, take the final assessment and earn a verifiable certificate.