UI/UX Design Basics for MarketersTesting with users and iterating · Lesson 19 of 21

Running lightweight usability tests

Article · 11 min · 8 min lecture

Video lecture

Running lightweight usability tests

12 chapters · about 8 min · full transcript

Coming soon

Chapter 1 of 12

Running lightweight usability tests

  • Watch one real customer
  • 'But it's right there!'
  • Plan, facilitate, recruit
  • Turn observations into fixes

The narrated lecture is in production

Every chapter is scripted and ready. Browse the chapters and read the full transcript now — the video will appear here when it’s published.

Chapters

Watch people use it

Usability testing means observing real people as they try to complete realistic tasks with your page, prototype or product. It is the single most reliable way to find out why people struggle — and it doesn't have to be expensive.

How many participants?

A widely cited guideline from usability research is that testing with around five users per round reveals many of the most common problems in a design, especially for a single, fairly homogeneous audience. Rather than one big study, run small rounds, fix issues, and test again. For distinct audiences (for example, customers in different countries or languages), test a few people from each.

Planning a test

Usability test plan
Goal:          What do we want to learn? ("Can mobile users book a consultation?")
Prototype/page: Link, device, version
Participants:  Who (match target audience), how many, recruitment, incentive
Tasks:         3–5 realistic scenarios
Metrics:       Task success, time, errors, confidence rating
Method:        Moderated/unmoderated, remote/in person
Consent:       Recording consent, data handling
Schedule:      Dates, durations (often 20–45 min)

Writing good tasks

Tasks should be realistic scenarios that don't give away the answer:

  • Poor: "Click the 'Pricing' link in the menu."
  • Better: "You're considering this service for your salon. Find out how much it would cost for three staff members."

Avoid using the exact words on the interface in the task; otherwise you test word-matching, not understanding.

Moderated vs unmoderated

TypeHowStrengthsLimitations
Moderated (live)Facilitator observes, asks follow-ups (in person or video call)Rich insight, can probe "why"Time-intensive
UnmoderatedParticipants complete tasks alone, recorded by a toolFast, scalableNo follow-up questions; quality varies

Both can be remote. For beginners, moderated remote tests over video calls with screen sharing are a practical start.

Facilitating well

  • Think-aloud: ask participants to say what they're thinking as they go.
  • Stay neutral: don't help, don't defend the design. If asked "Should I click here?", respond "What would you do if I weren't here?"
  • Probe gently: "What did you expect to happen?" "What made you choose that?"
  • Observe behavior over opinions: what people do matters more than "I like it".
  • Take structured notes — or have a second person take notes.

Recruiting participants

  • Existing customers, email subscribers, social followers (screen to match your target audience).
  • Friends and colleagues only for very early checks — they aren't your audience and may be polite.
  • Paid recruitment services for specific profiles.
  • Offer a fair incentive (voucher, payment, free product), and respect participants' time.
  • Obtain informed consent for recording and explain how data will be stored and used, in line with privacy laws.
  • Include people with disabilities and a range of devices when possible.

Analyzing results

  1. List every observed issue per participant.
  2. Group similar issues.
  3. Rate severity (how many participants, how badly blocked).
  4. Note positive findings too (what worked well).
  5. Recommend fixes; prioritize by severity and effort.
Findings table
Issue                         Participants  Severity  Evidence (quote/behavior)       Fix
Couldn't find price per staff  4/5           High      "Is this per salon or per user?" Show per-staff pricing example
Missed 'Book' button on mobile 3/5           High      Scrolled past sticky banner      Move CTA higher; contrast
Unclear refund policy          2/5           Medium    "What if it doesn't work?"       Add refund FAQ near pricing

Worked example: a Karachi-based online tutoring service

Five parents tested the sign-up flow on their phones via video call. Findings: parents didn't understand the difference between two plans, missed the free trial class option, and the WhatsApp contact button opened a broken link in one in-app browser. Fixes were made within a week, and a second round with four parents confirmed improvements.

Common mistakes

  • Testing with colleagues instead of target users.
  • Leading tasks that give away the answer.
  • Helping participants during the test.
  • Collecting findings but not acting on them.

Unmoderated testing tips

If you use an unmoderated testing tool, write tasks even more carefully because nobody can clarify them. Add a short warm-up task, ask participants to rate how easy each task was, and include one open question at the end. Watch every recording rather than relying only on completion rates, and remove sessions where participants clearly did not attempt the tasks seriously.

Hands-on: run a remote moderated test this week

Kit: a video-call tool with screen sharing and recording, your prototype or staging link, a consent script, a note-taking sheet and a small incentive.

1. Screener (send before booking). Three to five questions that confirm the person matches your audience without revealing the "right" answer:

1. Which best describes you? (Salon owner / Salon employee / Freelance stylist / Other)
2. How do you currently manage bookings? (Paper / WhatsApp / Booking app / Other)
3. Which device do you mostly use for work tasks? (Phone / Laptop / Tablet)
4. Are you available for a 30-minute video call this week? (Yes / No)

2. Session script (about 30 minutes).

Intro (3 min):   "We're testing the website, not you. There are no wrong answers.
                  Please think aloud. May I record the screen and audio? (wait for a clear yes)"
Warm-up (2 min): "Tell me how you handle bookings today."
Tasks (18 min):  T1 "You're considering this for your salon. Find out what it would cost for three staff."
                 T2 "You'd like to try it before paying. See how you'd do that."
                 T3 "You have a question about WhatsApp reminders. Find the answer."
After each task: "How easy or difficult was that, from 1 (very difficult) to 5 (very easy)?"
Wrap-up (5 min): "What, if anything, would stop you signing up?" "Anything confusing?"
Close (2 min):   Thank them; explain the incentive; stop recording.

3. Note-taking sheet (one row per observation, filled live by a second person if possible):

Participant | Task | Time | Observation (what they did/said) | Quote (verbatim) | Success (Y/P/N) | Severity guess

4. Debrief within the hour. List the top three issues while memories are fresh, then complete the findings table from this lesson after all sessions.

Using AI to speed up analysis

Transcription tools (many video-call platforms now include them) and AI assistants can draft summaries. Paste only anonymized notes or transcripts into approved tools and ask for verbatim quotes and counts; then verify each against the recording before you share. Never let a summary replace watching at least the key moments yourself.

Metrics worth recording

  • Task success rate: successes ÷ attempts per task (partial success counted separately).
  • Time on task: useful for comparing rounds on the same task, not across different tasks.
  • Ease rating: the 1–5 question after each task (a simplified form of the widely used Single Ease Question).
  • Issue count by severity: total and per round.

How to measure success

Compare rounds: the same tasks after fixes should show higher success, fewer high-severity issues and better ease ratings. Then look for the matching live signals: higher completion on the relevant funnel step and fewer support questions on the same topic.

Summary

Run small, frequent rounds with around five representative participants, write realistic scenario tasks, stay neutral while facilitating, recruit and record ethically, and turn observations into prioritized fixes.

Key takeaways

  • Small rounds with around five representative users reveal many common problems.
  • Write realistic scenario tasks that don't give away the answer.
  • Stay neutral, use think-aloud and focus on behavior over opinions.
  • Recruit representative participants ethically, with consent and fair incentives.

Check your understanding

Quick questions to lock in the lesson. They don’t count towards your certificate.

  1. Which task wording is best for a usability test?
  2. A participant asks, 'Should I tap here?' What should the facilitator say?
  3. Why is testing with around five users per round often recommended?

Put it into practice

Write a test plan with three scenario tasks for one of your pages, recruit three to five target users, run the sessions remotely, and complete a findings table.

Enrol for free to save your progress

Reading is always free. Enrol to keep your place, take the final assessment and earn a verifiable certificate.