NYC 212 926-3700 www.firstinsights.com Chicago 312 455-
0088
Seven Steps to Effective
Usability Testing
October 2018
ALL CONTENT © FIRST INSIGHTS LLC
NYC 212 926-3700 www.firstinsights.com Chicago 312 455-
0088
2
Make the Case for Usability Testing
Your efforts will…
•Save development time and avoid the headaches of
major post-launch revisions.
•Improve your acquisition and retention rates.
•Uncover critical glitches that may cause site
abandonment and loss of competitive edge.
•Minimize the risk of launching a site that does not
adequately address your targeted user needs.
•Save money - the usability testing cost benefit ratio is
considered to be $1 invested equals $10 - $100 in
interface development savings. Spending 10% of your
development budget on usability testing will work.
Step 1
NYC 212 926-3700 www.firstinsights.com Chicago 312 455-
0088
3
Review Your Goals
Usability testing is best for…
•Gathering detailed qualitative feedback on the
navigation, functionality, content and nomenclature of
an interface. If you are looking to ask yes/no questions,
segment your audience or learn A/B preferences a
quantitative survey is needed.
•Exploring your site or app’s value proposition and its
overall ease of use.
•Understanding the opinions of your target users.
•Moving a project along whether you are in an agile or
waterfall project development environment.
Step 2
NYC 212 926-3700 www.firstinsights.com Chicago 312 455-
0088
4
Plan to Succeed
• Choose a city for the testing that is logistically easy so that
you and all stakeholders can attend.
• Work with a professional research facility as they will be
your partner for a successful project.
• Develop a screener questionnaire that enables recruiters to
select participants that accurately fit into your targeted
audience segments. Interviewing friends / family is not
ideal.
• Select an objective and experienced moderator.
• Set expectations for a realistic schedule as follows:
− Week 1 - Facility selection, screener development & start recruitment
− Week 2 – Site / interface reviews & moderators guide development
− Week 3 – Complete the usability testing
− Week 4 – Report development & delivery
Step 3
NYC 212 926-3700 www.firstinsights.com Chicago 312 455-
0088
5
Develop a Solid Moderator’s Guide
• Ideally a discussion guide should have the following:
− Introduction about the interview and what the participant is
being asked to do.
− Pre-task questions about the industry and/or competitive set.
− Task based questions tied into the key features and/or
functionality of the site. This will let you know if the navigation,
content and terminology is working.
− Summary questions to wrap up ideas and get overall opinions
on all that was explored.
• Interview sessions should be 1 on 1 and between 45 -
75 minutes in length.
• Let all stakeholders review the guide to offer ideas.
• Conduct a trial run through with a colleague.
Step 4
NYC 212 926-3700 www.firstinsights.com Chicago 312 455-
0088
6
Execute on Testing Day
• Show up way before your first interview to check the
computer set up, video equipment and room
arrangements.
• Set expectations properly – not every interview is
going to be stellar and you may hear some negative
or unique feedback.
• Make adjustments with your moderator as minor
changes to questions and the order in which they are
asked can be productive.
• Don’t panic – if you are testing a prototype don’t start
playing around with it after each interview.
Step 5
NYC 212 926-3700 www.firstinsights.com Chicago 312 455-
0088
7
Prepare a Solid Summary Report
• Give your team and/or moderator about a week to
develop a comprehensive and detailed report.
• Explain the research methodology and project
objectives in the report as some who read it may not
have been able to attend in person.
• Add lots of screen shots as most people are visual.
• Provide the reader with findings and
recommendations that enhance the decision making
process.
• If 8 of 10 people were able to complete a task don’t
say 80% – stick to “8 of 10” as percentages make
results sound statistically valid, which they are not.
Step 6
NYC 212 926-3700 www.firstinsights.com Chicago 312 455-
0088
8
Don’t Stop With One Test
• Conducting usability testing on a regular basis will
benefit your overall marketing and interface
development efforts.
• Additional usability research will allow you to spot new
trends and hear opinions directly from your customers
and prospects.
• Try to coordinate your usability testing results with
quantitative research efforts and site analytics to
paint a broad picture about the health of your
interface.
• After seeing usability testing for the first time, you
should be able to get additional budget for follow up
research as the key players will see its value.
Step 7
NYC 212 926-3700 www.firstinsights.com Chicago 312 455-
0088
9
• Our specialties include:
− Usability Testing
− Contextual & Ethnographic Interviews
− Heuristic Analysis
− Focus Groups
− Competitive Analysis
− Quality Assurance
• Based in NYC & Chicago with resources
nationwide.
• Team has diverse background in advertising,
marketing, project management and interface
design which provides a unique viewpoint.
About First Insights
NYC 212 926-3700 www.firstinsights.com Chicago 312 455-
0088
10
• Experience working with Fortune 500 clients and
startups in multiple industry verticals including:
− Banking & Finance
− Packaged Goods
− Insurance
− Media & Publishing
− Pharmaceuticals
− Travel
− Automotive
− Technology
− Internet Pure Plays
About First Insights
NYC 212 926-3700 www.firstinsights.com Chicago 312 455-
0088
11
• Lon Taylor – Principal Usability Consultant
− NYC 212 926-3700
− Chicago 312 455-0088
− www.firstinsights.com
Questions & Contact Info

More Related Content

PPTX
Notes on usability testing
PDF
BENCHMARKING MINI-SERIES PART #1: Proving Value & Quantifying the Impact of U...
PDF
Benchmarking Mini-series Part #2: Conducting Quick, Cost-Effective UX Benchma...
PDF
Usability Testing To Prioritize Your Designs
PDF
Prototyping and Usability Testing your designs
PDF
[19.2 UserZoom Spring Release Webinar] Get Card Sort Insights with Confidence
PPTX
Live Conversation: Cut your customer interview costs by up to 90%
PDF
Moving the Needle with UX Benchmarking
Notes on usability testing
BENCHMARKING MINI-SERIES PART #1: Proving Value & Quantifying the Impact of U...
Benchmarking Mini-series Part #2: Conducting Quick, Cost-Effective UX Benchma...
Usability Testing To Prioritize Your Designs
Prototyping and Usability Testing your designs
[19.2 UserZoom Spring Release Webinar] Get Card Sort Insights with Confidence
Live Conversation: Cut your customer interview costs by up to 90%
Moving the Needle with UX Benchmarking

What's hot (18)

PPT
Preparing for a Website Redesign | SEO Design
PDF
User testing methodology
PPTX
Delivering Excellent Digital Quality to Your Customers
PPTX
Boost Your Intelligent Assistants with UX Testing
PPTX
VWO Webinar: How To Plan Your Optimisation Roadmap
 
PDF
Usability testing - have fun and improve your work
PDF
[Mush Honda] Software Testers From Good to Great
PDF
Apply A/B Testing with NGINX Routing Policy
PPTX
Kano analysis review and discussion with agile austin product sig 2014
PPTX
How To Do Usability Testing
PPTX
VWO Webinar: Scaling Your Testing Program
 
PDF
Optimizely Experience Customer Story - Atlassian
PPTX
How to Conduct UX Benchmarking Studies Your Own Site Over Time + Competitors ...
PDF
The Optimizely Experience Keynote by Matt Althauser - Optimizely Experience L...
PPTX
Tackling Strategic Engineering Challenges
PPT
Website Testing WINS!
PPT
Managing the Teams you have - not the one you wish you had
PPTX
Using Automated Testing Tools to Empower Your User Research
Preparing for a Website Redesign | SEO Design
User testing methodology
Delivering Excellent Digital Quality to Your Customers
Boost Your Intelligent Assistants with UX Testing
VWO Webinar: How To Plan Your Optimisation Roadmap
 
Usability testing - have fun and improve your work
[Mush Honda] Software Testers From Good to Great
Apply A/B Testing with NGINX Routing Policy
Kano analysis review and discussion with agile austin product sig 2014
How To Do Usability Testing
VWO Webinar: Scaling Your Testing Program
 
Optimizely Experience Customer Story - Atlassian
How to Conduct UX Benchmarking Studies Your Own Site Over Time + Competitors ...
The Optimizely Experience Keynote by Matt Althauser - Optimizely Experience L...
Tackling Strategic Engineering Challenges
Website Testing WINS!
Managing the Teams you have - not the one you wish you had
Using Automated Testing Tools to Empower Your User Research
Ad

Similar to 7 Steps to Effective Usability Testing (20)

PDF
First 30 days of Your CRO Program
 
PPTX
How to Perform an In-House SEO Audit in 2020
PDF
Research and Discovery Tools for Experimentation - 17 Apr 2024 - v 2.3 (1).pdf
 
PPTX
A comprehensive guide on advantages, methods, and process of Usability Testin...
PDF
Usability Testing 101 - an introduction
PPTX
Benchmarking
PDF
Technology development: What is audit's role?
PPTX
體驗劇場_1050524_W14_易用性測試_楊政達
PPTX
Accessibility in the Engineering Village CSUN 2019
PPTX
How Okta Created a Customer Community To Drive Engagement and Manage Support ...
PPTX
How to Balance Innovation and Optimization in your CRO program
 
DOC
SHWETA_METRI
PDF
Call center assessment[1]
PDF
Are You a Smart CAAT or a Copy CAAT
PPTX
Putting Customers First: How To Build Data-Driven Strategies To Ensure Custom...
 
PDF
Data analytics software selection and implementation
PPTX
evaluation -human computer interaction.pptx
PPTX
Web Usability Study - Why you need it
PPTX
Usability testing
PDF
UCD & Usability testing at the St. Augustine Campus
First 30 days of Your CRO Program
 
How to Perform an In-House SEO Audit in 2020
Research and Discovery Tools for Experimentation - 17 Apr 2024 - v 2.3 (1).pdf
 
A comprehensive guide on advantages, methods, and process of Usability Testin...
Usability Testing 101 - an introduction
Benchmarking
Technology development: What is audit's role?
體驗劇場_1050524_W14_易用性測試_楊政達
Accessibility in the Engineering Village CSUN 2019
How Okta Created a Customer Community To Drive Engagement and Manage Support ...
How to Balance Innovation and Optimization in your CRO program
 
SHWETA_METRI
Call center assessment[1]
Are You a Smart CAAT or a Copy CAAT
Putting Customers First: How To Build Data-Driven Strategies To Ensure Custom...
 
Data analytics software selection and implementation
evaluation -human computer interaction.pptx
Web Usability Study - Why you need it
Usability testing
UCD & Usability testing at the St. Augustine Campus
Ad

Recently uploaded (20)

PPTX
Starbucks by Propoint - PPT Template.pptx
PPTX
Fixing AI Hallucinations: The NeuroRank™ Approach
PDF
Google Display ads -Grow with Digital Experts
PDF
Octane Catalogue || Trending Branding Digital Solutions
PDF
Plastic Products-price poster holder pricing board-Loripos.pdf
PDF
What's New in Digital Q3 25 Webinar 2025
PPTX
Best Social Media Marketing Company in Lucknow
PPTX
AI Search Demystified: Future‑Proof Your Brand For AI‑Driven Queries
PDF
How CRM Helps with Community Management.pdf
PDF
Freelance digital marketing in 2025:Your path to freedom and growth
PPTX
The Rise of Chatbots in Conversational Commerce.pptx
PPTX
Best LLM SEO Tools for B2B Brands in 2025
PPTX
Events Management Overview of Events Management
PPTX
IMC Bimtech --------------------------.pptx
PDF
EYP Creation Presentation Deck - Offerings
PPTX
1 INTRODUCTION TO ENTREPRENEURSHIP ( ENTREPRENEURSHIP).pptx
PPTX
Introduction to HUMAN RESOURCE MANGEMENT.pptx
PPTX
Segmentation_EM[1]_Powerpoint prese.pptx
PPTX
Social Media Management Company in Lucknow
PDF
Nithila Digital Marketer Presentation (2).pdf
Starbucks by Propoint - PPT Template.pptx
Fixing AI Hallucinations: The NeuroRank™ Approach
Google Display ads -Grow with Digital Experts
Octane Catalogue || Trending Branding Digital Solutions
Plastic Products-price poster holder pricing board-Loripos.pdf
What's New in Digital Q3 25 Webinar 2025
Best Social Media Marketing Company in Lucknow
AI Search Demystified: Future‑Proof Your Brand For AI‑Driven Queries
How CRM Helps with Community Management.pdf
Freelance digital marketing in 2025:Your path to freedom and growth
The Rise of Chatbots in Conversational Commerce.pptx
Best LLM SEO Tools for B2B Brands in 2025
Events Management Overview of Events Management
IMC Bimtech --------------------------.pptx
EYP Creation Presentation Deck - Offerings
1 INTRODUCTION TO ENTREPRENEURSHIP ( ENTREPRENEURSHIP).pptx
Introduction to HUMAN RESOURCE MANGEMENT.pptx
Segmentation_EM[1]_Powerpoint prese.pptx
Social Media Management Company in Lucknow
Nithila Digital Marketer Presentation (2).pdf

7 Steps to Effective Usability Testing

  • 1. NYC 212 926-3700 www.firstinsights.com Chicago 312 455- 0088 Seven Steps to Effective Usability Testing October 2018 ALL CONTENT © FIRST INSIGHTS LLC
  • 2. NYC 212 926-3700 www.firstinsights.com Chicago 312 455- 0088 2 Make the Case for Usability Testing Your efforts will… •Save development time and avoid the headaches of major post-launch revisions. •Improve your acquisition and retention rates. •Uncover critical glitches that may cause site abandonment and loss of competitive edge. •Minimize the risk of launching a site that does not adequately address your targeted user needs. •Save money - the usability testing cost benefit ratio is considered to be $1 invested equals $10 - $100 in interface development savings. Spending 10% of your development budget on usability testing will work. Step 1
  • 3. NYC 212 926-3700 www.firstinsights.com Chicago 312 455- 0088 3 Review Your Goals Usability testing is best for… •Gathering detailed qualitative feedback on the navigation, functionality, content and nomenclature of an interface. If you are looking to ask yes/no questions, segment your audience or learn A/B preferences a quantitative survey is needed. •Exploring your site or app’s value proposition and its overall ease of use. •Understanding the opinions of your target users. •Moving a project along whether you are in an agile or waterfall project development environment. Step 2
  • 4. NYC 212 926-3700 www.firstinsights.com Chicago 312 455- 0088 4 Plan to Succeed • Choose a city for the testing that is logistically easy so that you and all stakeholders can attend. • Work with a professional research facility as they will be your partner for a successful project. • Develop a screener questionnaire that enables recruiters to select participants that accurately fit into your targeted audience segments. Interviewing friends / family is not ideal. • Select an objective and experienced moderator. • Set expectations for a realistic schedule as follows: − Week 1 - Facility selection, screener development & start recruitment − Week 2 – Site / interface reviews & moderators guide development − Week 3 – Complete the usability testing − Week 4 – Report development & delivery Step 3
  • 5. NYC 212 926-3700 www.firstinsights.com Chicago 312 455- 0088 5 Develop a Solid Moderator’s Guide • Ideally a discussion guide should have the following: − Introduction about the interview and what the participant is being asked to do. − Pre-task questions about the industry and/or competitive set. − Task based questions tied into the key features and/or functionality of the site. This will let you know if the navigation, content and terminology is working. − Summary questions to wrap up ideas and get overall opinions on all that was explored. • Interview sessions should be 1 on 1 and between 45 - 75 minutes in length. • Let all stakeholders review the guide to offer ideas. • Conduct a trial run through with a colleague. Step 4
  • 6. NYC 212 926-3700 www.firstinsights.com Chicago 312 455- 0088 6 Execute on Testing Day • Show up way before your first interview to check the computer set up, video equipment and room arrangements. • Set expectations properly – not every interview is going to be stellar and you may hear some negative or unique feedback. • Make adjustments with your moderator as minor changes to questions and the order in which they are asked can be productive. • Don’t panic – if you are testing a prototype don’t start playing around with it after each interview. Step 5
  • 7. NYC 212 926-3700 www.firstinsights.com Chicago 312 455- 0088 7 Prepare a Solid Summary Report • Give your team and/or moderator about a week to develop a comprehensive and detailed report. • Explain the research methodology and project objectives in the report as some who read it may not have been able to attend in person. • Add lots of screen shots as most people are visual. • Provide the reader with findings and recommendations that enhance the decision making process. • If 8 of 10 people were able to complete a task don’t say 80% – stick to “8 of 10” as percentages make results sound statistically valid, which they are not. Step 6
  • 8. NYC 212 926-3700 www.firstinsights.com Chicago 312 455- 0088 8 Don’t Stop With One Test • Conducting usability testing on a regular basis will benefit your overall marketing and interface development efforts. • Additional usability research will allow you to spot new trends and hear opinions directly from your customers and prospects. • Try to coordinate your usability testing results with quantitative research efforts and site analytics to paint a broad picture about the health of your interface. • After seeing usability testing for the first time, you should be able to get additional budget for follow up research as the key players will see its value. Step 7
  • 9. NYC 212 926-3700 www.firstinsights.com Chicago 312 455- 0088 9 • Our specialties include: − Usability Testing − Contextual & Ethnographic Interviews − Heuristic Analysis − Focus Groups − Competitive Analysis − Quality Assurance • Based in NYC & Chicago with resources nationwide. • Team has diverse background in advertising, marketing, project management and interface design which provides a unique viewpoint. About First Insights
  • 10. NYC 212 926-3700 www.firstinsights.com Chicago 312 455- 0088 10 • Experience working with Fortune 500 clients and startups in multiple industry verticals including: − Banking & Finance − Packaged Goods − Insurance − Media & Publishing − Pharmaceuticals − Travel − Automotive − Technology − Internet Pure Plays About First Insights
  • 11. NYC 212 926-3700 www.firstinsights.com Chicago 312 455- 0088 11 • Lon Taylor – Principal Usability Consultant − NYC 212 926-3700 − Chicago 312 455-0088 − www.firstinsights.com Questions & Contact Info