Future of Web Design, NYC – Nov, 2014 @designmeltdown
Practical
UX Methods
With Patrick McNeil
 	
  	
  	
  	
  	
  Future of Web Design, NYC – Nov, 2014 @designmeltdown
Extremely fast and simple UX
test methods.
I want to explore
 	
  	
  	
  	
  	
  Future of Web Design, NYC – Nov, 2014 @designmeltdown
When in doubt, reference Star Wars
What would Boba Fett do?
 	
  	
  	
  	
  	
  Future of Web Design, NYC – Nov, 2014 @designmeltdown
Actually…
Bounty hunters are an interesting model
 	
  	
  	
  	
  	
  Future of Web Design, NYC – Nov, 2014 @designmeltdown
If Boba Fett was a UX Designer
He would…
•  Write his own rules
•  Bypass bureaucracy
•  Focus on results
•  Minimize his expenses
•  Team oriented rogue committed to the
common purpose
 	
  	
  	
  	
  	
  Future of Web Design, NYC – Nov, 2014 @designmeltdown
Bounty Hunter UX Designers
So yes, I am suggesting we should be
 	
  	
  	
  	
  	
  Future of Web Design, NYC – Nov, 2014 @designmeltdown
Who am I?
•  Professor at the Univ. of MO St. Louis
•  Grew up with tech, formalized it with
design and topped it off with UX.
•  Get in touch:
–  mcneilp@gmail.com
–  @designmeltdown
–  pmcneil.com
 	
  	
  	
  	
  	
  Future of Web Design, NYC – Nov, 2014 @designmeltdown
Download the presentation
PDF link at the end
 	
  	
  	
  	
  	
  Future of Web Design, NYC – Nov, 2014 @designmeltdown
Anti goals
•  Write lengthy research plans
•  Publish long reports of results
•  Establish new principles for the field
•  Be a roadblock to progress
 	
  	
  	
  	
  	
  Future of Web Design, NYC – Nov, 2014 @designmeltdown
The Methods
•  First click tests
•  SUS Questionnaire
•  Nano-Usability Tests
•  Integrated tests
 	
  	
  	
  	
  	
  Future of Web Design, NYC – Nov, 2014 @designmeltdown
#1 - First Click Tests
The first click is the most important click
 	
  	
  	
  	
  	
  Future of Web Design, NYC – Nov, 2014 @designmeltdown
First Click Test Results
87% vs 46%
Source: http://webusability.com/firstclick-usability-testing/
In one such study:
 	
  	
  	
  	
  	
  Future of Web Design, NYC – Nov, 2014 @designmeltdown
First click tests
•  Identify a task-scenario
•  Define the correct path(s)
•  Conduct the test
•  Examine the results
 	
  	
  	
  	
  	
  Future of Web Design, NYC – Nov, 2014 @designmeltdown
Test with…
•  Sketches
•  Wireframes
•  Full designs or screenshots
 	
  	
  	
  	
  	
  Future of Web Design, NYC – Nov, 2014 @designmeltdown
Example Example using optimalworkshop.com
 	
  	
  	
  	
  	
  Future of Web Design, NYC – Nov, 2014 @designmeltdown
Radically simplified testing
Source: http://webusability.com/firstclick-usability-testing/
In practice we have
 	
  	
  	
  	
  	
  Future of Web Design, NYC – Nov, 2014 @designmeltdown
A/B testing
Brilliant as a focus for
 	
  	
  	
  	
  	
  Future of Web Design, NYC – Nov, 2014 @designmeltdown
#2 - System Usability Scale
SUS for short
 	
  	
  	
  	
  	
  Future of Web Design, NYC – Nov, 2014 @designmeltdown
Effectiveness, Efficiency
and Satisfaction
Measure the
of almost anything
 	
  	
  	
  	
  	
  Future of Web Design, NYC – Nov, 2014 @designmeltdown
SUS Questionnaire
•  ~25 year old tool
•  Fixed 10 question survey
•  1 to 5 likert scale
•  Calculate a score from 0 to 100
(this is not a percentage)
•  It is easy to implement and painless for users
 	
  	
  	
  	
  	
  Future of Web Design, NYC – Nov, 2014 @designmeltdown
1.  I think that I would like to use this system frequently.
2.  I found the system unnecessarily complex.
3.  I thought the system was easy to use.
4.  I think that I would need the support of a technical person to
be able to use this system.
5.  I found the various functions in this system were well
integrated.
6.  I thought there was too much inconsistency in this system.
7.  I would imagine that most people would learn to use this
system very quickly.
8.  I found the system very cumbersome to use.
9.  I felt very confident using the system.
10.  I needed to learn a lot of things before I could get going with
this system.
The questions:
 	
  	
  	
  	
  	
  Future of Web Design, NYC – Nov, 2014 @designmeltdown
#3 - Nano-Usability Tests
Source: Observing The User Experience
By: Goodman, Kuniavsky and Moed
 	
  	
  	
  	
  	
  Future of Web Design, NYC – Nov, 2014 @designmeltdown
A nano-sized version of
guerrilla testing
Described as
 	
  	
  	
  	
  	
  Future of Web Design, NYC – Nov, 2014 @designmeltdown
15 Min. Usability Tests!
1.  Fine one person who cares about your product.
2.  Arrange to watch them use the product.
3.  Have them use the product to do something.
4.  Silently watch them use the product.
5.  What did you learn?
Source: Observing The User Experience
 	
  	
  	
  	
  	
  Future of Web Design, NYC – Nov, 2014 @designmeltdown
Motivations
•  A great starting point for UX newbies
•  Extremely low cost
•  Great for finding the next test topic(s)
•  Perfect for churning on a design
 	
  	
  	
  	
  	
  Future of Web Design, NYC – Nov, 2014 @designmeltdown
#4 - Integrated Research
With a focus on bite-sized methods
 	
  	
  	
  	
  	
  Future of Web Design, NYC – Nov, 2014 @designmeltdown
Test driven development
Testing is the process – not an after thought.
 	
  	
  	
  	
  	
  Future of Web Design, NYC – Nov, 2014 @designmeltdown
Analysis & Optimization Tools
We already have
that weave into our product
 	
  	
  	
  	
  	
  Future of Web Design, NYC – Nov, 2014 @designmeltdown
Google Analytics
 	
  	
  	
  	
  	
  Future of Web Design, NYC – Nov, 2014 @designmeltdown
Optimizely https://www.optimizely.com
 	
  	
  	
  	
  	
  Future of Web Design, NYC – Nov, 2014 @designmeltdown
Crazy Egg http://www.crazyegg.com
 	
  	
  	
  	
  	
  Future of Web Design, NYC – Nov, 2014 @designmeltdown
How users feel?
Utility? Usability? Efficiency?
These are great tools, but what about…
 	
  	
  	
  	
  	
  Future of Web Design, NYC – Nov, 2014 @designmeltdown
GetSmily https://www.getsmily.com/
 	
  	
  	
  	
  	
  Future of Web Design, NYC – Nov, 2014 @designmeltdown
Temper https://www.temper.io/
 	
  	
  	
  	
  	
  Future of Web Design, NYC – Nov, 2014 @designmeltdown
FSC http://www.freesurveycreator.com/
 	
  	
  	
  	
  	
  Future of Web Design, NYC – Nov, 2014 @designmeltdown
Hotjar http://www.hotjar.com/
 	
  	
  	
  	
  	
  Future of Web Design, NYC – Nov, 2014 @designmeltdown
Nelio A/B Testing http://wp-abtesting.com/
 	
  	
  	
  	
  	
  Future of Web Design, NYC – Nov, 2014 @designmeltdown
Integrated tools
That allow us to continually conduct user research.
I hope for more
 	
  	
  	
  	
  	
  Future of Web Design, NYC – Nov, 2014 @designmeltdown
In the future I hope for:
Tools integrated into our products that allow for:
•  Monitor user satisfaction
•  Discover what users need
•  Live interviews with users
•  Card sorting
•  Personas
 	
  	
  	
  	
  	
  Future of Web Design, NYC – Nov, 2014 @designmeltdown
Other methods to explore:
Some other methods you might be interested in:
•  5 Second tests
•  Delphi card sort
•  RITE
•  Bodystorming
 	
  	
  	
  	
  	
  Future of Web Design, NYC – Nov, 2014 @designmeltdown
Thank you!
Download the presentation:
http://pmcneil.com/
 	
  	
  	
  	
  	
  Future of Web Design, NYC – Nov, 2014 @designmeltdown
First Click Tests
More about First Click Tests:
•  http://www.measuringu.com/blog/first-click.php
•  http://webusability.com/firstclick-usability-testing/
•  http://www.neoinsight.com/insights-articles/
firstclick-tests-spot-3-problems.html
 	
  	
  	
  	
  	
  Future of Web Design, NYC – Nov, 2014 @designmeltdown
SUS Questionnaire
More about the SUS Questionnaire:
•  http://www.usability.gov/how-to-and-tools/
methods/system-usability-scale.html
•  http://www.measuringu.com/sus.php
•  http://uxpajournal.org/wp-content/uploads/pdf/
JUS_Brooke_February_2013.pdf

Practical UX Methods - as presented at FOWD 2014

  • 1.
               Future of Web Design, NYC – Nov, 2014 @designmeltdown Practical UX Methods With Patrick McNeil
  • 2.
               Future of Web Design, NYC – Nov, 2014 @designmeltdown Extremely fast and simple UX test methods. I want to explore
  • 3.
               Future of Web Design, NYC – Nov, 2014 @designmeltdown When in doubt, reference Star Wars What would Boba Fett do?
  • 4.
               Future of Web Design, NYC – Nov, 2014 @designmeltdown Actually… Bounty hunters are an interesting model
  • 5.
               Future of Web Design, NYC – Nov, 2014 @designmeltdown If Boba Fett was a UX Designer He would… •  Write his own rules •  Bypass bureaucracy •  Focus on results •  Minimize his expenses •  Team oriented rogue committed to the common purpose
  • 6.
               Future of Web Design, NYC – Nov, 2014 @designmeltdown Bounty Hunter UX Designers So yes, I am suggesting we should be
  • 7.
               Future of Web Design, NYC – Nov, 2014 @designmeltdown Who am I? •  Professor at the Univ. of MO St. Louis •  Grew up with tech, formalized it with design and topped it off with UX. •  Get in touch: –  [email protected] –  @designmeltdown –  pmcneil.com
  • 8.
               Future of Web Design, NYC – Nov, 2014 @designmeltdown Download the presentation PDF link at the end
  • 9.
               Future of Web Design, NYC – Nov, 2014 @designmeltdown Anti goals •  Write lengthy research plans •  Publish long reports of results •  Establish new principles for the field •  Be a roadblock to progress
  • 10.
               Future of Web Design, NYC – Nov, 2014 @designmeltdown The Methods •  First click tests •  SUS Questionnaire •  Nano-Usability Tests •  Integrated tests
  • 11.
               Future of Web Design, NYC – Nov, 2014 @designmeltdown #1 - First Click Tests The first click is the most important click
  • 12.
               Future of Web Design, NYC – Nov, 2014 @designmeltdown First Click Test Results 87% vs 46% Source: http://webusability.com/firstclick-usability-testing/ In one such study:
  • 13.
               Future of Web Design, NYC – Nov, 2014 @designmeltdown First click tests •  Identify a task-scenario •  Define the correct path(s) •  Conduct the test •  Examine the results
  • 14.
               Future of Web Design, NYC – Nov, 2014 @designmeltdown Test with… •  Sketches •  Wireframes •  Full designs or screenshots
  • 15.
               Future of Web Design, NYC – Nov, 2014 @designmeltdown Example Example using optimalworkshop.com
  • 16.
               Future of Web Design, NYC – Nov, 2014 @designmeltdown Radically simplified testing Source: http://webusability.com/firstclick-usability-testing/ In practice we have
  • 17.
               Future of Web Design, NYC – Nov, 2014 @designmeltdown A/B testing Brilliant as a focus for
  • 18.
               Future of Web Design, NYC – Nov, 2014 @designmeltdown #2 - System Usability Scale SUS for short
  • 19.
               Future of Web Design, NYC – Nov, 2014 @designmeltdown Effectiveness, Efficiency and Satisfaction Measure the of almost anything
  • 20.
               Future of Web Design, NYC – Nov, 2014 @designmeltdown SUS Questionnaire •  ~25 year old tool •  Fixed 10 question survey •  1 to 5 likert scale •  Calculate a score from 0 to 100 (this is not a percentage) •  It is easy to implement and painless for users
  • 21.
               Future of Web Design, NYC – Nov, 2014 @designmeltdown 1.  I think that I would like to use this system frequently. 2.  I found the system unnecessarily complex. 3.  I thought the system was easy to use. 4.  I think that I would need the support of a technical person to be able to use this system. 5.  I found the various functions in this system were well integrated. 6.  I thought there was too much inconsistency in this system. 7.  I would imagine that most people would learn to use this system very quickly. 8.  I found the system very cumbersome to use. 9.  I felt very confident using the system. 10.  I needed to learn a lot of things before I could get going with this system. The questions:
  • 22.
               Future of Web Design, NYC – Nov, 2014 @designmeltdown #3 - Nano-Usability Tests Source: Observing The User Experience By: Goodman, Kuniavsky and Moed
  • 23.
               Future of Web Design, NYC – Nov, 2014 @designmeltdown A nano-sized version of guerrilla testing Described as
  • 24.
               Future of Web Design, NYC – Nov, 2014 @designmeltdown 15 Min. Usability Tests! 1.  Fine one person who cares about your product. 2.  Arrange to watch them use the product. 3.  Have them use the product to do something. 4.  Silently watch them use the product. 5.  What did you learn? Source: Observing The User Experience
  • 25.
               Future of Web Design, NYC – Nov, 2014 @designmeltdown Motivations •  A great starting point for UX newbies •  Extremely low cost •  Great for finding the next test topic(s) •  Perfect for churning on a design
  • 26.
               Future of Web Design, NYC – Nov, 2014 @designmeltdown #4 - Integrated Research With a focus on bite-sized methods
  • 27.
               Future of Web Design, NYC – Nov, 2014 @designmeltdown Test driven development Testing is the process – not an after thought.
  • 28.
               Future of Web Design, NYC – Nov, 2014 @designmeltdown Analysis & Optimization Tools We already have that weave into our product
  • 29.
               Future of Web Design, NYC – Nov, 2014 @designmeltdown Google Analytics
  • 30.
               Future of Web Design, NYC – Nov, 2014 @designmeltdown Optimizely https://www.optimizely.com
  • 31.
               Future of Web Design, NYC – Nov, 2014 @designmeltdown Crazy Egg http://www.crazyegg.com
  • 32.
               Future of Web Design, NYC – Nov, 2014 @designmeltdown How users feel? Utility? Usability? Efficiency? These are great tools, but what about…
  • 33.
               Future of Web Design, NYC – Nov, 2014 @designmeltdown GetSmily https://www.getsmily.com/
  • 34.
               Future of Web Design, NYC – Nov, 2014 @designmeltdown Temper https://www.temper.io/
  • 35.
               Future of Web Design, NYC – Nov, 2014 @designmeltdown FSC http://www.freesurveycreator.com/
  • 36.
               Future of Web Design, NYC – Nov, 2014 @designmeltdown Hotjar http://www.hotjar.com/
  • 37.
               Future of Web Design, NYC – Nov, 2014 @designmeltdown Nelio A/B Testing http://wp-abtesting.com/
  • 38.
               Future of Web Design, NYC – Nov, 2014 @designmeltdown Integrated tools That allow us to continually conduct user research. I hope for more
  • 39.
               Future of Web Design, NYC – Nov, 2014 @designmeltdown In the future I hope for: Tools integrated into our products that allow for: •  Monitor user satisfaction •  Discover what users need •  Live interviews with users •  Card sorting •  Personas
  • 40.
               Future of Web Design, NYC – Nov, 2014 @designmeltdown Other methods to explore: Some other methods you might be interested in: •  5 Second tests •  Delphi card sort •  RITE •  Bodystorming
  • 41.
               Future of Web Design, NYC – Nov, 2014 @designmeltdown Thank you! Download the presentation: http://pmcneil.com/
  • 42.
               Future of Web Design, NYC – Nov, 2014 @designmeltdown First Click Tests More about First Click Tests: •  http://www.measuringu.com/blog/first-click.php •  http://webusability.com/firstclick-usability-testing/ •  http://www.neoinsight.com/insights-articles/ firstclick-tests-spot-3-problems.html
  • 43.
               Future of Web Design, NYC – Nov, 2014 @designmeltdown SUS Questionnaire More about the SUS Questionnaire: •  http://www.usability.gov/how-to-and-tools/ methods/system-usability-scale.html •  http://www.measuringu.com/sus.php •  http://uxpajournal.org/wp-content/uploads/pdf/ JUS_Brooke_February_2013.pdf