Downloaded 38 times
Uploaded byCaroline Jarrett
10 tips for a better survey at UX Bristol
The document provides 10 tips for designing effective surveys, emphasizing the importance of clear questions, understanding respondent behavior, and ensuring conversation-like interactions. Key recommendations include using incentives for participation, including 'other' options in questions, and conducting pilot tests before the survey launch. It also highlights the need for trust and reward in obtaining quality responses.
More Related Content
Similar to 10 tips for a better survey at UX Bristol
More from Caroline Jarrett
![Laminated_Springs[1]. Machine design practice](https://cdn.slidesharecdn.com/ss_thumbnails/laminatedsprings1-251116120255-2a3c06fb-thumbnail.jpg?width=640&height=640&fit=bounds)
10 tips for a better survey at UX Bristol
- 1. 10 tips fora better survey Caroline Jarrett UX Bristol 2011 FORMS SURVEYS slightly different
- 2.
- 3. Survey = Questionnaire+ Process Successful That involves lots of testing 3
- 4. Outline Tips aboutquestions Tips about process Tips about testing 4
- 5.
- 6.
- 7. Tip 1 Oneintroduction is enough (and think 140 characters) 7
- 8. Try answering thisquestion, then tell me how you worked out your answer 8
- 9. The approximate curveof forgetting Long ago High Recent Low Time since event Quality of data Major life event Occasional, salient Unremarkable, repetitive 9
- 10. Tip 2 Donot ask questions about unremarkable repetitive behaviours 10
- 11. What’s missing fromthis question? 11
- 12. Tip 3 Alwaysinclude ‘other’ in category questions – Don’t know – Prefer not to answer – All of the above 12
- 13. Watch the orderof these two questions 13
- 14.
- 15. Tip 4 Thinkof your questions as a conversation with your respondent Jarrett, C. and Gaffney, G (2008) “Forms that work: Designing web forms for usability” Janice (Ginny) Redish (2007) “Letting go of the words: Writing web content that works” 15
- 16. Outline Tips aboutquestions Tips about process Tips about testing 16
- 17. Response relies on effort,reward, and trust Trust Perceived effort Perceived reward Diagram from Jarrett, C, and Gaffney, G (2008) “Forms that work: Designing web forms for usability” inspired by Dillman, D.A. (2000) “Internet, Mail and Mixed Mode Surveys: The Tailored Design Method” 17
- 18. How are response,effort and trust working here? 18
- 19. In mail surveys, atoken incentive works better than no incentive or a prize draw 19
- 20. Tip 5 Tryto find an incentive that gives an immediate reward 20
- 21.
- 22.
- 23.
- 24.
- 25. Tip 6 Onegood incentive: allowing the respondents to express their views 25
- 26. Write down youranswers to this questionnaire 1. How many user surveys have you run? NONE 1 to 5 6 to 10 more than 10 2. What is your top tip for a better user survey, based on experience of writing or answering? __________________________________ __________________________________ 26
- 27. Now try itas an interview. In pairs: use this is a script for an interview 1. How many user surveys have you run? NONE 1 to 5 6 to 10 more than 10 2. What is your top tip for a better user survey, based on experience of writing or answering? __________________________________ __________________________________ 27
- 28. Now tell eachother a story about your experience relevant to these questions 1. How many user surveys have you run? NONE 1 to 5 6 to 10 more than 10 2. What is your top tip for a better user survey, based on experience of writing or answering? __________________________________ __________________________________ 28
- 29. Now let’s sharedata and stories • What numbers have we collected? • What open answers? • What stories? 29
- 30. Tip 7 Askusers for stories to explore their concerns Quesenbery, W and Brooks, K (2010) “Storytelling in User Experience Design” 30
- 31. Did you answerthe same question that I asked? 1. How many user surveys have you run? 31
- 32. Does your householdhave access to running water? Picture credits: James Mooney, Caroline Jarrett 32
- 33. “Shared reference”: both sidesinterpret in the same way Service area? Reiss, E. (2000) “Practical Information Architecture: A Hands-On Approach to Structuring Successful Web Sites” Photo: chaptstickaddict 33
- 34. Tip 8 Interviewusers to find out if questions mean the same to them as to you 34
- 35. © Caroline Jarrettand Effortmark Ltd If you use this cartoon in another context, please credit Caroline Jarrett and Effortmark Ltd. 35
- 36. What recommendation willyou make based on your results? • What decision will you make? • What happens if … – The users all agree with your gut feel? – The users all disagree with your gut feel? – The users don’t care either way? 36
- 37. Tip 9 Trywriting your presentation first (before the questions) Natalie Webb, conversation at UPA2010 37
- 38. Outline Tips aboutquestions Tips about process Tips about testing 38
- 39. “If you don’thave time to do the pilot, you don’t have time to do the study” • Oppenheim, A. P. (1992) “Questionnaire Design, Interviewing and Attitude Measurement “ – And in each subsequent edition • Dillman, D.A. (2000) “Internet, Mail and Mixed Mode Surveys: The Tailored Design Method” – And in each subsequent edition • Gillham, B (2000) “Developing a Questionnaire” – And in the second edition I wish I’d run a pilot Jarrett, C. (2010) 39
- 40. Tip 10 Runa pilot 40
- 41. Caroline Jarrett Twitter: @cjforms Slideshare:cjforms [email protected] I’m a consultant, hire me: Consultancy: www.effortmark.co.uk Training: www.usabilitythatworks.com Free stuff: Forms advice: www.formsthatwork.com Editing: www.editingthatworks.com Columns: www.uxmatters.com “Good Questions” 41