Lean Startup Experimentation, outputs to outcomes, short version.
Download as PPTX, PDF0 likes66 views
The document discusses the importance of experimentation and customer feedback in improving performance outcomes, highlighting specific results such as a 25% increase in offer acceptance and a 4% revenue increase. Key lessons include the significance of mindset, the necessity of open surveys, and rigorous customer testing. It emphasizes the need for clarity in outputs to achieve desired outcomes while reflecting on the biases and analysis of results during experimentation.
Lean Startup Experimentation, outputs to outcomes, short version.
- 1. Experimentation Outcomes over OutputsFrom the real world @AndrewRusling
- 2. Performance
- 3. Outcomes over outputs • Offer acceptance up 25% • Complaints down 12% • Revenue up 4% • Installations up 7% • Built a new feature • Updated existing feature • Released a new version • Fixed some bugs
- 5. WHY HOW
- 8. Lesson learnt: Mindset is crucial Photo reference: https://www.flickr.com/photos/simmogl/2449850215
- 10. Listen to your customers, give them what they want, not what they ask for.
- 11. Your understanding What the user sees Photo Reference: https://www.flickr.com/photos/eggrole/7524458398
- 12. Customer Testing “Nothing is quite so humbling as being forced to watch in silence as some poor play-tester stumbles around your level for 20 minutes, unable to figure out the "obvious" answer that you now realize is completely arbitrary and impossible to figure out.”
- 13. Customer Testing
- 14. Customer Testing: Process 1. Provide an objective 2. Observe them and their screen 1. No guidance 2. Record over their shoulder 3. Ask them to explain their thinking
- 17. Surveys: Open over Closed CD 1: CD 2: CD 3: Please enter your top 3 CDs Yield: Pearl Jam 1 2 3 4 5 Please prioritise these CDs AC DC Live: AC DC Meddle: Pink Floyd Garbage: Garbage Wish you were here: Pink Floyd CLOSED OPEN
- 18. Key Lessons I learnt 1.Mindset is crucial 2.Listen to your customers 3.Customer testing 4.Survey's need to be open
- 20. Belief in Experimentation Frequency of Experimentation Fast Feedback Perfect practice running experiments Rigor put into Experimentation Clarity of Outputs that will lead to Outcomes Consideration of Bias Careful Analysis of results Focus on Outputs that will achieve Outcomes Experience Total effort put into Outputs Outcomes Achieved Luck Learning generated from ExperimentsAccurate Results
Editor's Notes
- #19: Mindset is crucial to getting value out of the Lean Startup and Experimentation Listen to your customers, give them what they want, not what they ask for Customer testing, great at validating a hypothesis and improving usability Survey's need to be open not closed.