ELIMINATE THE GUESSWORK
from quick fix to structural success
ROEL
WILLEMS10+ year - digital analytics & conversion optimisation
Current: Senior Digital Analyst, Conversion optimization specialist
- Ahold Delhaize
Former: Senior Consultant / Product manager Analytics and
conversion
- OrangeValley
consumer behaviour from a data perspective
ELIMINATE THE GUESSWORK
➤ From test to testing
➤ Quick fix(es) to structural approach
➤ 3 key principes
FROM TEST TO TESTING
VOORBEELDCHALLENGE: WHERE AND WHAT TO TEST?
?
HOMEPAGE CHECKOUT
VOORBEELDOPLOSSING:DO WE NEED MORE IDEAS?
VOORBEELDNEAR LIMITLESS OPPORTUNITY
“
… starting isn’t a problem,
continuity is the challenge.
“74% of the survey respondents who
reported having a structured approach
to conversion also stated they had
improved their sales.
-source: Econsultancy Conversion Rate Optimization Report
FROM QUICK FIX(ES) TO
STRUCTURAL APPROACH
3 KEY PRINCIPLES
VOORBEELDAD HOC TO STRUCTURAL APPROACH
-source: Adapted from Trochim, William M. The Research Methods Knowledge Base, 2nd Edition.
Result, but not reliable Reliable, but no result Reliable results
1. ELIMINATE GUESSWORK
VOORBEELDAD HOC / OPINION-BASED
“Most of the world will make decisions
by either guessing or using there gut.
They will be either lucky or wrong.
-Suhail Doshi
VOORBEELDLUCKY OR WRONG?
VOORBEELDFOCUS ON STRUCTURE & PROCESS
Ad hoc
Opinion-based
Testing discipline
Fact-based
VOORBEELDOPLOSSING:ITERATIVE APPROACH, LOOK FOR RELEVANCY
How can we stimulates
visitor behaviour?
Can we make it more
easy to use?
Does an element
influence visitor
behaviour?
VOORBEELDCASE
2. LEARN FROM FAILURE
VOORBEELDTESTING DISCIPLINE
“
➤ Only one third of the ideas tested at Microsoft improved the
metric(s) they were designed to improve;
➤ at Google, only “about 10 percent of controlled experiments
were leading to business changes;
➤ Netflix considers 90% of what they try to be wrong;
➤ Etsy “nearly everything fails” and “it's been humbling to
realize how rare it is to succeed on the first attempt;
➤ “No matter how much you think it’s a no-brainer, how much
research you’ve done, or how many competitors are doing it,
sometimes, more often than you might think, experiment
ideas simply fail.” - Skyscanner.
-source: exp-platform.com Online Controlled Experiments and A/B Tests
“It ain’t what you don’t know that gets
you in trouble, it’s what you know for
sure that ain’t so.
-Mark Twain
VOORBEELDDON’T TRUST IN INTUITION, … BUT VALIDATE ALTERNATIVES
VOORBEELDOPLOSSING:ACTION ORIENTED BIAS
➤ More experiments ≠ more effect
➤ Focus on information discovery, test valid alternatives
-source: Andrew Anderson
VOORBEELDCASE
3. FOCUS ON EFFICIENCY
VOORBEELDEFFICIENCY
ÍOPLOSSING:SINGLE BACKLOG
Backlog
Team
Visitors
√success / - failure
ÍOPLOSSING:ACCELERATE YOU OPTIMISATION PROGRAM? - MORE IDEAS?
Backlog
Team
Visitors
√success / - failure
ÍOPLOSSING:ACCELERATE? - MORE RESOURCES?
Backlog
Team
Visitors
√success / - failure
VOORBEELDOPLOSSING:MOVING FROM: SINGLE LANE TESTING…
OR
HOMEPAGE CHECKOUT
VOORBEELDOPLOSSING:… TO INCREASE EFFICIENCY (AND THUS INFORMATION DISCOVERY)…
HOMEPAGE
CHECKOUT
CATEGORIE PRODUCT
BASKET THANKS
√
VOORBEELDOPLOSSING:…TO: MULTI-LANE TESTING
HOMEPAGE
CHECKOUT
CATEGORIE PRODUCT
BASKET THANKS
√
TAKE AWAY
VOORBEELDOPTIMISING THE ORGANISATION
Eliminate the guesswork learn from failure focus on efficiency
“Want to be a better marksman? Stop
looking for silver bullets, improve you
aiming.
Roel Willems
info@roelwillems.com
@roelwillems
linkedin.com/in/roelwillems
VOORBEELDCONTACT

More Related Content

PDF
5. Conversie optimalisatie: De stand van zaken in de markt (Google - Jorden L...
PDF
[Elite Camp 2016] Karl Gilis - How to Make Sure Your New Website Won’t Be a F...
 
PDF
Always Be Testing - Learn from Every A/B Test (Hiten Shah)
PDF
SearchLove London 2016 | Stephen Pavlovich | Habits of Advanced Conversion Op...
PDF
The Million Dollar Optimization Strategy - Andre Morys - ConversionXL Live 2015
 
PDF
[Elite Camp 2016] Amy Harrison - The Science of Screenwriting for Online Mark...
 
PDF
Ronny Kohavi, Microsoft (USA) - Conversion Hotel 2017 - keynote
PPT
Startup Metrics for Pirates (Startonomics Beijing, June 2009)
5. Conversie optimalisatie: De stand van zaken in de markt (Google - Jorden L...
[Elite Camp 2016] Karl Gilis - How to Make Sure Your New Website Won’t Be a F...
 
Always Be Testing - Learn from Every A/B Test (Hiten Shah)
SearchLove London 2016 | Stephen Pavlovich | Habits of Advanced Conversion Op...
The Million Dollar Optimization Strategy - Andre Morys - ConversionXL Live 2015
 
[Elite Camp 2016] Amy Harrison - The Science of Screenwriting for Online Mark...
 
Ronny Kohavi, Microsoft (USA) - Conversion Hotel 2017 - keynote
Startup Metrics for Pirates (Startonomics Beijing, June 2009)

What's hot (20)

PDF
A/B Testing: You Might be Driving in the Wrong Direction
PPTX
Turning Data into Customers - Conversion Hotel - Peep Laja
 
PDF
Michelle Kiss, Analytics Demystified (AUS/NL/USA) - Conversion Hotel 2017 - k...
PDF
Matthew Roach, Sanoma (AUS/UK/NL) - Conversion Hotel 2017 - keynote
PDF
[Elite Camp 2016] Martijn Scheijbeler - Optimization for Content Sites
 
PDF
[CXL Live 16] The Grand Unified Theory of Conversion Optimization by John Ekman
 
PDF
Talks@Coursera - A/B Testing @ Internet Scale
PDF
4 Steps Toward Scientific A/B Testing
PDF
SearchLove London 2016 | Lea Pica | How to Present to Get Results
PDF
Website Redesigns: Why they Fail and How to Ensure Success
PDF
Conversion mistakes—and how CRO affects SEO (with Rand Fishkin and Karl Blanks)
PDF
5 Steps for Developing Successful Business Apps
PDF
The Power of A/B Testing
PDF
Optimizely Experience Customer Story - Atlassian
PDF
[CXL Live 16] You Can’t Make This Stuff Up by Alex Harris
 
PDF
12 Steps to Effective Growth Hacking (www.wepullthetrigger.com)
PDF
How to Get Survey Answers That Actually Help Your Business
PDF
Why A/B testing is probably damaging your business (and what you can do about...
PDF
Skill session Google Analytics @WeWork Amsterdam (Mike van Hoenselaar)
PPTX
One Squared Presentation: Margot Da Cunha - Video as a Marketing Element
A/B Testing: You Might be Driving in the Wrong Direction
Turning Data into Customers - Conversion Hotel - Peep Laja
 
Michelle Kiss, Analytics Demystified (AUS/NL/USA) - Conversion Hotel 2017 - k...
Matthew Roach, Sanoma (AUS/UK/NL) - Conversion Hotel 2017 - keynote
[Elite Camp 2016] Martijn Scheijbeler - Optimization for Content Sites
 
[CXL Live 16] The Grand Unified Theory of Conversion Optimization by John Ekman
 
Talks@Coursera - A/B Testing @ Internet Scale
4 Steps Toward Scientific A/B Testing
SearchLove London 2016 | Lea Pica | How to Present to Get Results
Website Redesigns: Why they Fail and How to Ensure Success
Conversion mistakes—and how CRO affects SEO (with Rand Fishkin and Karl Blanks)
5 Steps for Developing Successful Business Apps
The Power of A/B Testing
Optimizely Experience Customer Story - Atlassian
[CXL Live 16] You Can’t Make This Stuff Up by Alex Harris
 
12 Steps to Effective Growth Hacking (www.wepullthetrigger.com)
How to Get Survey Answers That Actually Help Your Business
Why A/B testing is probably damaging your business (and what you can do about...
Skill session Google Analytics @WeWork Amsterdam (Mike van Hoenselaar)
One Squared Presentation: Margot Da Cunha - Video as a Marketing Element
Ad

Viewers also liked (20)

PDF
9. Content Track - Contentmarketing, doelgroep en customer journey centraal -...
PDF
10. SEO Track: Veranderend zoekgedrag en het belang van goede content - Sande...
PDF
8. SEA track - Paid Search Strategie om de Customer Journey - Thijs Glass (Or...
PDF
7. Display track - Data-Driven programmatic marketing - Kelly Siemons (Orange...
PDF
11. Case Centraal Beheer "Even Apeldoorn bellen" en data-driven marketing - (...
PDF
2. Online Marketing trends en ontwikkelingen - Eduard Blacquière (OrangeValley)
PDF
6. De ontwikkelingen binnen programmatic buying - Carolina Massaro (OrangeVal...
PDF
3. DDMA Data-driven Marketing: de stand van zaken in Nederland (DDMA-Sanne Mu...
PDF
1. Opening - Ortwin Verreck (OrangeValley)
PDF
3. Sabine Straver & Jitty van Doodewaerd - Grip op Data
PPTX
20130307 kennissessie enhanced campaigns
PPTX
20130325 gauc enhanced campaigns
PDF
Roel Willems - GAUC Conversie optimalisatie aanpak, van strategie tot resultaat
PPT
Advanced businessdata integratie met Google Analytics (GAUC / Orange Valley)
PDF
Conversion Hotel 2016 - Dela Quist
PPTX
Web Analytics Uitdagingen bij VNU Media (GAUC / Orange Valley)
PDF
Craig Sullivan - Keynote speaker summary & final thoughts - Conversion Hotel ...
PDF
Automating Analytics - Jeff Sauer (GAUC16)
PDF
Conversion Hotel 2016 - Amy Harrison
PDF
Conversion Hotel 2016 - Ben Ambridge
9. Content Track - Contentmarketing, doelgroep en customer journey centraal -...
10. SEO Track: Veranderend zoekgedrag en het belang van goede content - Sande...
8. SEA track - Paid Search Strategie om de Customer Journey - Thijs Glass (Or...
7. Display track - Data-Driven programmatic marketing - Kelly Siemons (Orange...
11. Case Centraal Beheer "Even Apeldoorn bellen" en data-driven marketing - (...
2. Online Marketing trends en ontwikkelingen - Eduard Blacquière (OrangeValley)
6. De ontwikkelingen binnen programmatic buying - Carolina Massaro (OrangeVal...
3. DDMA Data-driven Marketing: de stand van zaken in Nederland (DDMA-Sanne Mu...
1. Opening - Ortwin Verreck (OrangeValley)
3. Sabine Straver & Jitty van Doodewaerd - Grip op Data
20130307 kennissessie enhanced campaigns
20130325 gauc enhanced campaigns
Roel Willems - GAUC Conversie optimalisatie aanpak, van strategie tot resultaat
Advanced businessdata integratie met Google Analytics (GAUC / Orange Valley)
Conversion Hotel 2016 - Dela Quist
Web Analytics Uitdagingen bij VNU Media (GAUC / Orange Valley)
Craig Sullivan - Keynote speaker summary & final thoughts - Conversion Hotel ...
Automating Analytics - Jeff Sauer (GAUC16)
Conversion Hotel 2016 - Amy Harrison
Conversion Hotel 2016 - Ben Ambridge
Ad

Similar to 13. Case: Ervaringen met conversie optimalisatie bij Ahold (Roel Willems) (20)

PDF
Eliminate the guess work - van quick fix naar structureel succes
PDF
[Webinar] Scaling experimentation: 5 key pillars of maturity by Nick So
PPTX
2010 10 15 the lean startup at tech_hub london
PDF
User Research: The Superpower Behind Experimentation Programs | VWO Webinars
 
PPTX
2011 10 12 eric ries lean startup web 2.0 expo ny keynote
PPTX
Eric Ries StartupDay 2011 Speech
PPTX
2011 03 11 eric ries - the lean startup sxsw
PDF
Democratizing Online Controlled Experiments at Booking.com
PDF
Fail Well, Pivot Fast: Product Experimentation for Continuous Discovery
PPTX
Introduction to cro
PDF
State Farm presentation at the Chief Analytics Officer Forum East Coast USA (...
PPTX
Meetup 16 dec data driven process to optimization
PPTX
Slideshare 3: Master the Essentials of Conversion Optimization
PPTX
Eric Ries - The Lean Startup - Google Tech Talk
PPTX
Eric Ries - The lean startup
PPT
Landing Page Testing To Increase Conversions
PPTX
Conversion Rate Optimization for Business Growth
PPTX
eric ries - the lean startup dogpatch LUXr nyc
PPTX
2010 10 28 the lean startup at ucsd
PDF
Iterate. Calculate. Communicate.
Eliminate the guess work - van quick fix naar structureel succes
[Webinar] Scaling experimentation: 5 key pillars of maturity by Nick So
2010 10 15 the lean startup at tech_hub london
User Research: The Superpower Behind Experimentation Programs | VWO Webinars
 
2011 10 12 eric ries lean startup web 2.0 expo ny keynote
Eric Ries StartupDay 2011 Speech
2011 03 11 eric ries - the lean startup sxsw
Democratizing Online Controlled Experiments at Booking.com
Fail Well, Pivot Fast: Product Experimentation for Continuous Discovery
Introduction to cro
State Farm presentation at the Chief Analytics Officer Forum East Coast USA (...
Meetup 16 dec data driven process to optimization
Slideshare 3: Master the Essentials of Conversion Optimization
Eric Ries - The Lean Startup - Google Tech Talk
Eric Ries - The lean startup
Landing Page Testing To Increase Conversions
Conversion Rate Optimization for Business Growth
eric ries - the lean startup dogpatch LUXr nyc
2010 10 28 the lean startup at ucsd
Iterate. Calculate. Communicate.

More from OrangeValley (20)

PDF
Digital Marketing Trend Event 2024 - Data gedreven testen verhoogt de convers...
PDF
Digital Marketing Trend Event 2024 - Trends in Social media Marketing.pdf
PDF
Digital Marketing Trend Event 2024 - SEO & Big Data_ winnen in Google én and...
PDF
Digital Marketing Trend Event 2024 - Afhankelijkheid van Google.pdf
PDF
Digital Marketing Trend Event 2024 - De juiste balans tussen branding en perf...
PDF
Klantcases in the spotlight event 2024 - De Wit Schijndel - Optimaliseren zon...
PDF
Klantcases in the spotlight event 2024 - CROP (Nonpaints) - De ultieme geïnt...
PDF
Klantcases in the spotlight event 2024 - Consumentenbond - 5 redenen waarom f...
PDF
Klantcases in the spotlight event 2024 - Blokker - Innovatieve groeistrategie...
PDF
Klantcases in the spotlight event 2024 - Medicura - Een digitale transformati...
PDF
Klantcases in the spotlight event 2024 - Hunkemoller - Marktaandeel gestabili...
PDF
Klantcases in the spotlight event 2024 - Service Apotheek - Apotheker, ligt m...
PDF
Klantcases in the spotlight event 2024 - StudyGo - TikTok Search bij StudyGo_...
PDF
Privacy First Digital Marketing Event 2024 - Welcome to the privacy first ma...
PDF
Privacy First Digital Marketing Event 2024 - Vuistregels voor een correcte co...
PDF
Privacy First Digital Marketing Event 2024 - Testen zonder cookies.pdf
PDF
Privacy First Digital Marketing Event 2024 - Responsible AI.pdf
PDF
Privacy First Digital Marketing Event 2024 - Privacy First Marketing Strategy...
PDF
Privacy First Digital Marketing Event 2024 - Optimaliseer je leadgeneratiestr...
PDF
Privacy First Digital Marketing Event 2024 - Mediastrategie_ Heroverweging v...
Digital Marketing Trend Event 2024 - Data gedreven testen verhoogt de convers...
Digital Marketing Trend Event 2024 - Trends in Social media Marketing.pdf
Digital Marketing Trend Event 2024 - SEO & Big Data_ winnen in Google én and...
Digital Marketing Trend Event 2024 - Afhankelijkheid van Google.pdf
Digital Marketing Trend Event 2024 - De juiste balans tussen branding en perf...
Klantcases in the spotlight event 2024 - De Wit Schijndel - Optimaliseren zon...
Klantcases in the spotlight event 2024 - CROP (Nonpaints) - De ultieme geïnt...
Klantcases in the spotlight event 2024 - Consumentenbond - 5 redenen waarom f...
Klantcases in the spotlight event 2024 - Blokker - Innovatieve groeistrategie...
Klantcases in the spotlight event 2024 - Medicura - Een digitale transformati...
Klantcases in the spotlight event 2024 - Hunkemoller - Marktaandeel gestabili...
Klantcases in the spotlight event 2024 - Service Apotheek - Apotheker, ligt m...
Klantcases in the spotlight event 2024 - StudyGo - TikTok Search bij StudyGo_...
Privacy First Digital Marketing Event 2024 - Welcome to the privacy first ma...
Privacy First Digital Marketing Event 2024 - Vuistregels voor een correcte co...
Privacy First Digital Marketing Event 2024 - Testen zonder cookies.pdf
Privacy First Digital Marketing Event 2024 - Responsible AI.pdf
Privacy First Digital Marketing Event 2024 - Privacy First Marketing Strategy...
Privacy First Digital Marketing Event 2024 - Optimaliseer je leadgeneratiestr...
Privacy First Digital Marketing Event 2024 - Mediastrategie_ Heroverweging v...

Recently uploaded (20)

PPTX
Week-1-BM.pptx for student that need to study
PPTX
Green 3D Illustration Digital Marketing Presentation_20250803_101117_0000.pptx
PPTX
Best Artificial Intelligence Course in Jalandhar
PPTX
Quizon logo and tagline recognition.pptx
PDF
LESSON 01 - TOPIC 01. Overview of Information Management.pdf
PPT
david_sm13_ppt_01.ppt MARKETING MANAGEMENT
PPTX
10-STRATEGIC-MANAEGEMENT marketing .pptx
DOCX
Elevate Transport Efficiency with QuickMove Transport Management System (TMS)...
PDF
MS Lecture Slides Session 1_17 Sep 2024.pdf
PDF
Expert Social Media Marketing Services for Maximum Engagement
PPTX
Best Machine & AI Company in India - Digital Navik
PDF
MS Lecture Slides Session 2_24 Sep 2024.pdf
PDF
Octane Catalogue || Trending Branding Digital Solutions
DOCX
Creative Marketing Campaigns in Milton Keynes
PDF
GEO vs SEO: Maximizing Engagement with LLM
PDF
White Paper - Building the AI-ready content organization
PDF
Ulas Utku Bozdogan – Excellence in Action
PPTX
The principles of Marketing Environment 2.pptx
PPTX
Presentation-on-strategic-management.pptx
DOCX
Space Based Laser Communication Market - 22 - 23 August 2025 .docx
Week-1-BM.pptx for student that need to study
Green 3D Illustration Digital Marketing Presentation_20250803_101117_0000.pptx
Best Artificial Intelligence Course in Jalandhar
Quizon logo and tagline recognition.pptx
LESSON 01 - TOPIC 01. Overview of Information Management.pdf
david_sm13_ppt_01.ppt MARKETING MANAGEMENT
10-STRATEGIC-MANAEGEMENT marketing .pptx
Elevate Transport Efficiency with QuickMove Transport Management System (TMS)...
MS Lecture Slides Session 1_17 Sep 2024.pdf
Expert Social Media Marketing Services for Maximum Engagement
Best Machine & AI Company in India - Digital Navik
MS Lecture Slides Session 2_24 Sep 2024.pdf
Octane Catalogue || Trending Branding Digital Solutions
Creative Marketing Campaigns in Milton Keynes
GEO vs SEO: Maximizing Engagement with LLM
White Paper - Building the AI-ready content organization
Ulas Utku Bozdogan – Excellence in Action
The principles of Marketing Environment 2.pptx
Presentation-on-strategic-management.pptx
Space Based Laser Communication Market - 22 - 23 August 2025 .docx

13. Case: Ervaringen met conversie optimalisatie bij Ahold (Roel Willems)