SOFTWARE IS EATING THE WORLD, AND
YOU’RE FOR LUNCH!
Edd Dumbill
@edd • edd@svds.com
2 © 2014 SILICON VALLEY DATA SCIENCE LLC. ALL RIGHTS RESERVED.
3
“… let's seek to understand how the new generation of
technology companies are doing what they do, what
the broader consequences are for businesses and the
economy and what we can collectively do to expand
the number of innovative new software companies
created in the U.S. and around the world.”
– Marc Andreesen
4 © 2014 SILICON VALLEY DATA SCIENCE LLC. ALL RIGHTS RESERVED.
DIGITAL NERVOUS SYSTEM
5
Data is your business
6 © 2014 SILICON VALLEY DATA SCIENCE LLC. ALL RIGHTS RESERVED.
7 © 2014 SILICON VALLEY DATA SCIENCE LLC. ALL RIGHTS RESERVED.
SILICON VALLEY’S DATA MACHINE
8
Where does it go wrong?
9 © 2014 SILICON VALLEY DATA SCIENCE LLC. ALL RIGHTS RESERVED.
CLEAN VALIDATE CONTROL PROTECT
CONVENTIONAL DATA STRATEGY
“WHAT YOU DO TO DATA”
10 © 2014 SILICON VALLEY DATA SCIENCE LLC. ALL RIGHTS RESERVED.
MODERN DATA STRATEGY
“WHAT YOU DO WITH DATA”
TARGET VIP CUSTOMERSATTRACT NEW CUSTOMERS
AUTOMATE
11 © 2014 SILICON VALLEY DATA SCIENCE LLC. ALL RIGHTS RESERVED.
UP vs. OUT in the Enterprise
Different use cases put
different demands on
the data infrastructure.
Increasing cost per unit
of capability from scale-
up architectures causes
rationing of resources.
Only the most valuable
use cases are pursued.
USDollars
Data Resource Usage
Scale-up cost
Scale-out cost
UC1
UC2
UC3
UC4
UC5
12 © 2014 SILICON VALLEY DATA SCIENCE LLC. ALL RIGHTS RESERVED.
USE CASE
2
NEW TOOLS MAKE IT POSSIBLE
USE CASE
1
WORKLOA
D
A
WORKLOA
D
B
WORKLOA
D
C
WORKLOA
D
B
WORKLOA
D
C
USE CASE
3WORKLOA
D
B
WORKLOA
D
C
WORKLOA
D
D
13 © 2014 SILICON VALLEY DATA SCIENCE LLC. ALL RIGHTS RESERVED.
THE DATA VALUE CHAIN
How data can be understood strategically
Discover Ingest Process Persist Integrate Analyze Expose
1414 © 2014 SILICON VALLEY DATA SCIENCE LLC. ALL RIGHTS RESERVED.
• Make it cheap
• Failure as a feature
• Ask good questions
• Make it quick
• Both learning and
adaptation
• Enable the feedback
loop
• Don’t break things
• Make operations a
platform for innovation
• APIs, platforms, simulation
BUILD FOR
EXPERIMENTS
15 © 2014 SILICON VALLEY DATA SCIENCE LLC. ALL RIGHTS RESERVED.
THE EXPERIMENTAL ENTERPRISE
We need to both support investigative
work and build a solid layer for
production.
Data science allows us to observe our
experiments and respond to the
changing environment.
The foundation of the experimental
enterprise focuses on making
infrastructure readily accessible.
16 © 2014 SILICON VALLEY DATA SCIENCE LLC. ALL RIGHTS RESERVED.
BECOME DATA NATIVE
• Can only win with situational awareness
• New architectures offer new opportunities
• Creation of data-driven value requires new
approach
• Business must lead, and understand the potential
of the technology
17
Edd Dumbill
edd@svds.com
@edd
Yes, we’re hiring!
info@svds.com

More Related Content

PPTX
Information Technology Discipline: Cleaning House
PDF
Top 5 Apps for Property Managers (Alameda Chapter)
PDF
I've got an iPad, now what?
PDF
Pecha Kucha: Internet of Things (IoT)
PDF
CloudCamp Chicago - Healthcare IT
PPTX
How software is eating the world
PDF
The Internet of Things - Software is eating the world, Industry, and everythi...
PDF
Mobile Is Eating the World (2015)
Information Technology Discipline: Cleaning House
Top 5 Apps for Property Managers (Alameda Chapter)
I've got an iPad, now what?
Pecha Kucha: Internet of Things (IoT)
CloudCamp Chicago - Healthcare IT
How software is eating the world
The Internet of Things - Software is eating the world, Industry, and everythi...
Mobile Is Eating the World (2015)

Similar to Software is Eating the World, And You're For Lunch" (20)

PDF
DutchMLSchool 2022 - A Data-Driven Company
PDF
The New Model
PDF
Disrupting with Data: Lessons from Silicon Valley
PDF
Lunch and Learn: You have the data, now what?
PDF
Piloting Big Data: Where To Start? - StampedeCon 2014
PDF
Architecting for Data Science
PDF
Data Resource Management: Good Practices to Make the Most out of a Hidden Tre...
PPTX
Jads arjan van den born
PPTX
Matt McIlwain opening keynote
PDF
ADV Slides: Data Curation for Artificial Intelligence Strategies
PDF
Data science, self learning algorithms (by Alexander Frimout & Max Nie)
PDF
Data Modelling For Software Engineers (Poland).pdf
PDF
Introduction to big data for the EA course at Solvay MBA
PDF
Digital Transformation Summit 2024 - Edinburgh
PDF
Industrial Data Science
PPTX
Big data analytics presented at meetup big data for decision makers
PDF
Data Modelling For Software Engineers (Full).key.pdf
PDF
Training Taster: Leading the way to become a data-driven organization
PDF
10 ways to stumble with big data
PDF
Data Modelling For Software Engineers V2.pdf
DutchMLSchool 2022 - A Data-Driven Company
The New Model
Disrupting with Data: Lessons from Silicon Valley
Lunch and Learn: You have the data, now what?
Piloting Big Data: Where To Start? - StampedeCon 2014
Architecting for Data Science
Data Resource Management: Good Practices to Make the Most out of a Hidden Tre...
Jads arjan van den born
Matt McIlwain opening keynote
ADV Slides: Data Curation for Artificial Intelligence Strategies
Data science, self learning algorithms (by Alexander Frimout & Max Nie)
Data Modelling For Software Engineers (Poland).pdf
Introduction to big data for the EA course at Solvay MBA
Digital Transformation Summit 2024 - Edinburgh
Industrial Data Science
Big data analytics presented at meetup big data for decision makers
Data Modelling For Software Engineers (Full).key.pdf
Training Taster: Leading the way to become a data-driven organization
10 ways to stumble with big data
Data Modelling For Software Engineers V2.pdf
Ad

More from Extract Data Conference (17)

PPTX
Andrew Ng, Chief Scientist at Baidu
PDF
Utilizing social data to connect brands to celebrities
PDF
Anomaly Detection for Global Scale at Netflix
PPTX
The Death of The Unpaid Internship
PPTX
Search Secrets Revealed: What Ranks in Google and Why
PDF
Search Inside Your Data
PPTX
Lessons from 2MM machine learning models
PDF
Grand Explorers: What We Can Learn From Data Innovators
PDF
Fashematics: The Science of Colour
PPTX
Visualising Flux: Storytelling with Time, Space & Torque
PPTX
Martins Vaivers, inforgr.am: "Data Beauty and Democracy"
PPTX
Stephen Follows, Founder of Catsnake Films: "Big Screen Data"
PPTX
Paul joyce, Founder & CEO at Geckoboard: "Brain Hacking: Designing Data for R...
PPTX
Ben Rush, CEO of AudioLock: "Fighting Content with Data Privacy"
PDF
Andrew Fogg, Founder & CDO at import.io: "Sex, Drugs & Data: UK GDP Redux"
PDF
Eric Williams, Data Scientist at Omada Health: "Data vs Donuts: Inspiring Hea...
PPTX
Alyson Murphy, Senior Data Analyst at Moz: "The Human Side of Business Analy...
Andrew Ng, Chief Scientist at Baidu
Utilizing social data to connect brands to celebrities
Anomaly Detection for Global Scale at Netflix
The Death of The Unpaid Internship
Search Secrets Revealed: What Ranks in Google and Why
Search Inside Your Data
Lessons from 2MM machine learning models
Grand Explorers: What We Can Learn From Data Innovators
Fashematics: The Science of Colour
Visualising Flux: Storytelling with Time, Space & Torque
Martins Vaivers, inforgr.am: "Data Beauty and Democracy"
Stephen Follows, Founder of Catsnake Films: "Big Screen Data"
Paul joyce, Founder & CEO at Geckoboard: "Brain Hacking: Designing Data for R...
Ben Rush, CEO of AudioLock: "Fighting Content with Data Privacy"
Andrew Fogg, Founder & CDO at import.io: "Sex, Drugs & Data: UK GDP Redux"
Eric Williams, Data Scientist at Omada Health: "Data vs Donuts: Inspiring Hea...
Alyson Murphy, Senior Data Analyst at Moz: "The Human Side of Business Analy...
Ad

Recently uploaded (20)

PPTX
Training Program for knowledge in solar cell and solar industry
PPTX
Internet of Everything -Basic concepts details
PPTX
SGT Report The Beast Plan and Cyberphysical Systems of Control
PDF
Improvisation in detection of pomegranate leaf disease using transfer learni...
PPTX
GROUP4NURSINGINFORMATICSREPORT-2 PRESENTATION
PDF
Transform-Your-Streaming-Platform-with-AI-Driven-Quality-Engineering.pdf
PDF
Enhancing plagiarism detection using data pre-processing and machine learning...
PPTX
Module 1 Introduction to Web Programming .pptx
PDF
Auditboard EB SOX Playbook 2023 edition.
PDF
Lung cancer patients survival prediction using outlier detection and optimize...
PDF
Introduction to MCP and A2A Protocols: Enabling Agent Communication
PDF
NewMind AI Weekly Chronicles – August ’25 Week IV
PDF
Transform-Your-Supply-Chain-with-AI-Driven-Quality-Engineering.pdf
PDF
A hybrid framework for wild animal classification using fine-tuned DenseNet12...
PPTX
AI-driven Assurance Across Your End-to-end Network With ThousandEyes
PDF
Dell Pro Micro: Speed customer interactions, patient processing, and learning...
PDF
Advancing precision in air quality forecasting through machine learning integ...
DOCX
Basics of Cloud Computing - Cloud Ecosystem
PDF
4 layer Arch & Reference Arch of IoT.pdf
PDF
Convolutional neural network based encoder-decoder for efficient real-time ob...
Training Program for knowledge in solar cell and solar industry
Internet of Everything -Basic concepts details
SGT Report The Beast Plan and Cyberphysical Systems of Control
Improvisation in detection of pomegranate leaf disease using transfer learni...
GROUP4NURSINGINFORMATICSREPORT-2 PRESENTATION
Transform-Your-Streaming-Platform-with-AI-Driven-Quality-Engineering.pdf
Enhancing plagiarism detection using data pre-processing and machine learning...
Module 1 Introduction to Web Programming .pptx
Auditboard EB SOX Playbook 2023 edition.
Lung cancer patients survival prediction using outlier detection and optimize...
Introduction to MCP and A2A Protocols: Enabling Agent Communication
NewMind AI Weekly Chronicles – August ’25 Week IV
Transform-Your-Supply-Chain-with-AI-Driven-Quality-Engineering.pdf
A hybrid framework for wild animal classification using fine-tuned DenseNet12...
AI-driven Assurance Across Your End-to-end Network With ThousandEyes
Dell Pro Micro: Speed customer interactions, patient processing, and learning...
Advancing precision in air quality forecasting through machine learning integ...
Basics of Cloud Computing - Cloud Ecosystem
4 layer Arch & Reference Arch of IoT.pdf
Convolutional neural network based encoder-decoder for efficient real-time ob...

Software is Eating the World, And You're For Lunch"

  • 1. SOFTWARE IS EATING THE WORLD, AND YOU’RE FOR LUNCH! Edd Dumbill @edd • [email protected]
  • 2. 2 © 2014 SILICON VALLEY DATA SCIENCE LLC. ALL RIGHTS RESERVED.
  • 3. 3 “… let's seek to understand how the new generation of technology companies are doing what they do, what the broader consequences are for businesses and the economy and what we can collectively do to expand the number of innovative new software companies created in the U.S. and around the world.” – Marc Andreesen
  • 4. 4 © 2014 SILICON VALLEY DATA SCIENCE LLC. ALL RIGHTS RESERVED. DIGITAL NERVOUS SYSTEM
  • 5. 5 Data is your business
  • 6. 6 © 2014 SILICON VALLEY DATA SCIENCE LLC. ALL RIGHTS RESERVED.
  • 7. 7 © 2014 SILICON VALLEY DATA SCIENCE LLC. ALL RIGHTS RESERVED. SILICON VALLEY’S DATA MACHINE
  • 8. 8 Where does it go wrong?
  • 9. 9 © 2014 SILICON VALLEY DATA SCIENCE LLC. ALL RIGHTS RESERVED. CLEAN VALIDATE CONTROL PROTECT CONVENTIONAL DATA STRATEGY “WHAT YOU DO TO DATA”
  • 10. 10 © 2014 SILICON VALLEY DATA SCIENCE LLC. ALL RIGHTS RESERVED. MODERN DATA STRATEGY “WHAT YOU DO WITH DATA” TARGET VIP CUSTOMERSATTRACT NEW CUSTOMERS AUTOMATE
  • 11. 11 © 2014 SILICON VALLEY DATA SCIENCE LLC. ALL RIGHTS RESERVED. UP vs. OUT in the Enterprise Different use cases put different demands on the data infrastructure. Increasing cost per unit of capability from scale- up architectures causes rationing of resources. Only the most valuable use cases are pursued. USDollars Data Resource Usage Scale-up cost Scale-out cost UC1 UC2 UC3 UC4 UC5
  • 12. 12 © 2014 SILICON VALLEY DATA SCIENCE LLC. ALL RIGHTS RESERVED. USE CASE 2 NEW TOOLS MAKE IT POSSIBLE USE CASE 1 WORKLOA D A WORKLOA D B WORKLOA D C WORKLOA D B WORKLOA D C USE CASE 3WORKLOA D B WORKLOA D C WORKLOA D D
  • 13. 13 © 2014 SILICON VALLEY DATA SCIENCE LLC. ALL RIGHTS RESERVED. THE DATA VALUE CHAIN How data can be understood strategically Discover Ingest Process Persist Integrate Analyze Expose
  • 14. 1414 © 2014 SILICON VALLEY DATA SCIENCE LLC. ALL RIGHTS RESERVED. • Make it cheap • Failure as a feature • Ask good questions • Make it quick • Both learning and adaptation • Enable the feedback loop • Don’t break things • Make operations a platform for innovation • APIs, platforms, simulation BUILD FOR EXPERIMENTS
  • 15. 15 © 2014 SILICON VALLEY DATA SCIENCE LLC. ALL RIGHTS RESERVED. THE EXPERIMENTAL ENTERPRISE We need to both support investigative work and build a solid layer for production. Data science allows us to observe our experiments and respond to the changing environment. The foundation of the experimental enterprise focuses on making infrastructure readily accessible.
  • 16. 16 © 2014 SILICON VALLEY DATA SCIENCE LLC. ALL RIGHTS RESERVED. BECOME DATA NATIVE • Can only win with situational awareness • New architectures offer new opportunities • Creation of data-driven value requires new approach • Business must lead, and understand the potential of the technology

Editor's Notes

  • #13: Next we have to consider: How will technology make it possible? This is where technologists need to take the reins Requires data and analytics expertise – exposure to and understanding of a rapidly changing landscape Describe the use cases – for each objective (the tactics from before) (from why to what to how) What will you actually build? (e.g., segment customers to discover VIPs, build predictive demand models, build user search capability) Exploit patterns and reuse - platforms, services, workloads Look across *all* the use cases What are the common workloads you can make use of? (e.g., social media sentiment analysis, customer product intelligence, and customer service call transcript analysis all share a common need for some form of text analytics)
  • #23: Focus on the value You’ve identified what you could build and even how you might build it efficiently Lots of things you *can* do, but what should you do *first* Prioritize your efforts - Not all projects are created equal What matters most to the business? (hint: prioritize the business’s goals first, *not* projects or use cases) Considers many different dimensions of priority (e.g. skills, difficulty, deployment) This helps you identify where you might find quick wins or black holes Overcome your assumptions and preconceptions (e.g., root out pet projects with real data) Because you did this together, you’ve got a shared sense of priority and a reason you’re headed down this path If someone is convinced that image processing is the most important technology project but that doesn’t line up with the business priorities, that will come out
  • #24: Build a roadmap to give you direction Using that combined notion of priorities Fuel agile development with an end-point in mind Use the strategy to identify a pipeline of projects that take you toward your goal Even though we’re talking about agile, the Goal of the roadmap is still to produce a sustainable architecture based on a platform
  • #25: Analysis is at a point in time Meant to be a repeatable process Re-assess priorities, difficulties, plans often Respond to changes in priorities, changes in the market, or new technology possibilities Your strategy should be a living document that guides you