Big data and your career final
Download as PPT, PDF•1 like•128 views
The document discusses the rise of big data and its impact on careers, focusing on its definition, usage across industries, and the necessary skills in demand for roles involving big data. It emphasizes that organizations are adopting big data for better decision-making, operational efficiency, and improved customer experiences, highlighting the importance of various technologies like Hadoop. Additionally, it outlines the types of data used and the evolving needs for foundational competencies in data, programming, and analytics as the field develops.
Big data and your career final
- 1. Big Data and Your Career Beyond the Classroom Marina Kerbel, Principal Information Architect at Deluxe Corporation November 12, 2013
- 2. Big Data Job Boom?
- 3. What is Big Data? Data that is obtained, processed, and analyzed using emerging technologies that can get any data in any format from any place and interpret it to get value. ‘hear what someone is whispering backstage while you're attending a booming outdoor concert.’ * * Source: TechRepublic 'Big Data basic concepts and benefits explained
- 4. Big Data – Hype vs. Reality Hype Reality 1. What makes the data ‘Big Data’? • Very large data sets • New technologies that help to obtain and process diverse, complex and dispersed data. 2. Who is using Big Data? • Internet giants like Google • Companies of all sizes and from all industries 3. Why do companies use Big Data? • Better decision making • Business - Customer Experience, Operational Efficiency • IT - Agility, Lower Cost 4. What data is being used? • Social and mobile data • Core transactional data 5. How do architecture & technology change? • Hadoop revolution • Incremental adds of Hadoop and other new technologies 6. What skills are in- demand? • Data Scientists with Ph.D. in Statistics • Big Data Architects, Software Engineers, or Business Analysts with a mix of old and new skills
- 5. What makes the data ‘Big Data’? Source: IBM ‘Big Data: Making the World go Round’ Big Data Platform helps reliably store, access and analyze any data regardless of how fast it is moving, what type it is, or where it resides. It's today's emerging technology that will help make sense of the Big Data Explosion.
- 6. Who is using Big Data? • Gartner 2013 Big Data Survey Reveals That 64 Percent of Organizations Have Invested or Plan to Invest in Big Data in 2013 • …The industries with the most planned investments over the next two years are transportation, with 50% planning to invest in big data technology, followed by healthcare at 41% and insurance companies at 40%. • However, every vertical industry again shows big data investment and planned investment….. Source: Gartner ‘Press Release - Gartner Survey Reveals That 64 Percent of Organizations Have Invested or Plan to Invest in Big Data in 2013’
- 7. Who is using Big Data? Source: Forrester ‘Forrsights Strategy Spotlight: Business Intelligence And Big Data, Q4 2012’
- 8. Why do companies use Big Data? Source: 2012 IBM and Said Business School study 'Analytics: the real world use of big data'
- 9. Why do companies use Big Data? Source: Forrester Blogs - Brian Hopkins' Blog I've found, in my direct interactions with firms, that leaders know the real value of big data is lower cost and greater agility. When I interviewed 11 firms with production-class big data implementations, all of them told me the same thing — they got into big data when they couldn't figure out how to accomplish what their business wanted in an affordable way with their existing technology.
- 10. What data is being used? Source: Forrester ‘Forrsights Strategy Spotlight: Business Intelligence And Big Data, Q4 2012’
- 11. How do architecture & technology change?SourcesData Systems Applications Traditional RDBMS Repositories (Oracle, DB2, SQLServer) Traditional Sources (Transactional data - CRM, ERP, custom applications) New Sources (Interaction data - Social Media, Web Logs , Emails, Video, Images, Sensors) Analytics OLTP EDW Custom Applications Packaged Applications Hadoop: MapReduce & HDFS NoSQL (HBase, MongoDB) InMemory (SAP Hana)
- 12. Use Case 1 - Implement Bill Payment service where customers can enter variable biller data in any order Who was using Big Data? Sales & Operations (Order Capture & Management) Why Big Data was used? Customer Experience, Operational Efficiency, Agility What data was used? Transactional data from corporate custom build application How did architecture & technology change? MongoDB added on front-end to allow capturing data incrementally and in variable format What skills were in- demand Programming, Databases, Data Modeling
- 13. Use Case 2 - Enable personalized campaigns that leverage prospect data from diverse sources Who was using Big Data? Marketing (Personalized Campaign) Why Big Data was used? Agility, Lower Integration Cost What data was used? Proprietary Prospect data + Third party data + Social Network data How did architecture & technology change? IBM BigInsighs and Amazon Web Services used to integrate and analyze data from diverse, frequently changing sources What skills were in- demand Integration, Cloud, Analytics, BI, Visualization
- 14. Use Case 3 - Leverage data from dropped website visits to entice customers to complete orders Who was using Big Data? Sales (User Experience) Why Big Data was used? Customer Experience, Performance What data was used? Transactional data from corporate packaged application + Weblog data from public facing site How did architecture & technology change? SAP Hana and Amazon Web Services used to integrate data real- time What skills were in- demand Integration, Cloud, Data Modeling
- 15. What skills are in-demand? Software Engineers Data Scientists Business Analysts Technical Business Capture, Integrate Discover, Explore Analyze, Present Programming Databases Data Modeling Cloud Integration Math Statistics Curiosity Data Story Analytics, BI Visualization Business Acumen Big Data Architects
- 16. What skills are in-demand? Source: Talent Neuron 'Understanding Big Data Skills Taxonomy'
- 17. What skills are in-demand? Source: Data Science Central ‘Top Big Data Skills in Demand’ posted by Fari Payandeh Immediate Needs
- 18. What skills are in-demand? Long-Term Skills • As Big Data matures, too much focus on a specific product might be counterproductive • The skills needed today and tomorrow: – Foundational data competencies (Data Modeling, Databases, Programming) – Knowing when to use traditional standards and when to break them – Some knowledge of math, statistics, analytics – Business acumen and ability to see the big picture – Ability to quickly learn various new approaches and technologies
- 19. How to Acquire Skills - Examples – Foundational data competencies – C.S. classes – Knowing when to use traditional standards and when to break them – published vendor documentation – Some knowledge of math, statistics, analytics – elective classes – Business acumen and ability to see the big picture – MBA classes, webinars and publications with business use cases from major vendors, on-the-job experience – Ability to quickly learn various new approaches and technologies – many free education sites and downloads such as http://bigdatauniversity.com/ What skills are in-demand?
- 20. Big Data – Hype vs. Reality Hype Reality 1. What makes the data ‘Big Data’? • Very large data sets • New technologies that help to obtain and process diverse, complex and dispersed data. 2. Who is using Big Data? • Internet giants like Google • Companies of all sizes and from all industries 3. Why do companies use Big Data? • Better decision making • Business - Customer Experience, Operational Efficiency • IT - Agility, Lower Cost 4. What data is being used? • Social and mobile data • Core transactional data 5. How do architecture & technology change? • Hadoop revolution • Incremental adds of Hadoop and other new technologies 6. What skills are in- demand? • Data Scientists with Ph.D. in Statistics • Big Data Architects, Software Engineers, or Business Analysts with a mix of old and new skills
- 21. Questions
- 22. References and Resources • TechRepublic 'Big Data basic concepts and benefits explained' • Gartner ‘Information 2020: Evolving Beyond Big Data’ (Free Webinar) • Gartner ‘Press Release - Gartner Survey Reveals That 64 Percent of Organizations Have Invested or Plan to Invest in Big Data in 2013’ • IBM ‘Big Data: Making the World go Round’ • IBM ‘Analytics: The real-world use of big data’ • Forrester ‘Forrsights Strategy Spotlight: Business Intelligence And Big Data, Q4 2012’ • Forrester Blog: Brian Hopkins • Talent Neuron 'Understanding Big Data Skills Taxonomy' • Data Science Central ‘Top Big Data Skills in Demand’ • Big Data University • MongoDB Introduction • MongoDB Data Modeling
Editor's Notes
- #3: Gartner predicts that there will be demand for 4.4 million big data jobs by 2015, with 1.9 million of those positions being created in the United States.