Advanced Spark and Tensorflow Meetup - London - Nov 15, 2016 - Deploy Spark ML and Tensorflow AI Models from Dev Notebooks to Prod Microservices
4 likes741 views
The document outlines a meetup held on November 15, 2016, focusing on deploying Spark and TensorFlow models into production, highlighting the impact of Pipeline.io and updates on Spark and TensorFlow. It shares metrics on the growing community, successful workshops, and future plans for performance and expansion in 2017. The session included demonstrations on model deployment, scaling, and dynamic code generation.
Advanced Spark and Tensorflow Meetup - London - Nov 15, 2016 - Deploy Spark ML and Tensorflow AI Models from Dev Notebooks to Prod Microservices
- 1. ADVANCED SPARK AND TENSORFLOW MEETUP Deploy Spark andTensorflow Models: From Notebook Dev to Microservice Prod London - November 15, 2016 ThankYou, PipelineIO,Rise, Barclays! http://pipeline.io
- 2. MEETUP AGENDA • Meetup Updates, Metrics, and Announcements • Spark Updates • Tensorflow Updates • Deploying and Scaling ML Models from Notebook to Production with PipelineIO (Chris Fregly, PipelineIO)
- 3. WHO AM I? Chris Fregly -------- Research Scientist @ PipelineIO (Formerly Netflix and Databricks) -------- http://pipeline.io
- 4. WHO ARE YOU? --Techies of London --
- 5. FUN WORKSHOP LAST MONTH (HERE IN LONDON)
- 6. MEETUP METRICS • 10,000+ Members Globally in 1Year! • 5,000 Members in San Francisco (Home) • Github Repo: 900 Stars, 300 Forks • DockerHub Repo: 6,200 Pulls
- 8. SPARK SUMMIT EU 2016 (BRUSSELS) • https://spark-summit.org/eu-2016/schedule/ • Structured Streaming (2 talks) • ML + Structured Streaming (1 talks) • ML Model Deployment (2 talks) • Spark Performance (4 talks)
- 10. TENSORFLOW WORKSHOP • Great Workshop From Google Directly • Finally, training involving more than MNIST! • Slides • http://bit.ly/tf-workshop-slides • Workshop • https://github.com/amygdala/tensorflow-workshop
- 11. WHAT IS PIPELINE.IO? ExtendingYour ML Pipelines into Production 100% Open Source! http://pipeline.io
- 12. BRAINSTORMING AND VALIDATING • Major Gaming Company • Large Ride Sharing Service • Popular Q & A Site • Online Clothing Retailer • DominantVideo Streaming
- 13. PIPELINE.IO FOCUS • Model Deploying andTesting • Model Scaling and Serving • Online ModelTraining • Dynamic Model Optimizing
- 14. MODEL DEPLOYING AND TESTING Continuously Test and Deploy Models in Production!
- 15. MODEL SCALING AND SERVING
- 16. ONLINE MODEL TRAINING • Continuous, Incremental, and Partial Training • Kafka + Spark Streaming + Spark ML • Real-time, Dynamic Recommendations
- 17. DYNAMIC MODEL OPTIMIZING Generate Optimized Code from Spark ML!
- 19. PIPELINE.IO PLAN FOR 2017 • Performance • Code Generation: CPU and GPU • Continued Global Expansion
- 20. MORE WORKSHOPS IN 2017
- 21. WE’RE HIRING!! • Kafka, Spark ML, and TensorFlow Contributors • Systems Engineers • GPU/CUDA Engineers • C++, Java, Scala, Python WE ONLY HIRE NICE PEOPLE!!
- 22. DEMO! Circuit Breakers and Request Batching
- 23. DEMO! Deploy Spark ML DecisionTree to Production Deploy to Cloud or On-Premise!
- 24. DEMO! Dynamic Code Generation of DecisionTree