BDW16 London - Alex Bordei, Bigstep - Building Data Labs in the Cloud
0 likes224 views
Building Data Labs in the Cloud summarizes how to build data labs in the cloud by connecting on-premise services through VPN or targeted firewalls, integrating identity services between on-premise and cloud realms, enabling single sign-on with two-factor authentication, using encryption with cloud or on-premise HSMs, leveraging Spark for data science, SQL, ETL, machine learning and graph processing, adopting a multi-context architecture for maintenance and efficiency, and ensuring real-time systems provide performance, stability, serviceability and fault tolerance.
1 of 25
More Related Content
What's hot (20)
Ad
Viewers also liked (20)
Ad
Similar to BDW16 London - Alex Bordei, Bigstep - Building Data Labs in the Cloud (20)
More from Big Data Week (10)
BDW16 London - Alex Bordei, Bigstep - Building Data Labs in the Cloud
- 1. Building Data Labs in the Cloud Alex Bordei Head of Product Management at Bigstep
- 14. Connecting to on-premise services - VPN
- 15. Connecting to on-premise services - Targeted Firewall
- 16. Identity Services integration - On-premises realm
- 17. Identity Services integration - cloud realm
- 18. Joined single sign on (for two factor auth)
- 19. • Hadoop’s Encryption (with KMS) • Third party Encryption with on-premise HSM • Cloud providers offer HSMs as well: CloudHSM Eg: Zettaset Encryption
- 21. HDFS+Spark Spark can do: 1. data science at scale 2. SQL on Hadoop 3. ETL 4. large scale data processing 5. machine learning 6. graph processing
- 22. Multi-Context Architecture - Rip and replace maintenance model - Multiplexing for resource utilization efficiency
- 23. Realtime = production The system will need to provide: - performance - stability - online serviceability - fault tolerance