Top 10 Big Data Technologies | Edureka
7 likes•379 views
The document discusses various big data technologies, describing their purpose, developer, programming languages used, and current stable versions. It covers technologies for data storage like Hadoop, MongoDB, and Splunk Hunk. Data mining technologies mentioned include Presto, RapidMiner, and Elasticsearch. Data analytics technologies covered are Apache Kafka, Splunk, KNIME, Apache Spark, and R-Language. The document also discusses data visualization technologies like Tableau and Plotly, as well as emerging technologies like TensorFlow, Apache Beam, Docker, Apache Airflow, and Kubernetes.
Top 10 Big Data Technologies | Edureka
- 1. Copyright © 2017, edureka and/or its affiliates. All rights reserved.
- 3. TYPES OF BIG-DATA TECHNOLOGIES TOP BIG-DATA TECHNOLOGIES www.edureka.co WHAT IS A BIG-DATA TECHNOLOGY? UPCOMING BIG-DATA TECHNOLOGIES
- 4. WHAT IS A BIG-DATA TECHNOLOGY?
- 5. Big-data technologies are used to perform accurate analysis to generate conclusions and predictions so as to minimise the risks in real-time. BIG-DATA TECHNOLOGY www.edureka.co WHAT IS A BIG-DATA TECHNOLOGY?
- 6. TYPES OF BIG-DATA TECHNOLOGIES
- 7. www.edureka.co TYPES OF BIG-DATA TECHNOLOGIES Big Data Is mainly divided into two types: • Operational Big-Data • Analytical Big-Data
- 13. www.edureka.co Apache Hadoop • Distributed Data Processing Environment • Uses commodity hardware • Developed by: Apache Software Foundation in the year 2011 10th of Dec. • Written in: JAVA • Current stable version: Hadoop 3.11
- 14. www.edureka.co
- 15. www.edureka.co MongoDB • NoSQL document database • Developed by: MongoDB in the year 2009 11th of Feb • Written in: C++, Go, JavaScript, Python • Current stable version: MongoDB 4.0.10
- 16. www.edureka.co
- 17. www.edureka.co RainStor • Uses Deduplication Technique • Developed by: RainStor Software company in the year 2004. • Works like: SQL • Current stable version: RainStor 5.5
- 18. www.edureka.co
- 19. www.edureka.co Splunk Hunk • Access data from remote Hadoop Clusters. • Developed by: Splunk INC in the year 2013. • Written in: JAVA • Current stable version: Splunk 6.2
- 21. www.edureka.co Presto • Open Source Distributed SQL Query Engine • Developed by: Apache Foundation in the year 2013. • Written in: JAVA • Current stable version: Presto 0.22
- 22. www.edureka.co
- 23. www.edureka.co RapidMiner • Powerful and Robust Graphical User Interface. • Developed by: RapidMiner in the year 2001 • Written in: JAVA • Current stable version: RapidMiner 9.2
- 24. www.edureka.co
- 25. www.edureka.co ElasticSearch • Based on Lucene Library • Developed by: Elastic NV in the year 2012. • Written in: JAVA • Current stable version: ElasticSearch 7.1
- 26. www.edureka.co
- 28. www.edureka.co Apache Kafka • Distributed Streaming Platform • Developed by: Apache Software Foundation in the year 2011 • Written in: Scala, JAVA • Current stable version: Apache Kafka 2.2.0
- 29. www.edureka.co
- 30. www.edureka.co Splunk • Used in Application Management, Web Analytics and Security and compliance • Developed by: Splunk INC in the year 2014 6th May • Written in: AJAX, C++, Python, XML • Current stable version: Splunk 7.3
- 31. www.edureka.co
- 32. www.edureka.co KNIME • Used to create Data Flows and uses Extension Mechanism • Developed by: KNIME in the year 2008 • Written in: JAVA • Current stable version: KNIME 3.7.2
- 33. www.edureka.co
- 34. www.edureka.co Apache Spark • Cluster computing tool. • Developed by: Apache Software Foundation • Written in: JAVA, Scala, Python, R • Current stable version: Apache Spark 2.4.3
- 35. www.edureka.co
- 36. www.edureka.co R-Language • Statistical Computing and Graphics. • Developed by: R-Foundation in the year 2000 29th Feb • Written in: Fortran • Current stable version: R-3.6.0
- 37. www.edureka.co
- 38. www.edureka.co Blockchain • Append Distributed System of Records • Business terms embedded transactions • Transaction Authentication • Network verified transactions • Developed by: Bitcoin • Written in: JavaScript, C++, Python • Current stable version: Blockchain 4.0
- 39. www.edureka.co
- 41. www.edureka.co TableAU • Creates NoCode data queries. • Can import all ranges of data sizes • Developed by: TableAU 2013 May 17th • Written in: JAVA, C++, Python, C • Current stable version: TableAU 8.2
- 42. www.edureka.co
- 43. www.edureka.co Plotly • Creates graphs faster and more efficient • Developed by: Plotly in the year 2012 • Written in: JavaScript • Current stable version: Plotly 1.47.4
- 44. www.edureka.co
- 47. www.edureka.co TensorFlow • End to End open source platform for Machine Learning • Developed by: Google Brain Team in the year 2019 • Written in: Python, C++, CUDA • Current stable version: TensorFlow 2.0 beta
- 48. www.edureka.co
- 49. www.edureka.co Apache Beam • Provides Portable API Layer. • Developed by: Apache Software Foundation in the year 2016 June 15th • Written in: JAVA, Python • Current stable version: Apache Beam 0.1.0 incubating.
- 50. www.edureka.co
- 51. www.edureka.co Docker • Create, Deploy and Run Applications using Containers • Developed by: Docker INC in the year 2003 13th of March. • Written in: Go • Current stable version: Docker 18.09
- 52. www.edureka.co
- 53. www.edureka.co Apache AirFlow • Work Flow automation and Scheduling system • Developed by: Apache Software Foundation on May 15th 2019 • Written in: Python • Current stable version: Apache AirFlow 1.10.3
- 54. www.edureka.co
- 55. www.edureka.co Kubernetes • Vendor Agnostic Cluster. • Developed by: Cloud Native Computing Foundation in the year 2015 21st of July • Written in: Go • Current stable version: Kubernetes 1.14
- 56. www.edureka.co
- 58. www.edureka.co