ML DL AI DS BD - An Introduction
7 likes8,640 views
The document provides an overview of machine learning, deep learning, artificial intelligence, and data science, including definitions, classifications, and applications of various algorithms such as supervised, unsupervised, and reinforcement learning. It also distinguishes between machine learning and data mining, while exploring deep learning's impact across several fields and the growing significance of big data analytics. The document emphasizes the importance of integrating data analysis and business intelligence to gain insights and competitive advantages in various sectors.
![Machine learning tasks
Machine learning tasks are typically classified into several broad categories:
• Supervised learning: The computer is presented with example inputs and their desired outputs, given by
a "teacher", and the goal is to learn a general rule that maps inputs to outputs. As special cases, the input
signal can be only partially available, or restricted to special feedback.
• Semi-supervised learning: The computer is given only an incomplete training signal: a training set with
some (often many) of the target outputs missing.
• Active learning: The computer can only obtain training labels for a limited set of instances (based on a
budget), and also has to optimize its choice of objects to acquire labels for. When used interactively, these
can be presented to the user for labeling.
• Unsupervised learning: No labels are given to the learning algorithm, leaving it on its own to find
structure in its input. Unsupervised learning can be a goal in itself (discovering hidden patterns in data) or
a means towards an end (feature learning).
• Reinforcement learning: Data (in form of rewards and punishments) are given only as feedback to the
program's actions in a dynamic environment, such as driving a vehicle or playing a game against an
opponent.[4]:3](https://image.slidesharecdn.com/mldlaidsbddaintroduction-190313080904/85/ML-DL-AI-DS-BD-An-Introduction-4-320.jpg)
![Deep Learning (contd)
• Most modern deep learning models are based on an artificial neural network, although they can also
include propositional formulas or latent variables organized layer-wise in deep generative models such as
the nodes in deep belief networks and deep Boltzmann machines.
• In deep learning, each level learns to transform its input data into a slightly more abstract and composite
representation. In an image recognition application, the raw input may be a matrix of pixels; the first
representational layer may abstract the pixels and encode edges; the second layer may compose and
encode arrangements of edges; the third layer may encode a nose and eyes; and the fourth layer may
recognize that the image contains a face. Importantly, a deep learning process can learn which features to
optimally place in which level on its own. (Of course, this does not completely obviate the need for hand-
tuning; for example, varying numbers of layers and layer sizes can provide different degrees of
abstraction.)
• The "deep" in "deep learning" refers to the number of layers through which the data is transformed.
More precisely, deep learning systems have a substantial credit assignment path (CAP) depth. The CAP
is the chain of transformations from input to output. CAPs describe potentially causal connections
between input and output. For a feedforward neural network, the depth of the CAPs is that of the network
and is the number of hidden layers plus one (as the output layer is also parameterized). For recurrent
neural networks, in which a signal may propagate through a layer more than once, the CAP depth is
potentially unlimited.[2] No universally agreed upon threshold of depth divides shallow learning from deep
learning, but most researchers agree that deep learning involves CAP depth > 2. CAP of depth 2 has
been shown to be a universal approximator in the sense that it can emulate any function.[citation needed]
Beyond that more layers do not add to the function approximator ability of the network. Deep models
(CAP > 2) are able to extract better features than shallow models and hence, extra layers help in learning
features.](https://image.slidesharecdn.com/mldlaidsbddaintroduction-190313080904/85/ML-DL-AI-DS-BD-An-Introduction-14-320.jpg)
![Data Analysis
• Data analysis is a process of inspecting, cleansing, transforming, and modeling data with the goal
of discovering useful information, informing conclusions, and supporting decision-making. Data analysis
has multiple facets and approaches, encompassing diverse techniques under a variety of names, while
being used in different business, science, and social science domains.
• Data mining is a particular data analysis technique that focuses on modeling and knowledge discovery
for predictive rather than purely descriptive purposes, while business intelligence covers data analysis
that relies heavily on aggregation, focusing mainly on business information.[1] In statistical applications,
data analysis can be divided into descriptive statistics, exploratory data analysis (EDA), and confirmatory
data analysis (CDA). EDA focuses on discovering new features in the data while CDA focuses on
confirming or falsifying existing hypotheses. Predictive analytics focuses on application of statistical
models for predictive forecasting or classification, while text analytics applies statistical, linguistic, and
structural techniques to extract and classify information from textual sources, a species of unstructured
data. All of the above are varieties of data analysis.
• Data integration is a precursor to data analysis,[according to whom?] and data analysis is closely
linked[how?] to data visualization and data dissemination. The term data analysis is sometimes used as a
synonym for data modeling.](https://image.slidesharecdn.com/mldlaidsbddaintroduction-190313080904/85/ML-DL-AI-DS-BD-An-Introduction-21-320.jpg)
More Related Content
Similar to ML DL AI DS BD - An Introduction (20)
![BBC NW_Tech Facilities_30 Odd Yrs Ago [J].pdf](https://cdn.slidesharecdn.com/ss_thumbnails/bbcnwtechfacilities30oddyrsagoj-250830230619-0d747bd6-thumbnail.jpg?width=560&fit=bounds)
ML DL AI DS BD - An Introduction
- 1. Machine Learning, Deep Learning, AI, Big Data, Data Science, Data Analytics by Dony Riyanto Prepared and Presented to Panin Asset Management January 2019
- 3. Machine Learning • Machine (ML) is a field of artificial intelligence that uses statistical techniques to give computer systems the ability to "learn" (e.g., progressively improve performance on a specific task) from data, without being explicitly programmed.
- 4. Machine learning tasks Machine learning tasks are typically classified into several broad categories: • Supervised learning: The computer is presented with example inputs and their desired outputs, given by a "teacher", and the goal is to learn a general rule that maps inputs to outputs. As special cases, the input signal can be only partially available, or restricted to special feedback. • Semi-supervised learning: The computer is given only an incomplete training signal: a training set with some (often many) of the target outputs missing. • Active learning: The computer can only obtain training labels for a limited set of instances (based on a budget), and also has to optimize its choice of objects to acquire labels for. When used interactively, these can be presented to the user for labeling. • Unsupervised learning: No labels are given to the learning algorithm, leaving it on its own to find structure in its input. Unsupervised learning can be a goal in itself (discovering hidden patterns in data) or a means towards an end (feature learning). • Reinforcement learning: Data (in form of rewards and punishments) are given only as feedback to the program's actions in a dynamic environment, such as driving a vehicle or playing a game against an opponent.[4]:3
- 5. ML Diagram
- 6. ML Diagram
- 7. 1. Regression Algorithms • Ordinary Least Squares Regression (OLSR) • Linear Regression • Logistic Regression • Stepwise Regression • Multivariate Adaptive Regression Splines (MARS) • Locally Estimated Scatterplot Smoothing (LOESS) 2. Instance-based Algorithms • k-Nearest Neighbour (kNN) • Learning Vector Quantization (LVQ) • Self-Organizing Map (SOM) • Locally Weighted Learning (LWL) 3. Regularization Algorithms • Ridge Regression • Least Absolute Shrinkage and Selection Operator (LASSO) • Elastic Net • Least-Angle Regression (LARS) 4. Decision Tree Algorithms • Classification and Regression Tree (CART) • Iterative Dichotomiser 3 (ID3) • C4.5 and C5.0 (different versions of a powerful approach) • Chi-squared Automatic Interaction Detection (CHAID) • Decision Stump • M5 • Conditional Decision Trees 5. Bayesian Algorithms • Naive Bayes • Gaussian Naive Bayes • Multinomial Naive Bayes • Averaged One-Dependence Estimators (AODE) • Bayesian Belief Network (BBN) • Bayesian Network (BN) 6. Clustering Algorithms • k-Means • k-Medians • Expectation Maximisation (EM) • Hierarchical Clustering
- 8. 7. Association Rule Learning Algorithms • Apriori algorithm • Eclat algorithm 8. Artificial Neural Network Algorithms • Perceptron • Back-Propagation • Hopfield Network • Radial Basis Function Network (RBFN) 9. Deep Learning Algorithms • Deep Boltzmann Machine (DBM) • Deep Belief Networks (DBN) • Convolutional Neural Network (CNN) • Stacked Auto-Encoders 10. Dimensionality Reduction Algorithms • Principal Component Analysis (PCA) • Principal Component Regression (PCR) • Partial Least Squares Regression (PLSR) • Sammon Mapping • Multidimensional Scaling (MDS) • Projection Pursuit • Linear Discriminant Analysis (LDA) • Mixture Discriminant Analysis (MDA) • Quadratic Discriminant Analysis (QDA) • Flexible Discriminant Analysis (FDA) 11. Ensemble Algorithms • Boosting • Bootstrapped Aggregation (Bagging) • AdaBoost • Stacked Generalization (blending) • Gradient Boosting Machines (GBM) • Gradient Boosted Regression Trees (GBRT) • Random Forest 12. Other Algorithms • Computational intelligence (evolutionary algorithms, etc.) • Computer Vision (CV) • Natural Language Processing (NLP) • Recommender Systems • Reinforcement Learning • Graphical Models
- 9. Machine learning applications Another categorization of machine learning tasks arises when one considers the desired output of a machine-learned system: • In classification, inputs are divided into two or more classes, and the learner must produce a model that assigns unseen inputs to one or more (multi-label classification) of these classes. This is typically tackled in a supervised way. Spam filtering is an example of classification, where the inputs are email (or other) messages and the classes are "spam" and "not spam". • In regression, also a supervised problem, the outputs are continuous rather than discrete. • In clustering, a set of inputs is to be divided into groups. Unlike in classification, the groups are not known beforehand, making this typically an unsupervised task. • Density estimation finds the distribution of inputs in some space. • Dimensionality reduction simplifies inputs by mapping them into a lower-dimensional space. Topic modeling is a related problem, where a program is given a list of human language documents and is tasked to find out which documents cover similar topics. • Among other categories of machine learning problems, learning to learn learns its own inductive bias based on previous experience. Developmental learning, elaborated for robot learning, generates its own sequences (also called curriculum) of learning situations to cumulatively acquire repertoires of novel skills through autonomous self-exploration and social interaction with human teachers and using guidance mechanisms such as active learning, maturation, motor synergies, and imitation.
- 10. Relation to Data Mining Machine learning and data mining often employ the same methods and overlap significantly, but while machine learning focuses on prediction, based on known properties learned from the training data, data mining focuses on the discovery of (previously) unknown properties in the data (this is the analysis step of knowledge discovery in databases). Data mining uses many machine learning methods, but with different goals; on the other hand, machine learning also employs data mining methods as "unsupervised learning" or as a preprocessing step to improve learner accuracy. Much of the confusion between these two research communities (which do often have separate conferences and separate journals, ECML PKDD being a major exception) comes from the basic assumptions they work with: in machine learning, performance is usually evaluated with respect to the ability to reproduce known knowledge, while in knowledge discovery and data mining (KDD) the key task is the discovery of previously unknown knowledge. Evaluated with respect to known knowledge, an uninformed (unsupervised) method will easily be outperformed by other supervised methods, while in a typical KDD task, supervised methods cannot be used due to the unavailability of training data.
- 11. When to use Machine Learning
- 12. ML between AI and DL
- 13. Deep Learning • Deep learning (also known as deep structured learning or hierarchical learning) is part of a broader family of machine learning methods based on learning data representations, as opposed to task-specific algorithms. Learning can also be supervised, semi-supervised or unsupervised. • Deep learning architectures such as deep neural networks, deep belief networks and recurrent neural networks have been applied to fields including computer vision, speech recognition, natural language processing, audio recognition, social network filtering, machine translation, bioinformatics, drug design, medical image analysis, material inspection and board game programs, where they have produced results comparable to and in some cases superior to human experts. • Deep learning models are vaguely inspired by information processing and communication patterns in biological nervous systems yet have various differences from the structural and functional properties of biological brains (especially human brains), which make them incompatible with neuroscience evidences.
- 14. Deep Learning (contd) • Most modern deep learning models are based on an artificial neural network, although they can also include propositional formulas or latent variables organized layer-wise in deep generative models such as the nodes in deep belief networks and deep Boltzmann machines. • In deep learning, each level learns to transform its input data into a slightly more abstract and composite representation. In an image recognition application, the raw input may be a matrix of pixels; the first representational layer may abstract the pixels and encode edges; the second layer may compose and encode arrangements of edges; the third layer may encode a nose and eyes; and the fourth layer may recognize that the image contains a face. Importantly, a deep learning process can learn which features to optimally place in which level on its own. (Of course, this does not completely obviate the need for hand- tuning; for example, varying numbers of layers and layer sizes can provide different degrees of abstraction.) • The "deep" in "deep learning" refers to the number of layers through which the data is transformed. More precisely, deep learning systems have a substantial credit assignment path (CAP) depth. The CAP is the chain of transformations from input to output. CAPs describe potentially causal connections between input and output. For a feedforward neural network, the depth of the CAPs is that of the network and is the number of hidden layers plus one (as the output layer is also parameterized). For recurrent neural networks, in which a signal may propagate through a layer more than once, the CAP depth is potentially unlimited.[2] No universally agreed upon threshold of depth divides shallow learning from deep learning, but most researchers agree that deep learning involves CAP depth > 2. CAP of depth 2 has been shown to be a universal approximator in the sense that it can emulate any function.[citation needed] Beyond that more layers do not add to the function approximator ability of the network. Deep models (CAP > 2) are able to extract better features than shallow models and hence, extra layers help in learning features.
- 15. Deep Learning is Better Process of ML
- 16. DL Application • Automatic speech recognition • Image recognition • Visual art processing • Natural language processing • Drug discovery and toxicology • CRM • Recomendation Systems • Bioinformatics • Mobile advertising • Image restoration • Financial fraud detection • Military
- 18. Artificial Intelligence • Artificial intelligence (AI), sometimes called machine intelligence, is intelligence demonstrated by machines, in contrast to the natural intelligence displayed by humans and other animals. In computer science AI research is defined as the study of "intelligent agents": any device that perceives its environment and takes actions that maximize its chance of successfully achieving its goals. Colloquially, the term "artificial intelligence" is applied when a machine mimics "cognitive" functions that humans associate with other human minds, such as "learning" and "problem solving". • Includes: • Experts Systems • Fuzzy Logic • Robotics (e.g humanoid, arm, chatbot, etc) • Natural Language Processing • Neural Language (general) • Etc • Some of the subfield of AI used/transformed itu Machine Learning/Deep Learning field, with the impact of advance computational technology and huge amount of data (especially unstructured/ no row+column)
- 19. Data Science • Data science is an interdisciplinary field that uses scientific methods, processes, algorithms and systems to extract knowledge and insights from data in various forms, both structured and unstructured, similar to data mining. • Data science is a "concept to unify statistics, data analysis, machine learning and their related methods" in order to "understand and analyze actual phenomena" with data. It employs techniques and theories drawn from many fields within the context of mathematics, statistics, information science, and computer science. • Turing award winner Jim Gray imagined data science as a "fourth paradigm" of science (empirical, theoretical, computational and now data-driven) and asserted that "everything about science is changing because of the impact of information technology" and the data deluge.
- 20. DS Area
- 21. Data Analysis • Data analysis is a process of inspecting, cleansing, transforming, and modeling data with the goal of discovering useful information, informing conclusions, and supporting decision-making. Data analysis has multiple facets and approaches, encompassing diverse techniques under a variety of names, while being used in different business, science, and social science domains. • Data mining is a particular data analysis technique that focuses on modeling and knowledge discovery for predictive rather than purely descriptive purposes, while business intelligence covers data analysis that relies heavily on aggregation, focusing mainly on business information.[1] In statistical applications, data analysis can be divided into descriptive statistics, exploratory data analysis (EDA), and confirmatory data analysis (CDA). EDA focuses on discovering new features in the data while CDA focuses on confirming or falsifying existing hypotheses. Predictive analytics focuses on application of statistical models for predictive forecasting or classification, while text analytics applies statistical, linguistic, and structural techniques to extract and classify information from textual sources, a species of unstructured data. All of the above are varieties of data analysis. • Data integration is a precursor to data analysis,[according to whom?] and data analysis is closely linked[how?] to data visualization and data dissemination. The term data analysis is sometimes used as a synonym for data modeling.
- 23. Business Intelligence • Business intelligence (BI) comprises the strategies and technologies used by enterprises for the data analysis of business information. BI technologies provide historical, current and predictive views of business operations. Common functions of business intelligence technologies include reporting, online analytical processing, analytics, data mining, process mining, complex event processing, business performance management, benchmarking, text mining, predictive analytics and prescriptive analytics. BI technologies can handle large amounts of structured to help identify, develop and otherwise create new strategic business opportunities. They aim to allow for the easy interpretation of these data. Identifying new opportunities and implementing an effective strategy based on insights can provide businesses with a competitive market advantage and long-term stability. • Business intelligence can be used by enterprises to support a wide range of business decisions ranging from operational to strategic. Basic operating decisions include product positioning or pricing. Strategic business decisions involve priorities, goals and directions at the broadest level. In all cases, BI is most effective when it combines data derived from the market in which a company operates (external data) with data from company sources internal to the business such as financial and operations data (internal data). When combined, external and internal data can provide a complete picture • Business Intelligence (structured data source, enterprise goal intensive, traditional process flow, result: insight from previous data for executives) VS Big Data Analytics (unstructured/semi structured, wide- range goals, modern aproach/flow, result: predictive, for executive and/or machine to decide next step)
- 24. BI Steps
- 28. Cube Example
- 29. Big Data • Big data is a term used to refer to data sets that are too large or complex for traditional data- processing application software to adequately deal with. Data with many cases (rows) offer greater statistical power, while data with higher complexity (more attributes or columns) may lead to a higher false discovery rate. Big data challenges include capturing data, data storage, data analysis, search, sharing, transfer, visualization, querying, updating, information privacy and data source. Big data was originally associated with three key concepts: volume, variety, and velocity. Other concepts later attributed with big data are veracity (i.e., how much noise is in the data) and value. • Current usage of the term "big data" tends to refer to the use of predictive analytics, user behavior analytics, or certain other advanced data analytics methods that extract value from data, and seldom to a particular size of data set. "There is little doubt that the quantities of data now available are indeed large, but that’s not the most relevant characteristic of this new data ecosystem."Analysis of data sets can find new correlations to" spot business trends, prevent diseases, combat crime and so on."Scientists, business executives, practitioners of medicine, advertising and governments alike regularly meet difficulties with large data-sets in areas including Internet search, fintech, urban informatics, and business informatics. Scientists encounter limitations in e-Science work, including meteorology, genomics, connectomics, complex physics simulations, biology and environmental research.
- 31. Big Data Definition shiftingThe term has been in use since the 1990s, with some giving credit to John Mashey for popularizing the term. Big data usually includes data sets with sizes beyond the ability of commonly used software tools to capture, curate, manage, and process data within a tolerable elapsed time. Big data philosophy encompasses unstructured, semi-structured and structured data, however the main focus is on unstructured data. Big data "size" is a constantly moving target, as of 2012 ranging from a few dozen terabytes to many exabytes of data. Big data requires a set of techniques and technologies with new forms of integration to reveal insights from datasets that are diverse, complex, and of a massive scale. A 2016 definition states that "Big data represents the information assets characterized by such a high volume, velocity and variety to require specific technology and analytical methods for its transformation into value". Additionally, a new V, veracity, is added by some organizations to describe it, revisionism challenged by some industry authorities. The three Vs (volume, variety and velocity) have been further expanded to other complementary characteristics of big data: • Machine learning: big data often doesn't ask why and simply detects patterns • Digital footprint: big data is often a cost-free byproduct of digital interaction (e.g people interaction in Facebook) A 2018 definition states "Big data is where parallel computing tools are needed to handle data", and notes, "This represents a distinct and clearly defined change in the computer science used, via parallel programming theories, and losses of some of the guarantees and capabilities made by Codd’s relational model". The growing maturity of the concept more starkly delineates the difference between "big data" and "Business Intelligence": • Business Intelligence uses descriptive statistics with data with high information density to measure things, detect trends, etc. • Big data uses inductive statistics and concepts from nonlinear system identification to infer laws (regressions, nonlinear relationships, and causal effects) from large sets of data with low information density to reveal relationships and dependencies, or to perform predictions of outcomes and behaviors.
- 33. The Pyramid of Wisdom
- 34. Big Data is surounding us
- 39. Perkenalan • Mendalami pemrograman dan teknik komputer/elektronik sejak 1991 hingga sekarang (-/+ 29 tahun) • Lebih menyukai bahasa pemrograman, logika dan algoritma (problem solving) • Pernah bekerja profesional bbrp perusahaan lintas industri (ISP, pabrik, broadcasting, telekomunikasi, finance/finserv, buku/perpustakaan) • Pernah berkarya sebagai dosen/pengajar dan konsultan lintas industri (agriculture, aquafarming/coldstorage, telco, retail, manufacturer, human resources/capital, dsb) • Sejak 2013 mulai mendalami ke dunia IoT, Drone/UAV, infosec, bigdata, machine learning, dsb • Aplikasi AI pertama pernah dibuat tahun 1992 menggunakan Turbo Prolog, voice recognition (1992/93), polymorphic / heuristic code (1993), aplikasi Fuzzy Logic (1996/97), dosen AI tahun 2008/10, mulai mempelajari map reduce/hadoop 2014. • Berpartisipasi aktif dalam bbrp conference terkait Big Data, antara lain: Data For Public Policy (international conference, PBB/Pulse Lab), Big Data Week (1st, 2nd), Precission Agruculture projects (with CIagri), Jakarta Smart City (literacy index, BPAD DKI Jakarta), dsb