Introduction to AutoML and Data Science using the Oracle Autonomous Database - LuxOUG Jun 2020

VP AIOps for the Autonomous Database
Sandesh Rao
Introduction to AutoML and Data Science
using the Oracle Autonomous Database
@sandeshr
https://www.linkedin.com/in/raosandesh/
https://www.slideshare.net/SandeshRao4

The following is intended to outline our general product direction. It is intended for information
purposes only, and may not be incorporated into any contract. It is not a commitment to deliver any
material, code, or functionality, and should not be relied upon in making purchasing decisions. The
development, release, timing, and pricing of any features or functionality described for Oracle’s
products may change and remains at the sole discretion of Oracle Corporation.
Statements in this presentation relating to Oracle’s future plans, expectations, beliefs, intentions and
prospects are “forward-looking statements” and are subject to material risks and uncertainties. A
detailed discussion of these factors and other risks that affect our business is contained in Oracle’s
Securities and Exchange Commission (SEC) filings, including our most recent reports on Form 10-K and
Form 10-Q under the heading “Risk Factors.” These filings are available on the SEC’s website or on
Oracle’s website at http://www.oracle.com/investor. All information in this presentation is current as of
September 2019 and Oracle undertakes no duty to update any statement in light of new information or
future events.
Safe harbor statement

1. Overview of ML and the Autonomous Database
2. Journey of the DBA to Data Scientist
3. OML Examples
4. AutoML and what’s coming
5. Questions
Agenda

Tasks Specific to Business and Innovation
• Architecture, planning, data modeling
• Data security and lifecycle management
• Application related tuning
• End-to-End service level management
Maintenance Tasks
• Configuration and tuning of systems, network, storage
• Database provisioning, patching
• Database backups, H/A, disaster recovery
• Database optimization
Traditionally DBAs are Responsible for:
Value Scale
Innovation
Maintenance

Tasks Specific to Business and Innovation
• Architecture, planning, data modeling
• Data security and lifecycle management
• Application related tuning
• End-to-End service level management
Maintenance Tasks
• Configuration and tuning of systems, network, storage
• Database provisioning, patching
• Database backups, H/A, disaster recovery
• Database optimization
Freedom from Drudgery for DBA: More Time to Innovate and Improve the Business
Autonomous Database Removes Generic Tasks
Value Scale
Innovation
Maintenance

Machine Learning
Solving data-driven
problems
Discovering insights
Making predictions
Data Security
Data classification,
Data life-cycle mgmt
Application Tuning
SQL tuning,
connection mgmt
The Evolution of the DBA/Database Developer Role
Data Engineer
Architecture,
“data wrangler”

Data extraction
Data wrangling
Deriving new attributes
(“feature engineering”)
…
…
…
Import predictions & insights
Translate and deploy ML models
Automate
You Are Probably Already Doing Most of This Work!
Database Developer to Data Scientist Journey
1 - https://www.infoworld.com/article/3228245/data-science/the-80-20-data-science-dilemma.html
Typically 80% of the work
Most data scientists spend only 20 percent of their time
on actual data analysis and 80 percent of their time
finding, cleaning, and reorganizing huge amounts of
data, which is an inefficient data strategy1
Eliminated or minimized with Oracle
Data Management platform becomes
combine/hybrid DM + machine learning platform

Analytics Value vs. Maturity
Reports &
Dashboards
Data
Information
Predictions & Insights Appls with ML
Analytical Maturity
ValueofAnalytics
Diagnostic
Analysis &
Reports
Predictive /
Machine
Learning
“ML Enabled”
Applications
What Happened?
Why it Happened?
What WILL happen?
Automated ML Appls

Algorithms automatically sift through large amounts of data to discover
hidden patterns, new insights and make predictions
What is Machine Learning?
Identify most important factor (Attribute Importance)
Predict customer behavior (Classification)
Find profiles of targeted people or items (Classification
Predict or estimate a value (Regression)
Segment a population (Clustering)
Find fraudulent or “rare events” (Anomaly Detection)
Determine co-occurring items in a “basket” (Associations)X1
X2
A1A2A3A4 A5A6 A7
SupervisedLearningUnsupervisedLearning
Copyright © 2020 Oracle and/or its affiliates.

CRISP-DM Methodology
Six Major Steps
10 https://en.wikipedia.org/wiki/Cross-industry_standard_process_for_data_miningCopyright © 2020 Oracle and/or its affiliates.
DATA UNDERSTANDING
Assemble the “right data”
Data profiling
• Data visualization
• Univariate statistics/group by
• Bi-variate statistics
DATA PREPARATION
Sampling/Stratified
Algorithm req’d transforms
• Auto Data Preparation
• Missing Values, Binning,
Normalization, etc.
• Unstructured data
• Aggregations
Domain specific transforms
• “Engineered Features”
Features Selection
MODELING
Algorithm settings/defaults
• Stratified sampling
• Feature selection
• Build model(s)
EVALUATION
Model evaluation
Model comparison
Model selection
DEPLOYMENT
In-DB ML model apply
• Real-time ML apply
• In-database, REST
Embed methodology
• Applications
• Dashboards
BUSINESS UNDERSTANDING
Well-defined
business problem
* Automated and/or system defaults

Oracle Machine Learning
Oracle Machine Learning extends Oracle Database(s)
and enables users to build “AI” applications and
analytics dashboards
OML delivers powerful in-database machine learning
algorithms, automated ML functionality via SQL APIs
and integration with open source Python* and R.
OML Services*
Model Deployment and Management,
Cognitive Image and Text
OML4SQL
SQL API
OML4Py*
Python API
OML4R
R API
OML Notebooks
with Apache Zeppelin on
Autonomous Database
OML4Spark
R API on Big Data
Oracle Data Miner
Oracle SQL Developer extension
* Coming soonCopyright © 2020 Oracle and/or its affiliates.

• Business Understanding—Week 1
• Data Understanding—Week 2
• Data Preparation—Week 3
• Modeling (ML)—Week 4
• Evaluation—Week 5
• Deployment—Week 6
Six Major Steps (Oracle Machine Learning POV)
13
https://en.wikipedia.org/wiki/Cross-industry_standard_process_for_data_mining

Poorly Defined Better
Data Mining
Technique
Predict employees that leave
• Based on past employees that voluntarily left:
• Create New Attribute EmplTurnover à O/1
Predict customers that churn
• Based on past customers that have churned:
• Create New Attribute Churn à YES/NO
Target “best” customers
• Recency, Frequency Monetary (RFM) Analysis
• Specific Dollar Amount over Time Window:
• Who has spent $500+ in most recent 18 months
How can I make more $$? • What helps me sell soft drinks & coffee?
Which customers are likely to buy? • How much is each customer likely to spend?
Who are my “best customers”? • What descriptive “rules” describe “best customers”?
How can I combat fraud?
• Which transactions are the most anomalous?
• Then roll-up to physician, claimant, employee…
Week 1—Business Understanding
Start with a Well-Defined Business Problem Statement

Week 1—Business Understanding
Target “best” customers who have GOOD CREDIT and make payments
15
Be Extremely Specific in your Problem Statement

Week 2—Data Understanding
16
Review the Data; Does it Makes Sense?
Are AGEs all positive, 0-120?
Are INCOME values weekly or monthly?
Are the LOAN_AMOUNTS reasonable?
Etc….

17
Simple, exploratory graphs to understand
the data

18
Are AGEs all positive, 0-120?
Are INCOME values weekly or monthly?
Are the LOAN_AMOUNTS reasonable?
Etc….

Week 3—Data Preparation
Prepare the Data, Create New Derived Attributes or “Engineered Features”
Source Attribute New Attribute/”Engineered Feature”
Date of Birth AGE
Address DISTANCE_TO_DESTINATION
COMMUTE_TIME
Call detail records (CDRs) #_DROPPED_CALLS
PERCENT_INTERNATIONAL
Salary PERCENT_VS_PEERS
Purchases TOTALS_PER_CATEGORY (e.g. Food,
Clothing)

Week 3—Data Preparation
Oracle Machine Learning’s Auto Data Prep (ADP) and ML algorithms are designed with intelligent defaults
and can automatically deal with:
– Missing values
– Outliers
– Binning
– Too many distinct values
– Too many constants
– Trans data/aggregations
– Unstructured data
– Correlated data
20
Prepare the Data, Create New Derived Attributes or “Engineered Features”

Week 4—Modeling (Machine Learning)
21
First, Identify the Key Attributes That Most Influence the Target Attribute

22
Training and Testing ML Models using 60/40% Random Samples
Historical DataTrain Test
Build Model Test Model Evaluate ModelTrain ModelHistorical Data

23
Build multiple models with different algorithms and settings

Week 5—Model Evaluation (ML)
Randomly selected “hold
out” sample of data that
was used to train the ML
model
Compute Cumulative
Gains, Lift, Accuracy, etc.
Review the attributes used
in the model and model
coefficients
Make sure the model
makes sense
24
Next, test model accuracy
Model Evaluation

Week 6—Deployment
Simple SQL Apply scripts run
100% inside the Database for
immediate ML model deployment
25
Apply the Models to Predict “Best Customers”
Model Apply/”Scoring”

Week 6—Deployment
Simple SQL Apply scripts run 100% inside the Database
for model build, model apply and immediate ML model
deployment
26
Apply the Models to Predict “Best Customers”
Model Build
Model Apply
Results

Congratulations!
Almost there J
Data Scientist

Simple SQL Syntax—Statistical Comparisons (t-tests)
Compare AVE Purchase Amounts Men vs. Women Grouped_By INCOME_LEVEL
Statistical Functions
SELECT SUBSTR(cust_income_level, 1, 22) income_level,
AVG(DECODE(cust_gender, 'M', amount_sold, null)) sold_to_men,
AVG(DECODE(cust_gender, 'F', amount_sold, null)) sold_to_women,
STATS_T_TEST_INDEPU(cust_gender, amount_sold, 'STATISTIC', 'F') t_observed,
STATS_T_TEST_INDEPU(cust_gender, amount_sold) two_sided_p_value
FROM customers c, sales s
WHERE c.cust_id = s.cust_id
GROUP BY ROLLUP(cust_income_level)
ORDER BY income_level, sold_to_men, sold_to_women, t_observed;
STATS_T_TEST_INDEPU (SQL) Example;
P_Values < 05 show statistically
significantly differences in the amounts
purchased by men vs. women

Simple SQL Syntax—Attribute Importance - ML Model Build (PL/SQL)
OAA Model Build and Real-time SQL Apply Prediction
BEGIN
DBMS_DATA_MINING.CREATE_MODEL(
model_name => 'BUY_INSURANCE_AI',
mining_function => DBMS_DATA_MINING.ATTRIBUTE_IMPORTANCE,
data_table_name => 'CUST_INSUR_LTV',
case_id_column_name => 'cust_id',
target_column_name => 'BUY_INSURANCE',
settings_table_name => 'Att_Import_Mode_Settings');
END;
/
SELECT attribute_name, rank , attribute_value
FROM BUY_INSURANCE_AI
ORDER BY rank, attribute_name;
Model Results (SQL query)
ATTRIBUTE_NAME RANK ATTRIBUTE_VALUE
BANK_FUNDS 1 0.2161
MONEY_MONTLY_OVERDRAWN 2 0.1489
N_TRANS_ATM 3 0.1463
N_TRANS_TELLER 4 0.1156
T_AMOUNT_AUTOM_PAYMENTS 5 0.1095
A1A2A3A4 A5A6 A7

OML for R Model Build
> ore.odmAI (BUY_INSURANCE ~ ., CUST_INSUR_LTV)
Call:
ore.odmAI(formula = BUY_INSURANCE ~ ., data = CUST_INSUR_LTV)
Simple R Language Syntax—Attribute Importance
ML Model Build (R)
Model Results (R)
Importance:
importance rank
BANK_FUNDS 0.2161187797 1
MONEY_MONTLY_OVERDRAWN 0.1489347141 2
N_TRANS_ATM 0.1463026512 3
N_TRANS_TELLER 0.1155879786 4
T_AMOUNT_AUTOM_PAYMENTS 0.1095178647 5
A1A2A3A4 A5A6 A7

OML for Python Model Build—Coming soon!
> ai_mod = ai(**setting) # Create AI model object
> ai_mod = ai_mod.fit(train_x, train_y)
Simple Python Language Syntax—Attribute Importance
ML Model Build (Python)
Model Results (Python)
Importance:
variable importance rank
BANK_FUNDS 0.2161187797 1
MONEY_MONTLY_OVERDRAWN 0.1489347141 2
N_TRANS_ATM 0.1463026512 3
N_TRANS_TELLER 0.1155879786 4
T_AMOUNT_AUTOM_PAYMENTS 0.1095178647 5
A1A2A3A4 A5A6 A7

Key Features:
• Collaborative UI for data
scientist and analysts
• Packaged with Autonomous Databases
• Quick start Example notebooks
• Easy access to shared notebooks,
templates, permissions, scheduler, etc.
• OML4SQL
• OML4Py coming soon
• Supports deployment of OML models
Machine Learning Notebooks included in Autonomous Databases

Oracle Machine Learning for R / Python
Transparency layer
‐ Leverage proxy objects so data remain in database
‐ Overload native functions translating functionality to SQL
‐ Use familiar R/Python syntax to manipulate database data
Parallel, distributed algorithms
‐ Scalability and performance
‐ Exposes in-database algorithms available from OML4SQL
Embedded execution
‐ Manage and invoke R or Python scripts in Oracle Database
‐ Data-parallel, task-parallel, and non-parallel execution
‐ Use open source packages to augment functionality
OML4Py, Automated Machine Learning - AutoML
‐ Feature selection, model selection, hyper-parameter tuning
Multiple Components/APIs of Oracle Machine Learning
Database
Server
Client
SQL Interfaces
SQL*Plus
SQLDeveloper
OML4Py OML4R
* Coming soon

Multiple Languages UIs Supported for End Users & Apps Development
Oracle Machine Leaning
Application DevelopersDBAs
R & Python Data Scientists “Citizen” Data ScientistsNotebook Users & DS Teams
New! New!

Coming Soon! | AutoML – new with OML4Py
Auto Feature Selection
– Reduce # of features by
identifying most
predictive
– Improve performance
and accuracy
Increase data scientist productivity – reduce overall compute time
Auto Algorithm
Selection
Much faster than
exhaustive search
Auto Feature
Selection
De-noise data and
reduce # of features
AutoTune
Significant accuracy
improvement
Auto Algorithm Selection
– Identify in-database
algorithm that achieves
highest model quality
– Find best algorithm faster
than with exhaustive search
Auto Tune Hyperparameters
– Significantly improve
model accuracy
– Avoid manual or exhaustive
search techniques
Enables non-expert users to leverage Machine Learning
Data
Table ML Model

Coming Soon! | OML AutoML User Interface
Automate production and deployment of ML models
• Enhance Data Scientist productivity
and user-experience
• Enable non-expert users to leverage ML
• Unify model deployment and monitoring
• Support model management
Features
• Minimal user input: data, target
• Model leaderboard
• Model deployment via REST
• Model monitoring
• Cognitive features for image and text
“Code-free” user interface supporting automated end-to-end machine
learning

Coming Soon! | Algorithms for Database 20c
Gradient Boosted Trees (XGBoost)
• Highly popular and powerful algorithm – Kaggle winners
• Classification, regression, ranking, survival analysis
MSET-SPRT
• Multivariate State Estimation Technique - Sequential
Probability Ratio Test (MSET-SPRT)
• Nonlinear, nonparametric anomaly detection
algorithm designed to monitor critical processes.
• Detects subtle anomalies while also producing
minimal false alarms.
• Calibrates expected behavior from historical normal
operational sequence of monitored signals.
• Re-implemented and sped up in-DB and based on original
Oracle Labs algorithm
Two major new ML algorithms

Oracle Data Miner UI
Easy to use to define
analytical
methodologies that
can be shared
SQL Developer
Extension
Workflow API
and generates SQL
code for immediate
deployment
Drag and Drop, Workflows, Easy to Use UI for “Citizen Data Scientist”

Introduction to AutoML and Data Science using the Oracle Autonomous Database - LuxOUG Jun 2020

Manage and Analyze All Your Data
Big Data SQL / R
SQL / R / Python
Object
Store
“Engineered Features”
– Derived attributes
that reflect domain
knowledge—key to
best models e.g.:
• Counts
• Totals
• Changes
over time
Boil down the Data Lake
Architecturally,
lots of options
and flexibility

In-Database Machine Learning
More Models
Better Models
Faster, More Secure
Less Cost
Ready to Deploy!
No Need To Extract and
Move Data
Data stays in Database
Zero time required.
No production impact.
Data Preparation and
Transformation
Accelerated with
Automatic Data Prep
No separate environment
required. Much faster data prep.
Data stays protected and secured.
Data Mining and
Model Building
SQL, R, Python
Oracle Data Miner UI
OML Notebooks
Oracle Data Miner and AutoML
greatly speed model building.
Less skill required. No coding.
No Need to Transform
Production Data
Embedded Data
Preparation
No need for second
production instance.
Model Scoring
Accelerated Via
Exadata Database Machine
Faster model validation
Easy to repeat model building as often as needed

• OAA (Oracle Data Mining + Oracle R Enterprise) and ORAAH combined
• OAA includes support for Partitioned Models, Transactional, Unstructured, Geo-spatial, Graph data. etc,
Oracle’s Machine Learning & Adv. Analytics Algorithms
CLASSIFICATION
• Naïve Bayes
• Logistic Regression (GLM)
• Decision Tree
• Random Forest
• Neural Network
• Support Vector Machine
• Explicit Semantic Analysis
CLUSTERING
• Hierarchical K-Means
• Hierarchical O-Cluster
• Expectation Maximization (EM)
ANOMALY DETECTION
• One-Class SVM
TIME SERIES
• State of the art forecasting using
Exponential Smoothing
• Includes all popular models
e.g. Holt-Winters with trends,
seasons, irregularity, missing data
REGRESSION
• Linear Model
• Generalized Linear Model
• Support Vector Machine (SVM)
• Stepwise Linear regression
• Neural Network
• LASSO *
ATTRIBUTE IMPORTANCE
• Minimum Description Length
• Principal Comp Analysis (PCA)
• Unsupervised Pair-wise KL Div
• CUR decomposition for row & AI
ASSOCIATION RULES
• A priori/ market basket
PREDICTIVE QUERIES
• Predict, cluster, detect, features
SQL ANALYTICS
• SQL Windows, SQL Patterns,
SQL Aggregates
FEATURE EXTRACTION
• Principal Comp Analysis (PCA)
• Non-negative Matrix Factorization
• Singular Value Decomposition (SVD)
• Explicit Semantic Analysis (ESA)
TEXT MINING SUPPORT
• Algorithms support text
• Tokenization and theme extraction
• Explicit Semantic Analysis (ESA) for
document similarity
STATISTICAL FUNCTIONS
• Basic statistics: min, max,
median, stdev, t-test, F-test,
Pearson’s, Chi-Sq, ANOVA, etc.
R PACKAGES
• CRAN R Algorithm Packages
through Embedded R Execution
• Spark MLlib algorithm integration
EXPORTABLE ML MODELS
• REST APIs for deployment
X
1
X
2
A
1
A
2
A
3
A
4
A
5
A
6
A
7

ANALYTICAL SQL
• SQL Windows
• SQL Aggregate functions
• LAG/LEAD functions
• SQL for Pattern Matching
• Additional approximate
query
processing: APPROX_COUNT
, APPROX_SUM,
APPROX_RANK
• Regular Expressions
• Linear regression
• ANOVA (Analysis of
variance)
• Test Distribution fit
(e.g. Normal distribution
test, Binomial test, Weibull
test, Uniform
test, Exponential
test, Poisson test, etc.)
• Statistical Aggregates (min,
max, mean, median, stdev,
mode, quantiles, plus x
sigma, minus x sigma, top n
outliers, bottom n outliers)
STATISTICAL FUNCTIONS
• Descriptive statistics
(e.g. median, stdev, mode, sum,
etc.)
• Hypothesis testing
(t-test, F-test, Kolmogorov-
Smirnov test, Mann Whitney
test, Wilcoxon Signed Ranks test
• Correlations analysis
(parametric and nonparametric
e.g.
Pearson’s test for
correlation, Spearman's rho
coefficient, Kendall's tau-b
correlation coefficient)
• Ranking functions
• Cross Tabulations with Chi-square
statistics|
Oracle’s Machine Learning & Adv. Analytics Algorithms

Algorithms Operate on Data
ML and AI are just “Algorithms”
Move the Algorithms; Not the Data!;
It Changes Everything!

Thank You
Any Questions ?
Sandesh Rao
VP AIOps for the Autonomous Database
@sandeshr
https://www.linkedin.com/in/raosandesh/
https://www.slideshare.net/SandeshRao4

Introduction to AutoML and Data Science using the Oracle Autonomous Database - LuxOUG Jun 2020

More Related Content

What's hot (20)

Similar to Introduction to AutoML and Data Science using the Oracle Autonomous Database - LuxOUG Jun 2020 (20)

More from Sandesh Rao (20)

Recently uploaded (20)

Introduction to AutoML and Data Science using the Oracle Autonomous Database - LuxOUG Jun 2020