Big Data and Artificial Intelligence:
The Game Changer
Prof. Dr. David Asirvatham
Executive Dean
Taylor’s University
MALAYSIA
Contact: david.asirvatham@taylors.edu.my
1
COVID-19 Impact on Education
• COVID-19 pandemic has created a global crisis.
• Many countries have decided to close schools, colleges and
universities.
• Almost 70% of the world’s student population are affected
(UNESCO). About 1.1 billion students
• There is a need for universities to be prepared to switch to
online mode to ensure the continuity of education.
• Many schools and universities are not prepared for this
crisis.
2
Schools Closure due to COVID-19 as of 20 May 2020.
3
COVID-19 and Technology Trends
1. Online Shopping has become more popular.
2. Delivery services supported by technology (Apps) become more
important
3. Increase in Digital Payment Systems
4. Work from home
5. Online Learning
6. Robotics and Drone
7. Technology (Connectivity, 5G, Laptops, etc.)
8. Video Conferencing Tools (Zoom, MS Teams, Google Meet, etc.)
9. Online Entertainments
10. E-Commerce and Supply Chain
4
The Emergence Artificial Intelligence (AI) Technology
4
5
Game Changer:
AI-based technology will
replace many jobs
6
Truck Drivers, Shipping Crews & Pilots
Major car manufacturers will roll-out
driverless cars by 2019/20.
No truck drivers or shipping crews?
Entire transport system will change
20-May-20 Dr. David Asirvatham 6
7
Drones for Law Enforcement (Police)
New York: Law-enforcement agencies across the city have adopted aerial drones to
map crime scenes, monitor large events and aid search-and-rescue operations
8
Drones
8
World of Drones
9
LAWYERS
• Can AI assist Lawyers?
• AI could be effectively deployed
to determine every case in
which a particular witness
testified, what his/her opinions
were, and how juries reacted,
much faster and more
thoroughly than any human
investigator ever could.
• AI-based tools to assist
10
JOURNALISTS
• Automated news writing and
distribution, without human
supervision, is already a reality
• Using bots to generate sports
reports and other news articles
• A.I. automated agents could be
used to help personalize
human-written stories for
readers, based on their
knowledge, location, age, or
reading level.
• Social Media: Every individual
becomes a reporter as they
witness an event.
11
CHEFS
• Chef Watson, it’s able to generate entirely
new recipes from scratch using an
astonishing knowledge of taste chemistry
and flavor pairings.
• Customize to the taste of individuals
• robots like Miso Robotics’ burger-
preparing Flippy are capable of preparing
meals and serving them up at speeds that
human chefs struggle to achieve
• Add table delivery drones into the mix
and you don’t even need human waiters
to deliver the food to customers.
12
FINANCIAL ANALYSTS,
ACCOUNTANTS & BANKERS
• AI can spot patterns and make trades
faster than even the most eagle-eyed of
human analysts.
• With billions of dollars (or more) at stake,
it’s no wonder that machine learning tools
are all the rage, while some estimates
suggest that around 30 percent of banking
sector jobs will be lost to A.I. within the
next decade.
13
CONSTRUCTION WORKERS OR
OTHER MANUAL LABOUR JOBS
• bricklaying on construction
sites, working in warehouses, or picking
fruit and vegetables on a farm, there’s
no doubt that a large number of manual
labor jobs that once required humans
can now be carried out by robots.
• Ability to work nonstop without getting
tired.
14
Research Project at Taylor’s University
15
MEDICS
• Algorithms which can make
diagnoses about disease, AI
being used to
make recommendations
about the best cancer
treatment.
• Wearable devices that can
help treat physical disorders.
• Robots carrying out surgery
• Cutting edge technology will
have a big impact on a range
of medical professions
16
Industry 4.0
16
17
What skills do I need for the
future jobs?
18
Future Jobs: The Right Skills
19
Which skills are important for the future?
Future Skills (Beyond 2020)
20
The Shift in Skills
21
22
Top 20 Emerging Jobs by LinkedIn
23
Why there will be changes?
24
IoT, Big Data and AI – the New
‘Superpowers’ In the Digital
Universe
Linda Misauer , 2017
25
Growth of Data
Source: IDC
26
Growth of Big Data
Source: www.hrboss.com
27
IOT, Big Data and AI
Source: I-ON Communication blog
28
Big Data
How do we handle large Data Sets?
– All data are valuable
– There is need to capture, store, manage and analyse these data
– We cannot fit large datasets into a single computer
– Data need to distributed and stored in different machines
– Distributed – Faster Computation
29
Solution for Big Data ……
30
Hadoop vs RDMS
31
Performance
32
Traditional DB vs Hadoop
Traditional DB
• Conceptually in one Database
• Data can be written many time
• SQL
• Single Product
• No Fault Tolerance within the DB
Hadoop
• Data is distributed
• Write once, Read many
• NoSQL, Pig, Hive, etc.
• Not a single product
• Fault Tolerance (Data
Redundancy)
33
Success Stories with Hadoop
34
Hadoop Environment: Do you have these Skills?
35
Top 10 Tech Skills
#1: Artificial Intelligence
#2: Machine Learning
#3: Data Science & Analytics
#4: Data Engineering
#5: Data Visualization
#6: Network and Information Security (Cybersecurity)
#7: Cloud Computing/AWS
#8: Extended Reality (Virtual Reality and Augmented Reality)
#9: Internet of Things (IoT)
#10: UI/UX Design
36
Demand for Data Science
Global: 25,330 Job as of 20 May 2020
India: 2,561 Job
Malaysia: 253 Jobs
All these in one platform-Glassdoor
37
Skills needed for Data Science
38
Data Analyst vs Data Engineer vs Data Scientist
Data analyst uses static modeling techniques that summarize the data through
descriptive analysis.
Data engineer is responsible for the development and maintenance of data pipelines.
Data scientist uses dynamic techniques like Machine Learning to gain insights about
the future
39
Tools: Data Engineer vs Data Scientist
DataEngineer
DataScientist
40
Demand for AI
Global: 16,717 Job as of 20 May 2020
India: 2,599 Job
Malaysia: 194 Jobs
All these in one platform-Glassdoor
41
What skillset do I need to acquire to be good in AI?
42
Revenues from the AI software market worldwide
43
AI Technology
• AI Technology market is flourishing
• Startups and the Internet giants are acquiring the AI Technology very quickly
(Forrester Research)
• IDC estimates that the AI market is expected to grow to $47 billion by 2020
• Big Data is the fuel for AI.
• More devices are connected to the Internet (IoT), the more data is gathered and
analysed using AI
44
Hottest AI
Technologies
(by Forrester)
1. Natural Language Generation
2. Speech Recognition
3. Virtual Agents
4. Machine Learning Platform
5. AI-optimised Hardware
6. Decision Management
7. Deep Learning Platforms
8. Biometrics
9. Robotic Process Automation
10. Text Analytics and NLP
45
Natural Language Generation
PRODUCE TEXT FOR
DIGITAL DATA
REPORT GENERATION AND
SUMMARISE BUSINESS
INTELLIGENCE INSIGHTS
EXAMPLE: ATTIVIO,
AUTOMATED INSIGHTS &
DIGITAL REASONING
46
Speech Recognition
Transcribe human speech
into format used by
computer
There are vast amount
video generated daily –
youtube
Can these video be
converted to text and
analysis conducted?
Example: NICE, OpenText,
Nuance Communications.
47
Virtual Agents
FROM CHATBOTS TO
ADVANCED SYSTEMS THAT CAN
NETWORK WITH HUMANS
EXAMPLE: AMAZON, APPLE,
GOOGLE, ETC (USED FOR
CUSTOMER SERVICE)
48
Machine Learning
DEVELOP ALGORITHMS,
APIS AND TRAINING
TOOLKITS
INVOLVED IN
PREDICTION AND
CLASSIFICATION
EXAMPLE: FRACTAL
ANALYTICS, H2O.AI, SAS,
& SKYTREE
49
Decision Management
ENGINES THAT INSERT
RULES AND LOGIC INTO AI
SYSTEMS
CAN PERFORM AUTOMATED
DECISION-MAKING IN
ENTERPRISE ENVIRONMENT
EXAMPLE: INFORMATICA,
MAANA AND PEGASYSTEMS
50
Deep Learning Platforms
Deep learning is a machine learning technique
that teaches computers to do what comes
naturally to humans: learn by example
Generally used in pattern recognition and
classification apps supported by large datasets.
Example: MathWorks, Fluid AI, Peltarion &
Sentient Technologies
51
Biometrics
Enable natural interactions between humans
and machines – image and touch
recognition, speech and body language.
Example: 3VR, Affectiva, Agnitio & FaceFirst
52
Robotics Process Automation (RPA)
Example: Advanced Systems, Automation
Anywhere, Blue Prism & WorkFusion
Use scripts and other methods to automate
human actions to support business processes
53
Text Analytics and NLP
Understanding sentence
structures, meaning &
sentiments.
Machine learning methods
used
Mining unstructured data
and understanding them
Example: Basis
Technology, Coveo,
Indico, Knime,
Mindbreeze, Lexalytics &
Linguamatics
54
Conclusion
1. AI will drive many businesses in the future.
2. It is important for companies and organizations to
adopt AI to remain competitive
3. There will be great opportunities for those who
provide of Big Data and AI services
Students:
1. Are you an expert in Data Science and AI?
2. Gain knowledge in Big Data and AI Technologies
3. Certifications: Cloudera, Hortonworks, Google
Platforms, Azure Platform, AWS, IBM, etc.

Big Data and Artificial Intelligence: Game Changer

  • 1.
    Big Data andArtificial Intelligence: The Game Changer Prof. Dr. David Asirvatham Executive Dean Taylor’s University MALAYSIA Contact: [email protected]
  • 2.
    1 COVID-19 Impact onEducation • COVID-19 pandemic has created a global crisis. • Many countries have decided to close schools, colleges and universities. • Almost 70% of the world’s student population are affected (UNESCO). About 1.1 billion students • There is a need for universities to be prepared to switch to online mode to ensure the continuity of education. • Many schools and universities are not prepared for this crisis.
  • 3.
    2 Schools Closure dueto COVID-19 as of 20 May 2020.
  • 4.
    3 COVID-19 and TechnologyTrends 1. Online Shopping has become more popular. 2. Delivery services supported by technology (Apps) become more important 3. Increase in Digital Payment Systems 4. Work from home 5. Online Learning 6. Robotics and Drone 7. Technology (Connectivity, 5G, Laptops, etc.) 8. Video Conferencing Tools (Zoom, MS Teams, Google Meet, etc.) 9. Online Entertainments 10. E-Commerce and Supply Chain
  • 5.
    4 The Emergence ArtificialIntelligence (AI) Technology 4
  • 6.
  • 7.
    6 Truck Drivers, ShippingCrews & Pilots Major car manufacturers will roll-out driverless cars by 2019/20. No truck drivers or shipping crews? Entire transport system will change 20-May-20 Dr. David Asirvatham 6
  • 8.
    7 Drones for LawEnforcement (Police) New York: Law-enforcement agencies across the city have adopted aerial drones to map crime scenes, monitor large events and aid search-and-rescue operations
  • 9.
  • 10.
    9 LAWYERS • Can AIassist Lawyers? • AI could be effectively deployed to determine every case in which a particular witness testified, what his/her opinions were, and how juries reacted, much faster and more thoroughly than any human investigator ever could. • AI-based tools to assist
  • 11.
    10 JOURNALISTS • Automated newswriting and distribution, without human supervision, is already a reality • Using bots to generate sports reports and other news articles • A.I. automated agents could be used to help personalize human-written stories for readers, based on their knowledge, location, age, or reading level. • Social Media: Every individual becomes a reporter as they witness an event.
  • 12.
    11 CHEFS • Chef Watson,it’s able to generate entirely new recipes from scratch using an astonishing knowledge of taste chemistry and flavor pairings. • Customize to the taste of individuals • robots like Miso Robotics’ burger- preparing Flippy are capable of preparing meals and serving them up at speeds that human chefs struggle to achieve • Add table delivery drones into the mix and you don’t even need human waiters to deliver the food to customers.
  • 13.
    12 FINANCIAL ANALYSTS, ACCOUNTANTS &BANKERS • AI can spot patterns and make trades faster than even the most eagle-eyed of human analysts. • With billions of dollars (or more) at stake, it’s no wonder that machine learning tools are all the rage, while some estimates suggest that around 30 percent of banking sector jobs will be lost to A.I. within the next decade.
  • 14.
    13 CONSTRUCTION WORKERS OR OTHERMANUAL LABOUR JOBS • bricklaying on construction sites, working in warehouses, or picking fruit and vegetables on a farm, there’s no doubt that a large number of manual labor jobs that once required humans can now be carried out by robots. • Ability to work nonstop without getting tired.
  • 15.
    14 Research Project atTaylor’s University
  • 16.
    15 MEDICS • Algorithms whichcan make diagnoses about disease, AI being used to make recommendations about the best cancer treatment. • Wearable devices that can help treat physical disorders. • Robots carrying out surgery • Cutting edge technology will have a big impact on a range of medical professions
  • 17.
  • 18.
    17 What skills doI need for the future jobs?
  • 19.
    18 Future Jobs: TheRight Skills
  • 20.
    19 Which skills areimportant for the future? Future Skills (Beyond 2020)
  • 21.
  • 22.
  • 23.
    22 Top 20 EmergingJobs by LinkedIn
  • 24.
    23 Why there willbe changes?
  • 25.
    24 IoT, Big Dataand AI – the New ‘Superpowers’ In the Digital Universe Linda Misauer , 2017
  • 26.
  • 27.
    26 Growth of BigData Source: www.hrboss.com
  • 28.
    27 IOT, Big Dataand AI Source: I-ON Communication blog
  • 29.
    28 Big Data How dowe handle large Data Sets? – All data are valuable – There is need to capture, store, manage and analyse these data – We cannot fit large datasets into a single computer – Data need to distributed and stored in different machines – Distributed – Faster Computation
  • 30.
  • 31.
  • 32.
  • 33.
    32 Traditional DB vsHadoop Traditional DB • Conceptually in one Database • Data can be written many time • SQL • Single Product • No Fault Tolerance within the DB Hadoop • Data is distributed • Write once, Read many • NoSQL, Pig, Hive, etc. • Not a single product • Fault Tolerance (Data Redundancy)
  • 34.
  • 35.
    34 Hadoop Environment: Doyou have these Skills?
  • 36.
    35 Top 10 TechSkills #1: Artificial Intelligence #2: Machine Learning #3: Data Science & Analytics #4: Data Engineering #5: Data Visualization #6: Network and Information Security (Cybersecurity) #7: Cloud Computing/AWS #8: Extended Reality (Virtual Reality and Augmented Reality) #9: Internet of Things (IoT) #10: UI/UX Design
  • 37.
    36 Demand for DataScience Global: 25,330 Job as of 20 May 2020 India: 2,561 Job Malaysia: 253 Jobs All these in one platform-Glassdoor
  • 38.
  • 39.
    38 Data Analyst vsData Engineer vs Data Scientist Data analyst uses static modeling techniques that summarize the data through descriptive analysis. Data engineer is responsible for the development and maintenance of data pipelines. Data scientist uses dynamic techniques like Machine Learning to gain insights about the future
  • 40.
    39 Tools: Data Engineervs Data Scientist DataEngineer DataScientist
  • 41.
    40 Demand for AI Global:16,717 Job as of 20 May 2020 India: 2,599 Job Malaysia: 194 Jobs All these in one platform-Glassdoor
  • 42.
    41 What skillset doI need to acquire to be good in AI?
  • 43.
    42 Revenues from theAI software market worldwide
  • 44.
    43 AI Technology • AITechnology market is flourishing • Startups and the Internet giants are acquiring the AI Technology very quickly (Forrester Research) • IDC estimates that the AI market is expected to grow to $47 billion by 2020 • Big Data is the fuel for AI. • More devices are connected to the Internet (IoT), the more data is gathered and analysed using AI
  • 45.
    44 Hottest AI Technologies (by Forrester) 1.Natural Language Generation 2. Speech Recognition 3. Virtual Agents 4. Machine Learning Platform 5. AI-optimised Hardware 6. Decision Management 7. Deep Learning Platforms 8. Biometrics 9. Robotic Process Automation 10. Text Analytics and NLP
  • 46.
    45 Natural Language Generation PRODUCETEXT FOR DIGITAL DATA REPORT GENERATION AND SUMMARISE BUSINESS INTELLIGENCE INSIGHTS EXAMPLE: ATTIVIO, AUTOMATED INSIGHTS & DIGITAL REASONING
  • 47.
    46 Speech Recognition Transcribe humanspeech into format used by computer There are vast amount video generated daily – youtube Can these video be converted to text and analysis conducted? Example: NICE, OpenText, Nuance Communications.
  • 48.
    47 Virtual Agents FROM CHATBOTSTO ADVANCED SYSTEMS THAT CAN NETWORK WITH HUMANS EXAMPLE: AMAZON, APPLE, GOOGLE, ETC (USED FOR CUSTOMER SERVICE)
  • 49.
    48 Machine Learning DEVELOP ALGORITHMS, APISAND TRAINING TOOLKITS INVOLVED IN PREDICTION AND CLASSIFICATION EXAMPLE: FRACTAL ANALYTICS, H2O.AI, SAS, & SKYTREE
  • 50.
    49 Decision Management ENGINES THATINSERT RULES AND LOGIC INTO AI SYSTEMS CAN PERFORM AUTOMATED DECISION-MAKING IN ENTERPRISE ENVIRONMENT EXAMPLE: INFORMATICA, MAANA AND PEGASYSTEMS
  • 51.
    50 Deep Learning Platforms Deeplearning is a machine learning technique that teaches computers to do what comes naturally to humans: learn by example Generally used in pattern recognition and classification apps supported by large datasets. Example: MathWorks, Fluid AI, Peltarion & Sentient Technologies
  • 52.
    51 Biometrics Enable natural interactionsbetween humans and machines – image and touch recognition, speech and body language. Example: 3VR, Affectiva, Agnitio & FaceFirst
  • 53.
    52 Robotics Process Automation(RPA) Example: Advanced Systems, Automation Anywhere, Blue Prism & WorkFusion Use scripts and other methods to automate human actions to support business processes
  • 54.
    53 Text Analytics andNLP Understanding sentence structures, meaning & sentiments. Machine learning methods used Mining unstructured data and understanding them Example: Basis Technology, Coveo, Indico, Knime, Mindbreeze, Lexalytics & Linguamatics
  • 55.
    54 Conclusion 1. AI willdrive many businesses in the future. 2. It is important for companies and organizations to adopt AI to remain competitive 3. There will be great opportunities for those who provide of Big Data and AI services Students: 1. Are you an expert in Data Science and AI? 2. Gain knowledge in Big Data and AI Technologies 3. Certifications: Cloudera, Hortonworks, Google Platforms, Azure Platform, AWS, IBM, etc.