Big Data Analysis
Marco Brambilla, Emanuele Della Valle
@marcobrambi
@manudellavalleData Science Lab
Who	we	are
• Marco	Brambilla
• Associate	Professor	at	Computer	Science	Dept.	(DEIB)
• Expert	in	data	science,	social	media	analysis,	conceptual	modeling
• Inventor	of	IFML	international	standard	for	user	interaction	with	data
• Emanuele Della	Valle
• Assistant	Professor	at	Computer	Science	Dept.	(DEIB)
• Expert	in	semantic	technologies	and	stream	computing	
• Brander	of	stream	reasoning,	tackling	velocity and		variety of	Big	Data	
• 15	years	experience	in	research	and	industrial	projects
• Startuppers:	fluxedo.com,	webratio.com
• R&D	advisors:	socialometers.com,	semioty.com,	ifml.org 2
[source:	IBM,	2012]
Big	Data	dimensions
Marco	Brambilla and	Emanuele	Della	Valle	- Big	Data	Analysis
Our	Activities
Full	coverage	of	the	Big	Data	Processing	pipeline
Marco	Brambilla and	Emanuele	Della	Valle	- Big	Data	Analysis
Data	
Acquisition
Data	
Preparation
Data	Analysis
Reporting
Prediction
Action
Data	Fusion	Scenario
Marco	Brambilla and	Emanuele	Della	Valle	- Big	Data	Analysis
Data	Fusion	Scenario
Data	Fusion	Scenario
• Social	Media	Data
• Opinion	mining
• Telecommunications	Data
• WI-FI	Log
• IoT
• 3D	Cameras
• Any	other	IoT enabled	sensors	
• Possibly	embedded	 in	
industrial	productsMarco	Brambilla and	Emanuele	Della	Valle	- Big	Data	Analysis
Como	City	Monitoring
Marco	Brambilla and	Emanuele	Della	Valle	- Big	Data	Analysis
Como	City	Monitoring
…	and	it’s	just	the	beginning
• CRM	+	IoT
• User	Engagement	
• Recommendation
• Resource	management
• Predictive	maintenance
Company
Object Customer
Marco	Brambilla and	Emanuele	Della	Valle	- Big	Data	Analysis
Stream	Reasoning	research
Tame	Variety and	Velocity simultaneously
Marco	Brambilla and	Emanuele	Della	Valle	- Big	Data	Analysis
TRADITIONAL APPROACH
Data
“in-motion” Data
“in-motion”
Registered
analysis
Insights
“in-motion”
Data put
“at-rest”
in DWH
Analysis
Analysis
Insight
PANOPTIQUE APPROACH
Ontology
+
Mappings
Traditional	approach StreamReasoning
Paradigmatic	change	enabled	by	Stream	Reasoning
Tame	Variety and	Velocity simultaneously
Marco	Brambilla and	Emanuele	Della	Valle	- Big	Data	Analysis
TRADITIONAL APPROACH
Data
“in-motion” Data
“in-motion”
Registered
analysis
Insights
“in-motion”
Data put
“at-rest”
in DWH
Analysis
Analysis
Insight
PANOPTIQUE APPROACH
Ontology
+
Mappings
Traditional	approach StreamReasoning
Our	Stream	Reasoner
Uses logical window
Connects to a variety of
data streams
Real-time
predictive and
actionable
insights
Stream	
Reasoner
for	data	
"in-motion"
(In-memory)
Store
data	
"at-rest"
(distributed)
post-hoc analysis
optimizes
joins
Usages	of	our	Research
Temporal, spatial,	statistical
analysis
Predictive
analysis
Real-time	and	post-hoc	data	collection,	fusion &	cleansing	to	enable
as	actionable	insights	and	visual	data	exploration
Fine	grained
information	access
Complex	event
processing
– Off-shore	oil	operations:	
– Smart	Cities
– Global	Contact	Center
– Social	networks
At	work	with	our	partners
Marco	Brambilla and	Emanuele Della	Valle	- Big	Data	Analysis
At	work	with	our	partners
Marco	Brambilla and	Emanuele Della	Valle	- Big	Data	Analysis
– Events:	Fashion	and	Design
– Utilities,	Resources,	Wholesale
– Sharing	Economy
Contacts
emanuele.dellavalle@polimi.it
@manudellavalle
http://emanueledellavalle.org
marco.brambilla@polimi.it
@marcobrambi
http://about.me/brambillamarco

More Related Content

PPTX
Model Driven Development of Social Media Environmental Monitoring Applications
PPTX
Model-driven Development of User Interfaces for IoT via Domain-specific Comp...
PDF
IFML - Internet of Things and Internet of People: The Role of User Interactio...
PPTX
Mobile + cloud + internet of things (iot) = nuove opportunità di business
PPTX
Mobile extensions for OMG's IFML modeling language presented at MobiWIS confe...
PPTX
Automatic code generation for cross platform, multi-device mobile apps. An in...
PPTX
Latest trend in IT industry
PPTX
Who is BIRT
Model Driven Development of Social Media Environmental Monitoring Applications
Model-driven Development of User Interfaces for IoT via Domain-specific Comp...
IFML - Internet of Things and Internet of People: The Role of User Interactio...
Mobile + cloud + internet of things (iot) = nuove opportunità di business
Mobile extensions for OMG's IFML modeling language presented at MobiWIS confe...
Automatic code generation for cross platform, multi-device mobile apps. An in...
Latest trend in IT industry
Who is BIRT

What's hot (20)

PPT
Iit 1782 designing for the internet of things (io t) v4 gb
PPTX
Icp 3273-the iiot understanding designing and developing the bigger picture v2
PDF
[GE207] Session03: Digital Technology Trends
PDF
Case Study Mm
PDF
Bimarabia3en
PDF
Latest Trends in Technology: BigData Analytics, Virtualization, Cloud Computi...
PDF
IBM InterConnect 2013 Mobile Keynote: Marie Wieck
PDF
Trends on Information Technology
PPTX
Latest trends in information technology
PPTX
Technical Comptency_ppt
PDF
IBM Z for the Digital Enterprise 2018 - Z Keynote
PDF
Bi marabia11 en
PPTX
MobileIrn Presentation
PDF
Bi marabia9 en
PPTX
Ethical AI - Open Compliance Summit 2020
PDF
20191126 modulair IFC
PDF
Bi marabia10 en
PPTX
Step by step AI Day 3: AI Technologies
PPT
Map Middle East 2009 - Enterprise Mashups in the Clouds
PPT
Iit 1782 designing for the internet of things (io t) v4 gb
Icp 3273-the iiot understanding designing and developing the bigger picture v2
[GE207] Session03: Digital Technology Trends
Case Study Mm
Bimarabia3en
Latest Trends in Technology: BigData Analytics, Virtualization, Cloud Computi...
IBM InterConnect 2013 Mobile Keynote: Marie Wieck
Trends on Information Technology
Latest trends in information technology
Technical Comptency_ppt
IBM Z for the Digital Enterprise 2018 - Z Keynote
Bi marabia11 en
MobileIrn Presentation
Bi marabia9 en
Ethical AI - Open Compliance Summit 2020
20191126 modulair IFC
Bi marabia10 en
Step by step AI Day 3: AI Technologies
Map Middle East 2009 - Enterprise Mashups in the Clouds
Ad

Viewers also liked (12)

PDF
Chapter 2.1 : Data Stream
PDF
Detecting Anomalies in Streaming Data
PPTX
Data streaming algorithms
PPTX
[RakutenTechConf2013] [D-3_2] Counting Big Data by Streaming Algorithms
PPTX
Streaming Algorithms
PPTX
Data Stream Outlier Detection Algorithm
PDF
Stream processing using Apache Storm - Big Data Meetup Athens 2016
PPTX
Data Stream Algorithms in Storm and R
PDF
Discover.hdp2.2.storm and kafka.final
PDF
Márton Balassi Streaming ML with Flink-
PDF
Data Stream Analytics - Why they are important
PDF
Advanced data science algorithms applied to scalable stream processing by Dav...
Chapter 2.1 : Data Stream
Detecting Anomalies in Streaming Data
Data streaming algorithms
[RakutenTechConf2013] [D-3_2] Counting Big Data by Streaming Algorithms
Streaming Algorithms
Data Stream Outlier Detection Algorithm
Stream processing using Apache Storm - Big Data Meetup Athens 2016
Data Stream Algorithms in Storm and R
Discover.hdp2.2.storm and kafka.final
Márton Balassi Streaming ML with Flink-
Data Stream Analytics - Why they are important
Advanced data science algorithms applied to scalable stream processing by Dav...
Ad

Similar to Big Data and Stream Data Analysis at Politecnico di Milano (20)

PPTX
Big data session five ( a )f
PPTX
PPSX
PPS
Self-Driving Cars, Smart Watches and Heads-Up Displays... Oh My!
PPTX
Algorithm Marketplace and the new "Algorithm Economy"
PPTX
Top Business Intelligence Trends for 2016 by Panorama Software
PDF
Building the Artificially Intelligent Enterprise
PDF
From Big Data to AI
PDF
A Review of Big data for Social Policy Decision Making
PDF
SuanIct-Bigdata desktop-final
PPT
Big Data Engineering- Introduction- Unit-I.ppt
PPT
I BIG DATA ENGINEERING _ INTRODUCTION.ppt
PDF
Cubitic: Predictive Analytics
PDF
Moving mobility forward 10 mobile predictions
PPTX
Kartikey tripathi
PDF
The Virtualization of Clouds - The New Enterprise Data Architecture Opportunity
PPTX
Sr. Jon Ander, Internet de las Cosas y Big Data: ¿hacia dónde va la Industria?
PDF
Let's make money from big data!
PPT
Big data and your career final
PPTX
A beginner's guide to Big data
Big data session five ( a )f
Self-Driving Cars, Smart Watches and Heads-Up Displays... Oh My!
Algorithm Marketplace and the new "Algorithm Economy"
Top Business Intelligence Trends for 2016 by Panorama Software
Building the Artificially Intelligent Enterprise
From Big Data to AI
A Review of Big data for Social Policy Decision Making
SuanIct-Bigdata desktop-final
Big Data Engineering- Introduction- Unit-I.ppt
I BIG DATA ENGINEERING _ INTRODUCTION.ppt
Cubitic: Predictive Analytics
Moving mobility forward 10 mobile predictions
Kartikey tripathi
The Virtualization of Clouds - The New Enterprise Data Architecture Opportunity
Sr. Jon Ander, Internet de las Cosas y Big Data: ¿hacia dónde va la Industria?
Let's make money from big data!
Big data and your career final
A beginner's guide to Big data

More from Marco Brambilla (20)

PDF
A GraphRAG approach for Energy Efficiency Q&A
PDF
Essential concepts of data architectures
PDF
M.Sc. Thesis Topics and Proposals @ Polimi Data Science Lab - 2024 - prof. Br...
PDF
Thesis Topics and Proposals @ Polimi Data Science Lab - 2023 - prof. Brambill...
PPTX
Hierarchical Transformers for User Semantic Similarity - ICWE 2023
PDF
Exploring the Bi-verse. A trip across the digital and physical ecospheres
PPTX
Conversation graphs in Online Social Media
PPTX
Trigger.eu: Cocteau game for policy making - introduction and demo
PPTX
Generation of Realistic Navigation Paths for Web Site Testing using RNNs and ...
PPTX
Analyzing rich club behavior in open source projects
PDF
Analysis of On-line Debate on Long-Running Political Phenomena. The Brexit C...
PPTX
Community analysis using graph representation learning on social networks
PDF
Available Data Science M.Sc. Thesis Proposals
PPTX
Data Cleaning for social media knowledge extraction
PPTX
Iterative knowledge extraction from social networks. The Web Conference 2018
PDF
Driving Style and Behavior Analysis based on Trip Segmentation over GPS Info...
PDF
Myths and challenges in knowledge extraction and analysis from human-generate...
PPTX
Harvesting Knowledge from Social Networks: Extracting Typed Relationships amo...
PPTX
A Model-Based Method for Seamless Web and Mobile Experience. Splash 2016 conf.
PPTX
Web Science. An introduction
A GraphRAG approach for Energy Efficiency Q&A
Essential concepts of data architectures
M.Sc. Thesis Topics and Proposals @ Polimi Data Science Lab - 2024 - prof. Br...
Thesis Topics and Proposals @ Polimi Data Science Lab - 2023 - prof. Brambill...
Hierarchical Transformers for User Semantic Similarity - ICWE 2023
Exploring the Bi-verse. A trip across the digital and physical ecospheres
Conversation graphs in Online Social Media
Trigger.eu: Cocteau game for policy making - introduction and demo
Generation of Realistic Navigation Paths for Web Site Testing using RNNs and ...
Analyzing rich club behavior in open source projects
Analysis of On-line Debate on Long-Running Political Phenomena. The Brexit C...
Community analysis using graph representation learning on social networks
Available Data Science M.Sc. Thesis Proposals
Data Cleaning for social media knowledge extraction
Iterative knowledge extraction from social networks. The Web Conference 2018
Driving Style and Behavior Analysis based on Trip Segmentation over GPS Info...
Myths and challenges in knowledge extraction and analysis from human-generate...
Harvesting Knowledge from Social Networks: Extracting Typed Relationships amo...
A Model-Based Method for Seamless Web and Mobile Experience. Splash 2016 conf.
Web Science. An introduction

Recently uploaded (20)

PPTX
Power BI DAX Formulas and fast easy technical learning
PPTX
Smart Card Face Mask detection soluiondr
PPTX
How to Make Sure Your Video is Optimized for SEO
PPTX
Philippine-Pop-Culture.pptx.hhtps.com.ph
PDF
The Effect of Compensation and Work Environment on Employee Performance with ...
PPTX
Lesson 3: person and his/her relationship with the others NSTP 1
PDF
Why AI-Savvy Freelance Digital Marketers Have a Competitive Edge!.pdf
PDF
What is TikTok Cyberbullying_ 15 Smart Ways to Prevent It.pdf
PDF
Dominate the Explore Page Level Me Up...
PDF
Implementation of Total Quality Management (TQM) in Plywood Production Contro...
PDF
Why Blend In When You Can Trend? Make Me Trend
PPTX
Unlock Your Business’s Full Online Potential
PPTX
Mindfulness_and_Coping_Workshop in workplace
PDF
People in Delhi call cheerful girls for celebrations
PPTX
Facebook Ads vs Instagram Ads: What Works Better?
PPTX
Social Media Optimization Services to Grow Your Brand Online
PDF
DIGITAL MARKETING CONTENTS INCLUDING DEFINTIONS AND IMPORTANTS
PDF
Faculty of E languageTruongMinhThien.pdf
PDF
Online echo chambers, misinformation, disinformation, identity politics, how ...
PDF
Delhi evenings are unforgettable when you call stylish girls
Power BI DAX Formulas and fast easy technical learning
Smart Card Face Mask detection soluiondr
How to Make Sure Your Video is Optimized for SEO
Philippine-Pop-Culture.pptx.hhtps.com.ph
The Effect of Compensation and Work Environment on Employee Performance with ...
Lesson 3: person and his/her relationship with the others NSTP 1
Why AI-Savvy Freelance Digital Marketers Have a Competitive Edge!.pdf
What is TikTok Cyberbullying_ 15 Smart Ways to Prevent It.pdf
Dominate the Explore Page Level Me Up...
Implementation of Total Quality Management (TQM) in Plywood Production Contro...
Why Blend In When You Can Trend? Make Me Trend
Unlock Your Business’s Full Online Potential
Mindfulness_and_Coping_Workshop in workplace
People in Delhi call cheerful girls for celebrations
Facebook Ads vs Instagram Ads: What Works Better?
Social Media Optimization Services to Grow Your Brand Online
DIGITAL MARKETING CONTENTS INCLUDING DEFINTIONS AND IMPORTANTS
Faculty of E languageTruongMinhThien.pdf
Online echo chambers, misinformation, disinformation, identity politics, how ...
Delhi evenings are unforgettable when you call stylish girls

Big Data and Stream Data Analysis at Politecnico di Milano