SlideShare a Scribd company logo
Jean-Pierre Riehl / Fabien Adato
Azure Data Factory
Hybrid Data Movement
THANKS to all Sponsors!
EXPO SPONSORS
EXPO LIGHT SPONSORS
EVENT SPONSORS
Meet me at the Community Zone
After this session, you can speak with me in the
Community Zone
WE MIGHT
• Discuss additional questions
• Review parts of my session in more detail
• Network
• Take selfies… 
Jean-Pierre Riehl
Practice Manager Data & BI
@djeepy1
http://blog.djeepy1.net
MVP Data Platform
French Data
Community Leader
Fabien Adato
Data Science Consultant
@fabienAD
http://fadata-blog.com/
MVP Data Platform
Azure Data Factory
Introduction
Once upon a time, a Data Platform…
SQLNexus Copenhaguen - Pipeline for the new oil: Azure Data Factory, Hybrid Data Movement
SQLNexus Copenhaguen - Pipeline for the new oil: Azure Data Factory, Hybrid Data Movement
SQLNexus Copenhaguen - Pipeline for the new oil: Azure Data Factory, Hybrid Data Movement
Data Lake ?
Schema-on-Read
Data Movement :
Pipelines
Azure Data Factory
Azure Data Factory is NOT
An ETL …Neither a Cloud-ETL
SSIS in the Cloud
A Data Prep tool
So what ?!?
ADF is an orchestrator,
dedicated to Data movement
and manipulation, accross
Data Assets.
ADF is hybrid but cloud-driven
orchestrator
Data movement
Hybrid Cloud-Driven
Data Assets
Azure Data Factory
Concepts & Basics
1..n
0..1
Azure Data Factory
Activities – Movement
Azure Blob storage
Azure Data Lake Store
Azure SQL Database
Azure SQL Data Warehouse
Azure Table storage
Azure DocumentDB
[Azure Search Index]
SQL Server*
Oracle*
File System*
Always updated : https://docs.microsoft.com/en-us/azure/data-factory/data-factory-data-movement-activities
Source & Sink Only Source
MySQL*
DB2*
Teradata*
PostgreSQL*
SAP BW
SAP HANA
Sybase*
Cassandra*
MongoDB*
Amazon Redshift
HDFS*
Amazon S3
FTP
Salesforce
Generic ODBC*
Generic OData
Web Table (table from HTML)
GE Historian*
Activities – « Transformation »
Tooling
Azure Portal Visual Studio Powershell
Enterprise Ready
 Scalable (Cloud-Scale)
 Monitoring
 ALM Scenarios
Démo
Please evaluate all sessions!
QR / LINK on posters and in program
MerciAny questions ?

More Related Content

What's hot (20)

PPTX
TechEvent Databricks on Azure
Trivadis
 
PDF
Azure Data Factory v2
Sergio Zenatti Filho
 
PPTX
Snowflake Datawarehouse Architecturing
Ishan Bhawantha Hewanayake
 
PPTX
Develop scalable analytical solutions with Azure Data Factory & Azure SQL Dat...
Microsoft Tech Community
 
PDF
Designing a modern data warehouse in azure
Antonios Chatzipavlis
 
PDF
SQL Server 2014 Faster Insights from Any Data
Stéphane Fréchette
 
PPTX
Big Data and Data Warehousing Together with Azure Synapse Analytics (SQLBits ...
Michael Rys
 
PPTX
Data & analytics challenges in a microservice architecture
Niels Naglé
 
PDF
Lessons Learned: Understanding Azure Data Factory Pricing (Microsoft Ignite 2...
Cathrine Wilhelmsen
 
PDF
Azure Databricks—Apache Spark as a Service with Sascha Dittmann
Databricks
 
PDF
Unleash the power of Azure Data Factory
Sergio Zenatti Filho
 
PPTX
Building an ETL pipeline for Elasticsearch using Spark
Itai Yaffe
 
PPTX
Atlanta Data Science Meetup | Qubole slides
Qubole
 
PPTX
Ai & Data Analytics 2018 - Azure Databricks for data scientist
Alberto Diaz Martin
 
PDF
1 Introduction to Microsoft data platform analytics for release
Jen Stirrup
 
PPTX
Analyzing StackExchange data with Azure Data Lake
BizTalk360
 
PDF
J1 T1 3 - Azure Data Lake store & analytics 101 - Kenneth M. Nielsen
MS Cloud Summit
 
PPTX
Azure Data Lake and Azure Data Lake Analytics
Waqas Idrees
 
PPTX
Architecting a datalake
Laurent Leturgez
 
PPTX
Introduction to Azure Databricks
James Serra
 
TechEvent Databricks on Azure
Trivadis
 
Azure Data Factory v2
Sergio Zenatti Filho
 
Snowflake Datawarehouse Architecturing
Ishan Bhawantha Hewanayake
 
Develop scalable analytical solutions with Azure Data Factory & Azure SQL Dat...
Microsoft Tech Community
 
Designing a modern data warehouse in azure
Antonios Chatzipavlis
 
SQL Server 2014 Faster Insights from Any Data
Stéphane Fréchette
 
Big Data and Data Warehousing Together with Azure Synapse Analytics (SQLBits ...
Michael Rys
 
Data & analytics challenges in a microservice architecture
Niels Naglé
 
Lessons Learned: Understanding Azure Data Factory Pricing (Microsoft Ignite 2...
Cathrine Wilhelmsen
 
Azure Databricks—Apache Spark as a Service with Sascha Dittmann
Databricks
 
Unleash the power of Azure Data Factory
Sergio Zenatti Filho
 
Building an ETL pipeline for Elasticsearch using Spark
Itai Yaffe
 
Atlanta Data Science Meetup | Qubole slides
Qubole
 
Ai & Data Analytics 2018 - Azure Databricks for data scientist
Alberto Diaz Martin
 
1 Introduction to Microsoft data platform analytics for release
Jen Stirrup
 
Analyzing StackExchange data with Azure Data Lake
BizTalk360
 
J1 T1 3 - Azure Data Lake store & analytics 101 - Kenneth M. Nielsen
MS Cloud Summit
 
Azure Data Lake and Azure Data Lake Analytics
Waqas Idrees
 
Architecting a datalake
Laurent Leturgez
 
Introduction to Azure Databricks
James Serra
 

Similar to SQLNexus Copenhaguen - Pipeline for the new oil: Azure Data Factory, Hybrid Data Movement (20)

PPTX
ADF Demo_ppt.pptx
vamsytaurus
 
PPTX
Best Azure Data Engineer Training - Best Data Engineer Course in Hyderabad.pptx
eshwarvisualpath
 
PPTX
Intro to Azure Data Factory v1
Eric Bragas
 
PPTX
Build ETL Process using Azure Data Factory
Manoj Mittal
 
PDF
Unleash the Power of Azure Data Factory - SQL User Group
Sergio Zenatti Filho
 
PDF
Azure Data Factory Introduction.pdf
MaheshPandit16
 
PDF
Pipelines and Packages: Introduction to Azure Data Factory (Techorama NL 2019)
Cathrine Wilhelmsen
 
PPTX
Azure Data Engineering.pptx
priyadharshini626440
 
PPTX
Azure Data Engineer Course | Azure Data Engineer Training Hyderabad.pptx
sivavisualpath
 
PPTX
Azure Data Factory ETL Patterns in the Cloud
Mark Kromer
 
PPTX
Transform your data with Azure Data factory
Prometix Pty Ltd
 
PDF
Azure Data Engineer Training In Hyderabad | Azure Data Engineer Training
eshwarvisualpath
 
PDF
Azure Data Engineer Course | Azure Data Engineer Training
Accentfuture
 
PPTX
SQL Saturday Redmond 2019 ETL Patterns in the Cloud
Mark Kromer
 
PPTX
Azuresatpn19 - An Introduction To Azure Data Factory
Riccardo Perico
 
PPTX
Azure datafactory
Dimko Zhluktenko
 
PPTX
Big Data Analytics: Finding diamonds in the rough with Azure
Christos Charmatzis
 
PDF
Mapping Data Flows in Azure Data Factory 1st Edition Mark Kromer
divacazokey
 
PDF
Mapping Data Flows in Azure Data Factory 1st Edition Mark Kromer
deltintebyan94
 
PPTX
ADF Mapping Data Flows Training Slides V1
Mark Kromer
 
ADF Demo_ppt.pptx
vamsytaurus
 
Best Azure Data Engineer Training - Best Data Engineer Course in Hyderabad.pptx
eshwarvisualpath
 
Intro to Azure Data Factory v1
Eric Bragas
 
Build ETL Process using Azure Data Factory
Manoj Mittal
 
Unleash the Power of Azure Data Factory - SQL User Group
Sergio Zenatti Filho
 
Azure Data Factory Introduction.pdf
MaheshPandit16
 
Pipelines and Packages: Introduction to Azure Data Factory (Techorama NL 2019)
Cathrine Wilhelmsen
 
Azure Data Engineering.pptx
priyadharshini626440
 
Azure Data Engineer Course | Azure Data Engineer Training Hyderabad.pptx
sivavisualpath
 
Azure Data Factory ETL Patterns in the Cloud
Mark Kromer
 
Transform your data with Azure Data factory
Prometix Pty Ltd
 
Azure Data Engineer Training In Hyderabad | Azure Data Engineer Training
eshwarvisualpath
 
Azure Data Engineer Course | Azure Data Engineer Training
Accentfuture
 
SQL Saturday Redmond 2019 ETL Patterns in the Cloud
Mark Kromer
 
Azuresatpn19 - An Introduction To Azure Data Factory
Riccardo Perico
 
Azure datafactory
Dimko Zhluktenko
 
Big Data Analytics: Finding diamonds in the rough with Azure
Christos Charmatzis
 
Mapping Data Flows in Azure Data Factory 1st Edition Mark Kromer
divacazokey
 
Mapping Data Flows in Azure Data Factory 1st Edition Mark Kromer
deltintebyan94
 
ADF Mapping Data Flows Training Slides V1
Mark Kromer
 
Ad

More from Jean-Pierre Riehl (20)

PPTX
SQLSaturday Toulouse 2017 - Azure Data Lake : SELECT people FROM data-lake WH...
Jean-Pierre Riehl
 
PPTX
Club Power BI - Partage et Collaboration avec Power BI
Jean-Pierre Riehl
 
PPTX
24HOP French 2017 - Azure Data Lake, le Big Data 2.0
Jean-Pierre Riehl
 
PPTX
Université d'été de la DFCG - Parlez-vous Big Data ? Guide de conversation po...
Jean-Pierre Riehl
 
PPTX
MS Experiences 17 - Comment le contrôle de gestion améliore le pilotage de l’...
Jean-Pierre Riehl
 
PPTX
Transformation d'un skipper en Iron Man grâce à la réalité augmentée et aux c...
Jean-Pierre Riehl
 
PPTX
Azure Data Lake, le big data 2.0 (Global Azure Bootcamp Paris 2017)
Jean-Pierre Riehl
 
PPTX
Data Science : Méthodologie, Outillage et Application - MS Cloud Summit Paris...
Jean-Pierre Riehl
 
PPTX
Azure Data Lake, le Big Data 2.0 - SQL Saturday Montreal 2017
Jean-Pierre Riehl
 
PPTX
Partager et collaborer avec Power BI - SQL Saturday Montreal 2017
Jean-Pierre Riehl
 
PPTX
Gateways to Power BI, Connect PowerBI.com to your On-Prem Data
Jean-Pierre Riehl
 
PPTX
Partage et Collaboration avec Power BI
Jean-Pierre Riehl
 
PPTX
Azure Data Factory, Mouvement de données hybride
Jean-Pierre Riehl
 
PPTX
Cortana Analytics, de nouveaux patterns pour vos plateformes de données
Jean-Pierre Riehl
 
PPTX
From Personal BI to Managed BI with Power BI
Jean-Pierre Riehl
 
PPTX
Deep Dive DMG (september update)
Jean-Pierre Riehl
 
PPTX
Deep Dive Data Management Gateway - SQLSaturday Edinburgh
Jean-Pierre Riehl
 
PPTX
Power BI 365
Jean-Pierre Riehl
 
PPTX
Deep Dive Data Management Gateway
Jean-Pierre Riehl
 
PPTX
TechDays 2015 - La gouvernance des données
Jean-Pierre Riehl
 
SQLSaturday Toulouse 2017 - Azure Data Lake : SELECT people FROM data-lake WH...
Jean-Pierre Riehl
 
Club Power BI - Partage et Collaboration avec Power BI
Jean-Pierre Riehl
 
24HOP French 2017 - Azure Data Lake, le Big Data 2.0
Jean-Pierre Riehl
 
Université d'été de la DFCG - Parlez-vous Big Data ? Guide de conversation po...
Jean-Pierre Riehl
 
MS Experiences 17 - Comment le contrôle de gestion améliore le pilotage de l’...
Jean-Pierre Riehl
 
Transformation d'un skipper en Iron Man grâce à la réalité augmentée et aux c...
Jean-Pierre Riehl
 
Azure Data Lake, le big data 2.0 (Global Azure Bootcamp Paris 2017)
Jean-Pierre Riehl
 
Data Science : Méthodologie, Outillage et Application - MS Cloud Summit Paris...
Jean-Pierre Riehl
 
Azure Data Lake, le Big Data 2.0 - SQL Saturday Montreal 2017
Jean-Pierre Riehl
 
Partager et collaborer avec Power BI - SQL Saturday Montreal 2017
Jean-Pierre Riehl
 
Gateways to Power BI, Connect PowerBI.com to your On-Prem Data
Jean-Pierre Riehl
 
Partage et Collaboration avec Power BI
Jean-Pierre Riehl
 
Azure Data Factory, Mouvement de données hybride
Jean-Pierre Riehl
 
Cortana Analytics, de nouveaux patterns pour vos plateformes de données
Jean-Pierre Riehl
 
From Personal BI to Managed BI with Power BI
Jean-Pierre Riehl
 
Deep Dive DMG (september update)
Jean-Pierre Riehl
 
Deep Dive Data Management Gateway - SQLSaturday Edinburgh
Jean-Pierre Riehl
 
Power BI 365
Jean-Pierre Riehl
 
Deep Dive Data Management Gateway
Jean-Pierre Riehl
 
TechDays 2015 - La gouvernance des données
Jean-Pierre Riehl
 
Ad

Recently uploaded (20)

PPTX
UVA-Ortho-PPT-Final-1.pptx Data analytics relevant to the top
chinnusindhu1
 
PPTX
short term internship project on Data visualization
JMJCollegeComputerde
 
PPTX
Nursing Shift Supervisor 24/7 in a week .pptx
amjadtanveer
 
PPTX
Future_of_AI_Presentation for everyone.pptx
boranamanju07
 
PDF
202501214233242351219 QASS Session 2.pdf
lauramejiamillan
 
PDF
717629748-Databricks-Certified-Data-Engineer-Professional-Dumps-by-Ball-21-03...
pedelli41
 
PPT
introdution to python with a very little difficulty
HUZAIFABINABDULLAH
 
PPTX
Data-Driven Machine Learning for Rail Infrastructure Health Monitoring
Sione Palu
 
PPTX
M1-T1.pptxM1-T1.pptxM1-T1.pptxM1-T1.pptx
teodoroferiarevanojr
 
PPTX
HSE WEEKLY REPORT for dummies and lazzzzy.pptx
ahmedibrahim691723
 
PPTX
Multiscale Segmentation of Survey Respondents: Seeing the Trees and the Fores...
Sione Palu
 
PDF
WISE main accomplishments for ISQOLS award July 2025.pdf
StatsCommunications
 
PDF
An Uncut Conversation With Grok | PDF Document
Mike Hydes
 
PPT
Real Life Application of Set theory, Relations and Functions
manavparmar205
 
PPTX
Data Security Breach: Immediate Action Plan
varmabhuvan266
 
PPTX
MR and reffffffvvvvvvvfversal_083605.pptx
manjeshjain
 
PPTX
White Blue Simple Modern Enhancing Sales Strategy Presentation_20250724_21093...
RamNeymarjr
 
PDF
blockchain123456789012345678901234567890
tanvikhunt1003
 
PPTX
Insurance-Analytics-Branch-Dashboard (1).pptx
trivenisapate02
 
PDF
apidays Munich 2025 - Developer Portals, API Catalogs, and Marketplaces, Miri...
apidays
 
UVA-Ortho-PPT-Final-1.pptx Data analytics relevant to the top
chinnusindhu1
 
short term internship project on Data visualization
JMJCollegeComputerde
 
Nursing Shift Supervisor 24/7 in a week .pptx
amjadtanveer
 
Future_of_AI_Presentation for everyone.pptx
boranamanju07
 
202501214233242351219 QASS Session 2.pdf
lauramejiamillan
 
717629748-Databricks-Certified-Data-Engineer-Professional-Dumps-by-Ball-21-03...
pedelli41
 
introdution to python with a very little difficulty
HUZAIFABINABDULLAH
 
Data-Driven Machine Learning for Rail Infrastructure Health Monitoring
Sione Palu
 
M1-T1.pptxM1-T1.pptxM1-T1.pptxM1-T1.pptx
teodoroferiarevanojr
 
HSE WEEKLY REPORT for dummies and lazzzzy.pptx
ahmedibrahim691723
 
Multiscale Segmentation of Survey Respondents: Seeing the Trees and the Fores...
Sione Palu
 
WISE main accomplishments for ISQOLS award July 2025.pdf
StatsCommunications
 
An Uncut Conversation With Grok | PDF Document
Mike Hydes
 
Real Life Application of Set theory, Relations and Functions
manavparmar205
 
Data Security Breach: Immediate Action Plan
varmabhuvan266
 
MR and reffffffvvvvvvvfversal_083605.pptx
manjeshjain
 
White Blue Simple Modern Enhancing Sales Strategy Presentation_20250724_21093...
RamNeymarjr
 
blockchain123456789012345678901234567890
tanvikhunt1003
 
Insurance-Analytics-Branch-Dashboard (1).pptx
trivenisapate02
 
apidays Munich 2025 - Developer Portals, API Catalogs, and Marketplaces, Miri...
apidays
 

SQLNexus Copenhaguen - Pipeline for the new oil: Azure Data Factory, Hybrid Data Movement

Editor's Notes

  • #4: IMPORTANT : ONLY SHOW THIS SLIDE IF YOU HAVE COMMITED TO BE AT THE COMMUNITY ZONE
  • #27: https://support.office.com/en-us/article/An-Inside-look-at-Microsoft-Data-Management-Gateway-078D306D-2D28-409C-962B-D80B69A1D0B2
  • #28: Azure IP adresses (for Azure Service Bus) : http://www.microsoft.com/en-us/download/details.aspx?id=41653