Principal Technical Evangelist
Microsoft
Universidade Fernando Pessoa
Luís Calado
Principal Technical Evangelist
Microsoft
@elcalado
luis.calado@Microsoft.com
Data R&D @ DevScope
#PowerBI #SQLServer #Web
#Analytics #Azure #Microsoft
#MachineLearning #R #Linux
#Bots #Hadoop #Docker
#Python #Coaching #Learning
twitter.com/rquintino
rquintino.wordpress.com
rui.quintino@devscope.net
www.devscope.net
“jack of all trades (and master of none)“
1. a person who can do many different types
of work but who is not (necessarily…) very
competent at any of them…
Bringing it all together
The Seeing AI App
Computer Vision, Image, Speech Recognition, NLP,
and ML from Microsoft Cognitive Services
Watch Video HereRead Blog Here
DEMO
Cognitive Bots
DEMO
Computer Vision,
Face & Emotion APIs
Cognitive Services
#MicrosoftCognitive
Code sample - vision
using Microsoft.ProjectOxford.Vision;
using Microsoft.ProjectOxford.Vision.Contract;
// Create Cognitive Services Vision API Service client
VisionServiceClient VisionServiceClient = new VisionServiceClient(SubscriptionKey);
// Analyze the url for all visual features
VisualFeature[] visualFeatures = new VisualFeature[] {
VisualFeature.Adult,
VisualFeature.Categories,
VisualFeature.Color,
VisualFeature.Description,
VisualFeature.Faces,
VisualFeature.ImageType,
VisualFeature.Tags };
AnalysisResult analysisResult = await VisionServiceClient.AnalyzeImageAsync(imageUrl,
visualFeatures);
return analysisResult;
Code sample – face detect
public ObservableCollection<Face> DetectedFaces = new ObservableCollection<Face>();
var faceServiceClient = new FaceServiceClient(subscriptionKey);
Contract.Face[] faces = await faceServiceClient.DetectAsync(fileStream, false, true,
new FaceAttributeType[] { FaceAttributeType.Gender,
FaceAttributeType.Age,
FaceAttributeType.Smile,
FaceAttributeType.Glasses });
foreach (var face in faces) {
DetectedFaces.Add(new Face() {
ImagePath = SelectedFile,
Left = face.FaceRectangle.Left,
Top = face.FaceRectangle.Top,
Width = face.FaceRectangle.Width,
Height = face.FaceRectangle.Height,
FaceId = face.FaceId.ToString(),
Gender = face.FaceAttributes.Gender,
Age = string.Format("{0:#} years old", face.FaceAttributes.Age),
IsSmiling = face.FaceAttributes.Smile > 0.0 ? "Smile" : "Not Smile",
Glasses = face.FaceAttributes.Glasses.ToString(),
});
}
Code sample – emotions
using Microsoft.ProjectOxford.Emotion;
using Microsoft.ProjectOxford.Emotion.Contract;
// Create Project Oxford Emotion API Service client
EmotionServiceClient emotionServiceClient = new EmotionServiceClient(subscriptionKey);
try {
// Detect the emotions in the URL
Emotion[] emotionResult = await emotionServiceClient.RecognizeAsync(url);
return emotionResult;
}
catch (Exception exception) {
return null;
}
www.botframework.com
Bot Connector Service
Connect your bot(s) seamlessly to
text/sms, Office 365 mail, Skype,
Slack, Twitter and more
A service to register your bot,
configure channels and publish
to the Bot Directory
Bot Builder SDK
Everything you need to build
great dialogs within your Node.js
or C# bot
An open source SDK hosted
on GitHub
Bot Directory
Discover, try, and add bots to
conversation experiences
A public directory of bots
registered and approved with Bot
Framework
DEMO
Bot Framework
LUIS
Understand what your users are saying
Use pre-built Bing & Cortana models or
create your own
Cortana Intelligence Suite
Transform data into intelligent action
Intelligence
Dashboards &
Visualizations
Information
Management
Big Data Stores Machine Learning
and Analytics
CortanaEvent Hub
HDInsight
(Hadoop and
Spark)
Stream Analytics
Data
Sources
Apps
Sensors
and
devices
Data Intelligence Action
People
Automated
Systems
Apps
Web
Mobile
Bots
Bot
Framework
SQL Data
WarehouseData Catalog
Data Lake
Analytics
Data Factory
Machine
Learning
Data Lake Store
Blob Store
Cognitive
Services
Power BI
Custom
Models
(Machine Learning/
Deep Learning )
https://gist.github.com/rquintino/988880ad8705033519431d532ce6336c
http://azure.microsoft.com
https://www.microsoft.com/cognitive-services/en-us/documentation
https://www.microsoft.com/cognitive-services
https://github.com/Microsoft/ProjectOxford-clientsdk
The Bot Framework
http://botframework.com/
Bot Builder
https://github.com/Microsoft/BotBuilder
Microsoft Cognitive Services & Bot Framework - Universidade Fernando Pessoa

Microsoft Cognitive Services & Bot Framework - Universidade Fernando Pessoa

Editor's Notes

  • #5 Here’s a preview of the Seeing AI app, which started as a research project that helps people who are visually impaired or blind to understand who and what is around them. The app will use computer vision, image & speech recognition, natural language processing and machine learning from Microsoft Cognitive Services. The app is under development and is not available today but it shows what’s possible with the APIs.
  • #6 Xiaomin
  • #9 Xiaomin
  • #13 Why choose these APIs? They work, and it’s easy. Easy:  The APIs are easy to implement because of the simple REST calls.  Being REST APIs, there’s a common way to implement and you can get started with all of them for free simply by going to one place, one website, www.microsoft.com/cognitive.  (You don’t have to hunt around to different places.)  Flexible:  We’ve got a breadth of intelligence and knowledge APIs so developers will be able to find what intelligence feature they need; and importantly, they all work on whatever language, framework, or platform developers choose. So, devs can integrated into their apps—iOS, Android, Windows—using their own tools they know and love (such as python or node.js, etc.). Tested: Tap into an ever-growing collection of powerful AI algorithms developed by experts. Developers can trust the quality and expertise build into each API by experts in their field from Microsoft’s Research organization, Bing, and Azure machine learning and these capabilities are used across many Microsoft first party products such as Cortana, Bing and Skype. 
  • #14 Todo: Change to generic icons (no inner logo)
  • #15 Xiaomin
  • #16 Xiaomin
  • #17 Xiaomin
  • #21 Xiaomin
  • #28 Xiaomin
  • #36 Xiaomin