Azure Cognitive Services for Developers
- 1. Azure Cognitive Services for Developers Marvin Heng, Microsoft MVP www.techconnect.io | @hmheng
- 2. • Software Engineer | AI MVP • Cognitive Services & Chatbot • @hmheng • www.techconnect.io Marvin Heng
- 3. Microsoft Build 2019 marks an important milestone for the evolution of Azure Cognitive Services with the introduction of new services and capabilities for developers.
- 5. After update….. Decision Vision Speech Search Language Content Moderator Anomaly Detector Computer Vision Face Video Indexer Custom Vision Speech Services Bing Web Search Bing Visual Search Bing Custom Search Bing Entity Search Bing Video Search Bing News Search Bing Image Search Bing Autosuggest Text Analytics Translator Text Bing Spell Check QnA Maker Content Moderator Language Understanding Preview Personalizer Preview Form Recognizer Ink Recognizer Updated Speaker Recognition Preview Bing Local Business Search
- 6. Preview • Cognitive service APIs: • Personalizer – creates personalized user experiences • Conversation transcription – transcribes in-person meetings in real-time • Form Recognizer – automates data-entry • Ink Recognizer – unlocks the potential of digital inked content
- 7. General Available (GA) • Neural Text-to-Speech • Computer Vision Read • Text Analytics Named Entity Recognition
- 8. Azure empowers developers to make reinforcement learning real for businesses with the launch of Personalizer.
- 9. Decision Introducing Personalizer, reinforcement learning for the enterprise
- 10. Personalizer • Provide information about your users and content and receive the top action to show your users. • No need to clean and label data before using Personalizer. • Provide feedback to Personalizer when it is convenient to you. • View real-time analytics. • Use Personalizer as part of a larger data science effort to validate existing experiments.
- 12. How does Personalizer work?
- 13. Where can I use Personalizer? • Personalize what article is highlighted on a news website. • Display a personalized "recommended item" on a shopping website. • Suggest user interface elements such as filters to apply to a specific photo.
- 14. For Developers • Send information (features) about your users and the content (actions) to personalize. Personalizer responds with the top action. • Send feedback to Personalizer about how well the ranking worked as a number typically between 0 and 1.
- 16. Speech In-person meetings just got better with conversation transcription
- 17. Conversation Transcription • Updated Speech-to-text service • Improves meeting efficiency by transcribing conversations in real- time • Integrates with a variety of meeting conference solutions including Microsoft Teams and other third-party meeting software. • SDK is available.
- 19. Conversation Transcription • Updated Speech-to-text service • Improves meeting efficiency by transcribing conversations in real- time • Help safeguard data with industry-leading security and compliance certifications. • Integrates with a variety of meeting conference solutions including Microsoft Teams and other third-party meeting software. • SDK is available.
- 21. Vision Unlocking the value of your content – from forms to digital inked notes
- 22. Two new Vision APIs • Form Recognizer • Ink Recognizer
- 23. Form Recognizer • Extract text and data from business’s forms and documents. • Easily extract text and structure, with simple REST API • Container support
- 25. Ink Recognizer • Recognize digital handwriting, common shapes, and the layout of inked documents. • Create experiences that combine the benefits of physical pen and paper with the best of the digital
- 28. Bringing AI to the Edge Unlocking the value of your content – from forms to digital inked notes
- 29. Container Support For Businesses AI Models At The Edge • Speech Services (Speech to Text & Text to Speech) • Anomaly Detector • Form Recognizer
- 31. More Improvements Enhanced Cognitive Services for Developers
- 32. More Enhanced Cognitive Services • Neural Text-to-Speech • Supports 5 voices and 9 regions • More voices available • Changing voice & emotion by using Speech Synthesis Markup Language <voice name='en-US-JessaNeural’> <mstts:express-as type="cheerful"> • Computer Vision • Multi-page documents • Improve capabilities for extracting text from the most common file types. • Now understands 10K+ concepts, scenes, and objects. • Expanded the set of recognized celebrities from 200K to 1M
- 33. More Enhanced Cognitive Services • Text Analytics • Named entity recognition - takes free-form text and identifies the occurrences of entities with 19 language supported. • QnA Maker • Supports multi-turn dialogs. • Enhancing its core capability of extracting dialog from PDFs or websites.
- 34. Demo – Facial Search with Face Verification A sample app empowered by Azure Cognitive Services
- 35. References • Personalizer • https://azure.microsoft.com/en-us/services/cognitive-services/personalizer/ • https://personalizationdemo.azurewebsites.net/ • Speech-To-Text • https://azure.microsoft.com/en-us/services/cognitive-services/speech-to-text/ • Form Recogizer • https://azure.microsoft.com/en-us/services/cognitive-services/form-recognizer/ • Ink Recognizer • https://azure.microsoft.com/en-us/services/cognitive-services/ink-recognizer/ • Speech • https://azure.microsoft.com/en-us/services/cognitive-services/speech-to-text/ • https://docs.microsoft.com/en-us/azure/cognitive-services/speech-service/speech-synthesis- markup
- 36. Azure Cognitive Services for Developers Marvin Heng, Microsoft MVP www.techconnect.io | @hmheng