Microsoft Building AI-Powered Apps
Microsoft Building AI-Powered Apps
Building AI-Powered
Applications
Virtual live event
November 14th, 2-4pm (CET)
Speakers Yu Guo Daan Duurkoop
VP of Engineering VP of Product
TomTom TomTom
Lif Neergaard
Ivan Diaz
App Innovation
Principal Staff Engineer
Technical Specialist
TomTom
Microsoft
Opening (5 mins)
Closing: 5 minutes
Reimagining app
development in the era of
AI
Xiaopeng Li
AI & Intelligent Apps Lead, Microsoft
This is a new moment for AI
2021
Generative AI
create new written, visual, and auditory
1950’s content given prompts or existing data.
Artificial Intelligence
the field of computer science that seeks
to create intelligent machines that can
replicate or exceed human intelligence.
2017
1959
Deep Learning
a machine learning technique in which
Machine Learning layers of neural networks are used to
subset of AI that enables machines to process data and make decisions.
learn from existing data to make
decisions or predictions
Generative AI has the potential to create $2.6 to $4.4
trillion in value across industries and automate
activities that absorb 60-70% of employees’ time.
The economic potential of generative AI, McKinsey June 2023
AI has forever changed what software makes possible
Intelligent apps
Platform Shift
Data-driven, personalized
Constrained interactions experiences that improve over time
1 2 3 4 5 6 7
Using federated learning techniques along with Azure Machine Learning and Azure
Confidential Computing, Swift and Microsoft are building an anomaly detection model for
transactional data—all without copying or moving data from secure locations. The shared
vision is that the model will become the new standard for reducing financial crime while
achieving the highest level of security, privacy, and cost efficiency.
Service and support
To change how it engages with customers, the multinational telco Telefonica used
Microsoft Azure Bot Service and Cognitive Services to build and support Aura, an
intelligent conversational agent for multiple services. With Aura, Telefonica customers can
manage their products and services with the company, get real-time support, or just
change the TV channel, all through natural voice interaction and personalized user
experience.
Information and product discovery
HEINEKEN wants to explore the capabilities of AI across the organization in a way that
builds on past experience and takes advantage of the latest developments. The company
has begun using Azure OpenAI Service and its built-in ChatGPT capabilities to build
chatbots for employees to easily discover information, while also using other Azure AI
services to modernize existing business processes.
Build your own copilots
Swedish fashion retailer Lindex built “Lindex Copilot” with Azure OpenAI
Service to offer contextually relevant and personalized support to store
employees.
Microsoft uses the same services and tools for intelligent
app innovation
Ensure your people have Develop app with Build and modernize with
the right skills, effectively modern methodologies, a modern app platform,
manage change, and focus strengthen security, scalable data services, and
on amplifying productivity. apply AI responsibly, and pretrained and
handle any data types. responsible AI.
Building and modernizing
intelligent apps with Azure
Apps Data
In the age of AI,
every app should
be intelligent
AI
18
Essential elements of intelligent applications
State of the art pre-trained AI Ability to handle high volumes of Developer-ready environments to
models that are easy to unstructured data, in real time, ship apps securely, and quickly in
discover, customize, and from disparate sources their language of choice.
integrate into new and existing
enterprise applications. App platform that can scale based Enable frequent iteration by
on the app's demand and ensure streamlining costly and time-
reliable performance. consuming app delivery.
Build intelligent applications on Azure
Cloud app
platform Azure
Kubernetes
Azure
App Service
Azure
Container
Azure
Functions
Service Apps
Data at
scale Azure
SQL family
Azure
PostgreSQL
Azure
Cosmos DB
OpenAI Service)
Azure Kubernetes Service
Juergen Etzlstorfer, App Innovation Specialist
Challenges for modern developers
App Server on
Containers, Infrastructure abstraction,
single machine
Serverless
Many tools,
Managed databases, AI models, APIs
ad hoc automation
Emerge stronger
by embracing technology and
open source to differentiate
and be productive
ACHIEVE EFFICIENCY with EXCELLENCE
Achieve efficiency
when you securely modernize and optimize with excellence
Optimize workload costs Rely on AKS automation Modernize your apps and
build cloud native
1. The Total Economic Impact™ Of Microsoft Azure Advisor – a commissioned study conducted by Forrester Consulting. Published June 2022 and The Total Economic Impact™ of Azure Cost Management and Billing—a commissioned study conducted by
Forrester Consulting. Published: February 2021. Results are for a composite organization based on interviewed customers over three years.
2. The Business Value of Migrating and Modernizing with Azure
3. The Total Economic Impact™ of Microsoft Azure PaaS
4. The Business Value of Migrating and Modernizing with Azure, sponsored by Microsoft Azure, #US49665122 Published: 9/24/2022
MAXIMIZE VALUE RELIABLY
Maximize value
by recognizing the full value of the AKS + Azure
1. The Total Economic Impact™ Of Microsoft Azure Arc for Security and Governance – a commissioned study conducted by Forrester Consulting. Published June 2022
2. The Total Economic Impact™ Of Microsoft Azure Advisor – a commissioned study conducted by Forrester Consulting. Published June 2022
3. The Cost of Enterprise Downtime, Tech Channel
End-to-end Cloud Native path
Community Security AI
GitHub
Azure Arc
DIFFERENTIATE AND FUTURE PROOF GROWTH
Emerge Stronger
by embracing technology to differentiate
1. https://www.accenture.com/us-en/services/applied-intelligence/unstructured-data-solutions
Modern app
devs need
modern
databases
AI-powered web and
mobile experiences
AI models in Azure.
Apps Azure
Add high-quality vision, speech, language, and Azure
Open AI
Azure Azure
Cosmos DB Kubernetes Service GitHub
ASOS (1 of 2)
Intelligent engine running on Azure
Cosmos DB and Azure Machine
Learning, providing real-time product
recommendations and instant order
updates for 26M+ global customers.
GPT-4 &
DALL·E 2 Whisper
GPT-3.5-Turbo
Text, Chat & Code Images Transcription &
Translation
GPT-4 and GPT-3.5-Turbo
Data Sources
(search, files, databases, storage etc.)
API & SDK
OUT
Whisper
IN Audio
+ 54 other languages
Introduction to top use cases
Business Need for process Degraded Customer Creating Content is Time
Productivity is lagging
Problem Automation Experience Consuming
Retail: Becoming friends with your web shop Normally you would have to click
through a website in your search for
Personalized shopping is a way of offering the right piece of kids wear.
products and services that match your preferences
RESULT
and needs. By using natural language, you can
Now you can chat your way to the
express your wishes and expectations in a simple
correct piece of kids wear and even
and natural way and get recommendations that
have the weather considered. You can
suit your taste and style. communicate with the web shop as if
For example, if you are looking for kids wear, you you were talking to a friend or a
can type or say something like “I want a jacket for salesperson and get personalized and
helpful feedback.
my 11-year-old son”.
search and discover new possibilities. Through Azure Functions, Azure Storage,
natural language the web shop will provide you Azure Cognitive Search, Azure
with relevant answers and suggestions, and help OpenAI, Weather API, and React
Metaprompt
Foundation models
AI infrastructure
Build your own Azure OpenAI
Azure OpenAI
Data Sources
(search, files, databases, storage etc.)
Henri Schulte
Data & AI Cloud Solution Architect
Effective AI automation
Solution: AI agents
Solution: Plugins
https://github.com/microsoft/autogen
https://github.com/HenriSchulte-MS/FlightBookingWithAIAgents/
TomTom’s journey of building
AI-powered applications
Yu Guo, VP of Engineering, TomTom
Daan Duurkoop, VP of Product, TomTom
Ivan Diaz, Principal Staff Engineer, TomTom
Build and Modernize
AI Applications @
TomTom
Copyright © 2023 TomTom
Everywhere location data and
mapping services are needed,
there is TomTom
Automotive
HUD
Center
Companion app Stack Passenger
Cluster Display Display
APIs
Platform Services
Rear seat
Passenger
Displays
Ivan Diaz
Principal Staff Software Engineer
Traditional IVIs
• Basic voice commands
• Limited interactivity
• Pre-set functions
Conversational lVIs
• Dynamic interactions
• Context-aware conversations
• Powered by advanced LLMs
Feature
Exploration Integration Optimization Feedback
Expansion
• Architecture Definition
• In-Vehicle Integration
• SDK-Based Integration
• System Evaluation
• Multi-language Support
• Performance Enhancements
Digital Cockpit
Speech SDK Azure Speech
Services
Plugins
Plugins
Vehicle Access
Location Bing
Services
Azure Kubernetes
Services
Digital Cockpit
Speech SDK Azure Speech
Services
Plugins
Plugins
Architecture Vehicle Access
Location Bing
Services
Azure Kubernetes
Services
What’s next:
• Offline Speech services
• Specialized LLMs for offline capabilities
Structure to Centralized
Innovation
Democratize Hub
Team
Support
Innovation Team Team
Team Team
Leadership
Influence Office
GemAI AI
Hours
Workshop Newsletter
Build Evolving
Knowledge
AMA / Base
Fireside
Lead chats Customized
Training Hackathons
Onboarding
GenAI
Road
Shows
Internal AI
External Community
Collaboration
& Partnership
Dec. 2022 Mar. 2023 May 2023 July 2023 Sept. 2023 Nov. 2023
ChatGPT 3.5 Brower version of Github Copilot Launched world's AI based PR review Tommy @ Microsoft
released | Tommy available available 1st location plugin tool Story
Start GenAI for ChatGPT
exploration @ Q/A chatbots with Document
TomTom internal translation
documentation
Customer support
chatbots
Jan. 2023 Apr. 2023 June 2023 Aug. 2023 Oct. 2023 Jan. 2024
Dec. 2022 Mar. 2023 May 2023 July 2023 Sept. 2023 Nov. 2023
ChatGPT 3.5 Brower version Github Copilot Launched AI based PR review Tommy @ Microsoft
released | available tool Story
of Tommy world's 1st
Start GenAI
exploration @
available location plugin Q/A chatbots with Document
TomTom for ChatGPT internal translation
documentation
Customer support
chatbots
Jan. 2023 Apr. 2023 June 2023 Aug. 2023 Oct. 2023 Jan. 2024
Application Platform
AI Builder
Power BI Power Apps Power Automate Power Virtual Agents
Scenario-Based
Services
Bot Service Cognitive Search Document Intelligence Video Indexer Metrics Advisor Immersive Reader
Useful Links 2
Deepen your knowledge by exploring Azure AI
documentation and learning content
https://learn.microsoft.com/en-us/azure/ai-services/