0% found this document useful (0 votes)
449 views105 pages

Microsoft Building AI-Powered Apps

Microsoft will host a virtual event on November 14th from 2-4pm CET called "Microsoft Discovery Day: Building AI-Powered Applications". The event will feature speakers from Microsoft and TomTom discussing how to reimagine app development using AI, building intelligent apps with Azure, and a demo of Azure tools. The agenda also includes TomTom sharing their journey of building AI applications.

Uploaded by

Jonas Melotte
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
0% found this document useful (0 votes)
449 views105 pages

Microsoft Building AI-Powered Apps

Microsoft will host a virtual event on November 14th from 2-4pm CET called "Microsoft Discovery Day: Building AI-Powered Applications". The event will feature speakers from Microsoft and TomTom discussing how to reimagine app development using AI, building intelligent apps with Azure, and a demo of Azure tools. The agenda also includes TomTom sharing their journey of building AI applications.

Uploaded by

Jonas Melotte
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
You are on page 1/ 105

Microsoft Discovery Day:

Building AI-Powered
Applications
Virtual live event
November 14th, 2-4pm (CET)
Speakers Yu Guo Daan Duurkoop
VP of Engineering VP of Product
TomTom TomTom

Lif Neergaard
Ivan Diaz
App Innovation
Principal Staff Engineer
Technical Specialist
TomTom
Microsoft

Henri Schulte Jürgen Etzlstorfer


Data & AI Cloud App Innovation
Solution Architect Specialist
Microsoft Microsoft

Davide Del Vecchio


Xiaopeng Li
Global Back Belt Senior
Western Europe AI Lead
Data Specialist
Microsoft
Microsoft
Agenda Times are approximate

November 14th , 2023

Opening (5 mins)

Reimagining app development in the era of AI (25 mins)

Building and modernizing intelligent apps with Azure (45 mins)

Demo: Azure OpenAI + Sementic Kernel + AutoGen (10 mins)

TomTom’s journey of building AI-powered applications (30 mins)

Closing: 5 minutes
Reimagining app
development in the era of
AI
Xiaopeng Li
AI & Intelligent Apps Lead, Microsoft
This is a new moment for AI
2021

Generative AI
create new written, visual, and auditory
1950’s content given prompts or existing data.

Artificial Intelligence
the field of computer science that seeks
to create intelligent machines that can
replicate or exceed human intelligence.

2017
1959
Deep Learning
a machine learning technique in which
Machine Learning layers of neural networks are used to
subset of AI that enables machines to process data and make decisions.
learn from existing data to make
decisions or predictions
Generative AI has the potential to create $2.6 to $4.4
trillion in value across industries and automate
activities that absorb 60-70% of employees’ time.
The economic potential of generative AI, McKinsey June 2023
AI has forever changed what software makes possible

It’s elevating It’s reshaping It’s rejuvenating


our expectations every industry transformation

ChatGPT crossed 1 million The value of AI is projected 87% of organizations believe


users in 5 days of launch, to increase 13x – to $15.7 AI will give them
setting the platform record1 trillion by 20302 a competitive edge3

1 OpenAI public statements


2 Global Artificial Intelligence Study: Exploiting the AI Revolution, PwC
3 AI Global Executive Study and Research Project, MIT Sloan and BCG
Generative AI makes apps truly intelligent

Intelligent apps

Current apps Natural language interaction

Platform Shift
Data-driven, personalized
Constrained interactions experiences that improve over time

Quickly deliver new features


Hard-coded and fixed data sets

Change is costly and complex


Azure powers
OpenAI’s ChatGPT innovation
No matter where you are in your cloud journey,
you can modernize existing applications and build new ones
with AI

1 2 3 4 5 6 7

Connected Transaction Real-time Service & Information Personalize Build


smart processing fraud support & product and your own
products at scale detection bot discovery recommend copilots
Real-time fraud detection

Using federated learning techniques along with Azure Machine Learning and Azure
Confidential Computing, Swift and Microsoft are building an anomaly detection model for
transactional data—all without copying or moving data from secure locations. The shared
vision is that the model will become the new standard for reducing financial crime while
achieving the highest level of security, privacy, and cost efficiency.
Service and support

To change how it engages with customers, the multinational telco Telefonica used
Microsoft Azure Bot Service and Cognitive Services to build and support Aura, an
intelligent conversational agent for multiple services. With Aura, Telefonica customers can
manage their products and services with the company, get real-time support, or just
change the TV channel, all through natural voice interaction and personalized user
experience.
Information and product discovery

HEINEKEN wants to explore the capabilities of AI across the organization in a way that
builds on past experience and takes advantage of the latest developments. The company
has begun using Azure OpenAI Service and its built-in ChatGPT capabilities to build
chatbots for employees to easily discover information, while also using other Azure AI
services to modernize existing business processes.
Build your own copilots

Swedish fashion retailer Lindex built “Lindex Copilot” with Azure OpenAI
Service to offer contextually relevant and personalized support to store
employees.
Microsoft uses the same services and tools for intelligent
app innovation

AI-based Copilot for Work Biometric identify Personalized Copilot


search with across Office 365 verification recommendations assisted coding
ChatGPT

Innovate on a pressure tested AI platform


Follow the right steps to drive value for your business

Train and enable Modernize your Leverage the


your people processes right technology

Ensure your people have Develop app with Build and modernize with
the right skills, effectively modern methodologies, a modern app platform,
manage change, and focus strengthen security, scalable data services, and
on amplifying productivity. apply AI responsibly, and pretrained and
handle any data types. responsible AI.
Building and modernizing
intelligent apps with Azure
Apps Data
In the age of AI,
every app should
be intelligent

AI

18
Essential elements of intelligent applications

Pre-trained models Scalability and high Simplified app


performance delivery

State of the art pre-trained AI Ability to handle high volumes of Developer-ready environments to
models that are easy to unstructured data, in real time, ship apps securely, and quickly in
discover, customize, and from disparate sources their language of choice.
integrate into new and existing
enterprise applications. App platform that can scale based Enable frequent iteration by
on the app's demand and ensure streamlining costly and time-
reliable performance. consuming app delivery.
Build intelligent applications on Azure

Cloud app
platform Azure
Kubernetes
Azure
App Service
Azure
Container
Azure
Functions
Service Apps

Data at
scale Azure
SQL family
Azure
PostgreSQL
Azure
Cosmos DB

Pretrained and Azure

responsible AI Azure AI Services


(including Azure
AI Studio

OpenAI Service)
Azure Kubernetes Service
Juergen Etzlstorfer, App Innovation Specialist
Challenges for modern developers

Agility Reliability Security


Adopt a better software development paradigm
Traditional Cloud-Native

Monolithic Apps Microservice/Composite apps

Waterfall/Sequential DevOps and CI/CD, Iterative releases

App Server on
Containers, Infrastructure abstraction,
single machine
Serverless

Many tools,
Managed databases, AI models, APIs
ad hoc automation

Designated deploys Always shipping code and business value


Building cloud-native apps

Increase developer velocity


Invoice Supply
Global scale and geographic reach Chain

Greater transaction volumes


Microservices
Massive data volume AKS

Multi layered security

High data velocity


Azure Cosmos DB

Frequently changing data shape


Data / events
High resiliency and availability at massive scale
Achieve efficiency
by modernizing securely &
with operational excellence

Achieve more with


Maximize value
Azure Kubernetes by ensuring resilience and

Service realizing the full potential


of the cloud

Emerge stronger
by embracing technology and
open source to differentiate
and be productive
ACHIEVE EFFICIENCY with EXCELLENCE

Achieve efficiency
when you securely modernize and optimize with excellence

Optimize workload costs Rely on AKS automation Modernize your apps and
build cloud native

Up to 34% Up to 53% Up to 50%


Lower AKS costs by optimizing Improvement in efficiency of IT & Dev Increased speed of secure app
workload costs by resizing resources teams by letting AKS take care of development with AKS.3
with cost management insights and time-consuming management tasks2
leveraging intelligent autoscaling.1

1. The Total Economic Impact™ Of Microsoft Azure Advisor – a commissioned study conducted by Forrester Consulting. Published June 2022 and The Total Economic Impact™ of Azure Cost Management and Billing—a commissioned study conducted by
Forrester Consulting. Published: February 2021. Results are for a composite organization based on interviewed customers over three years.
2. The Business Value of Migrating and Modernizing with Azure
3. The Total Economic Impact™ of Microsoft Azure PaaS
4. The Business Value of Migrating and Modernizing with Azure, sponsored by Microsoft Azure, #US49665122 Published: 9/24/2022
MAXIMIZE VALUE RELIABLY

Maximize value
by recognizing the full value of the AKS + Azure

Increase productivity of Improve workload Prioritize business continuity


hybrid & on-prem workloads performance & disaster recovery

Up to 206% Up to 33% Average $300k


Potential 3-year ROI and reduced Reduce in workload performance Average per-hour cost of
spend on 3rd party tools used to problems provides greater team enterprise downtime
3

manage multi-cloud & hybrid productivity and satisfaction2


environments1

1. The Total Economic Impact™ Of Microsoft Azure Arc for Security and Governance – a commissioned study conducted by Forrester Consulting. Published June 2022
2. The Total Economic Impact™ Of Microsoft Azure Advisor – a commissioned study conducted by Forrester Consulting. Published June 2022
3. The Cost of Enterprise Downtime, Tech Channel
End-to-end Cloud Native path
Community Security AI

Azure Azure Microsoft Cognitive Services Applied AI Machine Learning


Active Policy Defender
Directory

Development tools Platform Managed databases Storage

GitHub

Azure Azure Kubernetes Azure Azure Azure Azure Azure


Visual Studio Code Kubernetes Fleet PostgreSQL Cosmos DB SQL family MySQL & Storage
Service Manager MariaDB
Azure API Management

Cloud operations anywhere


Azure Container Registry

Azure Arc
DIFFERENTIATE AND FUTURE PROOF GROWTH

Emerge Stronger
by embracing technology to differentiate

Infuse intelligence to unlock Focus on code that matters to Increase


new, impactful scenarios accelerate app development sustainability

1,000+ 88% 92%


Customers are using Azure OpenAI Developers feel up to 88% more Reduce energy usage up
services, applying the most satisfied in their jobs and can complete to 92% and carbon
2 3
advanced AI models to innovate in tasks 55% faster with GitHub Copilot emissions up to 98%
2
new ways

1. ChatGPT is now available in Azure OpenAI Service – Blog March 2023


2. Research: quantifying GitHub Copilot’s impact on developer productivity and happiness | The GitHub Blog
3. The Carbon Benefits of Cloud Computing: a Study of the Microsoft Cloud
Customer Success Story

Every day, more than 1 million travelers


rely on the timely services of ÖBB—
Austrian Federal Railways—Austria’s
largest mobility services provider. As one of
the most punctual train services in Europe,
ÖBB prides itself on efficiency and great
customer service by offering a range of
mobility solutions that get people and
goods where they need to go. The
Ticketshop platform on Azure is an
example of innovation in efficiency for ÖBB
customers, who use it like a ticket counter,
travel guide, and travel agency all rolled
into one.

Microsoft Customer Story-ÖBB gains greater scale and state-of-the-art security


measures by moving ticket sales to the Azure cloud platform
Azure Cosmos DB
Davide Del Vecchio, Global Black Belt Senior Data Specialist
Data challenges for intelligent apps

Lots of data, Unstructured data Real-time data


many sources 80% of enterprise data
is unstructured1

1. https://www.accenture.com/us-en/services/applied-intelligence/unstructured-data-solutions
Modern app
devs need
modern
databases
AI-powered web and
mobile experiences

Build AI-powered apps with Simplified app


development
Azure Cosmos DB
Fast, distributed NoSQL
and relational database at Mission-critical
performance at any scale
any scale

Fully managed and


cost-effective
Azure Cosmos DB powers scalable, high-performance
apps anywhere in the world

AI-powered apps Internet of Personalized Order and Multi-tenant


Things recommendations payment SaaS
processing applications
AI-powered web and mobile Azure Cosmos DB for the era of AI
experiences Data
sources
Azure Consumers

 Build the future faster and more responsibly by


powering your intelligent apps using large-scale Databases

AI models in Azure.
Apps Azure
 Add high-quality vision, speech, language, and Azure
Open AI

decision-making AI models to your apps Cosmos DB


with Vector
through simple API calls Files
Search

 Leverage the supercomputing infrastructure of


Azure to process vast amounts of data using
machine learning models of your choice Azure App
Consumers/
End Users
Service
 Use generative AI technologies such as Intelligent
App UX
ChatGPT to unlock new efficiencies in any app
in every industry
Simplified app development
 Easily build cloud-native apps with a single distributed Azure Cosmos DB for:
database service for both relational and NoSQL data:
 Offers scalability and performance with native NoSQL
service, and MongoDB- and Cassandra-compatible
options. W!
NE
 Supports native, open-source PostgreSQL, with ACID
compliance, rich SQL querying, and PostgreSQL extensions.
 Integration with Azure Synapse Analytics, Azure
Kubernetes Service, and Azure Functions
 SDKs for .NET, Java, Python, and Node.js
 Change feed to easily track and manage changes to
database containers
 Automatic indexing of all your data
 Run advanced analytics over real-time data with Azure
Synapse Link
Performance at any scale
 Azure Cosmos DB offers a comprehensive suite
of SLAs
 99.999% availability worldwide,
 <10 ms latency
 Azure Cosmos DB delivers zero downtime with 0
RPO
 Continuous back up and point-in-time restore
 Enjoy enterprise-grade end-to-end encryption
and self-managed keys
 Role-based access control keeps your data safe
and offers fine-tuned control
Fully managed and
cost-effective
 Automatic maintenance and updates
 Serverless and autoscale options keep costs
low by matching resources to demand, and
eliminating capacity management and over-
provisioning
 Scale up and/or out to optimize workloads
 vCore and node options for PostgreSQL data
OpenAI
Challenge
ChatGPT scales to ▪ Meet incredible demand from traffic spikes, without having
to worry about database operations
tremendous
performance with Outcomes
Rapidly and seamlessly scaled real-time data handling
Azure Cosmos DB

as service grew, with zero downtime
▪ Maintained high performance and experience, thanks to
Popular AI chatbot with 100M+ Azure Cosmos DB elastic scale and guaranteed SLAs

monthly active users stores


responses in Azure Cosmos DB, Key Azure products used:
with real-time ingestion.

Azure Azure
Cosmos DB Kubernetes Service GitHub
ASOS (1 of 2)
Intelligent engine running on Azure
Cosmos DB and Azure Machine
Learning, providing real-time product
recommendations and instant order
updates for 26M+ global customers.

Azure Cosmos DB delivers:


<10 ms latency reads and writes
Global data distribution
Instant elastic scalability
Change feed for order workflows and
microservices
Azure OpenAI Service
Henri Schulte, Data & AI Cloud Solution Architect
Microsoft and OpenAI partnership

Ensure that artificial Empower every person


general intelligence and organization on the
(AGI) benefits humanity planet to achieve more

Azure OpenAI Service

GPT-4 &
DALL·E 2 Whisper
GPT-3.5-Turbo
Text, Chat & Code Images Transcription &
Translation
GPT-4 and GPT-3.5-Turbo

Natural language prompt + data context


“Based on the text below, how
IN long is the contract duration?
Contract:
The next level in text …”
generation with improved
alignment Natural language response
The provided contract has a duration of 24 months,
OUT if signed before 31/12/2023, and 36 months if
signed after that date.
As the contract was signed on 01/11/2023, the
contract duration is 24 months.
Azure OpenAI Service on your data

Data Sources
(search, files, databases, storage etc.)
API & SDK

App or Azure OpenAI


Copilot agent Service on your data
Additional 3P Data Sources
(files, databases, storage data etc.)
GPT-4 and GPT-3.5-Turbo

Natural language prompt + data context


Based on the contract below, fill in the following
JSON template: {…}
Contract:
IN

The next level in text
generation with improved
alignment Structured response
{
OUT “party1”: “Jane Smith”,
“party2”: “Contoso”,
“signing_date”: “01/11/2023”,
“duration_months”: 24
}
GPT-4 and GPT-3.5-Turbo

Natural language prompt


Give me a python script to
IN transform lowercase text into
The next level in text uppercase

generation with improved


alignment Code response
def convert_to_uppercase(input_string):
OUT return input_string.upper()

input_string = input("Enter a string in lowercase:


")
output_string = convert_to_uppercase(input_string)

print("The string in uppercase is: ",


output_string)
DALL-E

Natural language prompt


IN Cute cartoon frog,
white background
The next level in text-
to-image generation

OUT
Whisper

IN Audio

The next level


in transcription and
translation English Danish Italian
The quick brown Den hurtige La volpe
OUT fox jumps over brune ræv marrone rapida
the lazy dog hopper over den salta sopra il
dovne hund cane pigro

+ 54 other languages
Introduction to top use cases
Business Need for process Degraded Customer Creating Content is Time
Productivity is lagging
Problem Automation Experience Consuming

Business Improve Customer


Increase Productivity Automate Processes Build Creative Content
Needs Experience

• Conversational • Document Processing • Intelligent Contact • Marketing/Sales Content


Search/Knowledge • Workflow Management Center Generation
Insights • Agent/Employee • Personalized Content
• Fraud Detection
• Code Generation and Assistance Generation
Solutions Documentation • Supply Chain
Optimization • Virtual Assistance • Product Design &
• Trend Forecasting • Call Analytics Development
• Report Summarization & • Call Summarization • Digital Art
Generation

Generate New Revenue Streams


What can
Generative Deliver Differentiated Customer Experiences
AI Do? Modernize Internal Processes
CASE
CHALLENGE

Retail: Becoming friends with your web shop Normally you would have to click
through a website in your search for
Personalized shopping is a way of offering the right piece of kids wear.
products and services that match your preferences
RESULT
and needs. By using natural language, you can
Now you can chat your way to the
express your wishes and expectations in a simple
correct piece of kids wear and even
and natural way and get recommendations that
have the weather considered. You can
suit your taste and style. communicate with the web shop as if
For example, if you are looking for kids wear, you you were talking to a friend or a

can type or say something like “I want a jacket for salesperson and get personalized and
helpful feedback.
my 11-year-old son”.

Natural language can also help you refine your TECHNOLOGY

search and discover new possibilities. Through Azure Functions, Azure Storage,
natural language the web shop will provide you Azure Cognitive Search, Azure

with relevant answers and suggestions, and help OpenAI, Weather API, and React

you narrow down your choices.

EMPLOYEES INDUSTRY COUNTRY

1000+ Retail Finland/Denmark


Lucinity built “Luci”, an AI copilot powered by Azure
OpenAI Service, to help frontline analysts and financial
crime investigators more efficiently detect and prevent
financial crimes.
It’s time to develop your own custom copilots
Apps

Plugin extensibility Microsoft Copilots


+ your copilots
Copilots

Prompt Flow & Model Evaluation

Metaprompt

Data grounding Built-in safety


Azure AI system and
Plugin execution
responsible AI tools

Foundation models

AI infrastructure
Build your own Azure OpenAI

Copilot with (GPT-3.5-Turbo,


GPT-4)

Azure OpenAI

Data Sources
(search, files, databases, storage etc.)

User interface Orchestrator


Applications & Skills
(Dynamics 365, Office 365, Jira, etc.)
You can have confidence when using Azure OpenAI
Service
When you use Azure OpenAI Service, your prompts (inputs) and completions (outputs), your
embeddings, and your training data

Are NOT available to other customers. The Azure OpenAI


Service is fully
ARE NOT available to OpenAI. controlled by
Microsoft; Microsoft
Are NOT used to improve OpenAI models. hosts the OpenAI
models in Microsoft’s
Are NOT used to improve any Microsoft or 3rd party products or services. Azure environment and
the Service does NOT
Are NOT used for automatically improving Azure OpenAI models for your use interact with any
in your resource (The models are stateless, unless you explicitly fine-tune services operated by
models with your training data). OpenAI (e.g., ChatGPT,
or the OpenAI API).
Your fine-tuned Azure OpenAI models are available exclusively for your use.
Generative AI
does not have
to be a chatbot

Image (incl. text) generated with DALL-E 3 in Bing Image Creator


AI-Powered Apps Demo
Lif Neergaard
Application Innovation Technical Specialist

Henri Schulte
Data & AI Cloud Solution Architect
Effective AI automation

Not all tasks require human input at


every step. A chatbot is not always a
good fit.

Solution: AI agents

Large Language Models alone can’t do


much. Most tasks require the use of
special tools.

Solution: Plugins

Image generated with DALL-E 3 in Bing Image Creator


Flight Booking with AI agents

AI agents from AutoGen

https://github.com/microsoft/autogen

Plugins and functions from Semantic Kernel

Powered by Azure OpenAI,


and Azure CosmosDB
https://github.com/microsoft/semantic-kernel

https://github.com/HenriSchulte-MS/FlightBookingWithAIAgents/
TomTom’s journey of building
AI-powered applications
Yu Guo, VP of Engineering, TomTom
Daan Duurkoop, VP of Product, TomTom
Ivan Diaz, Principal Staff Engineer, TomTom
Build and Modernize
AI Applications @
TomTom
Copyright © 2023 TomTom
Everywhere location data and
mapping services are needed,
there is TomTom

Copyright © 2023 TomTom


Passenger cars Commercial vehicles Two-wheelers

Automotive

Digital Cockpit & Navigation ADAS & Automated Driving

Maps Software Services


64
Copyright © 2023 TomTom
Today’s presenters

Ivan Diaz Yu Guo


Principal Staff Software Engineer VP Software Engineering

Daan Duurkoop George de Boer (host)


VP Product Management Global Marketing Director,
Digital Cockpit TomTom Automotive
Copyright © 2023 TomTom
Digital Cockpit
Daan Duurkoop
VP Product Management
TOMTOM DIGITAL COCKPIT

TomTom’s open and modular cockpit HMI


development platform that you can build upon

Copyright © 2023 TomTom


TomTom Digital Cockpit across all screens
Open and modular cockpit HMI development platform built on Android Automotive OS

HUD
Center
Companion app Stack Passenger
Cluster Display Display

TomTom Digital Cockpit Platform


Applications

APIs

Platform Services

RTOS Android Automotive (AAOS) VHAL

Rear seat
Passenger
Displays

Copyright © 2023 TomTom


Highly customizable with little effort

Copyright © 2023 TomTom


Highly customizable with little effort

Copyright © 2023 TomTom


Highly customizable with little effort

Copyright © 2023 TomTom


Highly customizable with little effort

Copyright © 2023 TomTom


Ready to use, off the shelf,
applications for the core
infotainment areas:
• Phone & Messaging
• Music
• Navigation
• Voice assistant

Copyright © 2023 TomTom


Great developer & designer experience

Copyright © 2023 TomTom


74
Copyright © 2023 TomTom
HowHow to create
to create more
more value
forvalue forand
drivers drivers?
OEMs?

Copyright © 2023 TomTom


76
What about having a
conversation with your car?

• Drivers struggle with complex in-car technology.

• Even basic tasks still cumbersome.

• Hands-free controls don't ensure driver focus.

Copyright © 2023 TomTom


What do drivers expect?

• Drivers seek personalized, effortless


experiences.

• Cars should adapt to user needs.

• High demand for versatile voice


assistants.

Copyright © 2023 TomTom


AI Project Tommy
Overview and Architecture

Ivan Diaz
Principal Staff Software Engineer

Copyright © 2023 TomTom


Why consider a conversational IVI

Traditional IVIs
• Basic voice commands
• Limited interactivity
• Pre-set functions

Conversational lVIs
• Dynamic interactions
• Context-aware conversations
• Powered by advanced LLMs

Copyright © 2023 TomTom


From an idea to in-vehicle integration
The journey from exploration to integration

Feature
Exploration Integration Optimization Feedback
Expansion

Copyright © 2023 TomTom


Exploration
• Leveraged GPT capabilities.
• Explored tools like Langchain and
Semantic Kernel.
• Tested with a basic input for
integration feasibility.

Copyright © 2023 TomTom


Feature Expansion &
Proof of Concept
• Speech Integration
• Enhanced Use Cases
• Web App Version
• Feature-Centric
• External Service Integration

Copyright © 2023 TomTom


Integration

• Architecture Definition
• In-Vehicle Integration
• SDK-Based Integration
• System Evaluation
• Multi-language Support
• Performance Enhancements

Copyright © 2023 TomTom


In-Vehicle Cloud

Digital Cockpit
Speech SDK Azure Speech
Services
Plugins

Architecture Retrieve status.


Execute commands
Azure
Cosmos DB
Azure
Open AI
Language
Understanding

Plugins
Vehicle Access

Location Bing
Services

Azure Kubernetes
Services

Copyright © 2023 TomTom


In-Vehicle Cloud

Digital Cockpit
Speech SDK Azure Speech
Services
Plugins

Retrieve status. Azure Azure Language


Execute commands Cosmos DB Open AI Understanding

Plugins
Architecture Vehicle Access

Location Bing
Services

Azure Kubernetes
Services

What’s next:
• Offline Speech services
• Specialized LLMs for offline capabilities

Copyright © 2023 TomTom


Generative AI Strategy
@ TomTom
Yu Guo
VP Software Engineering
Enable AI apps to Create location tech
access location tech leveraging AI
Opportunity
Areas

TomTom prioritizes value Monitor and leverage


and market speed. Azure Open AI trends.
Copyright © 2023 TomTom
Team Team
Ideas
POC
Best Practices
Infrastructure
Operational support

Structure to Centralized
Innovation
Democratize Hub
Team
Support
Innovation Team Team

Tommy Plugins Tooling Copilot

Team Team

Copyright © 2023 TomTom


Location Technology – Tools and Plugins

Copyright © 2023 TomTom


Portfolio of Sponsored Projects

Copyright © 2023 TomTom


UpSkilling the Workforce

Leadership
Influence Office
GemAI AI
Hours
Workshop Newsletter

Build Evolving
Knowledge
AMA / Base
Fireside
Lead chats Customized
Training Hackathons
Onboarding

GenAI
Road
Shows
Internal AI
External Community
Collaboration
& Partnership

Copyright © 2023 TomTom


Gen AI Timelines @ TomTom

Dec. 2022 Mar. 2023 May 2023 July 2023 Sept. 2023 Nov. 2023

ChatGPT 3.5 Brower version of Github Copilot Launched world's AI based PR review Tommy @ Microsoft
released | Tommy available available 1st location plugin tool Story
Start GenAI for ChatGPT
exploration @ Q/A chatbots with Document
TomTom internal translation
documentation
Customer support
chatbots

1st GenAI hackathon Automatic Ticket


Upskilling efforts Triage
Exploration on Internally hosted Event detection using Tommy
conversational IVI in ChatGPT (Chatty) media feeds Release notes Convo IVI
the car - Tommy available AI Newsletter improvements CES demo!

Jan. 2023 Apr. 2023 June 2023 Aug. 2023 Oct. 2023 Jan. 2024

Copyright © 2023 TomTom


Gen AI Timelines @ TomTom

Dec. 2022 Mar. 2023 May 2023 July 2023 Sept. 2023 Nov. 2023

ChatGPT 3.5 Brower version Github Copilot Launched AI based PR review Tommy @ Microsoft
released | available tool Story
of Tommy world's 1st
Start GenAI
exploration @
available location plugin Q/A chatbots with Document
TomTom for ChatGPT internal translation
documentation
Customer support
chatbots

Internally hosted 1st GenAI hackathon Automatic Ticket


ChatGPT Upskilling efforts Triage Tommy
Exploration on Event detection using
conversational IVI in (Chatty) media feeds Release notes Convo IVI
the car - Tommy available AI Newsletter improvements CES demo!

Jan. 2023 Apr. 2023 June 2023 Aug. 2023 Oct. 2023 Jan. 2024

Copyright © 2023 TomTom


For more information, contact:
[email protected]

Other webinars: TomTom.com/events

Follow us on social media @TomTom


Sign up for early access to Tommy

Get on the Road with Tommy: Your In-Vehicle Assistant (office.com)

97 Confidential © 2022 TomTom


98 Confidential © 2022 TomTom
Wrap-up & Next Steps
Xiaopeng Li
AI & Intelligent Apps Lead, Microsoft
Microsoft AI is for everyone

Applications Partner Solutions

Application Platform
AI Builder
Power BI Power Apps Power Automate Power Virtual Agents

Scenario-Based
Services
Bot Service Cognitive Search Document Intelligence Video Indexer Metrics Advisor Immersive Reader

Customizable AI Azure OpenAI


Models Service
Vision Speech Language Decision

ML Platform Azure Machine Learning


Announcing

Take the next step


with Azure Innovate

Envisioning workshop Proof of concept Move to production


Connect your desired Put your intelligent apps Leverage funding and
business outcomes with vision into action with partners/implementation
possible solutions a technical pilot resources to move from
pilot to production
Our specialized partners are ready to support you
Reach out to your Microsoft account team for a
1
Envision Workshop.
Accelerate your AI
adoption journey
Get in touch with an Azure AI specialized partner
2
for a technical Proof of Concept.
Start building intelligent applications with Azure
1 OpenAI Service
https://azure.microsoft.com/en-us/products/ai-
services/openai-service/

Useful Links 2
Deepen your knowledge by exploring Azure AI
documentation and learning content
https://learn.microsoft.com/en-us/azure/ai-services/

Forrester study: Learn how cloud AI services can


3 accelerate application innovation
https://info.microsoft.com/ww-landing-forrester-fuel-
application-innovation-with-specialized-cloud-ai-
services.html
Thank you

You might also like