ACOT102

Innovate on enterprise data with

Amazon Q to improve employee
productivity
Vijai Gandikota
Principal Product Manager,
AWS

© 2023, Amazon Web

© 2023,
Services,
Amazon
Inc. or
Webits Services,
affiliates.Inc.
All or
rights
its affiliates.
reserved.All
Amazon
rights Confidential
reserved. Amazon
and Trademark.
Confidential and Trademark.
Agenda
• The opportunity

• Generative AI challenges

• What is Amazon Q?

• Key use cases

• Key features

• Demos

• Customer stories
© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. Amazon Confidential and Trademark.
Employee productivity

Marketing Manager

Sales Manager

R&D Engineer

Financial Analyst

Developer

Help Desk Employee (IT, HR etc.)

Product Manager…
© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. Amazon Confidential and Trademark.
© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Opportunity with generative AI

Generative AI’s ability to understand natural language enables

automation for work activities that account for

25% of total
work time

Imagine a generative AI powered assistant that saves

you
every

2 hours day

McKinsey Digital June 2023

© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. Amazon Confidential and Trademark.
Challenges adopting generative AI

Accuracy Security & control Time to value

© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. Amazon Confidential and Trademark.
Introducing

Amazon Q
Your generative AI assistant designed
for work that can be tailored to your
business, data, code, and operations

© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. Amazon Confidential and Trademark.
Amazon Q areas of expertise

Your Building Amazon Amazon AWS

business on AWS QuickSight Connect Supply Chain

© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. Amazon Confidential and Trademark.
Amazon Q areas of expertise

Your Building Amazon Amazon AWS

business on AWS QuickSight Connect Supply Chain

© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. Amazon Confidential and Trademark.
Amazon Q addresses generative AI challenges

Accuracy Security & control Time to value

• Accurate answers from enterprise • Support for enterprise • Connectors to 40+ popular
data sources using RAG permissions data sources
• Citations for fact-checking • Ability to configure response • In-built vector index with
guardrails managed ingestion
• Broad set of capabilities
• In-built application
with SSO

© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. Amazon Confidential and Trademark.
Top use cases

Streamlined search Accelerate content Generate summaries Extract key insights

experience creation
For a unified, Empower employees to Quickly understand the Perform comparative
conversational Q&A create content faster and essence of documents by analysis on your
experience, connect smarter across creating summaries of documents and unlock
internal wikis, SharePoint departments—from uploaded files or existing powerful insights with the
sites, Confluence, marketing to sales to enterprise documents Amazon Q application so
Salesforce, and 40+ other engineering that your employees can
applications make faster, better
data-driven decisions

© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. Amazon Confidential and Trademark.
Key features – Conversational Q&A
LET’S GET TO WORK

Trusted answers generated

from enterprise data

In-context conversations

Source references for

fact-checking

Conversation history

© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. Amazon Confidential and Trademark.
Key features - Execute actions using plugins

• Enable end-users to
perform actions on SaaS
applications
• “summarize conversation
and create ticket in Jira”

Jira ServiceNow

© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. Amazon Confidential and Trademark.
Key features – Admin console
LET’S CREATE AND DEPLOY GENERATIVE AI APPLICATIONS

In-built vector index with managed ingestion

In-built application with SSO

3 click setup: Settings, retriever, and data

sources

Accuracy of Retrieval Augmented

Generation (RAG)

© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. Amazon Confidential and Trademark.
Key features – Safety and security
ADD GUARDRAILS TO THE EXPERIENCE

Use pre-built guardrails for toxicity

Restrict responses to enterprise

content only

Specify blocked words or phrases

that never appear in responses

© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. Amazon Confidential and Trademark.
 Key features – Safety and security
AWARE OF ENTERPRISE USER PERMISSIONS

Databases

User & group info

User:vijai1
Identity
Provider
Salesforce

User:vijai2 Query

SharePoint

Ingest document content

and permissions information Permissions
Google Drive
filtered response User
Amazon Q
Confluence

User Store
Amazon S3
Federated user: [email protected] = vijai1,vijai2
© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. Amazon Confidential and Trademark.
Get started quickly
with 40+ connectors
Bring content from all your
enterprise sources together
in a few clicks!

© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. Amazon Confidential and Trademark.
Key features – Connectors
INDEXING CONTENT FROM THE ENTERPRISE
Batchputdocument API
support for ACL and Data Source ID
Types of Authentication Content
depending on the data source ACLs Content
Data
metadata
Source Metadata
Basic Connector
ACLs
Authentication

Logs
Oauth 2.0 Index
Logs
Data CloudWatch
Source
NTLM
Local users
Identity
Local groups
Kerberos Crawler User Store
Local Datasource
Users & Fed groups
Groups Mapping

User-group
mapping
repo API: Load federated users to local user mapping,
local groups and their users, federated groups

© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. Amazon Confidential and Trademark.
In summary
Amazon Q Application
Retriever Large Language Model

Customized
Experience (API)

User

• Source attribution and citations

Enterprise-ready features • Conflicting data identification
Built-in web • Conversation history
• 40+ Enterprise Connectors • SSO integration experience
• Conversations with uploaded files
• Smart document chunking • Admin dashboard
• Plugin actions (create tickets from the application)
• Semantic similarity • Support for Q&A, content analysis,
• Access control for secure answers content generation, collaboration, etc.
• Ready to deploy end-user UI • Enterprise Guardrails (customized topic
BENEFITS
• Plugins (actions on popular SaaS) handling)
ACCURACY SECURITY TIME TO VALUE
40+ Built-in • Smart document • ACL-aware connectors • Fully managed, turnkey
Datasource chunking
• Permissions-based • 40+ connectors
Connectors • Semantic similarity answers
• No ML experience
• Q&A, analysis, • SSO integration required
Built-in plugins collaboration, etc.
• Answers from customer • End-user application
(actions) • Plugins for actions sources only
Jira ServiceNow • Conflict detection • Customizable topic
handling
© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. Amazon Confidential and Trademark.
Demo
Web experience
QUESTION ANSWERING

© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. Amazon Confidential and Trademark.
© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. Amazon Confidential and Trademark.
Demo
Custom Amazon Q
applications: Slack
integration
EMBEDDING GENERATIVE AI IN
MESSAGING APPS

© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. Amazon Confidential and Trademark.
© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. Amazon Confidential and Trademark.
Try the Amazon Q Slack bot – Source code

GitHub repo: https://github.com/aws-samples/amazon-q-slack-gateway

© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. Amazon Confidential and Trademark.
Demo
Amazon Q application setup
with S3 connector

© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. Amazon Confidential and Trademark.
© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. Amazon Confidential and Trademark.
Customer stories

© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. Amazon Confidential and Trademark.
Accelerating generative AI application development

Gilead's use of generative AI on AWS has led to faster

innovation and productivity gains. By leveraging Amazon Q,
we will be able to generate insights and accelerate analysis
of large amounts of Gilead data across our enterprise.
Based on our evaluation, Amazon Q provides a faster way
to create generative AI solutions by streamlining
connections to our data sources, automating complex tasks,
such as managing vector stores, and quickly surfacing
relevant insights on demand. For life sciences organizations
like Gilead, the productivity benefits unlocked by
generative AI solutions on AWS like Amazon Q are exciting.

Kevin Cox
Chief Cloud Architect, Gilead

© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. Amazon Confidential and Trademark.
Reducing content discovery and marketing content
creation time
Adding Amazon Q as a topline layer over our various
content and data repositories brings a whole new level of
efficiency to our customer success and marketing teams.
Based on initial estimates, we expect the time spent on
content discovery alone to be reduced by over 30%, which
empowers our success team to service clients faster, and
with better accuracy. It also jump-starts the creation of
sales and marketing content, such as email drips,
whitepapers, and ad copy. With Amazon Q, we anticipate
the ability to accelerate the content creation process by
nearly 50%, allowing us to shift our attention to scaling the
personalization of content instead of spending time on the
laborious task of creating materials from scratch.

Richard Jones
Chief Revenue Officer at Wunderkind
© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. Amazon Confidential and Trademark.
Get started
RUN A FLASH POC

1 2 3

Pick easily Index your Perform

accessible and content Q&A,
well defined with Summarize,
set of Amazon Q interact
documents using with your
built-in content in
connectors the console
UI
© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. Amazon Confidential and Trademark.
Thank you!
Vijai Gandikota
Principal Product
Manager,
AWS

Link to console Webpage Developer guide

© 2023, Amazon Web

© 2023,
Services,
Amazon
Inc. or
Webits Services,
affiliates.Inc.
All or
rights
its affiliates.
reserved.All
Amazon
rights Confidential
reserved. Amazon
and Trademark.
Confidential and Trademark.