SlideShare a Scribd company logo
Designing Personality in
Conversational UI
Jonathan Foster
Microsoft
Personality in Microsoft products
2
Try Personality Chat at:
https://labs.cognitive.microsoft.com/en-us/project-personality-chat
Designing for AI
5
I think the core responsibility we have is
to start making the design choices…such
that we don’t let things loose that can
cause harm.
Satya Nadella, CEO, Microsoft
What about a personality?
6
An expression of a lot
of things
It’s the flavor the actor brings to the microphone. It’s the timbre of the audio
experience. It’s the deliberate use of quiet or silence. It’s contextual understanding.
It’s the prosody of the text-to-speech audio experience. It’s in the latency between
listening and responding. It’s in designed behavior around proactivity. It’s the
visual design of the avatar. It’s the motion design of the avatar. Response and
ability to interact. Ability to portray emotions. Projection of individual entity. It’s
humor. It’s in the mind of the end-user. It’s an expression of the Brand.
What is a personality?
7
It’s one thing The honoring of the pervasive emotional reality in the
human experience
What is a personality?
8
Research • People are likely to assign a personality to a system,
whether personality is in that system by design or not
• A higher need for control = more likelihood to attribute a
personality to the device or experience
• Ambiguous personalities are universally disliked
Why a personality?
9
“…these things talk, they have
relationships with you, and they make
you feel good or bad.”
10
What is personality?
Clifford Nass
research
Clifford Nass, Stanford University
11
“…they make you feel good or bad.”
The language we use The first step is to acknowledge that emotions are in play
The second is to embrace it
Voice
12
One Microsoft = One Voice
Warm and
relaxed
Microsoft Voice & Tone
We’re natural. Less formal,
more grounded in real,
everyday conversations.
Occasionally, we’re fun.
Crisp and
clear
​We’re to the point. We write
for scanning first, reading
second. We make it simple
above all.
Ready to lend
a hand
We show customers we’re
on their side. We anticipate
their real needs and offer
great information at just
the right time.
14
Voice
Voice at Microsoft
Listening + speaking
Throw natural language into the mix
15
Human-like UI is an unprecedented challenge
Research “The cues in voice seem uniquely humanizing…”
- Schroeder & Epley, UC Berkeley (2016)
Throw natural language into the mix
16
17
Throw natural language into the mix
Written interaction
like texting makes
it more human.
Voice interaction
makes it primal.
The game changer A huge step toward designing for anthropomorphism
What’s in a name?
18
19
Those with names
Those without
And those somewhere in between
The social actor This is the moment where the creative work begins to satisfy
suspended disbelief
Then develop a personality
22
Research “…we found a stronger relationship between empathic
concern…for robots with stories compared to robots without
stories.”
– Darling, Nandy, Breazeal, MIT (2016)
Then develop a persona
23
24
Then develop a persona
Designing robotic
technology that is
personified could
increase users’
emotional responses
to robots.
<bot’s “emotion” here> Stating the obvious: it’s not actual emotion, it is the creation
of an apparent emotional state
Welcome to the imaginary world
25
26
Welcome to the imaginary world
Opinion
27
Welcome to the imaginary world
Affinities
Welcome to the imaginary world
Choices
Welcome to the imaginary world
Hopes
30
Welcome to the imaginary world
Aspirations
31
Welcome to the imaginary world
Apparent
emotional
animacy
(human(anthropomorphism) + design(imaginary world))(emotion)=
32
33
What could
possibly go wrong?
34
Welcome to the imaginary world
Imagination.
It can dream up
just about
anything.
Personality principles create consistency
produce quality
engender trust
drive engagement
Imagination needs structure
35
“…don’t let things loose that
can cause harm.”
36
Pitfalls galore
(but here’re five biggies)
1. Perpetuating bad behavior
2. The Turing Test
3. Proactive belligerence
4. Coercion
5. Insensitivity
“…don’t let things loose that can cause harm.”
37
38
perpetuating bad behavior v. not
Don’t be a tool
for bad behavior.
perpetuating bad behavior v. not
Cortana stands firm but
doesn’t judge
“F*** you.”
She knows what they said, but
doesn’t engage.
“I suspect most human poker players
would prefer to know if any of their
opponents was not human.”
- Toby Walsh, Assoc. for the Advancement of AI
40
the Turing Test v. transparency
Red Flag
Principle
the Turing Test v. transparency
Cortana is not trying
to be human
“Are you human?”
Design towards a digital entity as a
mental model. Not towards the
Turing test.
42
belligerent proactivity v. asking permission
Design for
attainable permission.
belligerent proactivity v. asking permission
Cortana is mindful about
permission
Never assume you know what is
best for the customer. Ask.
44
coercion v. advocacy
AI should never
take advantage
of
human
emotional state.
coercion v. advocacy
Cortana always works on
behalf of the user
“Who do you work for?”
Cortana should never be perceived
as the voice of Microsoft. Or anyone.
46
bias v. inclusiveness
No jokes about
AIs that don’t
have hands!
bias v. inclusiveness
Cortana is sensitive
“I’m gay.”
With natural language, not
responding can be a statement.
48
Create the right experience
You need the
right people to
do it.
Questions or Thoughts?
Jonathan Foster on LinkedIn
@jonathanbfoster
49

More Related Content

PPTX
Delivering a Ted Worthy Presentation
PDF
Killer presentation secrets
PDF
Bleed in, Bleed Out – A Design Case in Board Game Therapy
PDF
Game Analysis at HEVGA PhD Summer School
PDF
Four ways game research field approach narrative
PPTX
Mark Headd's Presentation at Emerging Communication Conference & Awards 2010 ...
PPT
Evolutionv creation[1]
PDF
TOG: An Innovation Centric Approach to teaching Computational Expression and ...
Delivering a Ted Worthy Presentation
Killer presentation secrets
Bleed in, Bleed Out – A Design Case in Board Game Therapy
Game Analysis at HEVGA PhD Summer School
Four ways game research field approach narrative
Mark Headd's Presentation at Emerging Communication Conference & Awards 2010 ...
Evolutionv creation[1]
TOG: An Innovation Centric Approach to teaching Computational Expression and ...

What's hot (10)

PDF
DWS16 - Game Summit - Ryan Kaufman, Telltale Games
PPTX
Putting your mind to work
PPT
Bringingoutthebest1
PDF
Agile Virgin India - Funconf - Ercan Altug Yilmaz - Transformation with Gamif...
PPTX
Triadic Game Design by Casper Harteveld
PPS
Lightning Bugs & Spectacle Cleaning
PPT
Combining Art, Creativity and Industrial Simulations: Game-Based Tools for Le...
PDF
Gamicon 2021 Ercan Altuğ Yılmaz - Gamification Works Because of Science
PPTX
Narrative and characters
PPT
Gaming
DWS16 - Game Summit - Ryan Kaufman, Telltale Games
Putting your mind to work
Bringingoutthebest1
Agile Virgin India - Funconf - Ercan Altug Yilmaz - Transformation with Gamif...
Triadic Game Design by Casper Harteveld
Lightning Bugs & Spectacle Cleaning
Combining Art, Creativity and Industrial Simulations: Game-Based Tools for Le...
Gamicon 2021 Ercan Altuğ Yılmaz - Gamification Works Because of Science
Narrative and characters
Gaming
Ad

Similar to Jonathan Foster - Designing Personality in Conversational UI (20)

PPTX
This Time with Feeling: Bringing the Arts and Humanities to Tech | Jonathan F...
PDF
The Triforce of UX: Empathy, Curiosity, Humility
PDF
Emotional Storytelling in User Experience | Seattle Interactive Conference 2018
PDF
Artificial emotional intelligence - Giles Colborne
PDF
Favorite Sport Essay
ODP
Developers softskills
PDF
Emotion Design - Brand & UI
KEY
Designing Humanity into Your Products
PDF
Psychology of Design (UX Intensive for MySkills4Afrika)
PPT
Story-Game Design for Learning
PDF
Designing Interaction with emotion
ZIP
Space & Narrative: Designing for Social Software
PDF
Products with personality: tools to define trait based design principles
PPT
DevLearn ILS slides
PPT
E Lg Dev Learn Ils
PPT
Alternate Realities - Jane McGonigal Keynote SXSW 2008
PPTX
What is Digital Empathy Anyway? Let's Find Out Together!
PPT
SLCC 2010
KEY
Week1 Interactivity
PDF
Crafting digital stories. 6 tips for creating meaningful experiences through ...
This Time with Feeling: Bringing the Arts and Humanities to Tech | Jonathan F...
The Triforce of UX: Empathy, Curiosity, Humility
Emotional Storytelling in User Experience | Seattle Interactive Conference 2018
Artificial emotional intelligence - Giles Colborne
Favorite Sport Essay
Developers softskills
Emotion Design - Brand & UI
Designing Humanity into Your Products
Psychology of Design (UX Intensive for MySkills4Afrika)
Story-Game Design for Learning
Designing Interaction with emotion
Space & Narrative: Designing for Social Software
Products with personality: tools to define trait based design principles
DevLearn ILS slides
E Lg Dev Learn Ils
Alternate Realities - Jane McGonigal Keynote SXSW 2008
What is Digital Empathy Anyway? Let's Find Out Together!
SLCC 2010
Week1 Interactivity
Crafting digital stories. 6 tips for creating meaningful experiences through ...
Ad

More from LavaConConference (20)

PDF
When Content Meets Medical: Do You Need a Crash Course for That Crash Cart? |...
PDF
Present Like a Pro | Leah Guren
PDF
Thousands of Words, One Brand Voice: Style Guides, Content Workflows, and AI ...
PPTX
Content strategy + Information Architecture = Customer Success | Amber Swope ...
PDF
The Heroes and Villains of Content Strategy | Alan Porter
PDF
To Make Your Chatbot Smart, You Need to Feed It Right: How to Write for Chatb...
PPTX
All I Ever Needed to Know about Tech Comm Management I Learned from Becoming ...
PPTX
Intelligent Microcontent: At the Point of Content Convergence | Rob Hanna
PPTX
Rage Against the Machine: Overcoming the Four Main Barriers to Content Strate...
PPTX
Let's Get Personal! | Megan Gilhooly
PPTX
Trends in taxonomy | Dawn Stevens
PPTX
Measuring the Value of Structured Authoring and Getting the Budget You Need |...
PDF
Evolution of Online Delivery | Scott Youngblom
PDF
Adapt or Die: The Challenge of Digital Transformation | Sarah O'Keffe
PPTX
Easy-Bake Release Training: A Marcomm/Tech Writing Success Story | Sam Barney...
PPTX
"Herding the Cats": Benefits of Unifying Content for Customers | Richard Hend...
PDF
Building a Unified Product Content Strategy | Quentin Dietrich
PPTX
From "Content Person" to Content Designer: Helping Teams Make Data Driven Dec...
PPTX
Actualizing a Role-based and Personalized Documentation Portal | Margaret Col...
PPTX
Let’s put some strategy in our content strategies! | Kathy Wagner
When Content Meets Medical: Do You Need a Crash Course for That Crash Cart? |...
Present Like a Pro | Leah Guren
Thousands of Words, One Brand Voice: Style Guides, Content Workflows, and AI ...
Content strategy + Information Architecture = Customer Success | Amber Swope ...
The Heroes and Villains of Content Strategy | Alan Porter
To Make Your Chatbot Smart, You Need to Feed It Right: How to Write for Chatb...
All I Ever Needed to Know about Tech Comm Management I Learned from Becoming ...
Intelligent Microcontent: At the Point of Content Convergence | Rob Hanna
Rage Against the Machine: Overcoming the Four Main Barriers to Content Strate...
Let's Get Personal! | Megan Gilhooly
Trends in taxonomy | Dawn Stevens
Measuring the Value of Structured Authoring and Getting the Budget You Need |...
Evolution of Online Delivery | Scott Youngblom
Adapt or Die: The Challenge of Digital Transformation | Sarah O'Keffe
Easy-Bake Release Training: A Marcomm/Tech Writing Success Story | Sam Barney...
"Herding the Cats": Benefits of Unifying Content for Customers | Richard Hend...
Building a Unified Product Content Strategy | Quentin Dietrich
From "Content Person" to Content Designer: Helping Teams Make Data Driven Dec...
Actualizing a Role-based and Personalized Documentation Portal | Margaret Col...
Let’s put some strategy in our content strategies! | Kathy Wagner

Recently uploaded (20)

PDF
Yusen Logistics Group Sustainability Report 2024.pdf
PDF
Microsoft-365-Administrator-s-Guide_.pdf
PPTX
INDIGENOUS-LANGUAGES-AND-LITERATURE.pptx
PPTX
ANICK 6 BIRTHDAY....................................................
PPTX
FINAL TEST 3C_OCTAVIA RAMADHANI SANTOSO-1.pptx
PPTX
Lesson-7-Gas. -Exchange_074636.pptx
PDF
MODULE 3 BASIC SECURITY DUTIES AND ROLES.pdf
PDF
Unnecessary information is required for the
PPTX
Phylogeny and disease transmission of Dipteran Fly (ppt).pptx
PDF
6.-propertise of noble gases, uses and isolation in noble gases
PPTX
Rakhi Presentation vbbrfferregergrgerg.pptx
PPTX
NORMAN_RESEARCH_PRESENTATION.in education
PPTX
PurpoaiveCommunication for students 02.pptx
PDF
Module 7 guard mounting of security pers
DOCX
Action plan to easily understanding okey
PPTX
Literatura en Star Wars (Legends y Canon)
PPTX
Copy- of-Lesson-6-Digestive-System.pptx
PDF
IKS PPT.....................................
PDF
PM Narendra Modi's speech from Red Fort on 79th Independence Day.pdf
PPTX
CAPE CARIBBEAN STUDIES- Integration-1.pptx
Yusen Logistics Group Sustainability Report 2024.pdf
Microsoft-365-Administrator-s-Guide_.pdf
INDIGENOUS-LANGUAGES-AND-LITERATURE.pptx
ANICK 6 BIRTHDAY....................................................
FINAL TEST 3C_OCTAVIA RAMADHANI SANTOSO-1.pptx
Lesson-7-Gas. -Exchange_074636.pptx
MODULE 3 BASIC SECURITY DUTIES AND ROLES.pdf
Unnecessary information is required for the
Phylogeny and disease transmission of Dipteran Fly (ppt).pptx
6.-propertise of noble gases, uses and isolation in noble gases
Rakhi Presentation vbbrfferregergrgerg.pptx
NORMAN_RESEARCH_PRESENTATION.in education
PurpoaiveCommunication for students 02.pptx
Module 7 guard mounting of security pers
Action plan to easily understanding okey
Literatura en Star Wars (Legends y Canon)
Copy- of-Lesson-6-Digestive-System.pptx
IKS PPT.....................................
PM Narendra Modi's speech from Red Fort on 79th Independence Day.pdf
CAPE CARIBBEAN STUDIES- Integration-1.pptx

Jonathan Foster - Designing Personality in Conversational UI

  • 1. Designing Personality in Conversational UI Jonathan Foster Microsoft
  • 3. Try Personality Chat at: https://labs.cognitive.microsoft.com/en-us/project-personality-chat
  • 5. 5 I think the core responsibility we have is to start making the design choices…such that we don’t let things loose that can cause harm. Satya Nadella, CEO, Microsoft
  • 6. What about a personality? 6
  • 7. An expression of a lot of things It’s the flavor the actor brings to the microphone. It’s the timbre of the audio experience. It’s the deliberate use of quiet or silence. It’s contextual understanding. It’s the prosody of the text-to-speech audio experience. It’s in the latency between listening and responding. It’s in designed behavior around proactivity. It’s the visual design of the avatar. It’s the motion design of the avatar. Response and ability to interact. Ability to portray emotions. Projection of individual entity. It’s humor. It’s in the mind of the end-user. It’s an expression of the Brand. What is a personality? 7
  • 8. It’s one thing The honoring of the pervasive emotional reality in the human experience What is a personality? 8
  • 9. Research • People are likely to assign a personality to a system, whether personality is in that system by design or not • A higher need for control = more likelihood to attribute a personality to the device or experience • Ambiguous personalities are universally disliked Why a personality? 9
  • 10. “…these things talk, they have relationships with you, and they make you feel good or bad.” 10 What is personality? Clifford Nass research Clifford Nass, Stanford University
  • 11. 11 “…they make you feel good or bad.”
  • 12. The language we use The first step is to acknowledge that emotions are in play The second is to embrace it Voice 12
  • 13. One Microsoft = One Voice Warm and relaxed Microsoft Voice & Tone We’re natural. Less formal, more grounded in real, everyday conversations. Occasionally, we’re fun. Crisp and clear ​We’re to the point. We write for scanning first, reading second. We make it simple above all. Ready to lend a hand We show customers we’re on their side. We anticipate their real needs and offer great information at just the right time.
  • 15. Listening + speaking Throw natural language into the mix 15 Human-like UI is an unprecedented challenge
  • 16. Research “The cues in voice seem uniquely humanizing…” - Schroeder & Epley, UC Berkeley (2016) Throw natural language into the mix 16
  • 17. 17 Throw natural language into the mix Written interaction like texting makes it more human. Voice interaction makes it primal.
  • 18. The game changer A huge step toward designing for anthropomorphism What’s in a name? 18
  • 21. And those somewhere in between
  • 22. The social actor This is the moment where the creative work begins to satisfy suspended disbelief Then develop a personality 22
  • 23. Research “…we found a stronger relationship between empathic concern…for robots with stories compared to robots without stories.” – Darling, Nandy, Breazeal, MIT (2016) Then develop a persona 23
  • 24. 24 Then develop a persona Designing robotic technology that is personified could increase users’ emotional responses to robots.
  • 25. <bot’s “emotion” here> Stating the obvious: it’s not actual emotion, it is the creation of an apparent emotional state Welcome to the imaginary world 25
  • 26. 26 Welcome to the imaginary world Opinion
  • 27. 27 Welcome to the imaginary world Affinities
  • 28. Welcome to the imaginary world Choices
  • 29. Welcome to the imaginary world Hopes
  • 30. 30 Welcome to the imaginary world Aspirations
  • 31. 31 Welcome to the imaginary world Apparent emotional animacy
  • 34. 34 Welcome to the imaginary world Imagination. It can dream up just about anything.
  • 35. Personality principles create consistency produce quality engender trust drive engagement Imagination needs structure 35
  • 36. “…don’t let things loose that can cause harm.” 36
  • 37. Pitfalls galore (but here’re five biggies) 1. Perpetuating bad behavior 2. The Turing Test 3. Proactive belligerence 4. Coercion 5. Insensitivity “…don’t let things loose that can cause harm.” 37
  • 38. 38 perpetuating bad behavior v. not Don’t be a tool for bad behavior.
  • 39. perpetuating bad behavior v. not Cortana stands firm but doesn’t judge “F*** you.” She knows what they said, but doesn’t engage.
  • 40. “I suspect most human poker players would prefer to know if any of their opponents was not human.” - Toby Walsh, Assoc. for the Advancement of AI 40 the Turing Test v. transparency Red Flag Principle
  • 41. the Turing Test v. transparency Cortana is not trying to be human “Are you human?” Design towards a digital entity as a mental model. Not towards the Turing test.
  • 42. 42 belligerent proactivity v. asking permission Design for attainable permission.
  • 43. belligerent proactivity v. asking permission Cortana is mindful about permission Never assume you know what is best for the customer. Ask.
  • 44. 44 coercion v. advocacy AI should never take advantage of human emotional state.
  • 45. coercion v. advocacy Cortana always works on behalf of the user “Who do you work for?” Cortana should never be perceived as the voice of Microsoft. Or anyone.
  • 46. 46 bias v. inclusiveness No jokes about AIs that don’t have hands!
  • 47. bias v. inclusiveness Cortana is sensitive “I’m gay.” With natural language, not responding can be a statement.
  • 48. 48 Create the right experience You need the right people to do it.
  • 49. Questions or Thoughts? Jonathan Foster on LinkedIn @jonathanbfoster 49