The state of Artificial Intelligence has progressed such that devices can be aware of emotion by measuring inflection in voice calls and through contextualization of word patterns. Users who have permissioned apps to use this information, with rigorous safety and privacy protocols, can benefit from leveraging this data on their behalf. The challenge here is to gain user acceptance by demonstrating trustworthiness and value over time.
In this application Marsha has permissioned the app to register her location, text and voice content, and emotion.
Demonstrating predictive help based on user emotion tracked by text, data, and voice in the device.
I led a team of three to envision, design, and prototype improved experiences for this exercise.
Successful prototype and user testing with an engaging experience for our sample audience.
Marsha receives three voice calls in one hour. Her husband who tells her he was involved in a car accident that morning. Her regular doctor wants to discuss her recent blood work. Her mother is worried about her sister who is exhibiting signs of dementia.
Marsha has two text conversations in the next 30 minutes. Her daughter mentions a boyfriend and their recent breakup. A friend asks about having lunch.
The app registers the words "crash," "late," "biopsy," "Alzheimer’s" and emotions of sadness and anger in her voice tone.
In the afternoon Marsha leaves work three hours earlier than usual. The app phone knows her work and home locations and what time she usually travels between them. The app registered sadness in her voice tone in conversations this morning, and stressor words in her text coversations, the app cross checks this information against activities, behaviors, and information that it knows are pleasing to Marsha.
The app asks “Jennifer has an opening at 4:30 today. Would you like me to book a massage for you?” Marsha clicks on the microphone icon in the app to respond and says “Thanks, that would be great!”
The app then says “Marsha? Your pantry has everything you need to make mac and cheese tonight except butter. Would you like me to place an order for that at the store? Marsha says “Sure!”
Marsha stops by the store on the way home to buy butter. The app books Marsha’s massage appointment.
The app gets a response from Jennifer and displays a confirmation message.