2019 · 102 citations · 6 references
ComputingComputer ScienceHuman-computer InteractionInteraction DesignUser Experience DesignConversational InterfacesConversational User InterfacesDialogue SystemsHuman-machine InterfacesUsability EvaluationUsability TestingConversational User ExperienceEnd-user ExperienceEvaluation Of Dialogue SystemsIntelligent User InterfacesNatural User InterfacesPersonal Digital AssistantsUser Experience MetricsVoice User Interfaces
Natural user interfaces are becoming popular. One of the most common natural user interfaces nowadays are voice activated interfaces, particularly smart personal assistants such as Google Assistant, Alexa, Cortana, and Siri. This paper presents the results of an evaluation of these four smart personal assistants in two dimensions: the correctness of their answers and how natural the responses feel to users. Ninety-two participants conducted the evaluation. Results show that Alexa and Google Assistant are significantly better than Siri and Cortana. However, there is no statistically significant difference between Alexa and Google Assistant.
6
Automatic Online Evaluation of Intelligent Assistants
Jiepu Jiang, Ahmed Hassan Awadallah, Rosie Jones et al. · 2015 · 149 citations
Understanding Affective Experiences with Conversational Agents
Xi Yang, Marco Aurisicchio, Weston Baxter · 2019 · 93 citations