Should You Trust Your Voice Assistant? It’s Complicated, but No

In Florian Westphal, Einav Peretz-Andersson, Maria Riveiro, Kerstin Bach & Fredrik Heintz, 14th Scandinavian Conference on Artificial Intelligence SCAI 2024. Linköping, Sweden: Linköping Electronic Conference Proceedings 208 (2024)
  Copy   BIBTEX

Abstract

The widespread use of voice-assisted applications using artificial intelligence raises questions about the dynamics of trust and reliance on these systems. While users often rely on these applications for help, instances where users face unforeseen risks and heightened challenges have sparked conversations about the importance of fostering trustworthy artificial intelligence. In this paper, we argue that the prevailing narrative of trust and trustworthiness in relation to artificial intelligence, particularly voice assistants, is misconstrued and fundamentally misplaced. Drawing on insights from philosophy and artificial intelligence literature, we contend that artificial intelligence systems do not meet the criteria for participating in a relationship of trust with human users. Instead, a narrative of reliance is more appropriate. However, we investigate the matter further, to explore why the trust/trustworthiness narrative persists, focusing on the unique social dynamics of interactions with voice assistants. We identify factors such as diverse modalities and complexity, social aspects of voice assistants, and issues of uncertainty, assertiveness, and transparency as contributors to the trust narrative. By disentangling these factors, we shed light on the complexities of human-computer interactions and offer insights into the implications for our relationship with artificial intelligence. We advocate for a nuanced understanding of trust and reliance in artificial intelligence systems and provide suggestions for addressing the challenges posed by the dominance of the trust/trustworthiness narrative.

Author's Profile

Filippos Stamatiou
University of Copenhagen

Analytics

Added to PP
2024-09-04

Downloads
166 (#95,371)

6 months
132 (#40,381)

Historical graph of downloads since first upload
This graph includes both downloads from PhilArchive and clicks on external links on PhilPapers.
How can I increase my downloads?