English
Related papers

Related papers: Hey Alexa what did I just type? Decoding smartphon…

200 papers

With the recent advance in speech technology, smart voice assistants have been improved and are now used by many people. But often these assistants are running online as a cloud service and are not always known for a good protection of…

Cryptography and Security · Computer Science 2025-03-28 Daniel Bermuth , Alexander Poeppel , Wolfgang Reif

Much has been written about privacy in the context of conversational and voice assistants. Yet, there have been remarkably few developments in terms of the actual privacy offered by these devices. But how much of this is due to the…

Human-Computer Interaction · Computer Science 2023-06-09 Trung Dong Huynh , William Seymour , Luc Moreau , Jose Such

This paper investigates the privacy leakage of smart speakers under an encrypted traffic analysis attack, referred to as voice command fingerprinting. In this attack, an adversary can eavesdrop both outgoing and incoming encrypted voice…

Cryptography and Security · Computer Science 2020-05-21 Chenggang Wang , Sean Kennedy , Haipeng Li , King Hudson , Gowtham Atluri , Xuetao Wei , Wenhai Sun , Boyang Wang

Virtual assistants (VAs) have seen increased use in recent years due to their ease of use for daily tasks. Despite their growing prevalence, their security and privacy implications are still not well understood. To address this gap, we…

Cryptography and Security · Computer Science 2023-12-25 Borna Kalhor , Sanchari Das

We present the first acoustic side-channel attack that recovers what users type on the virtual keyboard of their touch-screen smartphone or tablet. When a user taps the screen with a finger, the tap generates a sound wave that propagates on…

Cryptography and Security · Computer Science 2019-03-28 Ilia Shumailov , Laurent Simon , Jeff Yan , Ross Anderson

The growing use of voice user interfaces has led to a surge in the collection and storage of speech data. While data collection allows for the development of efficient tools powering most speech services, it also poses serious privacy…

Cryptography and Security · Computer Science 2024-03-04 Pierre Champion

Determining how voice assistants should broker consent to share data with third party software has proven to be a complex problem. Devices often require users to switch to companion smartphone apps in order to navigate permissions menus for…

Human-Computer Interaction · Computer Science 2022-04-22 William Seymour , Mark Cote , Jose Such

Displaying a written transcript of what a human said (i.e. producing an "automatic speech recognition transcript") is a common feature for smartphone vocal assistants: the utterance produced by a human speaker (e.g. a question) is displayed…

Human-Computer Interaction · Computer Science 2025-04-08 Damien Rudaz , Christian Licoppe

This paper investigates the implementation of voice-enabled Google Assistant and Amazon Alexa on Raspberry Pi. Virtual Assistants are being a new trend in how we interact or do computations with physical devices. A voice-enabled system…

Computers and Society · Computer Science 2024-09-05 Shailesh D. Arya , Samir Patel

Since Siri's release in 2011 there have been a growing number of AI-driven domestic voice assistants that are increasingly being integrated into devices such as smartphones and TVs. But as their presence has expanded, a range of ethical…

Human-Computer Interaction · Computer Science 2023-06-26 William Seymour , Xiao Zhan , Mark Cote , Jose Such

Smartphones and tablets have become ubiquitous in our daily lives. Smartphones, in particular, have become more than personal assistants. These devices have provided new avenues for consumers to play, work, and socialize whenever and…

Cryptography and Security · Computer Science 2019-11-12 Abdulaziz Alzubaidi , Jugal Kalita

Speech technology for communication, accessing information, and services has rapidly improved in quality. It is convenient and appealing because speech is the primary mode of communication for humans. Such technology, however, also presents…

Audio and Speech Processing · Electrical Eng. & Systems 2025-11-11 Tom Bäckström

Many Internet of Things (IoT) devices have voice user interfaces (VUIs). One of the most popular VUIs is Amazon's Alexa, which supports more than 47,000 third-party applications ("skills"). We study how Alexa's integration of these skills…

Human-Computer Interaction · Computer Science 2019-11-01 David J. Major , Danny Yuxing Huang , Marshini Chetty , Nick Feamster

Due to the open nature of voice input, voice assistant (VA) systems (e.g., Google Home and Amazon Alexa) are under a high risk of sensitive information leakage (e.g., personal schedules and shopping accounts). Though the existing VA systems…

Human-Computer Interaction · Computer Science 2020-04-13 Chen Wang , Cong Shi , Yingying Chen , Yan Wang , Nitesh Saxena

Despite significant improvements in automatic speech recognition and spoken language understanding - human interaction with Virtual Personal Assistants (VPAs) through speech remains irregular and sporadic. According to recent studies,…

Human-Computer Interaction · Computer Science 2018-07-13 Mateusz Dubiel , Martin Halvey , Leif Azzopardi

The emergence of voice-assistant devices ushers in delightful user experiences not just on the smart home front, but also in diverse educational environments from classrooms to personalized-learning/tutoring. However, the use of voice as an…

Audio and Speech Processing · Electrical Eng. & Systems 2021-04-23 Mohammad Niknazar , Aditya Vempaty , Ravi Kokku

Eavesdropping from the user's smartphone is a well-known threat to the user's safety and privacy. Existing studies show that loudspeaker reverberation can inject speech into motion sensor readings, leading to speech eavesdropping. While…

Sound · Computer Science 2022-12-26 Ahmed Tanvir Mahdad , Cong Shi , Zhengkun Ye , Tianming Zhao , Yan Wang , Yingying Chen , Nitesh Saxena

The popularity and projected growth of in-home smart speaker assistants, such as Amazon's Echo, has raised privacy concerns among consumers and privacy advocates. Notable questions regarding the collection and storage of user data by…

Cryptography and Security · Computer Science 2020-07-21 Ilesanmi Olade , Christopher Champion , Haining Liang , Charles Fleming

Acoustic emanations of computer keyboards represent a serious privacy issue. As demonstrated in prior work, physical properties of keystroke sounds might reveal what a user is typing. However, previous attacks assumed relatively strong…

Cryptography and Security · Computer Science 2017-03-14 Alberto Compagno , Mauro Conti , Daniele Lain , Gene Tsudik

This paper presents a novel attack on voice-controlled digital assistants using nonsensical word sequences. We present the results of experimental work which demonstrates that it is possible for malicious actors to gain covert access to a…

Cryptography and Security · Computer Science 2018-08-07 Mary K. Bispham , Ioannis Agrafiotis , Michael Goldsmith