English
Related papers

Related papers: SkillFence: A Systems Approach to Practically Miti…

200 papers

Speech deepfakes are artificial voices generated by machine learning models. Previous literature has highlighted deepfakes as one of the biggest security threats arising from progress in artificial intelligence due to their potential for…

Human-Computer Interaction · Computer Science 2023-08-04 Kimberly T. Mai , Sergi D. Bray , Toby Davies , Lewis D. Griffin

Voice applications (voice apps) are a key element in Voice Assistant ecosystems such as Amazon Alexa and Google Assistant, as they provide assistants with a wide range of capabilities that users can invoke with a voice command. Most voice…

Human-Computer Interaction · Computer Science 2023-11-16 William Seymour , Noura Abdi , Kopo M. Ramokapane , Jide Edu , Guillermo Suarez-Tangil , Jose Such

Active listening is a well-known skill applied in human communication to build intimacy and elicit self-disclosure to support a wide variety of cooperative tasks. When applied to conversational UIs, active listening from machines can also…

Human-Computer Interaction · Computer Science 2022-09-26 Eugene Cho , Nasim Motalebi , S. Shyam Sundar , Saeed Abdullah

In the area of Internet of Things (IoT) voice assistants have become an important interface to operate smart speakers, smartphones, and even automobiles. To save power and protect user privacy, voice assistants send commands to the cloud…

Machine Learning · Computer Science 2021-09-22 Yanjiao Chen , Yijie Bai , Richard Mitev , Kaibo Wang , Ahmad-Reza Sadeghi , Wenyuan Xu

Voice authentication has become an integral part in security-critical operations, such as bank transactions and call center conversations. The vulnerability of automatic speaker verification systems (ASVs) to spoofing attacks instigated the…

Cryptography and Security · Computer Science 2021-08-02 Andre Kassis , Urs Hengartner

Human voices can be used to authenticate the identity of the speaker, but the automatic speaker verification (ASV) systems are vulnerable to voice spoofing attacks, such as impersonation, replay, text-to-speech, and voice conversion.…

Audio and Speech Processing · Electrical Eng. & Systems 2021-06-09 You Zhang , Fei Jiang , Zhiyao Duan

To improve user experience, Alexa now allows users to consent to data sharing via voice rather than directing them to the companion smartphone app. While verbal consent mechanisms for voice assistants (VAs) can increase usability, they can…

Human-Computer Interaction · Computer Science 2023-01-20 William Seymour , Mark Cote , Jose Such

Determining how voice assistants should broker consent to share data with third party software has proven to be a complex problem. Devices often require users to switch to companion smartphone apps in order to navigate permissions menus for…

Human-Computer Interaction · Computer Science 2022-06-23 William Seymour , Mark Cote , Jose Such

Voice-controlled house-hold devices, like Amazon Echo or Google Home, face the problem of performing speech recognition of device-directed speech in the presence of interfering background speech, i.e., background noise and interfering…

Computation and Language · Computer Science 2019-02-08 Yiming Wang , Xing Fan , I-Fan Chen , Yuzong Liu , Tongfei Chen , Björn Hoffmeister

This paper investigates the implementation of voice-enabled Google Assistant and Amazon Alexa on Raspberry Pi. Virtual Assistants are being a new trend in how we interact or do computations with physical devices. A voice-enabled system…

Computers and Society · Computer Science 2024-09-05 Shailesh D. Arya , Samir Patel

AI-generated speech is becoming increasingly used in everyday life, powering virtual assistants, accessibility tools, and other applications. However, it is also being exploited for malicious purposes such as impersonation, misinformation,…

Sound · Computer Science 2025-09-23 Viola Negroni , Davide Salvi , Alessandro Ilic Mezza , Paolo Bestagini , Stefano Tubaro

The advances in generative AI have enabled the creation of synthetic audio which is perceptually indistinguishable from real, genuine audio. Although this stellar progress enables many positive applications, it also raises risks of misuse,…

Personal voice assistants (VAs) are shown to be vulnerable against record-and-replay, and other acoustic attacks which allow an adversary to gain unauthorized control of connected devices within a smart home. Existing defenses either lack…

Cryptography and Security · Computer Science 2021-06-29 Dominika Woszczyk , Alvin Lee , Soteris Demetriou

This paper investigates the privacy leakage of smart speakers under an encrypted traffic analysis attack, referred to as voice command fingerprinting. In this attack, an adversary can eavesdrop both outgoing and incoming encrypted voice…

Cryptography and Security · Computer Science 2020-05-21 Chenggang Wang , Sean Kennedy , Haipeng Li , King Hudson , Gowtham Atluri , Xuetao Wei , Wenhai Sun , Boyang Wang

With the release of Amazon Alexa and the first Amazon Echo device, the company revolutionised the smart home. It allowed their users to communicate with, and control, their smart home ecosystem purely using voice commands. However, this…

Cryptography and Security · Computer Science 2020-07-28 Clemens Krueger , Sean McKeown

Currently, adaptive voice applications supported by voice assistants (VA) are very popular (i.e., Alexa skills and Google Home Actions). Under this circumstance, how to design and evaluate these voice interactions well is very important. In…

Human-Computer Interaction · Computer Science 2019-06-05 Xu Han , Tom Yeh

Voice authentication has undergone significant changes from traditional systems that relied on handcrafted acoustic features to deep learning models that can extract robust speaker embeddings. This advancement has expanded its applications…

Cryptography and Security · Computer Science 2025-09-17 Kamel Kamel , Keshav Sood , Hridoy Sankar Dutta , Sunil Aryal

Advances in deep learning have introduced a new wave of voice synthesis tools, capable of producing audio that sounds as if spoken by a target speaker. If successful, such tools in the wrong hands will enable a range of powerful attacks…

Cryptography and Security · Computer Science 2021-09-21 Emily Wenger , Max Bronckers , Christian Cianfarani , Jenna Cryan , Angela Sha , Haitao Zheng , Ben Y. Zhao

We present Alexa versus Alexa (AvA), a novel attack that leverages audio files containing voice commands and audio reproduction methods in an offensive fashion, to gain control of Amazon Echo devices for a prolonged amount of time. AvA…

Cryptography and Security · Computer Science 2022-02-18 Sergio Esposito , Daniele Sgandurra , Giampaolo Bella

We propose a new class of signal injection attacks on microphones by physically converting light to sound. We show how an attacker can inject arbitrary audio signals to a target microphone by aiming an amplitude-modulated light at the…

Cryptography and Security · Computer Science 2020-06-23 Takeshi Sugawara , Benjamin Cyr , Sara Rampazzi , Daniel Genkin , Kevin Fu