English
Related papers

Related papers: Nonsense Attacks on Google Assistant

200 papers

Voice assistants have become an essential tool for people with various disabilities because they enable complex phone- or tablet-based interactions without the need for fine-grained motor control, such as with touchscreens. However, these…

Audio and Speech Processing · Electrical Eng. & Systems 2022-02-17 Colin Lea , Zifang Huang , Dhruv Jain , Lauren Tooley , Zeinab Liaghat , Shrinath Thelapurath , Leah Findlater , Jeffrey P. Bigham

Machine learning approaches for speech enhancement are becoming increasingly expressive, enabling ever more powerful modifications of input signals. In this paper, we demonstrate that this expressiveness introduces a vulnerability: advanced…

Audio and Speech Processing · Electrical Eng. & Systems 2026-05-01 Rostislav Makarov , Lea Schönherr , Timo Gerkmann

Despite their immense popularity, deep learning-based acoustic systems are inherently vulnerable to adversarial attacks, wherein maliciously crafted audios trigger target systems to misbehave. In this paper, we present SirenAttack, a new…

Cryptography and Security · Computer Science 2019-07-25 Tianyu Du , Shouling Ji , Jinfeng Li , Qinchen Gu , Ting Wang , Raheem Beyah

Deep speech classification has achieved tremendous success and greatly promoted the emergence of many real-world applications. However, backdoor attacks present a new security threat to it, particularly with untrustworthy third-party…

Sound · Computer Science 2023-08-15 Zhe Ye , Terui Mao , Li Dong , Diqun Yan

Recent advances in multi-modal, highly capable LLMs have enabled voice-enabled AI agents. These agents are enabling new applications, such as voice-enabled autonomous customer service. However, with all AI capabilities, these new…

Artificial Intelligence · Computer Science 2024-10-22 Richard Fang , Dylan Bowman , Daniel Kang

Speech-to-text services aim to transcribe input audio as accurately as possible. They increasingly play a role in everyday life, for example in personal voice assistants or in customer-company interactions. We evaluate Open AI's Whisper, a…

Computation and Language · Computer Science 2024-05-06 Allison Koenecke , Anna Seo Gyeong Choi , Katelyn X. Mei , Hilke Schellmann , Mona Sloane

Automatic speaker verification (ASV) systems utilize the biometric information in human speech to verify the speaker's identity. The techniques used for performing speaker verification are often vulnerable to malicious attacks that attempt…

Sound · Computer Science 2020-11-26 Yang Gao , Jiachen Lian , Bhiksha Raj , Rita Singh

Substantial improvements have been achieved in recent years in voice conversion, which converts the speaker characteristics of an utterance into those of another speaker without changing the linguistic content of the utterance. Nonetheless,…

Audio and Speech Processing · Electrical Eng. & Systems 2021-05-05 Chien-yu Huang , Yist Y. Lin , Hung-yi Lee , Lin-shan Lee

Speech is a common and effective way of communication between humans, and modern consumer devices such as smartphones and home hubs are equipped with deep learning based accurate automatic speech recognition to enable natural interaction…

Computation and Language · Computer Science 2018-01-03 Moustafa Alzantot , Bharathan Balaji , Mani Srivastava

Due to the open nature of voice input, voice assistant (VA) systems (e.g., Google Home and Amazon Alexa) are under a high risk of sensitive information leakage (e.g., personal schedules and shopping accounts). Though the existing VA systems…

Human-Computer Interaction · Computer Science 2020-04-13 Chen Wang , Cong Shi , Yingying Chen , Yan Wang , Nitesh Saxena

Modern virtual personal assistants provide a convenient interface for completing daily tasks via voice commands. An important consideration for these assistants is the ability to recover from automatic speech recognition (ASR) and natural…

Computation and Language · Computer Science 2017-12-13 Maryam Fazel-Zarandi , Shang-Wen Li , Jin Cao , Jared Casale , Peter Henderson , David Whitney , Alborz Geramifard

Smart glasses are emerging as a popular wearable computing platform potentially revolutionizing the next generation of human-computer interaction. The widespread adoption of smart glasses has created a pressing need for discreet and…

Human-Computer Interaction · Computer Science 2024-08-22 Payal Mohapatra , Ali Aroudi , Anurag Kumar , Morteza Khaleghimeybodi

In this paper we argue, drawing from the perspectives of cybersecurity and social psychology, that Internet-based manipulation of an individual or group reality using ambient tactical deception is possible using only software and changing…

Human-Computer Interaction · Computer Science 2018-10-29 Adam Trowbridge , Jessica Westbrook , Filipo Sharevski

Inaudible voice command injection is one of the most threatening attacks towards voice assistants. Existing attacks aim at injecting the attack signals over the air, but they require the access to the authorized user's voice for activating…

Cryptography and Security · Computer Science 2022-02-11 Yuanda Wang , Hanqing Guo , Qiben Yan

In this work, we demonstrate the existence of universal adversarial audio perturbations that cause mis-transcription of audio signals by automatic speech recognition (ASR) systems. We propose an algorithm to find a single…

Machine Learning · Computer Science 2019-08-16 Paarth Neekhara , Shehzeen Hussain , Prakhar Pandey , Shlomo Dubnov , Julian McAuley , Farinaz Koushanfar

Voice Assistants (VAs) such as Amazon Alexa or Google Assistant rely on wake-word detection to respond to people's commands, which could potentially be vulnerable to audio adversarial examples. In this work, we target our attack on the…

Cryptography and Security · Computer Science 2019-12-09 Juncheng B. Li , Shuhui Qu , Xinjian Li , Joseph Szurley , J. Zico Kolter , Florian Metze

Speech enabled foundation models, either in the form of flexible speech recognition based systems or audio-prompted large language models (LLMs), are becoming increasingly popular. One of the interesting aspects of these models is their…

Sound · Computer Science 2024-10-14 Vyas Raina , Mark Gales

Smart home voice assistants enable users to conveniently interact with IoT devices and perform Internet searches; however, they also collect the voice input that can carry sensitive personal information about users. Previous papers…

Human-Computer Interaction · Computer Science 2024-03-12 Xinhang Ma , Sirui Chen

Intelligent virtual assistants are currently designed to perform tasks or services explicitly mentioned by users, so multiple related domains or tasks need to be performed one by one through a long conversation with many explicit intents.…

Computation and Language · Computer Science 2023-06-07 Hui-Chi Kuo , Yun-Nung Chen

AI assistants are becoming an integral part of society, used for asking advice or help in personal and confidential issues. In this paper, we unveil a novel side-channel that can be used to read encrypted responses from AI Assistants over…

Cryptography and Security · Computer Science 2024-03-18 Roy Weiss , Daniel Ayzenshteyn , Guy Amit , Yisroel Mirsky