English
Related papers

Related papers: Nonsense Attacks on Google Assistant

200 papers

In this work, we address a novel, but potentially emerging, problem of discriminating the natural human voices and those played back by any kind of audio devices in the context of interactions with in-house voice user interface. The tackled…

Sound · Computer Science 2019-02-19 Thanh-Ha Le , Philippe Gilberton , Ngoc Q. K. Duong

Autonomous agents deployed in the real world need to be robust against adversarial attacks on sensory inputs. Robustifying agent policies requires anticipating the strongest attacks possible. We demonstrate that existing observation-space…

Voice assistant applications have become omniscient nowadays. Two models that provide the two most important functions for real-life applications (i.e., Google Home, Amazon Alexa, Siri, etc.) are Automatic Speech Recognition (ASR) models…

Cryptography and Security · Computer Science 2023-04-20 Jingjin Li , Chao chen , Lei Pan , Mostafa Rahimi Azghadi , Hossein Ghodosi , Jun Zhang

Recent works investigated attacks on sensors by influencing analog sensor components with acoustic, light, and electromagnetic signals. Such attacks can have extensive security, reliability, and safety implications since many types of the…

Cryptography and Security · Computer Science 2022-03-16 Yazhou Tu , Sara Rampazzi , Xiali Hei

People communicate using both speech and non-verbal signals such as gestures, face expression or body pose. Non-verbal signals impact the meaning of the spoken utterance in an abundance of ways. An absence of non-verbal signals impoverishes…

Computer Vision and Pattern Recognition · Computer Science 2021-08-24 Manuel Rebol , Christian Gütl , Krzysztof Pietroszek

User errors while performing security-critical tasks can lead to undesirable or even disastrous consequences. One major factor influencing mistakes and failures is complexity of such tasks, which has been studied extensively in prior…

Human-Computer Interaction · Computer Science 2015-08-26 Tyler Kaczmarek , Alfed Kobsa , Robert Sy , Gene Tsudik

Recent years have seen a surge in the popularity of acoustics-enabled personal devices powered by machine learning. Yet, machine learning has proven to be vulnerable to adversarial examples. A large number of modern systems protect…

Machine Learning · Computer Science 2023-05-30 Shimaa Ahmed , Yash Wani , Ali Shahin Shamsabadi , Mohammad Yaghini , Ilia Shumailov , Nicolas Papernot , Kassem Fawaz

Conversational AI systems can engage in unsafe behaviour when handling users' medical queries that can have severe consequences and could even lead to deaths. Systems therefore need to be capable of both recognising the seriousness of…

Computation and Language · Computer Science 2022-10-04 Gavin Abercrombie , Verena Rieser

Audio deepfake detection (ADD) is essential for preventing the misuse of synthetic voices that may infringe on personal rights and privacy. Recent zero-shot text-to-speech (TTS) models pose higher risks as they can clone voices with a…

Sound · Computer Science 2024-09-23 Yuang Li , Min Zhang , Mengxin Ren , Miaomiao Ma , Daimeng Wei , Hao Yang

It has recently become feasible to run personal digital assistants on phones and other personal devices. In this paper we describe a design for a natural language understanding system that runs on device. In comparison to a server-based…

Persuasion is a fundamental aspect of communication, influencing decision-making across diverse contexts, from everyday conversations to high-stakes scenarios such as politics, marketing, and law. The rise of conversational AI systems has…

Computation and Language · Computer Science 2026-03-24 Nimet Beyza Bozdag , Shuhaib Mehri , Xiaocheng Yang , Hyeonjeong Ha , Zirui Cheng , Esin Durmus , Jiaxuan You , Heng Ji , Gokhan Tur , Dilek Hakkani-Tür

Malicious applications of visual manipulation have raised serious threats to the security and reputation of users in many fields. To alleviate these issues, adversarial noise-based defenses have been enthusiastically studied in recent…

Computer Vision and Pattern Recognition · Computer Science 2025-05-29 Dawei Zhou , Suzhi Gang , Decheng Liu , Tongliang Liu , Nannan Wang , Xinbo Gao

Voice dictation is an increasingly important text input modality. Existing systems that allow both dictation and editing-by-voice restrict their command language to flat templates invoked by trigger words. In this work, we study the…

Computation and Language · Computer Science 2023-07-11 Belinda Z. Li , Jason Eisner , Adam Pauls , Sam Thomson

The widespread adoption of voice-activated systems has modified routine human-machine interaction but has also introduced new vulnerabilities. This paper investigates the susceptibility of automatic speech recognition (ASR) algorithms in…

Cryptography and Security · Computer Science 2024-04-09 Forrest McKee , David Noever

Neural speech editing advancements have raised concerns about their misuse in spoofing attacks. Traditional partially edited speech corpora primarily focus on cut-and-paste edits, which, while maintaining speaker consistency, often…

As more attention is paid to security in the context of control systems and as attacks occur to real control systems throughout the world, it has become clear that some of the most nefarious attacks are those that evade detection. The term…

Systems and Control · Computer Science 2017-10-10 Navid Hashemi , Carlos Murguia , Justin Ruths

We present Alexa versus Alexa (AvA), a novel attack that leverages audio files containing voice commands and audio reproduction methods in an offensive fashion, to gain control of Amazon Echo devices for a prolonged amount of time. AvA…

Cryptography and Security · Computer Science 2022-02-18 Sergio Esposito , Daniele Sgandurra , Giampaolo Bella

Automatic speech recognition systems based on neural networks are vulnerable to adversarial attacks that alter transcriptions in a malicious way. Recent works in this field have focused on making attacks work in over-the-air scenarios,…

Audio and Speech Processing · Electrical Eng. & Systems 2026-03-19 Protopopov Alexey

Today, technological advancement is increasing day by day. Earlier, there was only a computer system in which we could only perform a few tasks. But now, machine learning, artificial intelligence, deep learning, and a few more technologies…

Human-Computer Interaction · Computer Science 2023-05-30 Sumit Kumar , Varun Gupta , Sankalp Sagar , Sachin Kumar Singh

Machine Learning as a Service (MLaaS) has gained popularity due to advancements in Deep Neural Networks (DNNs). However, untrusted third-party platforms have raised concerns about AI security, particularly in backdoor attacks. Recent…

Cryptography and Security · Computer Science 2024-03-12 Zhe Ye , Diqun Yan , Li Dong , Kailai Shen