English
Related papers

Related papers: Continuous Authentication for Voice Assistants

200 papers

Personalization of on-device speech recognition (ASR) has seen explosive growth in recent years, largely due to the increasing popularity of personal assistant features on mobile devices and smart home speakers. In this work, we present…

Audio and Speech Processing · Electrical Eng. & Systems 2022-06-28 Shaojin Ding , Rajeev Rikhye , Qiao Liang , Yanzhang He , Quan Wang , Arun Narayanan , Tom O'Malley , Ian McGraw

Speech recognition (SR) systems such as Siri or Google Now have become an increasingly popular human-computer interaction method, and have turned various systems into voice controllable systems(VCS). Prior work on attacking VCS shows that…

Cryptography and Security · Computer Science 2017-09-01 Guoming Zhang , Chen Yan , Xiaoyu Ji , Taimin Zhang , Tianchen Zhang , Wenyuan Xu

AI is promising in assisting UX evaluators with analyzing usability tests, but its judgments are typically presented as non-interactive visualizations. Evaluators may have questions about test recordings, but have no way of asking them.…

Human-Computer Interaction · Computer Science 2023-03-08 Emily Kuang , Ehsan Jahangirzadeh Soure , Mingming Fan , Jian Zhao , Kristen Shinohara

Voice control is a popular way to operate mobile devices, enabling users to communicate requests to their devices. However, adversaries can leverage voice control to trick mobile devices into executing commands to leak secrets or to modify…

Cryptography and Security · Computer Science 2016-04-04 Giuseppe Petracca , Yuqiong Sun , Ahmad Atamli , Trent Jaeger

Voice Assistants (VAs) can assist users in various everyday tasks, but many users are reluctant to rely on VAs for intricate tasks like online shopping. This study aims to examine whether the vocal characteristics of VAs can serve as an…

Human-Computer Interaction · Computer Science 2024-06-14 Sabid Bin Habib Pias , Ran Huang , Donald Williamson , Minjeong Kim , Apu Kapadia

In the realm of digital audio processing, Voice Activity Detection (VAD) plays a pivotal role in distinguishing speech from non-speech elements, a task that becomes increasingly complex in noisy environments. This paper details the…

Sound · Computer Science 2023-12-12 Joshua Ball

Despite advances in language and speech technologies, no open-source system enables full speech-to-speech, multi-turn dialogue with integrated tool use and agentic reasoning. We introduce AURA (Agent for Understanding, Reasoning, and…

Artificial Intelligence · Computer Science 2025-07-01 Leander Melroy Maben , Gayathri Ganesh Lakshmy , Srijith Radhakrishnan , Siddhant Arora , Shinji Watanabe

Effective time management during presentations is challenging, particularly for Blind and Low-Vision (BLV) individuals, as existing tools often lack accessibility and multimodal feedback. To address this gap, we developed vashTimer: a free,…

Human-Computer Interaction · Computer Science 2025-09-25 Aziz N Zeidieh , Sanchita S. Kamath , JooYoung Seo

We present SMAUG (Secure Mobile Authentication Using Gestures), a novel biometric assisted authentication algorithm for mobile devices that is solely based on data collected from multiple sensors that are usually installed on modern devices…

Cryptography and Security · Computer Science 2017-08-17 Christian A. Gorke , Frederik Armknecht

Supporting older adults in health self-management is crucial for promoting independent aging, particularly given the growing strain on healthcare systems. While voice assistants (VAs) hold the potential to support aging in place, they often…

Human-Computer Interaction · Computer Science 2025-03-11 Amama Mahmood , Shiye Cao , Maia Stiber , Victor Nikhil Antony , Chien-Ming Huang

The adoption of multimodal interactions by Voice Assistants (VAs) is growing rapidly to enhance human-computer interactions. Smartwatches have now incorporated trigger-less methods of invoking VAs, such as Raise To Speak (RTS), where the…

Augmented reality devices have the potential to enhance human perception and enable other assistive functionalities in complex conversational environments. Effectively capturing the audio-visual context necessary for understanding these…

Computer Vision and Pattern Recognition · Computer Science 2022-01-07 Hao Jiang , Calvin Murdock , Vamsi Krishna Ithapu

In-home IoT devices play a major role in healthcare systems as smart personal assistants. They usually come with a voice-enabled feature to add an extra level of usability and convenience to elderly, disabled people, and patients. In this…

Cryptography and Security · Computer Science 2018-09-13 Mohammad Hadian , Thamer Altuwaiyan , Xiaohui Liang , Wei Li

Visual voice activity detection (V-VAD) uses visual features to predict whether a person is speaking or not. V-VAD is useful whenever audio VAD (A-VAD) is inefficient either because the acoustic signal is difficult to analyze or because it…

Computer Vision and Pattern Recognition · Computer Science 2020-10-19 Sylvain Guy , Stéphane Lathuilière , Pablo Mesejo , Radu Horaud

Demographic growth and rise in the average age of the population is increasing the demand for the elderly assistance. Health care oriented ambient intelligence technologies are fundamental to support elderly peoples' autonomy. In this…

Human-Computer Interaction · Computer Science 2023-05-01 Mariya Kilina , Tommaso Elia , Syed Yusha Kareem , Alessandro Carfi , Fulvio Mastrogiovanni

There is a growing need for authentication methodology in virtual reality applications. Current systems assume that the immersive experience technology is a collection of peripheral devices connected to a personal computer or mobile device.…

Cryptography and Security · Computer Science 2022-01-25 Karthik Viswanathan , Abbas Yazdinejad

In recent times, voice assistants have become a part of our day-to-day lives, allowing information retrieval by voice synthesis, voice recognition, and natural language processing. These voice assistants can be found in many modern-day…

Audio and Speech Processing · Electrical Eng. & Systems 2023-01-03 Kashav Piya , Srijal Shrestha , Cameran Frank , Estephanos Jebessa , Tauheed Khan Mohd

We quickly approach a "pervasive future" where pervasive computing is the norm. In this scenario, humans are surrounded by a multitude of heterogeneous devices that assist them in almost every aspect of their daily routines. The realization…

Cryptography and Security · Computer Science 2019-07-12 Artur Souza , Antônio A. F. Loureiro , Leonardo B. Oliveira

CAPTCHAs are widely used by websites to block bots and spam by presenting challenges that are easy for humans but difficult for automated programs to solve. To improve accessibility, audio CAPTCHAs are designed to complement visual ones.…

Sound · Computer Science 2026-01-14 Ziqi Ding , Yunfeng Wan , Wei Song , Yi Liu , Gelei Deng , Nan Sun , Huadong Mo , Jingling Xue , Shidong Pan , Yuekang Li

With the advancements in AI speech synthesis, it is easier than ever before to generate realistic audio in a target voice. One only needs a few seconds of reference audio from the target, quite literally putting words in the target person's…

Sound · Computer Science 2026-03-23 Candice R. Gerstner