English
Related papers

Related papers: Listening Alone, Understanding Together: Collabora…

200 papers

The current "notice and consent" paradigm is broken: consent dialogues are often manipulative, and users cannot realistically read or understand every privacy policy. While recent LLM-based tools empower users seeking active control, many…

Human-Computer Interaction · Computer Science 2026-04-24 Vincent Freiberger

AI agents have become increasingly adept at complex tasks such as coding, reasoning, and multimodal understanding. However, building generalist systems requires moving beyond individual agents to collective inference -- a paradigm where…

Human cognition is constrained by processing limitations, leading to cognitive overload and inefficiencies in knowledge synthesis and decision-making. Large Language Models (LLMs) present an opportunity for cognitive augmentation, but their…

Human-Computer Interaction · Computer Science 2025-04-21 Xiangrong , Zhu , Yuan Xu , Tianjian Liu , Jingwei Sun , Yu Zhang , Xin Tong

Modern Security Operations Centres (SOCs) integrate diverse tools, such as SIEM, IDS, and XDR systems, offering rich contextual data, including alert enrichments, flow features, and similar case histories. Yet, analysts must still manually…

Cryptography and Security · Computer Science 2025-06-12 Ronal Singh , Mohan Baruwal Chhetri , Surya Nepal , Cecile Paris

General-purpose automatic speech recognition (ASR) systems do not always perform well in goal-oriented dialogue. Existing ASR correction methods rely on prior user data or named entities. We extend correction to tasks that have no prior…

Computation and Language · Computer Science 2025-01-13 Yuya Asano , Sabit Hassan , Paras Sharma , Anthony Sicilia , Katherine Atwell , Diane Litman , Malihe Alikhani

Recent years have seen significant advances in end-to-end (E2E) spoken language understanding (SLU) systems, which directly predict intents and slots from spoken audio. While dialogue history has been exploited to improve conventional…

The majority of voice-based conversational agents still rely on pause-and-respond turn-taking, leaving interactions sounding stiff and robotic. We present RESPOND (Responsive Engagement Strategy for Predictive Orchestration and Dialogue), a…

Human-Computer Interaction · Computer Science 2026-03-31 Meng-Chen Lee , Costas Panay , Javier Hernandez , Sean Andrist , Dan Bohus , Anatoly Churikov , Andrew D. Wilson

Advances in generative AI point towards a new era of personalized applications that perform diverse tasks on behalf of users. While general AI assistants have yet to fully emerge, their potential to share personal data raises significant…

Artificial Intelligence · Computer Science 2024-09-24 Zhao Cheng , Diane Wan , Matthew Abueg , Sahra Ghalebikesabi , Ren Yi , Eugene Bagdasarian , Borja Balle , Stefan Mellem , Shawn O'Banion

The proliferation of cloud-native architectures, characterized by microservices and dynamic orchestration, has rendered modern IT infrastructures exceedingly complex and volatile. This complexity generates overwhelming volumes of…

Multiagent Systems · Computer Science 2026-04-29 Zishan Bai , Hanxuan Chen , Jing Luo , Ziyi Ni , Enze Ge , Jiacheng Shi , Yichao Zhang , Jiayi Gu , Zhimo Han , Riyang Bao , Junfeng Hao

We introduce proactive hearing assistants that automatically identify and separate the wearer's conversation partners, without requiring explicit prompts. Our system operates on egocentric binaural audio and uses the wearer's self-speech as…

Computation and Language · Computer Science 2025-11-17 Guilin Hu , Malek Itani , Tuochao Chen , Shyamnath Gollakota

This paper introduces a novel approach to speech restoration by integrating a context-related conditioning strategy. Specifically, we employ the diffusion-based generative restoration model, UNIVERSE++, as a backbone to evaluate the…

Audio and Speech Processing · Electrical Eng. & Systems 2025-08-13 Soo-Whan Chung , Min-Seok Choi

The interactive use of large language models (LLMs) in AI assistants (at work, home, etc.) introduces a new set of inference-time privacy risks: LLMs are fed different types of information from multiple sources in their inputs and are…

Artificial Intelligence · Computer Science 2024-07-02 Niloofar Mireshghallah , Hyunwoo Kim , Xuhui Zhou , Yulia Tsvetkov , Maarten Sap , Reza Shokri , Yejin Choi

Many businesses and consumers are extending the capabilities of voice-based services such as Amazon Alexa, Google Home, Microsoft Cortana, and Apple Siri to create custom voice experiences (also known as skills). As the number of these…

Computation and Language · Computer Science 2019-11-18 Maryam Fazel-Zarandi , Sampat Biswas , Ryan Summers , Ahmed Elmalt , Andy McCraw , Michael McPhilips , John Peach

When multiple people share a single voice assistant, the system conflates their histories: one resident's preferences can leak into another's responses, eroding utility and trust. We call this failure mode persona confusion, and we show it…

Human-Computer Interaction · Computer Science 2026-04-29 Mohammad Al-Ratrout , Pavan Uttej Ravva , Shayla Sharmin , Aditya Raikwar , Ju Young Shin , Roghayeh Leila Barmaki

Conversational assistants process personal data and must comply with data protection regulations that require providers to be transparent with users about how their data is handled. Transparency, in a legal sense, demands preciseness,…

Human-Computer Interaction · Computer Science 2025-02-04 Anna Leschanowsky , Farnaz Salamatjoo , Zahra Kolagar , Birgit Popp

Faithful generation in large language models (LLMs) is challenged by knowledge conflicts between parametric memory and external context. Existing contrastive decoding methods tuned specifically to handle conflict often lack adaptability and…

Computation and Language · Computer Science 2025-08-28 Anant Khandelwal , Manish Gupta , Puneet Agrawal

In spoken conversations, spontaneous behaviors like filled pause and prolongations always happen. Conversational partner tends to align features of their speech with their interlocutor which is known as entrainment. To produce human-like…

Audio and Speech Processing · Electrical Eng. & Systems 2021-06-22 Jian Cong , Shan Yang , Na Hu , Guangzhi Li , Lei Xie , Dan Su

Large language models (LLMs) have become integral to modern Human-AI collaboration workflows, where accurately understanding user intent serves as a crucial step for generating satisfactory responses. Context-aware intent understanding,…

Computation and Language · Computer Science 2026-03-05 Guanming Liu , Meng Wu , Peng Zhang , Yu Zhang , Yubo Shu , Xianliang Huang , Kainan Tu , Ning Gu , Liuxin Zhang , Qianying Wang , Tun Lu

Building reliable conversational AI assistants for customer-facing industries remains challenging due to noisy conversational data, fragmented knowledge, and the requirement for accurate human hand-off - particularly in domains that depend…

Computation and Language · Computer Science 2026-02-19 Krittin Pachtrachai , Petmongkon Pornpichitsuwan , Wachiravit Modecrua , Touchapon Kraisingkorn

Emotion recognition plays a crucial role in various domains of human-robot interaction. In long-term interactions with humans, robots need to respond continuously and accurately, however, the mainstream emotion recognition methods mostly…

Human-Computer Interaction · Computer Science 2024-01-23 Zihan Lin , Francisco Cruz , Eduardo Benitez Sandoval