English
Related papers

Related papers: VoiceAgentRAG: Solving the RAG Latency Bottleneck …

200 papers

Interactive conversational recommender systems have gained significant attention for their ability to capture user preferences through natural language interactions. However, existing approaches face substantial challenges in handling…

Artificial Intelligence · Computer Science 2025-10-03 Bo Ma , Hang Li , ZeHua Hu , XiaoFan Gui , LuYao Liu , Simon Lau

Achieving human-like responsiveness is a critical yet challenging goal for cascaded spoken dialogue systems. Conventional ASR-LLM-TTS pipelines follow a strictly sequential paradigm, requiring complete transcription and full reasoning…

Computation and Language · Computer Science 2026-02-27 Siyuan Liu , Jiahui Xu , Feng Jiang , Kuang Wang , Zefeng Zhao , Chu-Ren Huang , Jinghang Gu , Changqing Yin , Haizhou Li

Retrieval-Augmented Generation (RAG) systems combine vector similarity search with large language models (LLMs) to deliver accurate, context-aware responses. However, co-locating the vector retriever and the LLM on shared GPU infrastructure…

Machine Learning · Computer Science 2026-01-21 Junkyum Kim , Divya Mahajan

Intrusion Detection and Prevention Systems (IDS/IPS) in large enterprises can generate hundreds of thousands of alerts per hour, overwhelming analysts with logs requiring rapidly evolving expertise. Conventional machine-learning detectors…

Cryptography and Security · Computer Science 2026-02-10 Francesco Blefari , Cristian Cosentino , Francesco Aurelio Pironti , Angelo Furfaro , Fabrizio Marozzo

Recent advances in AudioLLMs have enabled spoken dialogue systems to move beyond turn-based interaction toward real-time full-duplex communication, where the agent must decide when to speak, yield, or interrupt while the user is still…

Retrieval-Augmented Generation (RAG) has emerged as a powerful framework to overcome the knowledge limitations of Large Language Models (LLMs) by integrating external retrieval with language generation. While early RAG systems based on…

Artificial Intelligence · Computer Science 2025-06-13 Jintao Liang , Gang Su , Huifeng Lin , You Wu , Rui Zhao , Ziyue Li

This paper delves into the challenging task of Active Speaker Detection (ASD), where the system needs to determine in real-time whether a person is speaking or not in a series of video frames. While previous works have made significant…

Computer Vision and Pattern Recognition · Computer Science 2024-09-16 Arnav Kundu , Yanzi Jin , Mohammad Sekhavat , Max Horton , Danny Tormoen , Devang Naik

Retrieval-Augmented Generation (RAG) mitigates key limitations of Large Language Models (LLMs)-such as factual errors, outdated knowledge, and hallucinations-by dynamically retrieving external information. Recent work extends this paradigm…

Computation and Language · Computer Science 2026-05-22 Jingru Lin , Chen Zhang , Stephen Y. Liu , Haizhou Li

LLM-based conversational AI agents struggle to maintain coherent behavior over long horizons due to limited context. While RAG-based approaches are increasingly adopted to overcome this limitation by storing interactions in external memory…

Artificial Intelligence · Computer Science 2026-05-13 Jiazhou Liang , Armin Toroghi , Yifan Simon Liu , Faeze Moradi Kalarde , Liam Gallagher , Scott Sanner

Retrieval-Augmented Generation (RAG) systems and large language model (LLM)-powered chatbots have significantly advanced conversational AI by combining generative capabilities with external knowledge retrieval. Despite their success,…

Artificial Intelligence · Computer Science 2025-06-26 Priyaranjan Pattnayak , Amit Agarwal , Hansa Meghwani , Hitesh Laxmichand Patel , Srikant Panda

We present AgenticRAG, a practical agentic harness for retrieval and analysis over enterprise knowledge bases. Standard RAG pipelines place significant burden of grounding on the search stack, constraining the language model to a fixed…

Artificial Intelligence · Computer Science 2026-05-08 Susheel Suresh , Hazel Mak , Shangpo Chou , Fred Kroon , Sahil Bhatnagar

The rapid development of large language model (LLM)-based agents has unlocked new possibilities for autonomous multi-turn reasoning and tool-augmented decision-making. However, their real-world deployment is hindered by severe…

Answering complex, real-world queries often requires synthesizing facts scattered across vast document corpora. In these settings, standard retrieval-augmented generation (RAG) pipelines suffer from incomplete evidence coverage, while…

Computation and Language · Computer Science 2026-03-10 Yagiz Can Akay , Muhammed Yusuf Kartal , Esra Alparslan , Faruk Ortakoyluoglu , Arda Akpinar

Large language models (LLMs) are widely used in retrieval-augmented generation (RAG) to incorporate external knowledge at inference time. However, when retrieved contexts are noisy, incomplete, or heterogeneous, a single generation process…

Computation and Language · Computer Science 2026-04-22 Xingchen Xiao , Heyan Huang , Runheng Liu , Jincheng Xie

Retrieval-Augmented Generation (RAG) systems often face limitations in specialized domains such as fintech, where domain-specific ontologies, dense terminology, and acronyms complicate effective retrieval and synthesis. This paper…

Artificial Intelligence · Computer Science 2025-10-30 Thomas Cook , Richard Osuagwu , Liman Tsatiashvili , Vrynsia Vrynsia , Koustav Ghosal , Maraim Masoud , Riccardo Mattivi

Dual-system Vision-Language-Action (VLA) models achieve state-of-the-art robotic manipulation but are bottlenecked by the VLM backbone, which must execute at every control step while producing temporally redundant features. We propose…

In interactive automatic speech recognition (ASR) systems, low-latency requirements limit the amount of search space that can be explored during decoding, particularly in end-to-end neural ASR. In this paper, we present a novel streaming…

Audio and Speech Processing · Electrical Eng. & Systems 2024-01-29 Denis Filimonov , Prabhat Pandey , Ariya Rastrow , Ankur Gandhe , Andreas Stolcke

Retrieval Augmented Generation (RAG) has gained widespread adoption owing to its capacity to empower large language models (LLMs) to integrate external knowledge. However, existing RAG frameworks are primarily designed for text-based LLMs…

Sound · Computer Science 2025-02-21 Yifu Chen , Shengpeng Ji , Haoxiao Wang , Ziqing Wang , Siyu Chen , Jinzheng He , Jin Xu , Zhou Zhao

Multimodal document question answering requires retrieving dispersed evidence from visually rich long documents and performing reliable reasoning over heterogeneous information. Existing multimodal RAG systems remain limited by two…

Information Retrieval · Computer Science 2026-03-18 Jiashu Yang , Chi Zhang , Abudukelimu Wuerkaixi , Xuxin Cheng , Cao Liu , Ke Zeng , Xu Jia , Xunliang Cai

We introduce Voxtral Realtime, a natively streaming automatic speech recognition model that matches offline transcription quality at sub-second latency. Unlike approaches that adapt offline models through chunking or sliding windows,…

Artificial Intelligence · Computer Science 2026-04-07 Mistral-AI , : , Alexander H. Liu , Andy Ehrenberg , Andy Lo , Chen-Yo Sun , Guillaume Lample , Jean-Malo Delignon , Khyathi Raghavi Chandu , Patrick von Platen , Pavankumar Reddy Muddireddy , Rohin Arora , Sanchit Gandhi , Sandeep Subramanian , Soham Ghosh , Srijan Mishra , Abhinav Rastogi , Adrien Sadé , Alan Jeffares , Albert Jiang , Alexandre Cahill , Alexandre Gavaudan , Alexandre Sablayrolles , Amélie Héliou , Amos You , Andrew Bai , Angele Lenglemetz , Anmol Agarwal , Anton Eliseev , Antonia Calvi , Arjun Majumdar , Avi Sooriyarachchi , Baptiste Bout , Baptiste Rozière , Baudouin De Monicault , Benjamin Tibi , Charlotte Cronjäger , Clémence Lanfranchi , Connor Chen , Corentin Barreau , Corentin Sautier , Cyprien Courtot , Darius Dabert , Diego de las Casas , Elizaveta Demyanenko , Elliot Chane-Sane , Enguerrand Paquin , Etienne Goffinet , Fabien Niel , Faruk Ahmed , Federico Baldassarre , Gabrielle Berrada , Gaëtan Ecrepont , Gauthier Guinet , Genevieve Hayes , Georgii Novikov , Giada Pistilli , Guillaume Kunsch , Guillaume Martin , Guillaume Raille , Gunjan Dhanuka , Gunshi Gupta , Han Zhou , Harshil Shah , Hope McGovern , Hugo Thimonier , Indraneel Mukherjee , Irene Zhang , Jaeyoung Kim , Jan Ludziejewski , Jason Rute , Joachim Studnia , John Harvill , Jonas Amar , Joséphine Delas , Josselin Somerville Roberts , Julien Tauran , Karmesh Yadav , Kartik Khandelwal , Kilian Tep , Kush Jain , Laurence Aitchison , Laurent Fainsin , Léonard Blier , Lingxiao Zhao , Louis Martin , Lucile Saulnier , Luyu Gao , Maarten Buyl , Manan Sharma , Margaret Jennings , Marie Pellat , Mark Prins , Martin Alexandre , Mathieu Poirée , Mathilde Guillaumin , Matthieu Dinot , Matthieu Futeral , Maxime Darrin , Maximilian Augustin , Mert Unsal , Mia Chiquier , Minh-Quang Pham , Nathan Grinsztajn , Neha Gupta , Olivier Bousquet , Olivier Duchenne , Patricia Wang , Paul Jacob , Paul Wambergue , Paula Kurylowicz , Philippe Pinel , Philomène Chagniot , Pierre Stock , Piotr Miłoś , Prateek Gupta , Pravesh Agrawal , Quentin Torroba , Ram Ramrakhya , Rishi Shah , Romain Sauvestre , Roman Soletskyi , Rosalie Millner , Rupert Menneer , Sagar Vaze , Samuel Barry , Samuel Humeau , Sean Cha , Shashwat Verma , Siddhant Waghjale , Siddharth Gandhi , Simon Lepage , Sumukh Aithal , Szymon Antoniak , Teven Le Scao , Théo Cachet , Theo Simon Sorg , Thibaut Lavril , Thomas Chabal , Thomas Foubert , Thomas Robert , Thomas Wang , Tim Lawson , Tom Bewley , Tom Edwards , Tyler Wang , Umar Jamil , Umberto Tomasini , Valeriia Nemychnikova , Van Phung , Vedant Nanda , Victor Jouault , Vincent Maladière , Virgile Richard , Vladislav Bataev , Wassim Bouaziz , Wen-Ding Li , William Havard , William Marshall , Xinghui Li , Xingran Guo , Xinyu Yang , Yannic Neuhaus , Yassine El Ouahidi , Yassir Bendou , Yihan Wang , Yimu Pan , Zaccharie Ramzi , Zhenlin Xu