English
Related papers

Related papers: VoiceAgentRAG: Solving the RAG Latency Bottleneck …

200 papers

In this paper, we propose a Retrieval Augmented Generation (RAG) agent that maps natural language queries about research topics to precise, machine-interpretable semantic entities. Our approach combines RAG with Socratic dialogue to align a…

Computation and Language · Computer Science 2025-02-24 Lew Lefton , Kexin Rong , Chinar Dankhara , Lila Ghemri , Firdous Kausar , A. Hannibal Hamdallahi

Multi-agent systems using large language models (LLMs) have demonstrated impressive capabilities across various domains. However, current agent communication suffers from verbose output that overload context and increase computational…

Computation and Language · Computer Science 2026-04-09 Danqing Wang , Da Yin , Ruta Desai , Lei Li , Asli Celikyilmaz , Ansong Ni

Retrieval-Augmented Generation (RAG) is widely employed to mitigate risks such as hallucinations and knowledge obsolescence in medical question answering, yet its predominantly single-round, static retrieval paradigm misaligns with the…

Computation and Language · Computer Science 2026-05-19 Yongfeng Huang , Ruiying Chen , James Cheng

The evolution of recommender systems has shifted from traditional collaborative filtering to LLM-based agentic systems, which rely on semantic user and item memories to make predictions. However, existing agents maintain these memories in…

Information Retrieval · Computer Science 2026-04-29 Weixin Chen , Yuhan Zhao , Jingyuan Huang , Zihe Ye , Clark Mingxuan Ju , Tong Zhao , Neil Shah , Li Chen , Yongfeng Zhang

Agent assistance during human-human customer support spoken interactions requires triggering workflows based on the caller's intent (reason for call). Timeliness of prediction is essential for a good user experience. The goal is for a…

Artificial Intelligence · Computer Science 2022-08-16 Mrinal Rawat , Victor Barres

Although Large Language Models (LLMs) demonstrate significant capabilities, their reliance on parametric knowledge often leads to inaccuracies. Retrieval Augmented Generation (RAG) mitigates this by incorporating external knowledge, but…

Artificial Intelligence · Computer Science 2025-11-04 Hailong Yin , Bin Zhu , Jingjing Chen , Chong-Wah Ngo

Large Language Models (LLMs) have demonstrated strong capabilities in web search and reasoning. However, their dependence on static training corpora makes them prone to factual errors and knowledge gaps. Retrieval-Augmented Generation (RAG)…

Artificial Intelligence · Computer Science 2026-01-26 Jiasheng Xu , Mingda Li , Yongqiang Tang , Peijie Wang , Wensheng Zhang

Retrieval-Augmented Generation (RAG) has shown promise in enhancing recommendation systems by incorporating external context into large language model prompts. However, existing RAG-based approaches often rely on static retrieval heuristics…

Retrieval-Augmented Generation (RAG) enhances large language models (LLMs) by integrating external knowledge sources, enabling more accurate and contextually relevant responses tailored to user queries. These systems, however, remain…

Computation and Language · Computer Science 2025-05-26 Huichi Zhou , Kin-Hei Lee , Zhonghao Zhan , Yue Chen , Zhenhao Li , Zhaoyang Wang , Hamed Haddadi , Emine Yilmaz

Voice Activity Detection (VAD) is an important pre-processing step in a wide variety of speech processing systems. VAD should in a practical application be able to detect speech in both noisy and noise-free environments, while not…

Audio and Speech Processing · Electrical Eng. & Systems 2022-07-06 Claus Meyer Larsen , Peter Koch , Zheng-Hua Tan

Agents in the real world must make not only logical but also timely judgments. This requires continuous awareness of the dynamic environment: hazards emerge, opportunities arise, and other agents act, while the agent's reasoning is still…

Artificial Intelligence · Computer Science 2025-11-10 Yule Wen , Yixin Ye , Yanzhe Zhang , Diyi Yang , Hao Zhu

The latency bottleneck of traditional text-to-speech (TTS) systems fundamentally hinders the potential of streaming large language models (LLMs) in conversational AI. These TTS systems, typically trained and inferenced on complete…

Computation and Language · Computer Science 2025-05-27 Richard He Bai , Zijin Gu , Tatiana Likhomanenko , Navdeep Jaitly

The dialogue systems in customer services have been developed with neural models to provide users with precise answers and round-the-clock support in task-oriented conversations by detecting customer intents based on their utterances.…

Computation and Language · Computer Science 2023-10-17 Yu-Chien Tang , Wei-Yao Wang , An-Zi Yen , Wen-Chih Peng

Large language model (LLM) agents often rely on external demonstrations or retrieval-augmented planning, leading to brittleness, poor generalization, and high computational overhead. Inspired by human problem-solving, we propose DuSAR…

Artificial Intelligence · Computer Science 2026-02-03 Wentao Zhang , Qunbo Wang , BoXuan Zhao , Tao Zhang , Junsheng Wu , Hongping Gan , Ling Dai , Shizhuang Deng , Shuntong Sun , Yang Liu

We introduce AccurateRAG -- a novel framework for constructing high-performance question-answering applications based on retrieval-augmented generation (RAG). Our framework offers a pipeline for development efficiency with tools for raw…

Computation and Language · Computer Science 2026-03-04 Linh The Nguyen , Chi Tran , Dung Ngoc Nguyen , Van-Cuong Pham , Hoang Ngo , Dat Quoc Nguyen

Incident response (IR) requires fast, coordinated, and well-informed decision-making to contain and mitigate cyber threats. While large language models (LLMs) have shown promise as autonomous agents in simulated IR settings, their reasoning…

Computation and Language · Computer Science 2025-10-07 Zefang Liu , Arman Anwar

An inferior performance of the streaming automatic speech recognition models versus non-streaming model is frequently seen due to the absence of future context. In order to improve the performance of the streaming model and reduce the…

Sound · Computer Science 2022-03-30 Jingyu Sun , Guiping Zhong , Dinghao Zhou , Baoxiang Li

This paper presents mRAG, a multi-agent retrieval-augmented generation (RAG) framework composed of specialized agents for subtasks such as planning, searching, reasoning, and coordination. Our system uses a self-training paradigm with…

Computation and Language · Computer Science 2025-06-13 Alireza Salemi , Mukta Maddipatla , Hamed Zamani

Large Language Models (LLMs) have demonstrated impressive fluency and task competence in conversational settings. However, their effectiveness in multi-session and long-term interactions is hindered by limited memory persistence. Typical…

Computation and Language · Computer Science 2025-08-19 Maitreyi Chatterjee , Devansh Agarwal

This paper presents Compliance Brain Assistant (CBA), a conversational, agentic AI assistant designed to boost the efficiency of daily compliance tasks for personnel in enterprise environments. To strike a good balance between response…