中文
相关论文

相关论文: VoiceAgentRAG: Solving the RAG Latency Bottleneck …

200 篇论文

Retrieval Augmented Generation (RAG) systems have seen huge popularity in augmenting Large-Language Model (LLM) outputs with domain specific and time sensitive data. Very recently a shift is happening from simple RAG setups that query a…

信息检索 · 计算机科学 2024-03-05 Tristan Kenneweg , Philip Kenneweg , Barbara Hammer

Current end-to-end spoken language models (SLMs) have made notable progress, yet they still encounter considerable response latency. This delay primarily arises from the autoregressive generation of speech tokens and the reliance on complex…

计算与语言 · 计算机科学 2025-11-14 Yuhao Wang , Ziyang Cheng , Heyang Liu , Ronghua Wu , Qunshan Gu , Yanfeng Wang , Yu Wang

Retrieval-Augmented Generation (RAG) compensates for the static knowledge limitations of Large Language Models (LLMs) by integrating external knowledge, producing responses with enhanced factual correctness and query-specific…

计算与语言 · 计算机科学 2025-05-21 Ruobing Yao , Yifei Zhang , Shuang Song , Neng Gao , Chenyang Tu

In customer contact centers, human agents often struggle with long average handling times (AHT) due to the need to manually interpret queries and retrieve relevant knowledge base (KB) articles. While retrieval augmented generation (RAG)…

计算与语言 · 计算机科学 2024-10-15 Garima Agrawal , Sashank Gummuluri , Cosimo Spera

Effectively retrieving, reasoning, and understanding multimodal information remains a critical challenge for agentic systems. Traditional Retrieval-augmented Generation (RAG) methods rely on linear interaction histories, which struggle to…

计算机视觉与模式识别 · 计算机科学 2026-04-22 Qiuchen Wang , Shihang Wang , Yu Zeng , Qiang Zhang , Fanrui Zhang , Zhuoning Guo , Bosi Zhang , Wenxuan Huang , Lin Chen , Zehui Chen , Pengjun Xie , Ruixue Ding

While Visual Multi-Agent Systems (VMAS) promise to enhance comprehensive abilities through inter-agent collaboration, empirical evidence reveals a counter-intuitive "scaling wall": increasing agent turns often degrades performance while…

Retrieval-Augmented Generation (RAG) systems enhance large language models (LLMs) by integrating external knowledge sources, enabling more accurate and contextually relevant responses tailored to user needs. However, existing RAG systems…

信息检索 · 计算机科学 2025-04-29 Zirui Guo , Lianghao Xia , Yanhua Yu , Tu Ao , Chao Huang

Large Language Models (LLMs) exhibit high reasoning capacity in medical question-answering, but their tendency to produce hallucinations and outdated knowledge poses critical risks in healthcare fields. While Retrieval-Augmented Generation…

计算与语言 · 计算机科学 2026-03-25 Wenhao Wu , Zhentao Tang , Yafu Li , Shixiong Kai , Mingxuan Yuan , Chunlin Chen , Zhi Wang

Transcribing and understanding multi-speaker conversations requires speech recognition, speaker attribution, and timestamp localization. While speech LLMs excel at single-speaker tasks, multi-speaker scenarios remain challenging due to…

音频与语音处理 · 电气工程与系统科学 2026-04-06 Zhennan Lin , Shuai Wang , Zhaokai Sun , Pengyuan Xie , Chuan Xie , Jie Liu , Qiang Zhang , Lei Xie

Retrieval-augmented generation (RAG) and its graph-based extensions (GraphRAG) are effective paradigms for improving large language model (LLM) reasoning by grounding generation in external knowledge. However, most existing RAG and GraphRAG…

信息检索 · 计算机科学 2026-04-14 Dongzhe Fan , Zheyi Xue , Siyuan Liu , Qiaoyu Tan

Recent advancements in AI-driven conversational agents have exhibited immense potential of AI applications. Effective response generation is crucial to the success of these agents. While extensive research has focused on leveraging multiple…

计算与语言 · 计算机科学 2025-03-26 Junfeng Liu , Christopher T. Symons , Ranga Raju Vatsavai

While Retrieval-Augmented Generation (RAG) excels at injecting static, factual knowledge into Large Language Models (LLMs), it exhibits a critical deficit in handling longitudinal queries that require tracking entities and phenomena across…

计算与语言 · 计算机科学 2025-08-01 Kwun Hang Lau , Ruiyuan Zhang , Weijie Shi , Xiaofang Zhou , Xiaojun Cheng

Dialogue policy plays an important role in task-oriented spoken dialogue systems. It determines how to respond to users. The recently proposed deep reinforcement learning (DRL) approaches have been used for policy optimization. However,…

计算与语言 · 计算机科学 2019-05-28 Lu Chen , Zhi Chen , Bowen Tan , Sishan Long , Milica Gasic , Kai Yu

This study addresses the critical need for enhanced situational awareness in autonomous driving (AD) by leveraging the contextual reasoning capabilities of large language models (LLMs). Unlike traditional perception systems that rely on…

人工智能 · 计算机科学 2025-01-09 Xuewen Luo , Fan Ding , Fengze Yang , Yang Zhou , Junnyong Loo , Hwa Hui Tew , Chenxi Liu

One common approach for question answering over speech data is to first transcribe speech using automatic speech recognition (ASR) and then employ text-based retrieval-augmented generation (RAG) on the transcriptions. While this cascaded…

音频与语音处理 · 电气工程与系统科学 2025-01-06 Do June Min , Karel Mundnich , Andy Lapastora , Erfan Soltanmohammadi , Srikanth Ronanki , Kyu Han

Retrieval-Augmented Generation (RAG) lifts the factuality of Large Language Models (LLMs) by injecting external knowledge, yet it falls short on problems that demand multi-step inference; conversely, purely reasoning-oriented approaches…

Existing works on long-term open-domain dialogues focus on evaluating model responses within contexts spanning no more than five chat sessions. Despite advancements in long-context large language models (LLMs) and retrieval augmented…

计算与语言 · 计算机科学 2024-02-28 Adyasha Maharana , Dong-Ho Lee , Sergey Tulyakov , Mohit Bansal , Francesco Barbieri , Yuwei Fang

Manipulative communication, such as gaslighting, guilt-tripping, and emotional coercion, is often difficult for individuals to recognize. Existing agentic AI systems lack the structured, longitudinal memory to track these subtle,…

人工智能 · 计算机科学 2026-03-06 Ratna Kandala , Niva Manchanda , Akshata Kishore Moharir , Ananth Kandala

Retrieval-augmented generation (RAG) has proven highly effective in improving large language models (LLMs) across various domains. However, there is no benchmark specifically designed to assess the effectiveness of RAG in the legal domain,…

计算与语言 · 计算机科学 2025-03-03 Haitao Li , Yifan Chen , Yiran Hu , Qingyao Ai , Junjie Chen , Xiaoyu Yang , Jianhui Yang , Yueyue Wu , Zeyang Liu , Yiqun Liu

Inter-agent communication serves as an effective mechanism for enhancing performance in collaborative multi-agent reinforcement learning(MARL) systems. However, the inherent communication latency in practical systems induces both action…

多智能体系统 · 计算机科学 2025-11-26 Qian Zhang , Zhuo Sun , Yao Zhang , Zhiwen Yu , Bin Guo , Jun Zhang