中文
相关论文

相关论文: VoiceAgentRAG: Solving the RAG Latency Bottleneck …

200 篇论文

Streaming voice conversion has become increasingly popular for its potential in real-time applications. The recently proposed DualVC 2 has achieved robust and high-quality streaming voice conversion with a latency of about 180ms.…

音频与语音处理 · 电气工程与系统科学 2024-06-13 Ziqian Ning , Shuai Wang , Pengcheng Zhu , Zhichao Wang , Jixun Yao , Lei Xie , Mengxiao Bi

Medical question answering (QA) is a reasoning-intensive task that remains challenging for large language models (LLMs) due to hallucinations and outdated domain knowledge. Retrieval-Augmented Generation (RAG) provides a promising…

计算与语言 · 计算机科学 2025-05-01 Xuanzhao Dong , Wenhui Zhu , Hao Wang , Xiwen Chen , Peijie Qiu , Rui Yin , Yi Su , Yalin Wang

This paper presents an AI glasses system that integrates real-time voice processing, artificial intelligence(AI) agents, and cross-network streaming capabilities. The system employs dual-agent architecture where Agent 01 handles Automatic…

声音 · 计算机科学 2026-01-13 Sheng-Kai Chen , Jyh-Horng Wu , Ching-Yao Lin , Yen-Ting Lin

Retrieval-Augmented Generation (RAG) has emerged as the dominant paradigm for grounding large language model outputs in verifiable evidence. However, as modern AI agents transition from static knowledge bases to continuous multimodal…

机器学习 · 计算机科学 2025-11-05 Rohan Wandre , Yash Gajewar , Namrata Patel , Vivek Dhalkari

Current Retrieval-Augmented Generation (RAG) systems concatenate and process numerous retrieved document chunks for prefill which requires a large volume of computation, therefore leading to significant latency in time-to-first-token…

计算机视觉与模式识别 · 计算机科学 2024-10-11 Songshuo Lu , Hua Wang , Yutian Rong , Zhi Chen , Yaohua Tang

For speech interaction, voice activity detection (VAD) is often used as a front-end. However, traditional VAD algorithms usually need to wait for a continuous tail silence to reach a preset maximum duration before segmentation, resulting in…

音频与语音处理 · 电气工程与系统科学 2023-05-23 Mohan Shi , Yuchun Shu , Lingyun Zuo , Qian Chen , Shiliang Zhang , Jie Zhang , Li-Rong Dai

Due to recent advancements in Large Audio-Language Models (LALMs) that demonstrate remarkable performance across a range of sound-, speech- and music-related tasks, there is a growing interest in proposing benchmarks to assess these models.…

音频与语音处理 · 电气工程与系统科学 2026-02-12 Jingru Lin , Chen Zhang , Tianrui Wang , Haizhou Li

Retrieval-augmented generation (RAG) agents are increasingly deployed to answer questions over local knowledge bases that cannot be centralized due to knowledge-sovereignty constraints. This results in two recurring failures in production:…

多智能体系统 · 计算机科学 2026-04-07 Feijie Wu , Zitao Li , Fei Wei , Yaliang Li , Bolin Ding , Jing Gao

Retrieval-Augmented Generation (RAG) grounds Large Language Models (LLMs) to mitigate factual hallucinations. Recent paradigms shift from static pipelines to Modular and Agentic RAG frameworks, granting models autonomy for multi-hop…

信息检索 · 计算机科学 2026-03-03 Yichao Wu , Penghao Liang , Yafei Xiang , Mengwei Yuan , Jianan Liu , Jing Yang , Xianyou Li , Weiran Yan

Recent advancements in Retrieval-Augmented Generation (RAG) have enabled Large Language Models to answer financial questions using external knowledge bases of U.S. SEC filings, earnings reports, and regulatory documents. However, existing…

Agentic memory systems have become critical for enabling LLM agents to maintain long-term context and retrieve relevant information efficiently. However, existing memory frameworks suffer from a fundamental limitation: they perform…

计算与语言 · 计算机科学 2026-01-14 Anxin Tian , Yiming Li , Xing Li , Hui-Ling Zhen , Lei Chen , Xianzhi Yu , Zhenhua Dong , Mingxuan Yuan

Retrieval-Augmented Generation (RAG) has emerged as a powerful approach for grounding Large Language Model (LLM)-based chatbot responses on external knowledge. However, existing RAG studies typically assume well-structured textual sources…

计算与语言 · 计算机科学 2026-02-13 Sungmoon Kim , Hyuna Jeon , Dahye Kim , Mingyu Kim , Dong-Kyu Chae , Jiwoong Kim

We present QuadAgent, a training-free agent system for agile quadrotor flight guided by vision-language inputs. Unlike prior end-to-end or serial agent approaches, QuadAgent decouples high-level reasoning from low-level control using an…

机器人学 · 计算机科学 2026-04-06 Ao Zhuang , Feng Yu , Tianbao Zhang , Linzuo Zhang , Danping Zou

Speech-to-speech language models have recently emerged to enhance the naturalness of conversational AI. In particular, full-duplex models are distinguished by their real-time interactivity, including handling of pauses, interruptions, and…

计算与语言 · 计算机科学 2026-05-13 Chung-Ming Chien , Manu Orsini , Eugene Kharitonov , Neil Zeghidour , Karen Livescu , Alexandre Défossez

Long-horizon omnimodal question answering answers questions by reasoning over text, images, audio, and video. Despite recent progress on OmniLLMs, low-resource long audio-video QA still suffers from costly dense encoding, weak fine-grained…

计算与语言 · 计算机科学 2026-03-31 Yifan Zhu , Xinyu Mu , Tao Feng , Zhonghong Ou , Yuning Gong , Haoran Luo

Retrieval-augmented generation (RAG) has become a key paradigm for knowledge-intensive question answering. However, existing multi-hop RAG systems remain inefficient, as they alternate between retrieval and reasoning at each step, resulting…

计算与语言 · 计算机科学 2026-02-06 Hao Yang , Zhiyu Yang , Xupeng Zhang , Wei Wei , Yunjie Zhang , Lin Yang

Retrieval-Augmented Generation (RAG) couples a retriever with a large language model (LLM) to ground generated responses in external evidence. While this framework enhances factuality and domain adaptability, it faces a key bottleneck:…

信息检索 · 计算机科学 2026-01-08 Sherine George

The emergence of Large Language Models (LLMs) has significantly advanced natural language processing, but these models often generate factually incorrect information, known as "hallucination". Initial retrieval-augmented generation (RAG)…

计算与语言 · 计算机科学 2024-11-12 Yujia Zhou , Zheng Liu , Zhicheng Dou

We introduce a low-latency telecom AI voice agent pipeline for real-time, interactive telecommunications use, enabling advanced voice AI for call center automation, intelligent IVR (Interactive Voice Response), and AI-driven customer…

声音 · 计算机科学 2025-08-08 Vignesh Ethiraj , Ashwath David , Sidhanth Menon , Divya Vijay

Large Language Models (LLMs) have advanced artificial intelligence by enabling human-like text generation and natural language understanding. However, their reliance on static training data limits their ability to respond to dynamic,…

人工智能 · 计算机科学 2026-04-02 Aditi Singh , Abul Ehtesham , Saket Kumar , Tala Talaei Khoei , Athanasios V. Vasilakos