English
Related papers

Related papers: Stream RAG: Instant and Accurate Spoken Dialogue S…

200 papers

Small language models (SLMs) support efficient deployments on resource-constrained edge devices, but their limited capacity compromises inference performance. Retrieval-augmented generation (RAG) is a promising solution to enhance model…

Machine Learning · Computer Science 2025-04-17 Shangyu Liu , Zhenzhe Zheng , Xiaoyao Huang , Fan Wu , Guihai Chen , Jie Wu

Large Language Models (LLMs) have been increasingly adopted for health-related tasks, yet their performance in depression detection remains limited when relying solely on text input. While Retrieval-Augmented Generation (RAG) typically…

Audio and Speech Processing · Electrical Eng. & Systems 2025-05-26 Xiangyu Zhang , Hexin Liu , Qiquan Zhang , Beena Ahmed , Julien Epps

Retrieval-Augmented Generation (RAG) has emerged as a powerful paradigm to enhance large language models (LLMs) by conditioning generation on external evidence retrieved at inference time. While RAG addresses critical limitations of…

Information Retrieval · Computer Science 2025-06-03 Chaitanya Sharma

Most dialogue-based electronic medical record (EMR) systems still behave as passive pipelines: transcribe speech, extract information, and generate the final note after the consultation. That design improves documentation efficiency, but it…

Computation and Language · Computer Science 2026-04-16 Zhenhai Pan , Yan Liu , Jia You

Retrieval-augmented generation (RAG) has proven highly effective in improving large language models (LLMs) across various domains. However, there is no benchmark specifically designed to assess the effectiveness of RAG in the legal domain,…

Computation and Language · Computer Science 2025-03-03 Haitao Li , Yifan Chen , Yiran Hu , Qingyao Ai , Junjie Chen , Xiaoyu Yang , Jianhui Yang , Yueyue Wu , Zeyang Liu , Yiqun Liu

Large Language Models (LLMs) have been widely adopted in conversational applications. However, their reliance on parametric knowledge limits reliability in real-world scenarios that require dynamic or domain-specific information.…

Computation and Language · Computer Science 2026-05-26 Kaiqiao Han , LuAn Tang , Renliang Sun , Peng Yuan , Wei Cheng , Haoyu Wang , Wei Wang , Yizhou Sun , Haifeng Chen

Retrieval-Augmented Generation (RAG) is a technique that enhances the capabilities of large language models (LLMs) by incorporating external knowledge sources. This method addresses common LLM limitations, including outdated information and…

Computation and Language · Computer Science 2024-07-16 Yuanjie Lyu , Zhiyu Li , Simin Niu , Feiyu Xiong , Bo Tang , Wenjin Wang , Hao Wu , Huanyong Liu , Tong Xu , Enhong Chen

Speech-to-text translation (ST), which translates source language speech into target language text, has attracted intensive attention in recent years. Compared to the traditional pipeline system, the end-to-end ST model has potential…

Computation and Language · Computer Science 2019-12-17 Yuchen Liu , Jiajun Zhang , Hao Xiong , Long Zhou , Zhongjun He , Hua Wu , Haifeng Wang , Chengqing Zong

Retrieval Augmented Generation (RAG) frameworks have shown significant promise in leveraging external knowledge to enhance the performance of large language models (LLMs). However, conventional RAG methods often retrieve documents based…

Computation and Language · Computer Science 2025-04-02 Pouya Pezeshkpour , Estevam Hruschka

Despite their remarkable capabilities, large language models (LLMs) often produce responses containing factual inaccuracies due to their sole reliance on the parametric knowledge they encapsulate. Retrieval-Augmented Generation (RAG), an ad…

Computation and Language · Computer Science 2023-10-19 Akari Asai , Zeqiu Wu , Yizhong Wang , Avirup Sil , Hannaneh Hajishirzi

Recent advancements in discrete token-based speech generation have highlighted the importance of token-to-waveform generation for audio quality, particularly in real-time interactions. Traditional frameworks integrating semantic tokens with…

Sound · Computer Science 2025-07-02 Dake Guo , Jixun Yao , Linhan Ma , He Wang , Lei Xie

Although recent advances in deep learning technology have boosted automatic speech recognition (ASR) performance in the single-talker case, it remains difficult to recognize multi-talker speech in which many voices overlap. One conventional…

Audio and Speech Processing · Electrical Eng. & Systems 2022-09-20 Takafumi Moriya , Hiroshi Sato , Tsubasa Ochiai , Marc Delcroix , Takahiro Shinozaki

This paper tackles several challenges that arise when integrating Automatic Speech Recognition (ASR) and Machine Translation (MT) for real-time, on-device streaming speech translation. Although state-of-the-art ASR systems based on…

Computation and Language · Computer Science 2025-08-20 Zeeshan Ahmed , Frank Seide , Niko Moritz , Ju Lin , Ruiming Xie , Simone Merello , Zhe Liu , Christian Fuegen

Retrieval-Augmented Generation (RAG) has gained significant attention in recent years for its potential to enhance natural language understanding and generation by combining large-scale retrieval systems with generative models. RAG…

Computation and Language · Computer Science 2025-03-18 Mingyue Cheng , Yucong Luo , Jie Ouyang , Qi Liu , Huijie Liu , Li Li , Shuo Yu , Bohou Zhang , Jiawei Cao , Jie Ma , Daoyu Wang , Enhong Chen

We introduce Ragas (Retrieval Augmented Generation Assessment), a framework for reference-free evaluation of Retrieval Augmented Generation (RAG) pipelines. RAG systems are composed of a retrieval and an LLM based generation module, and…

Computation and Language · Computer Science 2025-04-29 Shahul Es , Jithin James , Luis Espinosa-Anke , Steven Schockaert

Recent advancements in large language models (LLMs) have led to significant progress in text-based dialogue systems. These systems can now generate high-quality responses that are accurate and coherent across a wide range of topics and…

Computation and Language · Computer Science 2025-01-10 Long Mai , Julie Carson-Berndsen

Normally, a system that translates speech into text consists of separate modules for speech recognition and text-to-text translation. Combining those tasks into a SpeechLLM promises to exploit paralinguistic information in the speech and to…

Computation and Language · Computer Science 2026-05-15 Titouan Parcollet , Shucong Zhang , Xianrui Zheng , Rogier C. van Dalen

Generative conversational interfaces powered by large language models (LLMs) typically stream output token-by-token at a rate determined by computational budget, often neglecting actual human reading speeds and the cognitive load associated…

Human-Computer Interaction · Computer Science 2025-07-25 Chang Xiao , Brenda Yang

Recent advancements in Large Language Models (LLMs) have transformed Natural Language Processing (NLP), enabling complex information retrieval and generation tasks. Retrieval-Augmented Generation (RAG) has emerged as a key innovation,…

Information Retrieval · Computer Science 2026-02-27 Teri Rumble , Zbyněk Gazdík , Javad Zarrin , Jagdeep Ahluwalia

Non-autoregressive (NAR) modeling has gained more and more attention in speech processing. With recent state-of-the-art attention-based automatic speech recognition (ASR) structure, NAR can realize promising real-time factor (RTF)…

Audio and Speech Processing · Electrical Eng. & Systems 2021-07-21 Tianzi Wang , Yuya Fujita , Xuankai Chang , Shinji Watanabe