English
Related papers

Related papers: Retrieval-augmented in-context learning for multim…

200 papers

Large Language Models (LLMs) have achieved impressive progress in natural language processing, but their limited ability to retain long-term context constrains performance on document-level or multi-turn tasks. Retrieval-Augmented…

Computation and Language · Computer Science 2025-05-20 Zhangyu Wang , Siyuan Gao , Rong Zhou , Hao Wang , Li Ning

Long text classification is challenging for Large Language Models (LLMs) due to token limits and high computational costs. This study explores whether a Retrieval Augmented Generation (RAG) approach using only the most relevant text…

Recent advancements in Large Vision Language Models (LVLMs) have significantly improved performance in Visual Question Answering (VQA) tasks through multimodal Retrieval-Augmented Generation (RAG). However, existing methods still face…

Computer Vision and Pattern Recognition · Computer Science 2025-06-10 Qi Yang , Chenghao Zhang , Lubin Fan , Kun Ding , Jieping Ye , Shiming Xiang

Retrieval-Augmented Generation (RAG) offers a well-established path to grounding large language model (LLM) outputs in external knowledge, yet the question of which retrieval strategy works best in a high-stakes domain such as biomedicine…

Computation and Language · Computer Science 2026-05-05 Devi Prasad Bal , Subhashree Puhan

Retrieval-augmented generation (RAG) frameworks enable large language models (LLMs) to retrieve relevant information from a knowledge base and incorporate it into the context for generating responses. This mitigates hallucinations and…

Computation and Language · Computer Science 2024-04-09 Pouria Rouzrokh , Shahriar Faghani , Cooper U. Gamble , Moein Shariatnia , Bradley J. Erickson

Large Language Models (LLMs) have demonstrated great performance in few-shot In-Context Learning (ICL) for a variety of generative and discriminative chemical design tasks. The newly expanded context windows of LLMs can further improve ICL…

Large language models (LLMs) can learn vast amounts of knowledge from diverse domains during pre-training. However, long-tail knowledge from specialized domains is often scarce and underrepresented, rarely appearing in the models'…

Computation and Language · Computer Science 2025-02-11 Shuyang Yu , Runxue Bao , Parminder Bhatia , Taha Kass-Hout , Jiayu Zhou , Cao Xiao

Retrieval-augmented generation (RAG) with large language models (LLMs) has demonstrated strong performance in multilingual question-answering (QA) tasks by leveraging relevant passages retrieved from corpora. In multilingual RAG (mRAG), the…

Computation and Language · Computer Science 2025-12-12 Jirui Qi , Raquel Fernández , Arianna Bisazza

In-context learning has recently been linked to implicit gradient descent in linear self-attention models, suggesting that context can induce a forward-pass update. Retrieval-augmented generation (RAG) also relies on context, but retrieved…

Computation and Language · Computer Science 2026-05-27 Mingchen Li , Jiatan Huang , Chuxu Zhang , Liang Zhao , Hong Yu

As one of the most advanced techniques in AI, Retrieval-Augmented Generation (RAG) can offer reliable and up-to-date external knowledge, providing huge convenience for numerous tasks. Particularly in the era of AI-Generated Content (AIGC),…

Computation and Language · Computer Science 2024-06-18 Wenqi Fan , Yujuan Ding , Liangbo Ning , Shijie Wang , Hengyun Li , Dawei Yin , Tat-Seng Chua , Qing Li

Multimodal biomedical Vision-Language Models (VLMs) exhibit immense potential in the field of Continual Learning (CL). However, they confront a core dilemma: how to preserve fine-grained intra-modality features while bridging the…

Computer Vision and Pattern Recognition · Computer Science 2025-12-16 Zizhi Chen , Yizhen Gao , Minghao Han , Yizhou Liu , Zhaoyu Chen , Dingkang Yang , Lihua Zhang

Future wireless networks aim to deliver high data rates and lower power consumption while ensuring seamless connectivity, necessitating robust optimization. Large language models (LLMs) have been deployed for generalized optimization…

Networking and Internet Architecture · Computer Science 2025-03-12 Muhammad Ahmed Mohsin , Ahsan Bilal , Sagnik Bhattacharya , John M. Cioffi

Large language models (LLMs) exhibit remarkable flexibility: they can adapt to novel tasks from in-context examples without any parameter updates, a capability known as in-context learning (ICL). Prior work on synthetic tasks has shown that…

Computation and Language · Computer Science 2026-05-29 Hua-Dong Xiong , Li Ji-An , Robert C. Wilson , Kwonjoon Lee , Xue-Xin Wei

Large Language Models (LLMs) have exhibited remarkable proficiency in natural language understanding, prompting extensive exploration of their potential applications across diverse domains. In the medical domain, open-source LLMs have…

Computation and Language · Computer Science 2024-08-01 Cui Long , Yongbin Liu , Chunping Ouyang , Ying Yu

Effective organization of in-context learning (ICL) demonstrations is key to improving the quality of large language model (LLM) responses. To create better sample-label pairs that instruct LLM understanding, we introduce logit…

Computation and Language · Computer Science 2024-10-16 Zhu Zixiao , Feng Zijian , Zhou Hanzhang , Qian Junlang , Mao Kezhi

Retrieval-Augmented Generation (RAG) merges retrieval methods with deep learning advancements to address the static limitations of large language models (LLMs) by enabling the dynamic integration of up-to-date external information. This…

Information Retrieval · Computer Science 2026-05-19 Yizheng Huang , Jimmy Huang

Retrieval-Augmented Generation (RAG) is an effective method to enhance the capabilities of large language models (LLMs). Existing methods typically optimize the retriever or the generator in a RAG system by directly using the top-k…

Computation and Language · Computer Science 2025-10-07 Shaohan Wang , Licheng Zhang , Zheren Fu , Zhendong Mao , Yongdong Zhang

The recent surge of large language models (LLMs) highlights their ability to perform in-context learning, i.e., "learning" to perform a task from a few demonstrations in the context without any parameter updates. However, their capabilities…

Computation and Language · Computer Science 2023-07-07 Tianle Cai , Kaixuan Huang , Jason D. Lee , Mengdi Wang

Older adults commonly experience chronic conditions such as pain and sleep disturbances and may consider cannabidiol for symptom management. Safe use requires appropriate dosing, careful titration, and awareness of drug interactions, yet…

Information Retrieval · Computer Science 2026-04-14 Ali Abedi , Charlene H. Chu , Shehroz S. Khan

Large Language Models (LLMs) hold significant promise for mathematics education, yet they often struggle with complex mathematical reasoning. While Retrieval-Augmented Generation (RAG) mitigates these issues by grounding LLMs in external…

Computation and Language · Computer Science 2025-12-02 Shiting Chen , Zijian Zhao , Jinsong Chen