English
Related papers

Related papers: RAG-IT: Retrieval-Augmented Instruction Tuning for…

200 papers

Retrieval-augmented language models (RALMs) improve performance by accessing long-tail and up-to-date knowledge from external data stores, but are challenging to build. Existing approaches require either expensive retrieval-specific…

In the modern financial sector, the exponential growth of data has made efficient and accurate financial data analysis increasingly crucial. Traditional methods, such as statistical analysis and rule-based systems, often struggle to process…

Statistical Finance · Quantitative Finance 2025-04-10 Jingru Wang , Wen Ding , Xiaotong Zhu

The current technology landscape lacks a foundational AI model for solving process engineering calculations. In this work, we introduce a novel autonomous agent framework leveraging Retrieval-Augmented Instruction-Tuning (RAIT) to enhance…

Software Engineering · Computer Science 2024-08-29 Sagar Srinivas Sakhinana , Geethan Sannidhi , Venkataramana Runkana

Financial sentiment analysis is crucial for trading and investment decision-making. This study introduces an adaptive retrieval augmented framework for Large Language Models (LLMs) that aligns with human instructions through Instruction…

Computational Engineering, Finance, and Science · Computer Science 2024-10-22 Zijie Zhao , Roy E. Welsch

Retrieval-Augmented Generation (RAG) struggles on long, structured financial filings where relevant evidence is sparse and cross-referenced. This paper presents a systematic investigation of advanced metadata-driven Retrieval-Augmented…

Information Retrieval · Computer Science 2025-10-29 Michail Dadopoulos , Anestis Ladas , Stratos Moschidis , Ioannis Negkakis

Retrieval-Augmented Generation (RAG) has emerged as a key paradigm for enhancing large language models (LLMs) by incorporating external knowledge. However, current RAG methods face two limitations: (1) they only cover limited RAG scenarios.…

Computation and Language · Computer Science 2025-01-03 Wanlong Liu , Junying Chen , Ke Ji , Li Zhou , Wenyu Chen , Benyou Wang

Code completion, a crucial practice in industrial settings, helps developers improve programming efficiency by automatically suggesting code snippets during development. With the emergence of Large Code Models (LCMs), this field has…

Software Engineering · Computer Science 2025-05-22 Chaozheng Wang , Zezhou Yang , Shuzheng Gao , Cuiyun Gao , Ting Peng , Hailiang Huang , Yuetang Deng , Michael Lyu

As a typical and practical application of Large Language Models (LLMs), Retrieval-Augmented Generation (RAG) techniques have gained extensive attention, particularly in vertical domains where LLMs may lack domain-specific knowledge. In this…

Computation and Language · Computer Science 2025-02-18 Shuting Wang , Jiejun Tan , Zhicheng Dou , Ji-Rong Wen

The strong capability of large language models (LLMs) has been applied to information extraction (IE) through either retrieval augmented prompting or instruction tuning (IT). However, the best way to incorporate information with LLMs for IE…

Computation and Language · Computer Science 2024-12-03 Tingyu Xie , Jian Zhang , Yan Zhang , Yuanyuan Liang , Qi Li , Hongwei Wang

There are two common ways in which developers are incorporating proprietary and domain-specific data when building applications of Large Language Models (LLMs): Retrieval-Augmented Generation (RAG) and Fine-Tuning. RAG augments the prompt…

Short answer assessment is a vital component of science education, allowing evaluation of students' complex three-dimensional understanding. Large language models (LLMs) that possess human-like ability in linguistic tasks are increasingly…

Computation and Language · Computer Science 2025-06-05 Yucheng Chu , Peng He , Hang Li , Haoyu Han , Kaiqi Yang , Yu Xue , Tingting Li , Joseph Krajcik , Jiliang Tang

This research project addresses the errors of financial numerical reasoning Question Answering (QA) tasks due to the lack of domain knowledge in finance. Despite recent advances in Large Language Models (LLMs), financial numerical questions…

Computation and Language · Computer Science 2026-01-01 Yukun Zhang , Stefan Elbl Droguett , Samyak Jain

Retrieval-Augmented Generation (RAG) has emerged as a promising framework to mitigate hallucinations in Large Language Models (LLMs), yet its overall performance is dependent on the underlying retrieval system. In the finance domain,…

Information Retrieval · Computer Science 2025-03-20 Sejong Kim , Hyunseo Song , Hyunwoo Seo , Hyunjun Kim

As Large Language Models (LLMs) increasingly address domain-specific problems, their application in the financial sector has expanded rapidly. Tasks that are both highly valuable and time-consuming, such as analyzing financial statements,…

Computation and Language · Computer Science 2024-11-28 Joohyun Lee , Minji Roh

As retrieval-augmented generation (RAG) becomes more widespread, the role of retrieval is shifting from retrieving information for human browsing to retrieving context for AI reasoning. This shift creates more complex search environments,…

Computation and Language · Computer Science 2026-01-05 Jiawei Zhou , Lei Chen

Large language models (LLMs) have demonstrated remarkable capabilities across various professional domains, with their performance typically evaluated through standardized benchmarks. In the financial field, the stringent demands for…

Computation and Language · Computer Science 2025-09-03 Feng Wang , Yiding Sun , Jiaxin Mao , Wei Xue , Danqing Xu

Pretraining Large Language Models (LLMs) on large corpora of textual data is now a standard paradigm. When using these LLMs for many downstream applications, it is common to additionally bake in new knowledge (e.g., time-critical news, or…

Computation and Language · Computer Science 2024-06-06 Tianjun Zhang , Shishir G. Patil , Naman Jain , Sheng Shen , Matei Zaharia , Ion Stoica , Joseph E. Gonzalez

Electronic design engineers often struggle to efficiently access relevant information for tasks like design verification and technology development. While large language models (LLMs) can enhance productivity as conversational agents,…

Computation and Language · Computer Science 2025-06-10 Luyao Shi , Michael Kazda , Charles Schmitter , Hemlata Gupta

Retrieval-Augmented Language Models (RALMs) have demonstrated significant potential in knowledge-intensive tasks; however, they remain vulnerable to performance degradation when presented with irrelevant or noisy retrieved contexts.…

Computation and Language · Computer Science 2026-04-03 Jaemin Kim , Jae O Lee , Sumyeong Ahn , Seo Yeon Park

Retrieval-augmented generation (RAG) enhances large language models (LLMs) by integrating external knowledge retrieved from a knowledge base. However, its effectiveness is fundamentally constrained by the reliability of both the retriever…

Computation and Language · Computer Science 2025-01-31 Yiteng Tu , Weihang Su , Yujia Zhou , Yiqun Liu , Qingyao Ai
‹ Prev 1 2 3 10 Next ›