English
Related papers

Related papers: Programmatic Context Augmentation for LLM-based Sy…

200 papers

Large Language Models (LLMs) showcase remarkable abilities, yet they struggle with limitations such as hallucinations, outdated knowledge, opacity, and inexplicable reasoning. To address these challenges, Retrieval-Augmented Generation…

Computation and Language · Computer Science 2024-10-03 Sourav Verma

In the field of language modeling, models augmented with retrieval components have emerged as a promising solution to address several challenges faced in the natural language processing (NLP) field, including knowledge grounding,…

Machine Learning · Computer Science 2024-10-22 To Eun Kim , Alireza Salemi , Andrew Drozdov , Fernando Diaz , Hamed Zamani

Large Language Models (LLMs) are emerging as promising tools for automated reinforcement learning (RL) reward design, owing to their robust capabilities in commonsense reasoning and code generation. By engaging in dialogues with RL agents,…

Artificial Intelligence · Computer Science 2025-04-14 Zen Kit Heng , Zimeng Zhao , Tianhao Wu , Yuanfei Wang , Mingdong Wu , Yangang Wang , Hao Dong

Programmatic reinforcement learning (PRL) has been explored for representing policies through programs as a means to achieve interpretability and generalization. Despite promising outcomes, current state-of-the-art PRL methods are hindered…

Machine Learning · Computer Science 2025-03-12 Max Liu , Chan-Hung Yu , Wei-Hsu Lee , Cheng-Wei Hung , Yen-Chun Chen , Shao-Hua Sun

Recently embedding-based retrieval or dense retrieval have shown state of the art results, compared with traditional sparse or bag-of-words based approaches. This paper introduces a model-agnostic doc-level embedding framework through large…

Information Retrieval · Computer Science 2024-04-10 Mingrui Wu , Sheng Cao

Financial sentiment analysis is critical for valuation and investment decision-making. Traditional NLP models, however, are limited by their parameter size and the scope of their training datasets, which hampers their generalization…

Computation and Language · Computer Science 2023-11-07 Boyu Zhang , Hongyang Yang , Tianyu Zhou , Ali Babar , Xiao-Yang Liu

Large Language Models (LLMs) have shown remarkable ability in solving complex tasks, making them a promising tool for enhancing tabular learning. However, existing LLM-based methods suffer from high resource requirements, suboptimal…

Machine Learning · Computer Science 2025-05-12 Ruxue Shi , Hengrui Gu , Xu Shen , Xin Wang

Speech recognition systems often face challenges due to domain mismatch, particularly in real-world applications where domain-specific data is unavailable because of data accessibility and confidentiality constraints. Inspired by…

Computation and Language · Computer Science 2025-02-24 Peng Shen , Xugang Lu , Hisashi Kawai

Symbolic Regression (SR) is a powerful technique for discovering interpretable mathematical expressions. However, benchmarking SR methods remains challenging due to the diversity of algorithms, datasets, and evaluation criteria. In this…

Large language models (LLMs) have greatly improved their capability in performing NLP tasks. However, deeper semantic understanding, contextual coherence, and more subtle reasoning are still difficult to obtain. The paper discusses…

Computation and Language · Computer Science 2025-12-05 Mohanakrishnan Hariharan

We introduce LLM-Lasso, a novel framework that leverages large language models (LLMs) to guide feature selection in Lasso $\ell_1$ regression. Unlike traditional methods that rely solely on numerical data, LLM-Lasso incorporates…

Automated feature engineering plays a critical role in improving predictive model performance for tabular learning tasks. Traditional automated feature engineering methods are limited by their reliance on pre-defined transformations within…

Machine Learning · Computer Science 2026-05-12 Nikhil Abhyankar , Parshin Shojaee , Chandan K. Reddy

In-Context Learning (ICL) enables Large Language Models (LLMs) to perform new tasks by conditioning on prompts with relevant information. Retrieval-Augmented Generation (RAG) enhances ICL by incorporating retrieved documents into the LLM's…

Machine Learning · Computer Science 2024-12-02 Marie Al Ghossein , Emile Contal , Alexandre Robicquet

Large Vision and Language Models (LVLMs) have shown strong performance across various vision-language tasks in natural image domains. However, their application to remote sensing (RS) remains underexplored due to significant domain…

Computer Vision and Pattern Recognition · Computer Science 2025-06-30 Sungjune Park , Yeongyun Kim , Se Yeon Kim , Yong Man Ro

Retrieval-augmented generation (RAG) has emerged as an approach to augment large language models (LLMs) by reducing their reliance on static knowledge and improving answer factuality. RAG retrieves relevant context snippets and generates an…

Computation and Language · Computer Science 2025-02-21 Juraj Vladika , Florian Matthes

Recent research has highlighted that Large Language Models (LLMs), even when trained to generate extended long reasoning steps, still face significant challenges on hard reasoning problems. However, much of the existing literature relies on…

Artificial Intelligence · Computer Science 2025-05-29 Fanzeng Xia , Yidong Luo , Tinko Sebastian Bartels , Yaqi Xu , Tongxin Li

Retrieval Augmented Generation (RAG), a paradigm that integrates external contextual information with large language models (LLMs) to enhance factual accuracy and relevance, has emerged as a pivotal area in generative AI. The LLMs used in…

Computation and Language · Computer Science 2024-09-17 Xuan-Phi Nguyen , Shrey Pandit , Senthil Purushwalkam , Austin Xu , Hailin Chen , Yifei Ming , Zixuan Ke , Silvio Savarese , Caiming Xong , Shafiq Joty

Equation discovery is aimed at directly extracting physical laws from data and has emerged as a pivotal research domain. Previous methods based on symbolic mathematics have achieved substantial advancements, but often require the design of…

Machine Learning · Computer Science 2024-07-23 Mengge Du , Yuntian Chen , Zhongzheng Wang , Longfeng Nie , Dongxiao Zhang

LLM development has aroused great interest in Sequential Recommendation (SR) applications. However, comprehensive evaluation of SR models remains lacking due to the limitations of the existing benchmarks: 1) an overemphasis on accuracy,…

Information Retrieval · Computer Science 2026-04-14 Jianhong Li , Zeheng Qian , Wangze Ni , Haoyang Li , Hongwei Yao , Yang Bai , Kui Ren

Prompt engineering is a new paradigm for enhancing the performance of trained neural network models. For optimizing text-style prompts, existing methods usually individually operate small portions of a text step by step, which either breaks…

Computation and Language · Computer Science 2023-10-03 Yujian Betterest Li , Kai Wu