English
Related papers

Related papers: Subgoal Graph-Augmented Planning for LLM-Guided Op…

200 papers

Retrieval Augmented Generation (RAG) frameworks improve the accuracy of large language models (LLMs) by integrating external knowledge from retrieved documents, thereby overcoming the limitations of models' static intrinsic knowledge.…

Information Retrieval · Computer Science 2025-09-19 Jingjie Zheng , Aryo Pradipta Gema , Giwon Hong , Xuanli He , Pasquale Minervini , Youcheng Sun , Qiongkai Xu

Goal-directed Reinforcement Learning (RL) traditionally considers an agent interacting with an environment, prescribing a real-valued reward to an agent proportional to the completion of some goal. Goal-directed RL has seen large gains in…

Machine Learning · Computer Science 2020-10-28 Sharath Chandra Raparthy , Bhairav Mehta , Florian Golemo , Liam Paull

Large Language Models (LLMs) integrated with Retrieval-Augmented Generation (RAG) techniques have exhibited remarkable performance across a wide range of domains. However, existing RAG approaches primarily operate on unstructured data and…

Artificial Intelligence · Computer Science 2026-04-22 Ge Chang , Jinbo Su , Jiacheng Liu , Pengfei Yang , Yuhao Shang , Huiwen Zheng , Hongli Ma , Yan Liang , Yuanchun Li , Yunxin Liu

Reinforcement learning (RL) can align language models with non-differentiable reward signals, such as human preferences. However, a major challenge arises from the sparsity of these reward signals - typically, there is only a single reward…

Computation and Language · Computer Science 2024-02-20 Meng Cao , Lei Shu , Lei Yu , Yun Zhu , Nevan Wichers , Yinxiao Liu , Lei Meng

Short answer assessment is a vital component of science education, allowing evaluation of students' complex three-dimensional understanding. Large language models (LLMs) that possess human-like ability in linguistic tasks are increasingly…

Computation and Language · Computer Science 2025-06-05 Yucheng Chu , Peng He , Hang Li , Haoyu Han , Kaiqi Yang , Yu Xue , Tingting Li , Joseph Krajcik , Jiliang Tang

Large Language Model (LLM) based agents are powerful yet fundamentally static after deployment, lacking the ability to autonomously expand capabilities, generate new tools, or evolve their reasoning. This work introduces a hierarchical…

Computation and Language · Computer Science 2026-01-21 Indrajit Kar , Sammy Zonunpuia , Zonunfeli Ralte

We introduce SuperIgor, a framework for instruction-following tasks. Unlike prior methods that rely on predefined subtasks, SuperIgor enables a language model to generate and refine high-level plans through a self-learning mechanism,…

Artificial Intelligence · Computer Science 2026-04-23 Zoya Volovikova , Nikita Sorokin , Dmitriy Lukashevskiy , Aleksandr Panov , Alexey Skrynnik

Large Language Models (LLMs) have shown remarkable performance in multi-turn dialogue. However, in multi-turn dialogue, models still struggle to stay aligned with what has been established earlier, follow dependencies across many turns, and…

Computation and Language · Computer Science 2026-01-12 Jiawei Shen , Jia Zhu , Hanghui Guo , Weijie Shi , Yue Cui , Qingyu Niu , Guoqing Ma , Yidan Liang , Jingjiang Liu , Yiling Wang , Shimin Di , Jiajie Xu

Large Language Models (LLMs) demonstrate strong reasoning abilities but face limitations such as hallucinations and outdated knowledge. Knowledge Graph (KG)-based Retrieval-Augmented Generation (RAG) addresses these issues by grounding LLM…

Computation and Language · Computer Science 2025-03-04 Mufei Li , Siqi Miao , Pan Li

Large language models (LLMs) equipped with retrieval--the Retrieval-Augmented Generation (RAG) paradigm--should combine their parametric knowledge with external evidence, yet in practice they often hallucinate, over-trust noisy snippets, or…

Artificial Intelligence · Computer Science 2026-01-13 Hua Ye , Siyuan Chen , Ziqi Zhong , Canran Xiao , Haoliang Zhang , Yuhan Wu , Fei Shen

Retrieval-Augmented Generation (RAG) enables large language models (LLMs) to access external knowledge sources, but the effectiveness of RAG relies on the coordination between the retriever and the generator. Since these components are…

Computation and Language · Computer Science 2025-09-24 Junlin Wang , Zehao Wu , Shaowei Lu , Yanlan Li , Xinghao Huang

Large language models (LLMs) inevitably exhibit hallucinations since the accuracy of generated texts cannot be secured solely by the parametric knowledge they encapsulate. Although retrieval-augmented generation (RAG) is a practicable…

Computation and Language · Computer Science 2024-10-08 Shi-Qi Yan , Jia-Chen Gu , Yun Zhu , Zhen-Hua Ling

Reinforcement Learning (RL) in games has gained significant momentum in recent years, enabling the creation of different agent behaviors that can transform a player's gaming experience. However, deploying RL agents in production…

Artificial Intelligence · Computer Science 2025-07-01 António Afonso , Iolanda Leite , Alessandro Sestini , Florian Fuchs , Konrad Tollmar , Linus Gisslén

Designing reinforcement learning curricula for agile robots traditionally requires extensive manual tuning of reward functions, environment randomizations, and training configurations. We introduce AURA (Autonomous Upskilling with…

Robotics · Computer Science 2025-11-06 Alvin Zhu , Yusuke Tanaka , Andrew Goldberg , Dennis Hong

Building effective knowledge graphs (KGs) for Retrieval-Augmented Generation (RAG) is pivotal for advancing question answering (QA) systems. However, its effectiveness is hindered by a fundamental disconnect: the knowledge graph (KG)…

Computation and Language · Computer Science 2026-04-23 Hong Ting Tsang , Jiaxin Bai , Haoyu Huang , Qiao Xiao , Tianshi Zheng , Baixuan Xu , Shujie Liu , Yangqiu Song

Autonomous agents based on large language models (LLMs) have demonstrated impressive capabilities in a wide range of applications, including web navigation, software development, and embodied control. While most LLMs are limited in several…

Artificial Intelligence · Computer Science 2025-09-03 Yixin Liu , Guibin Zhang , Kun Wang , Shiyuan Li , Shirui Pan

To think critically about arguments, human learners are trained to identify, reconstruct, and evaluate arguments. Argument reconstruction is especially important because it makes an argument's underlying inferences explicit. However, it…

Computation and Language · Computer Science 2026-05-15 Hyun Ryu , Gyouk Chu , Gregor Betz , Eunho Yang , Carolyn Rose , Sean Welleck

Knowledge graph completion (KGC) aims to infer new knowledge and make predictions from knowledge graphs. Recently, large language models (LLMs) have exhibited remarkable reasoning capabilities. LLM-enhanced KGC methods primarily focus on…

Computation and Language · Computer Science 2025-09-03 Yu Liu , Yanan Cao , Xixun Lin , Yanmin Shang , Shi Wang , Shirui Pan

Next-token prediction is the fundamental principle for training large language models (LLMs), and reinforcement learning (RL) further enhances their reasoning performance. As an effective way to model language, image, video, and other…

Computer Vision and Pattern Recognition · Computer Science 2025-05-27 Zuyao Chen , Jinlin Wu , Zhen Lei , Marc Pollefeys , Chang Wen Chen

Retrieval-Augmented Generation (RAG) enhances large language models (LLMs) by integrating up-to-date external knowledge, yet real-world web environments present unique challenges. These limitations manifest as two key challenges: pervasive…

Information Retrieval · Computer Science 2026-03-24 Yuqin Dai , Shuo Yang , Guoqing Wang , Yong Deng , Zhanwei Zhang , Jun Yin , Pengyu Zeng , Zhenzhe Ying , Changhua Meng , Can Yi , Yuchen Zhou , Weiqiang Wang , Shuai Lu