English
Related papers

Related papers: Temp-R1: A Unified Autonomous Agent for Complex Te…

200 papers

While reinforcement learning (RL) has demonstrated remarkable success in enhancing large language models (LLMs), it has primarily focused on single-turn tasks such as solving math problems. Training effective web agents for multi-turn…

Computation and Language · Computer Science 2025-10-10 Zhepei Wei , Wenlin Yao , Yao Liu , Weizhi Zhang , Qin Lu , Liang Qiu , Changlong Yu , Puyang Xu , Chao Zhang , Bing Yin , Hyokun Yun , Lihong Li

Question answering over knowledge graphs (KG-QA) is a vital topic in IR. Questions with temporal intent are a special class of practical importance, but have not received much attention in research. This work presents EXAQT, the first…

Information Retrieval · Computer Science 2021-09-21 Zhen Jia , Soumajit Pramanik , Rishiraj Saha Roy , Gerhard Weikum

Knowledge Base Question Answering (KBQA) aims to answer natural-language questions over a structured Knowledge Base (KB). Recent work improves KBQA by adopting an agentic reasoning paradigm, in which Large Language Models (LLMs) iteratively…

Artificial Intelligence · Computer Science 2025-11-19 Zhuo Chen , Fei Wang , Zixuan Li , Zhao Zhang , Weiwei Ding , Chuanguang Yang , Yongjun Xu , Xiaolong Jin , Jiafeng Guo

Tasks with complex temporal structures and long horizons pose a challenge for reinforcement learning agents due to the difficulty in specifying the tasks in terms of reward functions as well as large variances in the learning signals. We…

Artificial Intelligence · Computer Science 2018-09-27 Xiao Li , Yao Ma , Calin Belta

Tabular data serves as the backbone of modern data analysis and scientific research. While Large Language Models (LLMs) fine-tuned via Supervised Fine-Tuning (SFT) have significantly improved natural language interaction with such…

Knowledge Graph Question Answering aims to answer natural language questions by reasoning over structured knowledge graphs. While large language models have advanced KGQA through their strong reasoning capabilities, existing methods…

Artificial Intelligence · Computer Science 2026-01-28 Yanlin Song , Ben Liu , Víctor Gutiérrez-Basulto , Zhiwei Hu , Qianqian Xie , Min Peng , Sophia Ananiadou , Jeff Z. Pan

Query optimization is a crucial component for the efficacy of Retrieval-Augmented Generation (RAG) systems. While reinforcement learning (RL)-based agentic and reasoning methods have recently emerged as a promising direction on query…

Artificial Intelligence · Computer Science 2026-01-30 Wei Wen , Sihang Deng , Tianjun Wei , Keyu Chen , Ruizhi Qiao , Xing Sun

This paper describes how domain knowledge of power system operators can be integrated into reinforcement learning (RL) frameworks to effectively learn agents that control the grid's topology to prevent thermal cascading. Typical RL-based…

Systems and Control · Electrical Eng. & Systems 2021-12-21 Amarsagar Reddy Ramapuram Matavalam , Kishan Prudhvi Guddanti , Yang Weng , Venkataramana Ajjarapu

Textbook question answering (TQA) is a challenging task in artificial intelligence due to the complex nature of context needed to answer complex questions. Although previous research has improved the task, there are still some limitations…

Computation and Language · Computer Science 2025-01-23 Hessa Abdulrahman Alawwad , Areej Alhothali , Usman Naseem , Ali Alkhathlan , Amani Jamal

This paper introduces TempSamp-R1, a new reinforcement fine-tuning framework designed to improve the effectiveness of adapting multimodal large language models (MLLMs) to video temporal grounding tasks. We reveal that existing reinforcement…

Computer Vision and Pattern Recognition · Computer Science 2025-09-26 Yunheng Li , Jing Cheng , Shaoyong Jia , Hangyi Kuang , Shaohui Jiao , Qibin Hou , Ming-Ming Cheng

Agentic knowledge graph question answering (KGQA) requires an agent to iteratively interact with knowledge graphs (KGs), posing challenges in both training data scarcity and reasoning generalization. Specifically, existing approaches often…

Computation and Language · Computer Science 2026-04-07 Shuwen Xu , Yao Xu , Jiaxiang Liu , Chenhao Yuan , Wenshuo Peng , Jun Zhao , Kang Liu

Conversational search systems require effective handling of context-dependent queries that often contain ambiguity, omission, and coreference. Conversational Query Reformulation (CQR) addresses this challenge by transforming these queries…

Computation and Language · Computer Science 2025-09-16 Changtai Zhu , Siyin Wang , Ruijun Feng , Kai Song , Xipeng Qiu

Knowledge Graph Question Answering (KGQA) involves retrieving entities as answers from a Knowledge Graph (KG) using natural language queries. The challenge is to learn to reason over question-relevant KG facts that traverse KG entities and…

Computation and Language · Computer Science 2022-10-26 Costas Mavromatis , George Karypis

Knowledge-based visual question answering (KB-VQA) requires vision-language models to understand images and use external knowledge, especially for rare entities and long-tail facts. Most existing retrieval-augmented generation (RAG) methods…

Computer Vision and Pattern Recognition · Computer Science 2026-04-10 Zhuohong Chen , Zhenxian Wu , Yunyao Yu , Hangrui Xu , Zirui Liao , Zhifang Liu , Xiangwen Deng , Pen Jiao , Haoqian Wang

Knowledge in the real world is being updated constantly. However, it is costly to frequently update large language models (LLMs). Therefore, it is crucial for LLMs to understand the concept of temporal knowledge. However, prior works on…

Computation and Language · Computer Science 2024-07-15 Qingyu Tan , Hwee Tou Ng , Lidong Bing

The "Reason-Then-Respond" paradigm, enhanced by Reinforcement Learning, has shown great promise in advancing Multimodal Large Language Models. However, its application to the video domain has led to specialized models that excel at either…

Computer Vision and Pattern Recognition · Computer Science 2025-09-29 Xinlong Chen , Yuanxing Zhang , Yushuo Guan , Weihong Lin , Zekun Wang , Bohan Zeng , Yang Shi , Sihan Yang , Qiang Liu , Pengfei Wan , Liang Wang , Tieniu Tan

Retrieval-Augmented Generation (RAG) systems face challenges with complex, multihop questions, and agentic frameworks such as Search-R1 (Jin et al., 2025), which operates iteratively, have been proposed to address these complexities.…

Multi-agent reinforcement learning (MARL) provides an efficient way for simultaneously learning policies for multiple agents interacting with each other. However, in scenarios requiring complex interactions, existing algorithms can suffer…

Machine Learning · Computer Science 2022-03-08 Xiaobai Ma , David Isele , Jayesh K. Gupta , Kikuo Fujimura , Mykel J. Kochenderfer

Temporal knowledge graphs (TKGs) model the temporal evolution of events and have recently attracted increasing attention. Since TKGs are intrinsically incomplete, it is necessary to reason out missing elements. Although existing TKG…

Artificial Intelligence · Computer Science 2023-04-11 Shangfei Zheng , Hongzhi Yin , Tong Chen , Quoc Viet Hung Nguyen , Wei Chen , Lei Zhao

Recent curriculum Reinforcement Learning (RL) has shown notable progress in solving complex tasks by proposing sequences of surrogate tasks. However, the previous approaches often face challenges when they generate curriculum goals in a…

Machine Learning · Computer Science 2023-10-27 Seungjae Lee , Daesol Cho , Jonghae Park , H. Jin Kim