English
Related papers

Related papers: Ask Only When Needed: Proactive Retrieval from Mem…

200 papers

Retrieval-augmented generation (RAG) enhances the text generation capabilities of large language models (LLMs) by integrating external knowledge and up-to-date information. However, traditional RAG systems are limited by static workflows…

We describe a method for proactive information retrieval targeted at retrieving relevant information during a writing task. In our method, the current task and the needs of the user are estimated, and the potential next steps are…

Information Retrieval · Computer Science 2016-06-21 Petri Luukkonen , Markus Koskela , Patrik Floréen

In this work, we propose MetaAgent, an agentic paradigm inspired by the principle of learning-by-doing, where expertise is developed through hands-on practice and continual self-improvement. MetaAgent starts with a minimal workflow,…

Artificial Intelligence · Computer Science 2025-09-03 Hongjin Qian , Zheng Liu

The recent surge in research interest in applying large language models (LLMs) to decision-making tasks has flourished by leveraging the extensive world knowledge embedded in LLMs. While there is a growing demand to tailor LLMs for custom…

Machine Learning · Computer Science 2024-12-23 Andrew Zhao , Daniel Huang , Quentin Xu , Matthieu Lin , Yong-Jin Liu , Gao Huang

Retrieval-augmented generation supports language models to strengthen their factual groundings by providing external contexts. However, language models often face challenges when given extensive information, diminishing their effectiveness…

Computation and Language · Computer Science 2024-10-15 Chanwoong Yoon , Taewhoo Lee , Hyeon Hwang , Minbyul Jeong , Jaewoo Kang

Most LLM benchmarks score how well a model responds to explicit requests. They leave unmeasured a different conversational ability: noticing and acting on needs the user has implied but not said. We call this \emph{conversational…

Machine Learning · Computer Science 2026-05-12 Sepehr Harfi , Ahmad Salimi , Dongming Shen , Alex Smola

Reinforcement learning is a powerful technique for learning from trial and error, but it often requires a large number of interactions to achieve good performance. In some domains, such as sparse-reward tasks, an oracle that can provide…

Artificial Intelligence · Computer Science 2023-09-22 Zhourui Guo , Meng Yao , Yang Yu , Qiyue Yin

Recent advances in Reinforcement Learning with Verifiable Rewards (RLVR) have demonstrated significant potential in single-turn reasoning tasks. With the paradigm shift toward self-evolving agentic learning, models are increasingly expected…

Artificial Intelligence · Computer Science 2026-04-21 Xinshun Feng , Xinhao Song , Lijun Li , Gongshen Liu , Jing Shao

Modern recommender systems aim to improve user experience. As reinforcement learning (RL) naturally fits this objective -- maximizing an user's reward per session -- it has become an emerging topic in recommender systems. Developing…

Information Retrieval · Computer Science 2022-06-16 Xin Xin , Tiago Pimentel , Alexandros Karatzoglou , Pengjie Ren , Konstantina Christakopoulou , Zhaochun Ren

AI agent frameworks operate in isolation, forcing agents to rediscover solutions and repeat mistakes across different systems. Despite valuable problem-solving experiences accumulated by frameworks like smolagents, OpenHands, and OWL, this…

Current large language model agents predominantly operate under a reactive paradigm, responding only to immediate user queries within short-term sessions. This limitation hinders their ability to maintain long-term user's intents and…

Artificial Intelligence · Computer Science 2026-01-15 Qinglong Shi , Donghai Wang , Hantao Zhou , Jiguo Li , Jun Xu , Jiuchong Gao , Jinghua Hao , Renqing He

Learning effective representations in image-based environments is crucial for sample efficient Reinforcement Learning (RL). Unfortunately, in RL, representation learning is confounded with the exploratory experience of the agent -- learning…

Machine Learning · Computer Science 2021-07-21 Denis Yarats , Rob Fergus , Alessandro Lazaric , Lerrel Pinto

Recent advances in Large Language Models (LLMs) have propelled intelligent agents from reactive responses to proactive support. While promising, existing proactive agents either rely exclusively on observations from enclosed environments…

Artificial Intelligence · Computer Science 2025-10-28 Bufang Yang , Lilin Xu , Liekang Zeng , Kaiwei Liu , Siyang Jiang , Wenrui Lu , Hongkai Chen , Xiaofan Jiang , Guoliang Xing , Zhenyu Yan

Proactive Recommender Systems (PRSs) aim to guide user preference shift toward target items by generating paths of intermediate recommendations. Reinforcement learning (RL) provides a principled framework for optimizing such sequential…

Machine Learning · Computer Science 2026-05-29 Hongru Hou , Tiehua Mei , Denghui Geng , Jinhui Huang , Ao Xu , Hengrui Chen , Jiaqing Liang , Deqing Yang

Modern world models require costly and time-consuming collection of large video datasets with action demonstrations by people or by environment-specific agents. To simplify training, we focus on using many virtual environments for…

Computer Vision and Pattern Recognition · Computer Science 2025-04-04 Nedko Savov , Naser Kazemi , Mohammad Mahdi , Danda Pani Paudel , Xi Wang , Luc Van Gool

Large language models (LLMs) excel at natural language tasks but are limited by their static parametric knowledge, especially in knowledge-intensive task. Retrieval-augmented generation (RAG) mitigates this by integrating external…

Artificial Intelligence · Computer Science 2025-10-10 Yi Jiang , Lei Shen , Lujie Niu , Sendong Zhao , Wenbo Su , Bo Zheng

Robust Policy Search is the problem of learning policies that do not degrade in performance when subject to unseen environment model parameters. It is particularly relevant for transferring policies learned in a simulation environment to…

Machine Learning · Computer Science 2021-11-23 Sai Kiran Narayanaswami , Nandan Sudarsanam , Balaraman Ravindran

Experience intervention in web agents emerges as a promising technical paradigm, enhancing agent interaction capabilities by providing valuable insights from accumulated experiences. However, existing methods predominantly inject experience…

Computation and Language · Computer Science 2026-04-16 Wenyuan Zhang , Xinghua Zhang , Haiyang Yu , Shuaiyi Nie , Bingli Wu , Juwei Yue , Tingwen Liu , Yongbin Li

We introduce SuperIntelliAgent, an agentic learning framework that couples a trainable small diffusion model (the learner) with a frozen large language model (the verifier) to enable continual intelligence growth through self-supervised…

Artificial Intelligence · Computer Science 2025-12-01 Jianzhe Lin , Zeyu Pan , Yun Zhu , Ruiqi Song , Jining Yang

Reward is critical to the evaluation and training of large language models (LLMs). However, existing rule-based or model-based reward methods struggle to generalize to GUI agents, where access to ground-truth trajectories or application…

Artificial Intelligence · Computer Science 2026-04-16 Gaole Dai , Shiqi Jiang , Ting Cao , Yuqing Yang , Yuanchun Li , Rui Tan , Mo Li , Lili Qiu