English
Related papers

Related papers: Reflection-Based Memory For Web navigation Agents

200 papers

Multi-agent reinforcement learning (MARL) provides an efficient way for simultaneously learning policies for multiple agents interacting with each other. However, in scenarios requiring complex interactions, existing algorithms can suffer…

Machine Learning · Computer Science 2022-03-08 Xiaobai Ma , David Isele , Jayesh K. Gupta , Kikuo Fujimura , Mykel J. Kochenderfer

We investigate multi-agent navigation tasks, where multiple agents need to reach initially unassigned goals in a limited time. Classical planning-based methods suffer from expensive computation overhead at each step and offer limited…

Machine Learning · Computer Science 2024-12-03 Xinyi Yang , Xinting Yang , Chao Yu , Jiayu Chen , Wenbo Ding , Huazhong Yang , Yu Wang

The rapid evolution of the web has led to an exponential growth in content. Recommender systems play a crucial role in Human-Computer Interaction (HCI) by tailoring content based on individual preferences. Despite their importance,…

Information Retrieval · Computer Science 2023-10-18 Yubo Shu , Haonan Zhang , Hansu Gu , Peng Zhang , Tun Lu , Dongsheng Li , Ning Gu

In this paper, we generalize the problem of single-index model to the context of continual learning in which a learner is challenged with a sequence of tasks one by one and the dataset of each task is revealed in an online fashion. We…

Machine Learning · Statistics 2022-08-26 The Tien Mai

In social systems, people communicate with each other and form groups based on their interests. The pattern of interactions, the network, and the ideas that flow on the network naturally evolve together. Researchers use simple models to…

Physics and Society · Physics 2015-03-18 Atieh Mirshahvalad , Martin Rosvall

This paper introduces a novel agent-based approach for enhancing existing portfolio strategies using Proximal Policy Optimization (PPO). Rather than focusing solely on traditional portfolio construction, our approach aims to improve an…

Portfolio Management · Quantitative Finance 2025-02-06 Daniil Karzanov , Rubén Garzón , Mikhail Terekhov , Caglar Gulcehre , Thomas Raffinot , Marcin Detyniecki

We study the problem of planning under model uncertainty in an online meta-reinforcement learning (RL) setting where an agent is presented with a sequence of related tasks with limited interactions per task. The agent can use its experience…

Artificial Intelligence · Computer Science 2023-01-02 Khimya Khetarpal , Claire Vernade , Brendan O'Donoghue , Satinder Singh , Tom Zahavy

Episodic memory is a psychology term which refers to the ability to recall specific events from the past. We suggest one advantage of this particular type of memory is the ability to easily assign credit to a specific state when remembered…

Machine Learning · Computer Science 2018-06-05 Kenny J. Young , Richard S. Sutton , Shuo Yang

We have developed a conversational recommendation system designed to help users navigate through a set of limited options to find the best choice. Unlike many internet scale systems that use a singular set of search terms and return a…

Computation and Language · Computer Science 2021-04-15 Victor S. Bursztyn , Jennifer Healey , Eunyee Koh , Nedim Lipka , Larry Birnbaum

Reinforcement learning (RL) agents are costly to train and fragile to environmental changes. They often perform poorly when there are many changing tasks, prohibiting their widespread deployment in the real world. Many Lifelong RL agent…

Machine Learning · Computer Science 2025-01-31 John Birkbeck , Adam Sobey , Federico Cerutti , Katherine Heseltine Hurley Flynn , Timothy J. Norman

Socially aware robot navigation, where a robot is required to optimize its trajectory to maintain comfortable and compliant spatial interactions with humans in addition to reaching its goal without collisions, is a fundamental yet…

Robotics · Computer Science 2022-08-02 Ruiqi Wang , Weizheng Wang , Byung-Cheol Min

Supervised fine-tuning enhances the problem-solving abilities of language models across various mathematical reasoning tasks. To maximize such benefits, existing research focuses on broadening the training set with various data augmentation…

Computation and Language · Computer Science 2024-10-08 Zhihan Zhang , Tao Ge , Zhenwen Liang , Wenhao Yu , Dian Yu , Mengzhao Jia , Dong Yu , Meng Jiang

We unveil that internal representations in large language models (LLMs) serve as reliable proxies of learned knowledge, and propose RECALL, a novel representation-aware model merging framework for continual learning without access to…

Computation and Language · Computer Science 2025-10-24 Bowen Wang , Haiyuan Wan , Liwen Shi , Chen Yang , Peng He , Yue Ma , Haochen Han , Wenhao Li , Tiao Tan , Yongjian Li , Fangming Liu , Yifan Gong , Sheng Zhang

Reward models play a fundamental role in aligning large language models with human preferences. Existing methods predominantly follow two paradigms: scalar discriminative preference models, which are efficient but lack interpretability, and…

Computation and Language · Computer Science 2026-05-08 Zirui Zhu , Hailun Xu , Yang Luo , Yong Liu , Kanchan Sarkar , Kun Xu , Yang You

Autonomous agents powered by large language models (LLMs) show significant potential for achieving high autonomy in various scenarios such as software development. Recent research has shown that LLM agents can leverage past experiences to…

Computation and Language · Computer Science 2024-05-08 Chen Qian , Jiahao Li , Yufan Dang , Wei Liu , YiFei Wang , Zihao Xie , Weize Chen , Cheng Yang , Yingli Zhang , Zhiyuan Liu , Maosong Sun

Training large language models (LLMs) as autonomous agents often begins with imitation learning, but it only teaches agents what to do without understanding why: agents never contrast successful actions against suboptimal alternatives and…

Artificial Intelligence · Computer Science 2026-03-10 Weize Liu , Minghui Liu , Sy-Tuyen Ho , Souradip Chakraborty , Xiyao Wang , Furong Huang

A Multi-Agent Cooperative Learning (MACL) system is an artificial intelligence (AI) system where multiple learning agents work together to complete a common task. Recent empirical success of MACL systems in various domains (e.g. traffic…

Machine Learning · Computer Science 2023-10-31 Jialin Yi

Modeling user's historical feedback is essential for Click-Through Rate Prediction in personalized search and recommendation. Existing methods usually only model users' positive feedback information such as click sequences which neglects…

Information Retrieval · Computer Science 2022-03-30 Zhifang Fan , Dan Ou , Yulong Gu , Bairan Fu , Xiang Li , Wentian Bao , Xin-Yu Dai , Xiaoyi Zeng , Tao Zhuang , Qingwen Liu

This work presents a case study of a learning-based approach for target driven map-less navigation. The underlying navigation model is an end-to-end neural network which is trained using a combination of expert demonstrations, imitation…

Forgetting is in common in daily life, and 50-80% everyday's forgetting is due to prospective memory failures, which have significant impacts on our life. More seriously, some of these memory lapses can bring fatal consequences such as…

Human-Computer Interaction · Computer Science 2016-01-26 Jinghua Hou