English
Related papers

Related papers: UI-Mem: Self-Evolving Experience Memory for Online…

200 papers

Reinforcement learning (RL) excels in various applications but struggles in dynamic environments where the underlying Markov decision process evolves. Continual reinforcement learning (CRL) enables RL agents to continually learn and adapt…

Machine Learning · Computer Science 2025-12-23 Xue Yang , Michael Schukat , Junlin Lu , Patrick Mannion , Karl Mason , Enda Howley

Large Language Models (LLMs) have shown remarkable capabilities across diverse tasks, yet they face inherent limitations such as constrained parametric knowledge and high retraining costs. Retrieval-Augmented Generation (RAG) augments the…

Information Retrieval · Computer Science 2025-08-26 Leqian Li , Dianxi Shi , Jialu Zhou , Xinyu Wei , Mingyue Yang , Songchang Jin , Shaowu Yang

The rapid progress of large language models (LLMs) has sparked growing interest in building Artificial General Intelligence (AGI) within Graphical User Interface (GUI) environments. However, existing GUI agents based on LLMs or…

Artificial Intelligence · Computer Science 2025-05-27 Runliang Niu , Jinglong Ji , Yi Chang , Qi Wang

Autonomous agents powered by large language models (LLMs) show significant potential for achieving high autonomy in various scenarios such as software development. Recent research has shown that LLM agents can leverage past experiences to…

Computation and Language · Computer Science 2024-05-08 Chen Qian , Jiahao Li , Yufan Dang , Wei Liu , YiFei Wang , Zihao Xie , Weize Chen , Cheng Yang , Yingli Zhang , Zhiyuan Liu , Maosong Sun

Most deep reinforcement learning (RL) algorithms distill experience into parametric behavior policies or value functions via gradient updates. While effective, this approach has several disadvantages: (1) it is computationally expensive,…

The continuous adaptation of software systems to meet the evolving needs of users is very important for enhancing user experience (UX). User interface (UI) adaptation, which involves adjusting the layout, navigation, and content…

Software Engineering · Computer Science 2023-12-13 Daniel Gaspar-Figueiredo

Large Language Model (LLM) agents have demonstrated remarkable proficiency in learned tasks, yet they often struggle to adapt to non-stationary environments with feedback. While In-Context Learning and external memory offer some…

Artificial Intelligence · Computer Science 2026-03-05 Lu Yang , Zelai Xu , Minyang Xie , Jiaxuan Gao , Zhao Shok , Yu Wang , Yi Wu

Continual learning, the setting where a learning agent is faced with a never ending stream of data, continues to be a great challenge for modern machine learning systems. In particular the online or "single-pass through the data" setting…

Machine Learning · Computer Science 2019-10-31 Rahaf Aljundi , Lucas Caccia , Eugene Belilovsky , Massimo Caccia , Min Lin , Laurent Charlin , Tinne Tuytelaars

This paper presents a pioneering exploration of reinforcement learning (RL) via group relative policy optimization for unified multimodal large language models (ULMs), aimed at simultaneously reinforcing generation and understanding…

Computer Vision and Pattern Recognition · Computer Science 2025-11-21 Jingjing Jiang , Chongjie Si , Jun Luo , Hanwang Zhang , Chao Ma

A central component of training in Reinforcement Learning (RL) is Experience: the data used for training. The mechanisms used to generate and consume this data have an important effect on the performance of RL algorithms. In this paper, we…

Machine Learning · Computer Science 2021-02-10 Albin Cassirer , Gabriel Barth-Maron , Eugene Brevdo , Sabela Ramos , Toby Boyd , Thibault Sottiaux , Manuel Kroiss

Reinforcement learning (RL) is a sub-domain of machine learning, mainly concerned with solving sequential decision-making problems by a learning agent that interacts with the decision environment to improve its behavior through the reward…

Machine Learning · Computer Science 2025-09-23 Hossein Hassani , Ehsan Hallaji , Roozbeh Razavi-Far , Mehrdad Saif , Liang Lin

Retrieval-augmented generation (RAG) systems commonly improve robustness via query-time adaptations such as query expansion and iterative retrieval. While effective, these approaches are inherently stateless: adaptations are recomputed for…

Information Retrieval · Computer Science 2026-02-06 Yuntong Hu , Sha Li , Naren Ramakrishnan , Liang Zhao

Large language models (LLMs) have recently emerged as promising tools for solving challenging robotic tasks, even in the presence of action and observation uncertainties. Recent LLM-based decision-making methods (also referred to as…

Artificial Intelligence · Computer Science 2024-09-20 Abhinav Jain , Chris Jermaine , Vaibhav Unhelkar

Electric motors are used in many applications and their efficiency is strongly dependent on their control. Among others, PI approaches or model predictive control methods are well-known in the scientific literature and industrial practice.…

Systems and Control · Electrical Eng. & Systems 2019-10-22 Arne Traue , Gerrit Book , Wilhelm Kirchgässner , Oliver Wallscheid

Vision-language model (VLM) based GUI agents show promise for automating complex desktop and mobile tasks, but face significant challenges in applying reinforcement learning (RL): (1) slow multi-turn interactions with GUI environments for…

Reinforcement learning (RL) recommender systems often rely on static datasets that fail to capture the fluid, ever changing nature of user preferences in real-world scenarios. Meanwhile, generative AI techniques have emerged as powerful…

Information Retrieval · Computer Science 2025-09-10 Danial Ebrat , Eli Paradalis , Luis Rueda

This paper introduces a novel framework for proactive cross-domain resource orchestration in 6G RAN-Edge networks, featuring large language model (LLM)-augmented agents. The system comprises specialized RAN (energy efficiency) and Edge…

Networking and Internet Architecture · Computer Science 2025-10-01 Hatim Chergui , Miguel Catalan Cid , Pouria Sayyad Khodashenas , Daniel Camps Mur , Christos Verikoukis

Increasing demand for algorithms that can learn quickly and efficiently has led to a surge of development within the field of artificial intelligence (AI). An important paradigm within AI is reinforcement learning (RL), where agents…

An ideal embodied agent should possess lifelong learning capabilities to handle long-horizon and complex tasks, enabling continuous operation in general environments. This not only requires the agent to accurately accomplish given tasks but…

Artificial Intelligence · Computer Science 2026-03-24 Sen Wang , Bangwei Liu , Zhenkun Gao , Lizhuang Ma , Xuhong Wang , Yuan Xie , Xin Tan

Currently, deep reinforcement learning (RL) shows impressive results in complex gaming and robotic environments. Often these results are achieved at the expense of huge computational costs and require an incredible number of episodes of…

Machine Learning · Computer Science 2020-06-18 Alexey Skrynnik , Aleksey Staroverov , Ermek Aitygulov , Kirill Aksenov , Vasilii Davydov , Aleksandr I. Panov