English
Related papers

Related papers: MineEvolve: Self-Evolution with Accumulated Knowle…

200 papers

Training long-horizon LLM agents with reinforcement learning is challenging because sparse outcome rewards reveal whether a task succeeds, but not which intermediate actions caused the outcome or how they should be corrected. Recent methods…

Machine Learning · Computer Science 2026-05-19 Woongyeng Yeo , Yumin Choi , Taekyung Ki , Sung Ju Hwang

Recent years, multimodal models have made remarkable strides and pave the way for intelligent browser use agents. However, when solving tasks on real world webpages in multi-turn, long-horizon trajectories, current agents still suffer from…

Artificial Intelligence · Computer Science 2025-09-26 Kaiwen He , Zhiwei Wang , Chenyi Zhuang , Jinjie Gu

Learning high-performance control policies that remain consistent with expert behavior is a fundamental challenge in robotics. Reinforcement learning can discover high-performing strategies but often departs from desirable human behavior,…

Robotics · Computer Science 2026-04-06 Siwei Ju , Jan Tauberschmidt , Oleg Arenz , Peter van Vliet , Jan Peters

Clinical diagnosis is a complex cognitive process, grounded in dynamic cue acquisition and continuous expertise accumulation. Yet most current artificial intelligence (AI) systems are misaligned with this reality, treating diagnosis as…

Artificial Intelligence · Computer Science 2026-03-12 Ruiyang Ren , Yuhao Wang , Yunsen Liang , Lan Luo , Jing Liu , Haifeng Wang , Cong Feng , Yinan Zhang , Chunyan Miao , Ji-Rong Wen , Wayne Xin Zhao

Advances in deep generative modeling have made it increasingly plausible to train human-level embodied agents. Yet progress has been limited by the absence of large-scale, real-time, multi-modal, and socially interactive datasets that…

Machine Learning · Computer Science 2026-02-19 Yingchen He , Christian D. Weilbach , Martyna E. Wojciechowska , Yuxuan Zhang , Frank Wood

Improving context faithfulness in large language models is essential for developing trustworthy retrieval augmented generation systems and mitigating hallucinations, especially in long-form question answering (LFQA) tasks or scenarios…

Computation and Language · Computer Science 2025-03-04 Kun Li , Tianhua Zhang , Yunxiang Li , Hongyin Luo , Abdalla Moustafa , Xixin Wu , James Glass , Helen Meng

Reinforcement learning from verifiable rewards (RLVR) is a promising paradigm for improving large language model (LLM) agents on long-horizon interactive tasks. However, in partially observable environments, incomplete observations cause…

Computation and Language · Computer Science 2026-05-20 Wenjie Tang , Minne Li , Sijie Huang , Liquan Xiao , Yuan Zhou

While deep reinforcement learning methods have shown impressive results in robot learning, their sample inefficiency makes the learning of complex, long-horizon behaviors with real robot systems infeasible. To mitigate this issue,…

Machine Learning · Computer Science 2022-04-26 Taewook Nam , Shao-Hua Sun , Karl Pertsch , Sung Ju Hwang , Joseph J Lim

Large language model (LLM) agents are fundamentally bottlenecked by finite context windows on long-horizon tasks. As trajectories grow, retaining tool outputs and intermediate reasoning in-context quickly becomes infeasible: the working…

Computation and Language · Computer Science 2026-03-05 Zhenting Wang , Huancheng Chen , Jiayun Wang , Wei Wei

To achieve scenario intelligence, humans must transfer knowledge to robots by developing goal-oriented algorithms, which are sometimes insensitive to dynamically changing environments. While deep reinforcement learning achieves significant…

Artificial Intelligence · Computer Science 2018-07-31 Tingguang Li , Jin Pan , Delong Zhu , Max Q. -H. Meng

Evolutionary algorithms serve as a powerful paradigm for tackling optimization challenges, yet their reliance on manually engineered heuristics inherently limits their adaptability across diverse landscapes. However, the transition from the…

Neural and Evolutionary Computing · Computer Science 2026-03-04 Jiaxin Gao , Yaohua Liu , Ran Cheng , Kay Chen Tan

Reinforcement Learning (RL) has demonstrated significant potential in enhancing the reasoning capabilities of large language models (LLMs). However, the success of RL for LLMs heavily relies on human-curated datasets and verifiable rewards,…

Artificial Intelligence · Computer Science 2025-10-31 Yixing Chen , Yiding Wang , Siqi Zhu , Haofei Yu , Tao Feng , Muhan Zhang , Mostofa Patwary , Jiaxuan You

Establishing object-level correspondence between egocentric and exocentric views is essential for intelligent assistants to deliver precise and intuitive visual guidance. However, this task faces numerous challenges, including extreme…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Yijun Hu , Bing Fan , Xin Gu , Haiqing Ren , Dongfang Liu , Heng Fan , Libo Zhang

Pre-training Reinforcement Learning agents in a task-agnostic manner has shown promising results. However, previous works still struggle in learning and discovering meaningful skills in high-dimensional state-spaces, such as pixel-spaces.…

Artificial Intelligence · Computer Science 2021-07-20 Juan José Nieto , Roger Creus , Xavier Giro-i-Nieto

In real-world industrial settings, large language models (LLMs) must learn continually to keep pace with diverse and evolving tasks, requiring self-evolution to refine knowledge under dynamic data distributions. However, existing continual…

Machine Learning · Computer Science 2025-10-16 Jiazheng Kang , Le Huang , Cheng Hou , Zhe Zhao , Zhenxiang Yan , Ting Bai

Mobile GUI agents powered by large foundation models enable autonomous task execution, but frequent updates altering UI appearance and reorganizing workflows cause agents trained on historical data to fail. Despite surface changes,…

Artificial Intelligence · Computer Science 2026-02-03 Libo Sun , Jiwen Zhang , Siyuan Wang , Zhongyu Wei

Lifelong learning can be viewed as a continuous transfer learning procedure over consecutive tasks, where learning a given task depends on accumulated knowledge --- the so-called knowledge base. Most published work on lifelong learning…

Machine Learning · Statistics 2018-10-30 Changjian Shui , Ihsen Hedhli , Christian Gagné

Multi-step robot manipulation requires acting under uncertainty about how the scene will evolve, making exploration and policy adaptation challenging. We study whether short-horizon, task-consistent future videos can provide useful…

Robotics · Computer Science 2026-05-29 Mohammad Khoshnazar , Andrew Melnik , Michael Beetz

Long-horizon action-conditioned video generation aims to synthesize temporally coherent videos that follow complex action instructions over extended horizons, requiring procedural ordering, persistent action execution, and scene consistency…

Computer Vision and Pattern Recognition · Computer Science 2026-05-22 Yu Yang , Yue Liao , Jianbiao Mei , Baisen Wang , Xuemeng Yang , Licheng Wen , Jiangning Zhang , Xiangtai Li , Liang Lv , Hanlin Chen , Botian Shi , Yong Liu , Shuicheng Yan , Gim Hee Lee

Humans have the capability, aided by the expressive compositionality of their language, to learn quickly by demonstration. They are able to describe unseen task-performing procedures and generalize their execution to other contexts. In this…