English
Related papers

Related papers: DemoEvolve: Overcoming Sparse Feedback in Agentic …

200 papers

The implicit feedback (e.g., clicks) in real-world recommender systems is often prone to severe noise caused by unintentional interactions, such as misclicks or curiosity-driven behavior. A common approach to denoising this feedback is…

Information Retrieval · Computer Science 2025-04-01 Zongwei Wang , Min Gao , Junliang Yu , Yupeng Hou , Shazia Sadiq , Hongzhi Yin

Unambiguous identification of the rewards driving behaviours of entities operating in complex open-ended real-world environments is difficult, partly because goals and associated behaviours emerge endogenously and are dynamically updated as…

Machine Learning · Computer Science 2024-05-03 Richard M. Bailey

The scalability of robotic manipulation is fundamentally bottlenecked by the scarcity of task-aligned physical interaction data. While vision-language models (VLMs) and video generation models (VGMs) hold promise for autonomous data…

Robotics · Computer Science 2026-05-14 Harold Haodong Chen , Sirui Chen , Yingjie Xu , Wenhang Ge , Ying-Cong Chen

Demonstrations are widely used in Deep Reinforcement Learning (DRL) for facilitating solving tasks with sparse rewards. However, the tasks in real-world scenarios can often have varied initial conditions from the demonstration, which would…

Robotics · Computer Science 2023-07-11 Ruiqi Zhu , Siyuan Li , Tianhong Dai , Chongjie Zhang , Oya Celiktutan

Large language model (LLM) agents learn by interacting with environments, but long-horizon training remains fundamentally bottlenecked by sparse and delayed rewards. Existing methods typically address this challenge through post-hoc credit…

This position paper argues that, for long-horizon tasks evaluated across models with comparable frontier capability, the agent execution harness, namely the infrastructure layer that governs context construction, tool interaction,…

Artificial Intelligence · Computer Science 2026-05-26 Yunbei Zhang , Janet Wang , Yingqiang Ge , Weijie Xu , Jihun Hamm , Chandan K. Reddy

This paper documents a case study in agent-driven autonomous reinforcement learning research for quadruped locomotion. The setting was not a fully self-starting research system. A human provided high-level directives through an agentic…

Robotics · Computer Science 2026-03-31 Nimesh Khandelwal , Shakti S. Gupta

Large language model (LLM) applications such as agents and domain-specific reasoning increasingly rely on context adaptation: modifying inputs with instructions, strategies, or evidence, rather than weight updates. Prior approaches improve…

Achieving general-purpose robotics requires empowering robots to adapt and evolve based on their environment and feedback. Traditional methods face limitations such as extensive training requirements, difficulties in cross-task…

Robotics · Computer Science 2026-04-23 Jianzong Wang , Botao Zhao , Yayun He , Junqing Peng , Xulong Zhang

While large language model (LLM) agents have demonstrated impressive problem-solving capabilities, they typically operate as static systems, lacking the ability to evolve through lifelong interaction. Existing attempts to bridge this gap…

Machine Learning · Computer Science 2026-02-03 Hongzhuo Yu , Fei Zhu , Guo-Sen Xie , Ling Shao

Imitation learning has shown great promise in robotic manipulation, but the policy's execution is often unsatisfactorily slow due to commonly tardy demonstrations collected by human operators. In this work, we present DemoSpeedup, a…

Robotics · Computer Science 2025-06-11 Lingxiao Guo , Zhengrong Xue , Zijing Xu , Huazhe Xu

This paper introduces DualReward, a novel reinforcement learning framework for automatic distractor generation in cloze tests. Unlike conventional approaches that rely primarily on supervised learning or static generative models, our method…

Computation and Language · Computer Science 2025-07-17 Tianyou Huang , Xinglu Chen , Jingshen Zhang , Xinying Qiu , Ruiying Niu

Despite significant empirical and theoretically supported evidence that non-static parameter choices can be strongly beneficial in evolutionary computation, the question how to best adjust parameter values plays only a marginal role in…

Neural and Evolutionary Computing · Computer Science 2018-03-06 Carola Doerr , Markus Wagner

Automating quantitative trading strategy development in dynamic markets is challenging, especially with increasing demand for personalized investment solutions. Existing methods often fail to explore the vast strategy space while preserving…

Artificial Intelligence · Computer Science 2025-10-22 Junhyeog Yun , Hyoun Jun Lee , Insu Jeon

The acquisition of competence is a key element in the ability to assert oneself in the complex and rapidly changing modern worlds of work. This paper examines the evolution of competence, i.e. the role of competences in an evolutionary…

Physics and Society · Physics 2007-05-23 Andrea Scharnhorst , Werner Ebeling

Recent advances in large language models (LLMs) have enabled the development of autonomous agents capable of complex reasoning and multi-step problem solving. However, these agents struggle to adapt to specialized environments and do not…

Machine Learning · Computer Science 2026-04-02 Marc-Antoine Allard , Arnaud Teinturier , Victor Xing , Gautier Viaud

Self-improving AI systems aim to reduce reliance on human engineering by learning to improve their own learning and problem-solving processes. Existing approaches to self-improvement rely on fixed, handcrafted meta-level mechanisms,…

Artificial Intelligence · Computer Science 2026-03-23 Jenny Zhang , Bingchen Zhao , Wannan Yang , Jakob Foerster , Jeff Clune , Minqi Jiang , Sam Devlin , Tatiana Shavrina

Sparse autoencoders (SAEs) have lately been used to uncover interpretable latent features in large language models. By projecting dense embeddings into a much higher-dimensional and sparse space, learned features become disentangled and…

Machine Learning · Computer Science 2025-07-30 Viktoria Schuster

Self-evolving agents improve by accumulating and reusing experience from past interactions. Existing work has largely focused on how experience is constructed, represented, and updated, while paying less attention to how experience should…

Computation and Language · Computer Science 2026-05-11 Weixiang Zhao , Yingshuo Wang , Yichen Zhang , Yanyan Zhao , Yu Zhang , Yang Wu , Dandan Tu , Bing Qin , Ting Liu

Reinforcement Learning has emerged as a strong alternative to solve optimization tasks efficiently. The use of these algorithms highly depends on the feedback signals provided by the environment in charge of informing about how good (or…

Machine Learning · Computer Science 2022-12-01 Alain Andres , Esther Villar-Rodriguez , Javier Del Ser