English
Related papers

Related papers: CompoSuite: A Compositional Reinforcement Learning…

200 papers

The failures of train wheels account for disruptions of train operations and even a large portion of train derailments. Remaining useful life (RUL) of a wheelset measures the how soon the next failure will arrive, and the failure type…

Machine Learning · Computer Science 2021-01-21 Weixin Wang

Predictive autoscaling (autoscaling with workload forecasting) is an important mechanism that supports autonomous adjustment of computing resources in accordance with fluctuating workload demands in the Cloud. In recent works, Reinforcement…

Self-navigation, referred as the capability of automatically reaching the goal while avoiding collisions with obstacles, is a fundamental skill required for mobile robots. Recently, deep reinforcement learning (DRL) has shown great…

Robotics · Computer Science 2020-01-09 Wei Zhang , Yunfeng Zhang , Ning Liu

Reinforcement learning (RL) algorithms find applications in inventory control, recommender systems, vehicular traffic management, cloud computing and robotics. The real-world complications of many tasks arising in these domains makes them…

Machine Learning · Computer Science 2021-06-03 Sindhu Padakandla

A network lasso enables us to construct a model for each sample, which is known as multi-task learning. Existing methods for multi-task learning cannot be applied to compositional data due to their intrinsic properties. In this paper, we…

Methodology · Statistics 2023-01-04 Akira Okazaki , Shuichi Kawano

Large language models (LLMs) have emerged as powerful tools for many AI problems and exhibit remarkable in-context learning (ICL) capabilities. Compositional ability, solving unseen complex tasks that combine two or more simple tasks, is an…

Computation and Language · Computer Science 2024-08-13 Zhuoyan Xu , Zhenmei Shi , Yingyu Liang

Evaluating LLMs with a single prompt has proven unreliable, with small changes leading to significant performance differences. However, generating the prompt variations needed for a more robust multi-prompt evaluation is challenging,…

Computation and Language · Computer Science 2026-04-07 Eliya Habba , Noam Dahan , Gili Lior , Gabriel Stanovsky

Compositional generalization is a crucial step towards developing data-efficient intelligent machines that generalize in human-like ways. In this work, we tackle a challenging form of distribution shift, termed compositional shift, where…

Machine Learning · Computer Science 2025-07-14 Divyat Mahajan , Mohammad Pezeshki , Charles Arnal , Ioannis Mitliagkas , Kartik Ahuja , Pascal Vincent

To realize effective large-scale, real-world robotic applications, we must evaluate how well our robot policies adapt to changes in environmental conditions. Unfortunately, a majority of studies evaluate robot performance in environments…

Robotics · Computer Science 2024-05-29 Wilbert Pumacay , Ishika Singh , Jiafei Duan , Ranjay Krishna , Jesse Thomason , Dieter Fox

Reinforcement learning (RL) has significantly advanced the control of physics-based and robotic characters that track kinematic reference motion. However, methods typically rely on a weighted sum of conflicting reward functions, requiring…

Robotics · Computer Science 2025-05-30 Lucas N. Alegre , Agon Serifi , Ruben Grandia , David Müller , Espen Knoop , Moritz Bächer

Reinforcement learning has shown promising results in learning neural network policies for complicated control tasks. However, the lack of formal guarantees about the behavior of such policies remains an impediment to their deployment. We…

Machine Learning · Computer Science 2023-12-05 Đorđe Žikelić , Mathias Lechner , Abhinav Verma , Krishnendu Chatterjee , Thomas A. Henzinger

In a Human-Robot Cooperation (HRC) environment, safety and efficiency are the two core properties to evaluate robot performance. However, safety mechanisms usually hinder task efficiency since human intervention will cause backup motions…

Robotics · Computer Science 2025-10-15 Gaoyuan Liu , Joris de Winter , Kelly Merckaert , Denis Steckelmacher , Ann Nowe , Bram Vanderborght

Manipulation tasks can often be decomposed into multiple subtasks performed in parallel, e.g., sliding an object to a goal pose while maintaining contact with a table. Individual subtasks can be achieved by task-axis controllers defined…

Robotics · Computer Science 2020-11-17 Mohit Sharma , Jacky Liang , Jialiang Zhao , Alex LaGrassa , Oliver Kroemer

Many modern robotic systems such as multi-robot systems and manipulators exhibit redundancy, a property owing to which they are capable of executing multiple tasks. This work proposes a novel method, based on the Reinforcement Learning (RL)…

Robotics · Computer Science 2025-04-03 Sheikh A. Tahmid , Gennaro Notomista

Multimodal human action understanding is a significant problem in computer vision, with the central challenge being the effective utilization of the complementarity among diverse modalities while maintaining model efficiency. However, most…

Computer Vision and Pattern Recognition · Computer Science 2026-03-11 Hongsong Wang , Heng Fei , Bingxuan Dai , Jie Gui

Designing reinforcement learning (RL) problems that can produce delicate and precise manipulation policies requires careful choice of the reward function, state, and action spaces. Much prior work on applying RL to manipulation tasks has…

Robotics · Computer Science 2019-08-26 Patrick Varin , Lev Grossman , Scott Kuindersma

Compositional generalization has achieved substantial progress in computer vision on pre-collected training data. Nonetheless, real-world data continually emerges, with possible compositions being nearly infinite, long-tailed, and not…

Computer Vision and Pattern Recognition · Computer Science 2025-11-13 Zhen Li , Yuwei Wu , Chenchen Jing , Che Sun , Chuanhao Li , Yunde Jia

The objective comparison of Reinforcement Learning (RL) algorithms is notoriously complex as outcomes and benchmarking of performances of different RL approaches are critically sensitive to environmental design, reward structures, and…

Machine Learning · Computer Science 2026-03-19 Sinan Ibrahim , Grégoire Ouerdane , Hadi Salloum , Henni Ouerdane , Stefan Streif , Pavel Osinenko

Reinforcement learning (RL) algorithms have demonstrated promising results on complex tasks, yet often require impractical numbers of samples since they learn from scratch. Meta-RL aims to address this challenge by leveraging experience…

Machine Learning · Computer Science 2020-10-28 Russell Mendonca , Abhishek Gupta , Rosen Kralev , Pieter Abbeel , Sergey Levine , Chelsea Finn

Recent works in robotic manipulation through reinforcement learning (RL) or imitation learning (IL) have shown potential for tackling a range of tasks e.g., opening a drawer or a cupboard. However, these techniques generalize poorly to…

Robotics · Computer Science 2023-03-10 Kai Lu , Bo Yang , Bing Wang , Andrew Markham