English
Related papers

Related papers: CANDID DAC: Leveraging Coupled Action Dimensions w…

200 papers

This paper presents Dual Action Policy (DAP), a novel approach to address the dynamics mismatch inherent in the sim-to-real gap of reinforcement learning. DAP uses a single policy to predict two sets of actions: one for maximizing task…

Machine Learning · Computer Science 2024-10-17 Ng Wen Zheng Terence , Chen Jianda

We reformulate the option framework as two parallel augmented MDPs. Under this novel formulation, all policy optimization algorithms can be used off the shelf to learn intra-option policies, option termination conditions, and a master…

Machine Learning · Computer Science 2019-09-12 Shangtong Zhang , Shimon Whiteson

Algorithms that exploit factored Markov decision processes are far more sample-efficient than factor-agnostic methods, yet they assume a factored representation is known a priori -- a requirement that breaks down when the agent sees only…

Machine Learning · Computer Science 2025-10-06 Rafael Rodriguez-Sanchez , Cameron Allen , George Konidaris

Quality-Diversity (QD) algorithms have shown remarkable success in discovering diverse, high-performing solutions, but rely heavily on hand-crafted behavioral descriptors that constrain exploration to predefined notions of diversity.…

Machine Learning · Computer Science 2026-03-05 Saeed Hedayatian , Stefanos Nikolaidis

Building a general-purpose intelligent home-assistant agent skilled in diverse tasks by human commands is a long-term blueprint of embodied AI research, which poses requirements on task planning, environment modeling, and object…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Xinyu Xu , Shengcheng Luo , Yanchao Yang , Yong-Lu Li , Cewu Lu

There are many applications where users seek to explore the impact of the settings of several categorical variables with respect to one dependent numerical variable. For example, a computer systems analyst might want to study how the type…

Graphics · Computer Science 2020-03-03 Anjul Tyagi , Zhen Cao , Tyler Estro , Erez Zadok , Klaus Mueller

The ability to learn reward functions plays an important role in enabling the deployment of intelligent agents in the real world. However, comparing reward functions, for example as a means of evaluating reward learning methods, presents a…

Machine Learning · Computer Science 2022-01-26 Blake Wulfe , Ashwin Balakrishna , Logan Ellis , Jean Mercat , Rowan McAllister , Adrien Gaidon

Adversarial imitation learning (AIL) has stood out as a dominant framework across various imitation learning (IL) applications, with Discriminator Actor Critic (DAC) (Kostrikov et al.,, 2019) demonstrating the effectiveness of off-policy…

Machine Learning · Computer Science 2024-04-15 Jonathan D. Chang , Dhruv Sreenivas , Yingbing Huang , Kianté Brantley , Wen Sun

Recent developments in sequential experimental design look to construct a policy that can efficiently navigate the design space, in a way that maximises the expected information gain. Whilst there is work on achieving tractable policies for…

Machine Learning · Computer Science 2025-08-20 Yasir Zubayr Barlas , Kizito Salako

We propose a fully distributed actor-critic algorithm approximated by deep neural networks, named \textit{Diff-DAC}, with application to single-task and to average multitask reinforcement learning (MRL). Each agent has access to data from…

Continual Learning (CL) is a powerful tool that enables agents to learn a sequence of tasks, accumulating knowledge learned in the past and using it for problem-solving or future task learning. However, existing CL methods often assume that…

Machine Learning · Computer Science 2025-06-09 Chaofan Pan , Jiafen Liu , Yanhua Li , Linbo Xiong , Fan Min , Wei Wei , Xin Yang

The difficulty of an entity matching task depends on a combination of multiple factors such as the amount of corner-case pairs, the fraction of entities in the test set that have not been seen during training, and the size of the…

Machine Learning · Computer Science 2023-07-03 Ralph Peeters , Reng Chiz Der , Christian Bizer

In this article, we propose a centralized Multi-Agent Learning framework for learning a policy that models the simultaneous behavior of multiple agents that need to coordinate to solve a certain task. Centralized approaches often suffer…

Artificial Intelligence · Computer Science 2025-04-08 Ángel Aso-Mollar , Eva Onaindia

When domain experts are needed to perform data annotation for complex machine-learning tasks, reducing annotation effort is crucial in order to cut down time and expenses. For cases when there are no annotations available, one approach is…

Machine Learning · Computer Science 2022-06-22 Einari Vaaras , Manu Airaksinen , Okko Räsänen

Background subtraction in video provides the preliminary information which is essential for many computer vision applications. In this paper, we propose a sequence of approaches named CANDID to handle the change detection problem in…

Computer Vision and Pattern Recognition · Computer Science 2018-04-20 Murari Mandal , Prafulla Saxena , Santosh Kumar Vipparthi , Subrahmanyam Murala

Language-conditioned manipulation policies typically process instructions and observations through shared network parameters. This task-state entanglement provides a pathway for observation leakage -- networks learn scene-to-action…

Robotics · Computer Science 2026-05-21 Hanxiang Ren , Pei Zhou , Xunzhe Zhou , Yanchao Yang

Following the pivotal success of learning strategies to win at tasks, solely by interacting with an environment without any supervision, agents have gained the ability to make sequential decisions in complex MDPs. Yet, reinforcement…

Machine Learning · Computer Science 2026-03-18 Ezgi Korkmaz

Calibrating deep learning models to yield uncertainty-aware predictions is crucial as deep neural networks get increasingly deployed in safety-critical applications. While existing post-hoc calibration methods achieve impressive results on…

Machine Learning · Computer Science 2023-07-06 Christian Tomani , Futa Waseda , Yuesong Shen , Daniel Cremers

Deep reinforcement learning can generate complex control policies, but requires large amounts of training data to work effectively. Recent work has attempted to address this issue by leveraging differentiable simulators. However, inherent…

Machine Learning · Computer Science 2022-04-15 Jie Xu , Viktor Makoviychuk , Yashraj Narang , Fabio Ramos , Wojciech Matusik , Animesh Garg , Miles Macklin

Recently, self-supervised instance discrimination methods have achieved significant success in learning visual representations from unlabeled photographic images. However, given the marked differences between photographic and medical…

Image and Video Processing · Electrical Eng. & Systems 2022-04-18 Mohammad Reza Hosseinzadeh Taher , Fatemeh Haghighi , Michael B. Gotway , Jianming Liang