English
Related papers

Related papers: Amortized Active Causal Induction with Deep Reinfo…

200 papers

Active imitation learning (AIL) combats covariate shift by querying an expert during training. However, expert action labeling often dominates the cost, especially in GPU-intensive simulators, human-in-the-loop settings, and robot fleets…

Robotics · Computer Science 2025-12-02 Arad Firouzkouhi , Omid Mirzaeedodangeh , Lars Lindemann

Model-based reinforcement learning is an effective approach for controlling an unknown system. It is based on a longstanding pipeline familiar to the control community in which one performs experiments on the environment to collect a…

Systems and Control · Electrical Eng. & Systems 2024-08-14 Bruce D. Lee , Ingvar Ziemann , George J. Pappas , Nikolai Matni

Deep reinforcement learning in continuous domains focuses on learning control policies that map states to distributions over actions that ideally concentrate on the optimal choices in each step. In multi-agent navigation problems, the…

Robotics · Computer Science 2022-10-20 Chenning Yu , Hongzhan Yu , Sicun Gao

In this paper, we suggest a novel data-driven approach to active learning (AL). The key idea is to train a regressor that predicts the expected error reduction for a candidate sample in a particular learning state. By formulating the query…

Machine Learning · Computer Science 2017-07-17 Ksenia Konyushkova , Raphael Sznitman , Pascal Fua

A key task in Artificial Intelligence is learning effective policies for controlling agents in unknown environments to optimize performance measures. Off-policy learning methods, like Q-learning, allow learners to make optimal decisions…

Artificial Intelligence · Computer Science 2025-10-27 Mingxuan Li , Junzhe Zhang , Elias Bareinboim

Estimating the Conditional Average Treatment Effect (CATE) is often constrained by the high cost of obtaining outcome measurements, making active learning essential. However, conventional active learning strategies suffer from a fundamental…

Machine Learning · Statistics 2025-09-29 Erdun Gao , Jake Fawkes , Dino Sejdinovic

Deep reinforcement learning has made significant progress in robotic manipulation tasks and it works well in the ideal disturbance-free environment. However, in a real-world environment, both internal and external disturbances are…

Robotics · Computer Science 2020-11-09 Pingcheng Jian , Chao Yang , Di Guo , Huaping Liu , Fuchun Sun

Dynamic material handling (DMH) involves the assignment of dynamically arriving material transporting tasks to suitable vehicles in real time for minimising makespan and tardiness. In real-world scenarios, historical task records are…

Neural and Evolutionary Computing · Computer Science 2025-06-23 Chengpeng Hu , Ziming Wang , Bo Yuan , Jialin Liu , Chengqi Zhang , Xin Yao

A key task in Artificial Intelligence is learning effective policies for controlling agents in unknown environments to optimize performance measures. Off-policy learning methods, like Q-learning, allow learners to make optimal decisions…

Artificial Intelligence · Computer Science 2025-09-10 Mingxuan Li , Junzhe Zhang , Elias Bareinboim

Critical sectors of human society are progressing toward the adoption of powerful artificial intelligence (AI) agents, which are trained individually on behalf of self-interested principals but deployed in a shared environment. Short of…

Multiagent Systems · Computer Science 2021-12-22 Jiachen Yang , Ethan Wang , Rakshit Trivedi , Tuo Zhao , Hongyuan Zha

Adversarial imitation learning (AIL) has stood out as a dominant framework across various imitation learning (IL) applications, with Discriminator Actor Critic (DAC) (Kostrikov et al.,, 2019) demonstrating the effectiveness of off-policy…

Machine Learning · Computer Science 2024-04-15 Jonathan D. Chang , Dhruv Sreenivas , Yingbing Huang , Kianté Brantley , Wen Sun

Learning the kernel parameters for Gaussian processes is often the computational bottleneck in applications such as online learning, Bayesian optimization, or active learning. Amortizing parameter inference over different datasets is a…

Machine Learning · Computer Science 2023-06-19 Matthias Bitzer , Mona Meister , Christoph Zimmer

Estimating personalized treatment effects from high-dimensional observational data is essential in situations where experimental designs are infeasible, unethical, or expensive. Existing approaches rely on fitting deep models on outcomes…

Machine Learning · Computer Science 2022-02-02 Andrew Jesson , Panagiotis Tigas , Joost van Amersfoort , Andreas Kirsch , Uri Shalit , Yarin Gal

We develop estimation for potentially high-dimensional additive structural equation models. A key component of our approach is to decouple order search among the variables from feature or edge selection in a directed acyclic graph encoding…

Methodology · Statistics 2014-12-02 Peter Bühlmann , Jonas Peters , Jan Ernest

Many causal and structural effects depend on regressions. Examples include policy effects, average derivatives, regression decompositions, average treatment effects, causal mediation, and parameters of economic structural models. The…

Statistics Theory · Mathematics 2022-10-25 Victor Chernozhukov , Whitney K Newey , Rahul Singh

Adversarial Imitation Learning (AIL) is a broad family of imitation learning methods designed to mimic expert behaviors from demonstrations. While AIL has shown state-of-the-art performance on imitation learning with only small number of…

Machine Learning · Computer Science 2020-02-21 Ruohan Wang , Carlo Ciliberto , Pierluigi Amadori , Yiannis Demiris

Faced with data-driven policies, individuals will manipulate their features to obtain favorable decisions. While earlier works cast these manipulations as undesirable gaming, recent works have adopted a more nuanced causal framing in which…

Machine Learning · Computer Science 2023-02-22 Tom Yan , Shantanu Gupta , Zachary Lipton

Causal representation learning seeks to uncover causal relationships among high-level latent variables from low-level, entangled, and noisy observations. Existing approaches often either rely on deep neural networks, which lack…

Methodology · Statistics 2026-03-27 Wenjin Zhang , Yixin Wang , Yuqi Gu

Causal structure learning, also known as causal discovery, aims to estimate causal relationships between variables as a form of a causal directed acyclic graph (DAG) from observational data. One of the major frameworks is the order-based…

Machine Learning · Statistics 2026-02-18 Kentaro Kanamori , Hirofumi Suzuki , Takuya Takagi

We study active structure learning of Bayesian networks in an observational setting, in which there are external limitations on the number of variable values that can be observed from the same sample. Random samples are drawn from the joint…

Machine Learning · Computer Science 2022-08-23 Noa Ben-David , Sivan Sabato