English
Related papers

Related papers: Amortized Active Causal Induction with Deep Reinfo…

200 papers

Flexible, goal-directed behavior is a fundamental aspect of human life. Based on the free energy minimization principle, the theory of active inference formalizes the generation of such behavior from a computational neuroscience…

Artificial Intelligence · Computer Science 2022-08-03 Fedor Scholz , Christian Gumbsch , Sebastian Otte , Martin V. Butz

The increasing availability of interventional data offers new opportunities for causal discovery, with gene perturbation studies providing a prominent example. Such data are typically count-valued and subject to substantial measurement…

Methodology · Statistics 2026-03-30 Yijiao Zhang , Hongzhe Li

Causal representation learning aims to recover the latent causal variables and their causal relations, typically represented by directed acyclic graphs (DAGs), from low-level observations such as image pixels. A prevailing line of research…

Machine Learning · Computer Science 2026-04-28 Ignavier Ng , Shaoan Xie , Xinshuai Dong , Peter Spirtes , Kun Zhang

This work introduces Dirichlet Active Learning (DiAL), a Bayesian-inspired approach to the design of active learning algorithms. Our framework models feature-conditional class probabilities as a Dirichlet random field and lends…

Machine Learning · Statistics 2023-11-10 Kevin Miller , Ryan Murray

The aerodynamic design of modern civil aircraft requires a true sense of intelligence since it requires a good understanding of transonic aerodynamics and sufficient experience. Reinforcement learning is an artificial general intelligence…

Computational Engineering, Finance, and Science · Computer Science 2021-09-21 Runze Li , Yufei Zhang , Haixin Chen

Reinforcement learning (RL) has achieved enormous progress in solving various sequential decision-making problems, such as control tasks in robotics. Since policies are overfitted to training environments, RL methods have often failed to be…

Robotics · Computer Science 2023-03-21 Xiao Wang , Saasha Nair , Matthias Althoff

An active learning (AL) algorithm seeks to construct an effective classifier with a minimal number of labeled examples in a bootstrapping manner. While standard AL heuristics, such as selecting those points for annotation for which a…

Computer Vision and Pattern Recognition · Computer Science 2020-09-03 Ishani Mondal , Debasis Ganguly

We propose a method for tackling catastrophic forgetting in deep reinforcement learning that is \textit{agnostic} to the timescale of changes in the distribution of experiences, does not require knowledge of task boundaries, and can adapt…

Machine Learning · Computer Science 2019-06-18 Christos Kaplanis , Murray Shanahan , Claudia Clopath

Data Augmentation is a common technique used to enhance the performance of deep learning models by expanding the training dataset. Automatic Data Augmentation (ADA) methods are getting popular because of their capacity to generate policies…

Machine Learning · Computer Science 2024-04-02 Tien-Yu Chang , Hao Dai , Vincent S. Tseng

The utility of tabular data for tasks ranging from model training to large-scale data analysis is often constrained by privacy concerns or regulatory hurdles. While existing data generation methods, particularly those based on Generative…

Machine Learning · Computer Science 2025-10-29 Tu Anh Hoang Nguyen , Dang Nguyen , Tri-Nhan Vo , Thuc Duy Le , Sunil Gupta

Training robust deep learning (DL) systems for medical image classification or segmentation is challenging due to limited images covering different disease types and severity. We propose an active learning (AL) framework to select most…

Computer Vision and Pattern Recognition · Computer Science 2019-10-23 Dwarikanath Mahapatra , Behzad Bozorgtabar , Jean-Philippe Thiran , Mauricio Reyes

Causal inference explores the causation between actions and the consequent rewards on a covariate set. Recently deep learning has achieved a remarkable performance in causal inference, but existing statistical theories cannot well explain…

Machine Learning · Computer Science 2020-11-04 Minshuo Chen , Hao Liu , Wenjing Liao , Tuo Zhao

Offline reinforcement learning (RL) enables learning effective policies from fixed datasets without any environment interaction. Existing methods typically employ policy constraints to mitigate the distribution shift encountered during…

Machine Learning · Computer Science 2026-04-30 Tan Jing , Xiaorui Li , Chao Yao , Xiaojuan Ban , Yuetong Fang , Renjing Xu , Zhaolin Yuan

Context-based offline meta-reinforcement learning (OMRL) methods have achieved appealing success by leveraging pre-collected offline datasets to develop task representations that guide policy learning. However, current context-based OMRL…

Machine Learning · Computer Science 2025-02-04 Zhengzhe Zhang , Wenjia Meng , Haoliang Sun , Gang Pan

Deep reinforcement learning (DRL) is a promising approach for developing legged locomotion skills. However, the iterative design process that is inevitable in practice is poorly supported by the default methodology. It is difficult to…

Robotics · Computer Science 2019-03-25 Zhaoming Xie , Patrick Clary , Jeremy Dao , Pedro Morais , Jonathan Hurst , Michiel van de Panne

Offline reinforcement learning enables sample-efficient policy acquisition without risky online interaction, yet policies trained on static datasets remain brittle under action-space perturbations such as actuator faults. This study…

Robotics · Computer Science 2026-03-02 Shingo Ayabe , Hiroshi Kera , Kazuhiko Kawamoto

Quantifying the impacts of air pollution on health and climate relies on key atmospheric particle properties such as toxicity and hygroscopicity. However, these properties typically require complex observational techniques or expensive…

Machine Learning · Computer Science 2026-02-13 Fei Jiang , Jiyang Xia , Junjie Yu , Mingfei Sun , Hugh Coe , David Topping , Dantong Liu , Zhenhui Jessie Li , Zhonghua Zheng

We study the problem of reducing test-time acquisition costs in classification systems. Our goal is to learn decision rules that adaptively select sensors for each example as necessary to make a confident prediction. We model our system as…

Machine Learning · Statistics 2015-10-27 Joseph Wang , Kirill Trapeznikov , Venkatesh Saligrama

Causal representation learning (CRL) offers the promise of uncovering the underlying causal model by which observed data was generated, but the practical applicability of existing methods remains limited by the strong assumptions required…

Machine Learning · Computer Science 2026-01-30 Yuhang Liu , Zhen Zhang , Dong Gong , Erdun Gao , Biwei Huang , Mingming Gong , Anton van den Hengel , Kun Zhang , Javen Qinfeng Shi

We introduce Sophisticated Learning (SL), a planning-to-learn algorithm that embeds active parameter learning inside the Sophisticated Inference (SI) tree-search framework of Active Inference. Unlike SI -- which optimizes beliefs about…

Artificial Intelligence · Computer Science 2025-08-18 Rowan Hodson , Bruce Bassett , Charel van Hoof , Benjamin Rosman , Mark Solms , Jonathan P. Shock , Ryan Smith