English
Related papers

Related papers: Interpretable Imitation Learning with Dynamic Caus…

200 papers

As systems are getting more autonomous with the development of artificial intelligence, it is important to discover the causal knowledge from observational sensory inputs. By encoding a series of cause-effect relations between events,…

Machine Learning · Computer Science 2020-01-16 Yuhao Wang , Vlado Menkovski , Hao Wang , Xin Du , Mykola Pechenizkiy

Although deep reinforcement learning has become a promising machine learning approach for sequential decision-making problems, it is still not mature enough for high-stake domains such as autonomous driving or medical applications. In such…

Machine Learning · Computer Science 2022-02-25 Claire Glanois , Paul Weng , Matthieu Zimmer , Dong Li , Tianpei Yang , Jianye Hao , Wulong Liu

Understanding the interactions of agents trained with deep reinforcement learning is crucial for deploying agents in games or the real world. In the former, unreasonable actions confuse players. In the latter, that effect is even more…

Artificial Intelligence · Computer Science 2023-09-08 Manuel Eberhardinger , Johannes Maucher , Setareh Maghsudi

Imitation learning targets deriving a mapping from states to actions, a.k.a. policy, from expert demonstrations. Existing methods for imitation learning typically require any actions in the demonstrations to be fully available, which is…

Machine Learning · Computer Science 2019-06-25 Mingfei Sun , Xiaojuan Ma

Exploratory analysis of time series data can yield a better understanding of complex dynamical systems. Granger causality is a practical framework for analysing interactions in sequential data, applied in a wide range of domains. In this…

Machine Learning · Computer Science 2021-01-20 Ričards Marcinkevičs , Julia E. Vogt

Autonomous robots need to be able to adapt to unforeseen situations and to acquire new skills through trial and error. Reinforcement learning in principle offers a suitable methodological framework for this kind of autonomous learning.…

Robotics · Computer Science 2016-08-02 Nikolas J. Hemion

Machine learning approaches are widely studied in the production prediction of CBM wells after hydraulic fracturing, but merely used in practice due to the low generalization ability and the lack of interpretability. A novel methodology is…

Machine Learning · Computer Science 2022-12-22 Chao Min , Guoquan Wen , Liangjie Gou , Xiaogang Li , Zhaozhong Yang

Two key challenges within Reinforcement Learning involve improving (a) agent learning within environments with sparse extrinsic rewards and (b) the explainability of agent actions. We describe a curious subgoal focused agent to address both…

Machine Learning · Computer Science 2021-04-20 Connor van Rossum , Candice Feinberg , Adam Abu Shumays , Kyle Baxter , Benedek Bartha

Understanding human behavior from observed data is critical for transparency and accountability in decision-making. Consider real-world settings such as healthcare, in which modeling a decision-maker's policy is challenging -- with no…

Machine Learning · Statistics 2023-11-01 Alihan Hüyük , Daniel Jarrett , Mihaela van der Schaar

In artificial multi-agent systems, the ability to learn collaborative policies is predicated upon the agents' communication skills: they must be able to encode the information received from the environment and learn how to share it with…

Machine Learning · Computer Science 2023-01-23 Emanuele Pesce , Giovanni Montana

We consider the problem of imitation learning from a finite set of expert trajectories, without access to reinforcement signals. The classical approach of extracting the expert's reward function via inverse reinforcement learning, followed…

Machine Learning · Computer Science 2019-06-10 Ruohan Wang , Carlo Ciliberto , Pierluigi Amadori , Yiannis Demiris

Recent years have seen rapid progress at the intersection between causality and machine learning. Motivated by scientific applications involving high-dimensional data, in particular in biomedicine, we propose a deep neural architecture for…

Machine Learning · Computer Science 2022-12-12 Kai Lagemann , Christian Lagemann , Bernd Taschler , Sach Mukherjee

In many predictive decision-making scenarios, such as credit scoring and academic testing, a decision-maker must construct a model that accounts for agents' propensity to "game" the decision rule by changing their features so as to receive…

Machine Learning · Computer Science 2022-08-26 Yonadav Shavit , Benjamin Edelman , Brian Axelrod

Effective interaction modeling and behavior prediction of dynamic agents play a significant role in interactive motion planning for autonomous robots. Although existing methods have improved prediction accuracy, few research efforts have…

Robotics · Computer Science 2024-01-09 Victoria M. Dax , Jiachen Li , Enna Sachdeva , Nakul Agarwal , Mykel J. Kochenderfer

On time-series data, most causal discovery methods fit a new model whenever they encounter samples from a new underlying causal graph. However, these samples often share relevant information which is lost when following this approach.…

Machine Learning · Computer Science 2022-02-24 Sindy Löwe , David Madras , Richard Zemel , Max Welling

Graph neural networks (GNNs) demonstrate great performance in compound property and activity prediction due to their capability to efficiently learn complex molecular graph structures. However, two main limitations persist including…

Biomolecules · Quantitative Biology 2023-10-10 Apakorn Kengkanna , Masahito Ohue

In real-world sequential decision making tasks like autonomous driving, robotics, and healthcare, learning from observed state-action trajectories is critical for tasks like imitation, classification, and clustering. For example,…

Machine Learning · Computer Science 2025-01-20 Zichang Ge , Changyu Chen , Arunesh Sinha , Pradeep Varakantham

Recent developments in generative artificial intelligence (AI) rely on machine learning techniques such as deep learning and generative modeling to achieve state-of-the-art performance across wide-ranging domains. These methods' surprising…

Machine Learning · Statistics 2026-01-27 Gemma E. Moran , Bryon Aragam

Granger causality, commonly used for inferring causal structures from time series data, has been adopted in widespread applications across various fields due to its intuitive explainability and high compatibility with emerging deep neural…

Machine Learning · Computer Science 2024-06-18 Ziyi Zhang , Shaogang Ren , Xiaoning Qian , Nick Duffield

We ground the asymmetry of causal relations in the internal physical states of a special kind of open and irreversible physical system, a causal agent. A causal agent is an autonomous physical system, maintained in a steady state, far from…

History and Philosophy of Physics · Physics 2023-06-05 G. J. Milburn , S. Shrapnel , P. W. Evans
‹ Prev 1 8 9 10 Next ›