English
Related papers

Related papers: Distributional Actor-Critic Ensemble for Uncertain…

200 papers

Predictive uncertainty estimation remains a challenging problem precluding the use of deep neural networks as subsystems within safety-critical applications. Aleatoric uncertainty is a component of predictive uncertainty that cannot be…

Machine Learning · Computer Science 2023-12-12 Angel Daruna , Yunye Gong , Abhinav Rajvanshi , Han-Pang Chiu , Yi Yao

Much of uncertainty quantification to date has focused on determining the effect of variables modeled probabilistically, and with a known distribution, on some physical or engineering system. We develop methods to obtain information on the…

Numerical Analysis · Mathematics 2015-03-19 Kamaljit Chowdhary , Paul Dupuis

Large-scale robotic policies trained on data from diverse tasks and robotic platforms hold great promise for enabling general-purpose robots; however, reliable generalization to new environment conditions remains a major challenge. Toward…

Robotics · Computer Science 2024-07-30 Bo Wu , Bruce D. Lee , Kostas Daniilidis , Bernadette Bucher , Nikolai Matni

Reinforcement learning in heterogeneous multi-agent scenarios is important for real-world applications but presents challenges beyond those seen in homogeneous settings and simple benchmarks. In this work, we present an actor-critic…

Multiagent Systems · Computer Science 2020-10-07 Ceyer Wakilpoor , Patrick J. Martin , Carrie Rebhuhn , Amanda Vu

Continuous control of non-stationary environments is a major challenge for deep reinforcement learning algorithms. The time-dependency of the state transition dynamics aggravates the notorious stability problems of model-free deep…

Machine Learning · Computer Science 2025-11-05 Abdullah Akgül , Gulcin Baykal , Manuel Haußmann , Melih Kandemir

In recent years, fully differentiable rigid body physics simulators have been developed, which can be used to simulate a wide range of robotic systems. In the context of reinforcement learning for control, these simulators theoretically…

Machine Learning · Computer Science 2022-03-08 Sean Gillen , Katie Byl

In this paper, we explore using deep reinforcement learning for problems with multiple agents. Most existing methods for deep multi-agent reinforcement learning consider only a small number of agents. When the number of agents increases,…

Machine Learning · Computer Science 2018-05-24 Arbaaz Khan , Clark Zhang , Daniel D. Lee , Vijay Kumar , Alejandro Ribeiro

Uncertainty quantification of deep neural networks has become an active field of research and plays a crucial role in various downstream tasks such as active learning. Recent advances in evidential deep learning shed light on the direct…

Machine Learning · Computer Science 2023-11-21 Ruxiao Duan , Brian Caffo , Harrison X. Bai , Haris I. Sair , Craig Jones

Traffic light timing optimization is still an active line of research despite the wealth of scientific literature on the topic, and the problem remains unsolved for any non-toy scenario. One of the key issues with traffic light optimization…

Neural and Evolutionary Computing · Computer Science 2017-08-03 Noe Casas

This paper develops the first policy gradient method with global optimality guarantee and complexity analysis for robust reinforcement learning under model mismatch. Robust reinforcement learning is to learn a policy robust to model…

Machine Learning · Computer Science 2022-05-17 Yue Wang , Shaofeng Zou

Uncertainty estimation has been extensively studied in recent literature, which can usually be classified as aleatoric uncertainty and epistemic uncertainty. In current aleatoric uncertainty estimation frameworks, it is often neglected that…

Computer Vision and Pattern Recognition · Computer Science 2021-11-23 Jing Zhang , Yuchao Dai , Mehrtash Harandi , Yiran Zhong , Nick Barnes , Richard Hartley

Assessing the systemic effects of uncertainty that arises from agents' partial observation of the true states of the world is critical for understanding a wide range of scenarios. Yet, previous modeling work on agent learning and…

Adaptation and Self-Organizing Systems · Physics 2022-04-15 Wolfram Barfuss , Richard P. Mann

Uncertainty quantification is crucial for building reliable and trustable machine learning systems. We propose to estimate uncertainty in recurrent neural networks (RNNs) via stochastic discrete state transitions over recurrent timesteps.…

Machine Learning · Computer Science 2020-11-25 Cheng Wang , Carolin Lawrence , Mathias Niepert

Learning auxiliary tasks, such as multiple predictions about the world, can provide many benefits to reinforcement learning systems. A variety of off-policy learning algorithms have been developed to learn such predictions, but as yet there…

Machine Learning · Computer Science 2022-02-24 Matthew McLeod , Chunlok Lo , Matthew Schlegel , Andrew Jacobsen , Raksha Kumaraswamy , Martha White , Adam White

When learning behavior, training data is often generated by the learner itself; this can result in unstable training dynamics, and this problem has particularly important applications in safety-sensitive real-world control tasks such as…

Machine Learning · Computer Science 2019-10-10 Vibhavari Dasagi , Jake Bruce , Thierry Peynot , Jürgen Leitner

With the implementation of reinforcement learning (RL) algorithms, current state-of-art autonomous vehicle technology have the potential to get closer to full automation. However, most of the applications have been limited to game domains…

Robotics · Computer Science 2020-01-14 Wenhui Huang , Francesco Braghin , Zhuo Wang

The exploration mechanism used by a Deep Reinforcement Learning (RL) agent plays a key role in determining its sample efficiency. Thus, improving over random exploration is crucial to solve long-horizon tasks with sparse rewards. We propose…

Machine Learning · Computer Science 2019-12-17 Andrey Kurenkov , Ajay Mandlekar , Roberto Martin-Martin , Silvio Savarese , Animesh Garg

Machine learning techniques are becoming an integral component of data analysis in High Energy Physics (HEP). These tools provide a significant improvement in sensitivity over traditional analyses by exploiting subtle patterns in…

Data Analysis, Statistics and Probability · Physics 2021-10-04 Aishik Ghosh , Benjamin Nachman , Daniel Whiteson

We propose a learning-based robust predictive control algorithm that compensates for significant uncertainty in the dynamics for a class of discrete-time systems that are nominally linear with an additive nonlinear component. Such systems…

Systems and Control · Electrical Eng. & Systems 2022-12-05 Rohan Sinha , James Harrison , Spencer M. Richards , Marco Pavone

Reliability of machine learning (ML) systems is crucial in safety-critical applications such as healthcare, and uncertainty estimation is a widely researched method to highlight the confidence of ML systems in deployment. Sequential and…

Machine Learning · Computer Science 2021-04-23 Utkarsh Sarawgi , Rishab Khincha , Wazeer Zulfikar , Satrajit Ghosh , Pattie Maes