English
Related papers

Related papers: EnsembleDAgger: A Bayesian Approach to Safe Imitat…

200 papers

This paper puts forward the concept that learning to take safe actions in unknown environments, even with probability one guarantees, can be achieved without the need for an unbounded number of exploratory trials. This is indeed possible,…

Systems and Control · Electrical Eng. & Systems 2023-02-14 Agustin Castellano , Hancheng Min , Juan Bazerque , Enrique Mallada

In industrial machine learning pipelines, data often arrive in parts. Particularly in the case of deep neural networks, it may be too expensive to train the model from scratch each time, so one would rather use a previously learned model…

Machine Learning · Statistics 2018-03-29 Max Kochurov , Timur Garipov , Dmitry Podoprikhin , Dmitry Molchanov , Arsenii Ashukha , Dmitry Vetrov

We investigate ensemble methods for prediction in an online setting. Unlike all the literature in ensembling, for the first time, we introduce a new approach using a meta learner that effectively combines the base model predictions via…

Machine Learning · Computer Science 2022-12-01 Arda Fazla , Mustafa Enes Aydin , Orhun Tamyigit , Suleyman Serdar Kozat

The idea to distinguish and quantify two important types of uncertainty, often referred to as aleatoric and epistemic, has received increasing attention in machine learning research in the last couple of years. In this paper, we consider…

Machine Learning · Computer Science 2021-12-13 Mohammad Hossein Shaker , Eyke Hüllermeier

In this paper, we study the learning of safe policies in the setting of reinforcement learning problems. This is, we aim to control a Markov Decision Process (MDP) of which we do not know the transition probabilities, but we have access to…

Systems and Control · Electrical Eng. & Systems 2022-01-14 Santiago Paternain , Miguel Calvo-Fullana , Luiz F. O. Chamon , Alejandro Ribeiro

Agents that interact with other agents often do not know a priori what the other agents' strategies are, but have to maximise their own online return while interacting with and learning about others. The optimal adaptive behaviour under…

Machine Learning · Computer Science 2022-04-19 Luisa Zintgraf , Sam Devlin , Kamil Ciosek , Shimon Whiteson , Katja Hofmann

Equalizer parameter optimization is critical for signal integrity in high-speed memory systems operating at multi-gigabit data rates. However, existing methods suffer from computationally expensive eye diagram evaluation, optimization of…

Machine Learning · Computer Science 2026-05-07 Muhammad Usama , Dong Eui Chang

Recent advancements in edge computing have significantly enhanced the AI capabilities of Internet of Things (IoT) devices. However, these advancements introduce new challenges in knowledge exchange and resource management, particularly…

Machine Learning · Computer Science 2024-10-14 Gleb Radchenko , Victoria Andrea Fill

As we aim to control complex systems, use of a simulator in model-based reinforcement learning is becoming more common. However, it has been challenging to overcome the Reality Gap, which comes from nonlinear model bias and susceptibility…

Robotics · Computer Science 2017-05-16 Gilwoo Lee , Siddhartha S. Srinivasa , Matthew T. Mason

Bayesian reward learning from demonstrations enables rigorous safety and uncertainty analysis when performing imitation learning. However, Bayesian reward learning methods are typically computationally intractable for complex control…

Machine Learning · Computer Science 2020-12-21 Daniel S. Brown , Russell Coleman , Ravi Srinivasan , Scott Niekum

This paper investigates how a Bayesian reinforcement learning method can be used to create a tactical decision-making agent for autonomous driving in an intersection scenario, where the agent can estimate the confidence of its recommended…

Robotics · Computer Science 2020-11-04 Carl-Johan Hoel , Tommy Tram , Jonas Sjöberg

Deep neural networks has been increasingly applied in fault diagnostics, where it uses historical data to capture systems behavior, bypassing the need for high-fidelity physical models. However, despite their competence in prediction tasks,…

Machine Learning · Computer Science 2025-09-24 Arman Mohammadi , Mattias Krysander , Daniel Jung , Erik Frisk

Intrusion detection systems (IDSs) play an important role in identifying malicious attacks and threats in networking systems. As fundamental tools of IDSs, learning based classification methods have been widely employed. When it comes to…

Cryptography and Security · Computer Science 2019-01-29 He Zhang , Xingrui Yu , Peng Ren , Chunbo Luo , Geyong Min

This paper considers the use of a simple posterior sampling algorithm to balance between exploration and exploitation when learning to optimize actions such as in multi-armed bandit problems. The algorithm, also known as Thompson Sampling,…

Machine Learning · Computer Science 2014-02-04 Daniel Russo , Benjamin Van Roy

While learning from demonstrations is powerful for acquiring visuomotor policies, high-performance imitation without large demonstration datasets remains challenging for tasks requiring precise, long-horizon manipulation. This paper…

Robotics · Computer Science 2024-11-12 Lars Ankile , Anthony Simeonov , Idan Shenfeld , Pulkit Agrawal

Cybersecurity risk analysis plays an essential role in supporting organizations make effective decision about how to manage and control cybersecurity risk. Cybersecurity risk is a function of the interplay between the defender, i.e., the…

Computer Science and Game Theory · Computer Science 2021-06-02 Jiali Wang , Martin Neil

The increasing adoption of Reinforcement Learning in safety-critical systems domains such as autonomous vehicles, health, and aviation raises the need for ensuring their safety. Existing safety mechanisms such as adversarial training,…

Machine Learning · Computer Science 2021-11-11 Paulina Stevia Nouwou Mindom , Amin Nikanjam , Foutse Khomh , John Mullins

Imitation from observation is the framework of learning tasks by observing demonstrated state-only trajectories. Recently, adversarial approaches have achieved significant performance improvements over other methods for imitating complex…

Machine Learning · Computer Science 2019-06-19 Faraz Torabi , Sean Geiger , Garrett Warnell , Peter Stone

Active learning methods for neural networks are usually based on greedy criteria which ultimately give a single new design point for the evaluation. Such an approach requires either some heuristics to sample a batch of design points at one…

Machine Learning · Computer Science 2020-01-28 Evgenii Tsymbalov , Sergei Makarychev , Alexander Shapeev , Maxim Panov

Differential equations in general and neural ODEs in particular are an essential technique in continuous-time system identification. While many deterministic learning algorithms have been designed based on numerical integration via the…

Machine Learning · Computer Science 2021-10-18 Lenart Treven , Philippe Wenk , Florian Dörfler , Andreas Krause