English
Related papers

Related papers: Enabling robust offline active learning for machin…

200 papers

Offline reinforcement learning (RL) refers to the problem of learning policies from a static dataset of environment interactions. Offline RL enables extensive use and re-use of historical datasets, while also alleviating safety concerns…

Machine Learning · Computer Science 2020-12-22 Rafael Rafailov , Tianhe Yu , Aravind Rajeswaran , Chelsea Finn

Motion planning of autonomous agents in partially known environments with incomplete information is a challenging problem, particularly for complex tasks. This paper proposes a model-free reinforcement learning approach to address this…

Artificial Intelligence · Computer Science 2023-05-02 Junchao Li , Mingyu Cai , Zhen Kan , Shaoping Xiao

Quantum machine learning is an emergent field that continues to draw significant interest for its potential to offer improvements over classical algorithms in certain areas. However, training quantum models remains a challenging task,…

Quantum Physics · Physics 2024-11-20 Erik Recio-Armengol , Franz J. Schreiber , Jens Eisert , Carlos Bravo-Prieto

We consider the problem of learning useful robotic skills from previously collected offline data without access to manually specified rewards or additional online exploration, a setting that is becoming increasingly important for scaling…

Model-based control requires an accurate model of the system dynamics for precisely and safely controlling the robot in complex and dynamic environments. Moreover, in the presence of variations in the operating conditions, the model should…

Robotics · Computer Science 2024-09-04 Alessandro Saviolo , Jonathan Frey , Abhishek Rathod , Moritz Diehl , Giuseppe Loianno

Offline reinforcement learning enables agents to leverage large pre-collected datasets of environment transitions to learn control policies, circumventing the need for potentially expensive or unsafe online data collection. Significant…

Machine Learning · Computer Science 2022-03-17 Cong Lu , Philip J. Ball , Jack Parker-Holder , Michael A. Osborne , Stephen J. Roberts

Pushing is a useful robotic capability for positioning and reorienting objects. The ability to accurately predict the effect of pushes can enable efficient trajectory planning and complicated object manipulation. Physical prediction models…

Robotics · Computer Science 2019-10-21 Huidong Gao , Yi Ouyang , Masayoshi Tomizuka

We focus on the online-based active learning (OAL) setting where an agent operates over a stream of observations and trades-off between the costly acquisition of information (labelled observations) and the cost of prediction errors. We…

Machine Learning · Computer Science 2024-05-16 Maxime Heuillet , Ola Ahmad , Audrey Durand

Meta-learning is a promising strategy for learning to efficiently learn within new tasks, using data gathered from a distribution of tasks. However, the meta-learning literature thus far has focused on the task segmented setting, where at…

Machine Learning · Computer Science 2020-10-22 James Harrison , Apoorva Sharma , Chelsea Finn , Marco Pavone

The transition of the power grid requires new technologies and methodologies, which can only be developed and tested in simulations. Especially larger simulation setups with many levels of detail can become quite slow. Therefore, the number…

Signal Processing · Electrical Eng. & Systems 2020-06-23 Stephan Balduin , Tom Westermann , Erika Puiutta

As the most important solvent, water has been at the center of interest since the advent of computer simulations. While early molecular dynamics and Monte Carlo simulations had to make use of simple model potentials to describe the atomic…

Soft Condensed Matter · Physics 2024-02-01 Amir Omranpour , Pablo Montero De Hijes , Jörg Behler , Christoph Dellago

Predictive simulations are essential for applications ranging from weather forecasting to material design. The veracity of these simulations hinges on their capacity to capture the effective system dynamics. Massively parallel simulations…

Recent advances in parallel computing and GPU acceleration have created new opportunities for computation-intensive learning problems such as Active SLAM -- where actions are selected to reduce uncertainty and improve joint mapping and…

Robotics · Computer Science 2026-03-30 Martín Arce Llobera , Julio A. Placed , Mariano De Paula , Pablo De Cristóforis

We present two elegant solutions for modeling continuous-time dynamics, in a novel model-based reinforcement learning (RL) framework for semi-Markov decision processes (SMDPs), using neural ordinary differential equations (ODEs). Our models…

Machine Learning · Computer Science 2020-10-27 Jianzhun Du , Joseph Futoma , Finale Doshi-Velez

Neural networks are very effective when trained on large datasets for a large number of iterations. However, when they are trained on non-stationary streams of data and in an online fashion, their performance is reduced (1) by the online…

Machine Learning · Computer Science 2023-07-04 Albin Soutif--Cormerais , Antonio Carta , Joost Van de Weijer

Dynamic resource management has become one of the major areas of research in modern computer and communication system design due to lower power consumption and higher performance demands. The number of integrated cores, level of…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-08-25 Sumit K. Mandal , Umit Y. Ogras , Janardhan Rao Doppa , Raid Z. Ayoub , Michael Kishinevsky , Partha P. Pande

Learning agents that excel at sequential decision-making tasks must continuously resolve the problem of exploration and exploitation for optimal learning. However, such interactions with the environment online might be prohibitively…

Machine Learning · Computer Science 2024-12-30 Ambedkar Dukkipati , Ranga Shaarad Ayyagari , Bodhisattwa Dasgupta , Parag Dutta , Prabhas Reddy Onteru

In recent years, model-free methods that use deep learning have achieved great success in many different reinforcement learning environments. Most successful approaches focus on solving a single task, while multi-task reinforcement learning…

Machine Learning · Computer Science 2017-05-25 Asier Mujika

We propose a machine learning framework to accelerate numerical computations of time-dependent ODEs and PDEs. Our method is based on recasting (generalizations of) existing numerical methods as artificial neural networks, with a set of…

Numerical Analysis · Mathematics 2019-03-08 Siddhartha Mishra

We propose a simplified, biologically inspired predictive local learning rule that eliminates the need for global backpropagation in conventional neural networks and membrane integration in event-based training. Weight updates are triggered…

Hardware Architecture · Computer Science 2025-12-29 Zhenya Zang , Xingda Li , David Day Uei Li