English
Related papers

Related papers: Drift is a Sampling Error: SNR-Aware Power Distrib…

200 papers

While deep reinforcement learning methods have shown impressive results in robot learning, their sample inefficiency makes the learning of complex, long-horizon behaviors with real robot systems infeasible. To mitigate this issue,…

Machine Learning · Computer Science 2022-04-26 Taewook Nam , Shao-Hua Sun , Karl Pertsch , Sung Ju Hwang , Joseph J Lim

Traffic state prediction in a transportation network is paramount for effective traffic operations and management, as well as informed user and system-level decision-making. However, long-term traffic prediction (beyond 30 minutes into the…

Machine Learning · Computer Science 2022-11-08 Bin Lei , Shaoyi Huang , Caiwen Ding , Monika Filipovska

This paper addresses the problem of learning optimal control policies for systems with uncertain dynamics and high-level control objectives specified as Linear Temporal Logic (LTL) formulas. Uncertainty is considered in the workspace…

Robotics · Computer Science 2024-10-17 Yiannis Kantaros , Jun Wang

A fundamental problem for waveform-agile radar systems is that the true environment is unknown, and transmission policies which perform well for a particular tracking instance may be sub-optimal for another. Additionally, there is a limited…

Information Theory · Computer Science 2021-10-25 Charles E. Thornton , R. Michael Buehrer , Anthony F. Martone

When deploying autonomous agents in unstructured environments over sustained periods of time, adaptability and robustness oftentimes outweigh optimality as a primary consideration. In other words, safety and survivability constraints play a…

Systems and Control · Electrical Eng. & Systems 2021-04-08 Motoya Ohnishi , Gennaro Notomista , Masashi Sugiyama , Magnus Egerstedt

The feasibility of collecting a large amount of expert demonstrations has inspired growing research interests in learning-to-drive settings, where models learn by imitating the driving behaviour from experts. However, exclusively relying on…

Robotics · Computer Science 2022-12-20 Jonathan Francis , Bingqing Chen , Weiran Yao , Eric Nyberg , Jean Oh

Reinforcement learning algorithms are typically designed for discrete-time dynamics, even though the underlying real-world control systems are often continuous in time. In this paper, we study the problem of continuous-time reinforcement…

Machine Learning · Computer Science 2026-03-03 Klemens Iten , Lenart Treven , Bhavya Sukhija , Florian Dörfler , Andreas Krause

A machine learning method needs to adapt to over time changes in the environment. Such changes are known as concept drift. In this paper, we propose concept drift tackling method as an enhancement of Online Sequential Extreme Learning…

Artificial Intelligence · Computer Science 2016-10-10 Arif Budiman , Mohamad Ivan Fanany , Chan Basaruddin

Model Predictive Control (MPC) is a state-of-the-art (SOTA) control technique which requires solving hard constrained optimization problems iteratively. For uncertain dynamics, analytical model based robust MPC imposes additional…

Robotics · Computer Science 2023-02-27 Sourav Sanyal , Kaushik Roy

Load forecasting is a crucial topic in energy management systems (EMS) due to its vital role in optimizing energy scheduling and enabling more flexible and intelligent power grid systems. As a result, these systems allow power utility…

Machine Learning · Computer Science 2023-05-16 Firas Bayram , Phil Aupke , Bestoun S. Ahmed , Andreas Kassler , Andreas Theocharis , Jonas Forsman

In this paper we show an effective means of integrating data driven frameworks to sampling based optimal control to vastly reduce the compute time for easy adoption and adaptation to real time applications such as on-road autonomous driving…

Robotics · Computer Science 2023-10-23 Kaustab Pal , Aditya Sharma , Mohd Omama , Parth N. Shah , K. Madhava Krishna

This paper presents a new parameter estimation algorithm for the adaptive control of a class of time-varying plants. The main feature of this algorithm is a matrix of time-varying learning rates, which enables parameter estimation error…

Optimization and Control · Mathematics 2021-11-18 Joseph E. Gaudio , Anuradha M. Annaswamy , Eugene Lavretsky , Michael A. Bolender

Deep Reinforcement Learning (DRL) has become a popular method for solving control problems in power systems. Conventional DRL encourages the agent to explore various policies encoded in a neural network (NN) with the goal of maximizing the…

Systems and Control · Electrical Eng. & Systems 2024-10-28 Tong Wu , Anna Scaglione , Daniel Arnold

Recent advances have shown that sequential fine-tuning (SeqFT) of pre-trained vision transformers (ViTs), followed by classifier refinement using approximate distributions of class features, can be an effective strategy for…

Computer Vision and Pattern Recognition · Computer Science 2025-11-14 Xuan Rao , Simian Xu , Zheng Li , Bo Zhao , Derong Liu , Mingming Ha , Cesare Alippi

This paper studies the use of Metropolis-Hastings sampling for training Spiking Neural Network (SNN) hardware subject to strong unknown non-idealities, and compares the proposed approach to the common use of the backpropagation of error…

Neural and Evolutionary Computing · Computer Science 2024-02-12 Ali Safa , Vikrant Jaltare , Samira Sebt , Kameron Gano , Johannes Leugering , Georges Gielen , Gert Cauwenberghs

Gradient-based meta-learning techniques aim to distill useful prior knowledge from a set of training tasks such that new tasks can be learned more efficiently with gradient descent. While these methods have achieved successes in various…

Machine Learning · Computer Science 2023-10-16 Mike Huisman , Aske Plaat , Jan N. van Rijn

We present a modelling framework for the investigation of supervised learning in non-stationary environments. Specifically, we model two example types of learning systems: prototype-based Learning Vector Quantization (LVQ) for…

Machine Learning · Computer Science 2021-04-30 Michiel Straat , Fthi Abadi , Zhuoyun Kan , Christina Göpfert , Barbara Hammer , Michael Biehl

The brain is a nonlinear and highly Recurrent Neural Network (RNN). This RNN is surprisingly plastic and supports our astonishing ability to learn and execute complex tasks. However, learning is incredibly complicated due to the brain's…

Neural and Evolutionary Computing · Computer Science 2023-03-14 Mohammad Modiri

Machine learning traditionally assumes that the training and testing data are distributed independently and identically. However, in many real-world settings, the data distribution can shift over time, leading to poor generalization of…

Machine Learning · Computer Science 2024-02-19 Sepidehsadat Hosseini , Mengyao Zhai , Hossein Hajimirsadegh , Frederick Tung

In a conventional supervised learning setting, a machine learning model has access to examples of all object classes that are desired to be recognized during the inference stage. This results in a fixed model that lacks the flexibility to…

Computer Vision and Pattern Recognition · Computer Science 2020-01-27 Jathushan Rajasegaran , Munawar Hayat , Salman Khan , Fahad Shahbaz Khan , Ling Shao , Ming-Hsuan Yang