English
Related papers

Related papers: A Reinforcement Learning Approach for Sequential S…

200 papers

In resource-constrained environments, one can employ spatial multiplexing cameras to acquire a small number of measurements of a scene, and perform effective reconstruction or high-level inference using purely data-driven neural networks.…

Computer Vision and Pattern Recognition · Computer Science 2018-09-11 Suhas Lohit , Rajhans Singh , Kuldeep Kulkarni , Pavan Turaga

This paper targets the efficient construction of a safety shield for decision making in scenarios that incorporate uncertainty. Markov decision processes (MDPs) are prominent models to capture such planning problems. Reinforcement learning…

Artificial Intelligence · Computer Science 2019-11-26 Nils Jansen , Bettina Könighofer , Sebastian Junges , Alexandru C. Serban , Roderick Bloem

In this work, we first describe a framework for the application of Reinforcement Learning (RL) control to a radar system that operates in a congested spectral setting. We then compare the utility of several RL algorithms through a…

Machine Learning · Computer Science 2020-06-24 Charles E. Thornton , R. Michael Buehrer , Anthony F. Martone , Kelly D. Sherbondy

Much research has been done to analyze the stock market. After all, if one can determine a pattern in the chaotic frenzy of transactions, then they could make a hefty profit from capitalizing on these insights. As such, the goal of our…

Machine Learning · Computer Science 2025-05-27 Ziyi Zhou , Nicholas Stern , Julien Laasri

This paper introduces an efficient Residual Reinforcement Learning (RRL) framework for voltage control in active distribution grids. Voltage control remains a critical challenge in distribution grids, where conventional Reinforcement…

Systems and Control · Electrical Eng. & Systems 2025-12-30 Sarra Bouchkati , Ramil Sabirov , Steffen Kortmann , Andreas Ulbig

This study introduces a novel supervised learning approach for spiking neural networks that does not rely on traditional backpropagation. Instead, it employs spike-timing-dependent plasticity (STDP) within a supervised framework for image…

Computer Vision and Pattern Recognition · Computer Science 2025-02-13 Wei Xie

Renewable energy resources (RERs) have been increasingly integrated into distribution networks (DNs) for decarbonization. However, the variable nature of RERs introduces uncertainties to DNs, frequently resulting in voltage fluctuations…

Systems and Control · Electrical Eng. & Systems 2024-01-30 Jinhao Li , Ruichang Zhang , Hao Wang , Zhi Liu , Hongyang Lai , Yanru Zhang

The sim-to-real gap, which represents the disparity between training and testing environments, poses a significant challenge in reinforcement learning (RL). A promising approach to addressing this challenge is distributionally robust RL,…

Machine Learning · Computer Science 2024-11-05 Miao Lu , Han Zhong , Tong Zhang , Jose Blanchet

Humans achieve efficient learning by relying on prior knowledge about the structure of naturally occurring tasks. There is considerable interest in designing reinforcement learning (RL) algorithms with similar properties. This includes…

Machine Learning · Computer Science 2019-10-23 Jan Humplik , Alexandre Galashov , Leonard Hasenclever , Pedro A. Ortega , Yee Whye Teh , Nicolas Heess

In image classification task, feature extraction is always a big issue. Intra-class variability increases the difficulty in designing the extractors. Furthermore, hand-crafted feature extractor cannot simply adapt new situation. Recently,…

Computer Vision and Pattern Recognition · Computer Science 2020-06-18 Chieh-Ning Fang , Chin-Teng Lin

This paper contributes to a development of randomized methods for neural networks. The proposed learner model is generated incrementally by stochastic configuration (SC) algorithms, termed as Stochastic Configuration Networks (SCNs). In…

Neural and Evolutionary Computing · Computer Science 2018-02-14 Dianhui Wang , Ming Li

Table structure recognition (TSR) aims to convert tabular images into a machine-readable format. Although hybrid convolutional neural network (CNN)-transformer architecture is widely used in existing approaches, linear projection…

Computer Vision and Pattern Recognition · Computer Science 2024-02-27 ShengYun Peng , Seongmin Lee , Xiaojing Wang , Rajarajeswari Balasubramaniyan , Duen Horng Chau

Based on its great successes in inference and denosing tasks, Dictionary Learning (DL) and its related sparse optimization formulations have garnered a lot of research interest. While most solutions have focused on single layer…

Machine Learning · Computer Science 2021-04-22 Wen Tang , Emilie Chouzenoux , Jean-Christophe Pesquet , Hamid Krim

Spiking Neural Networks (SNNs) are brain-inspired, event-driven machine learning algorithms that have been widely recognized in producing ultra-high-energy-efficient hardware. Among existing SNNs, unsupervised SNNs based on synaptic…

Neural and Evolutionary Computing · Computer Science 2022-09-20 Mingyuan Meng , Xingyu Yang , Lei Bi , Jinman Kim , Shanlin Xiao , Zhiyi Yu

Interpretability of AI models allows for user safety checks to build trust in these models. In particular, decision trees (DTs) provide a global view on the learned model and clearly outlines the role of the features that are critical to…

Machine Learning · Computer Science 2023-04-13 Hector Kohler , Riad Akrour , Philippe Preux

Despite the successful application of machine learning (ML) in a wide range of domains, adaptability---the very property that makes machine learning desirable---can be exploited by adversaries to contaminate training and evade…

We study model-based reinforcement learning (RL) for episodic Markov decision processes (MDP) whose transition probability is parametrized by an unknown transition core with features of state and action. Despite much recent progress in…

Machine Learning · Statistics 2024-11-19 Taehyun Hwang , Min-hwan Oh

Recurrent Neural Networks (RNNs) achieve state-of-the-art results in many sequence-to-sequence modeling tasks. However, RNNs are difficult to train and tend to suffer from overfitting. Motivated by the Data Processing Inequality (DPI), we…

Machine Learning · Statistics 2018-05-24 Ziv Aharoni , Gal Rattner , Haim Permuter

Transformer-based Spiking Neural Networks (SNNs) suffer from a great performance gap compared to floating-point \mbox{Artificial} Neural Networks (ANNs) due to the binary nature of spike trains. Recent efforts have introduced deep-level…

Neural and Evolutionary Computing · Computer Science 2025-08-12 Zeqi Zheng , Zizheng Zhu , Yingchao Yu , Yanchen Huang , Changze Lv , Junfeng Tang , Zhaofei Yu , Yaochu Jin

Deep Learning (DL) has shown potential in accelerating Magnetic Resonance Image acquisition and reconstruction. Nevertheless, there is a dearth of tailored methods to guarantee that the reconstruction of small features is achieved with high…

Image and Video Processing · Electrical Eng. & Systems 2021-04-28 Francesco Calivá , Kaiyang Cheng , Rutwik Shah , Valentina Pedoia