English
Related papers

Related papers: Spatio-temporal Value Semantics-based Abstraction …

200 papers

In multiple-input multiple-output (MIMO) systems, it is crucial of utilizing the available channel state information (CSI) at the transmitter for precoding to improve the performance of frequency division duplex (FDD) networks. One of the…

Signal Processing · Electrical Eng. & Systems 2022-04-28 Xiangyi Li , Huaming Wu

Utilizing Deep Reinforcement Learning (DRL) for Reconfigurable Intelligent Surface (RIS) assisted wireless communication has been extensively researched. However, existing DRL methods either act as a simple optimizer or only solve problems…

Systems and Control · Electrical Eng. & Systems 2026-01-19 Meng-Qian Alexander Wu , Tzu-Hsien Sang , Luisa Schuhmacher , Ming-Jie Guo , Khodr Hammoud , Sofie Pollin

Existing automatic 3D image segmentation methods usually fail to meet the clinic use. Many studies have explored an interactive strategy to improve the image segmentation performance by iteratively incorporating user hints. However, the…

Computer Vision and Pattern Recognition · Computer Science 2019-11-26 Xuan Liao , Wenhao Li , Qisen Xu , Xiangfeng Wang , Bo Jin , Xiaoyun Zhang , Ya Zhang , Yanfeng Wang

Empowered by deep neural networks, deep reinforcement learning (DRL) has demonstrated tremendous empirical successes in various domains, including games, health care, and autonomous driving. Despite these advancements, DRL is still…

Machine Learning · Computer Science 2024-01-22 Dayang Liang , Yaru Zhang , Yunlong Liu

We present a novel method for Deep Reinforcement Learning (DRL), incorporating the convex property of the value function over the belief space in Partially Observable Markov Decision Processes (POMDPs). We introduce hard- and soft-enforced…

Machine Learning · Computer Science 2025-03-13 Daniel Koutas , Daniel Hettegger , Kostas G. Papakonstantinou , Daniel Straub

With the excellent representation capabilities of Pre-Trained Models (PTMs), remarkable progress has been made in non-rehearsal Class-Incremental Learning (CIL) research. However, it remains an extremely challenging task due to three…

Computer Vision and Pattern Recognition · Computer Science 2025-10-15 Jiawei Zhan , Jun Liu , Jinlong Peng , Xiaochen Chen , Bin-Bin Gao , Yong Liu , Chengjie Wang

Deep reinforcement learning (DRL) is a well-suited approach to financial decision-making, where an agent makes decisions based on its trading strategy developed from market observations. Existing DRL intraday trading strategies mainly use…

Trading and Market Microstructure · Quantitative Finance 2024-06-13 Sven Goluža , Tomislav Kovačević , Tessa Bauman , Zvonko Kostanjčar

Contrastive Reinforcement Learning (CRL) provides a promising framework for extracting useful structured representations from unlabeled interactions. By pulling together state-action pairs and their corresponding future states, while…

Robotics · Computer Science 2025-07-23 Arsh Tangri , Nichols Crawford Taylor , Haojie Huang , Robert Platt

Effective agent exploration remains a core challenge in reinforcement learning (RL) for complex discrete state-space environments, particularly under partial observability. This paper presents a decoupled hierarchical RL framework…

Machine Learning · Computer Science 2025-06-04 Qingyu Xiao , Yuanlin Chang , Youtian Du

How can a robot safely navigate around people with complex motion patterns? Deep Reinforcement Learning (DRL) in simulation holds some promise, but much prior work relies on simulators that fail to capture the nuances of real human motion.…

Robotics · Computer Science 2025-02-17 James R. Han , Hugues Thomas , Jian Zhang , Nicholas Rhinehart , Timothy D. Barfoot

Deep reinforcement learning (DRL) is a promising approach for developing legged locomotion skills. However, the iterative design process that is inevitable in practice is poorly supported by the default methodology. It is difficult to…

Robotics · Computer Science 2019-03-25 Zhaoming Xie , Patrick Clary , Jeremy Dao , Pedro Morais , Jonathan Hurst , Michiel van de Panne

Reinforcement Learning (RL) based methods have seen their paramount successes in solving serial decision-making and control problems in recent years. For conventional RL formulations, Markov Decision Process (MDP) and state-action-value…

Machine Learning · Computer Science 2020-06-09 Ziyao Zhang , Liang Ma , Kin K. Leung , Konstantinos Poularakis , Mudhakar Srivatsa

The proliferation of Internet of Things (IoT) devices and the advent of 6G technologies have introduced computationally intensive tasks that often surpass the processing capabilities of user devices. Efficient and secure resource allocation…

Machine Learning · Computer Science 2025-01-22 Jianfei Sun , Qiang Gao , Cong Wu , Yuxian Li , Jiacheng Wang , Dusit Niyato

We propose a novel generalization of constrained Markov decision processes (CMDPs) that we call the \emph{semi-infinitely constrained Markov decision process} (SICMDP). Particularly, we consider a continuum of constraints instead of a…

Machine Learning · Computer Science 2023-05-02 Liangyu Zhang , Yang Peng , Wenhao Yang , Zhihua Zhang

Deep Reinforcement Learning (DRL) is a trending field of research, showing great promise in many challenging problems such as playing Atari, solving Go and controlling robots. While DRL agents perform well in practice we are still missing…

Machine Learning · Statistics 2016-06-24 Nir Ben Zrihem , Tom Zahavy , Shie Mannor

Reinforcement learning (RL) is currently one of the most prominent methods for optimizing dynamical systems, with breakthrough results across various fields. The framework is based on the concept of a Markov decision process (MDP), leading…

Optimization and Control · Mathematics 2025-11-17 Rene Carmona , Mathieu Lauriere

Endoscopic video analysis is essential for early gastrointestinal screening but remains hindered by limited high-quality annotations. While self-supervised video pre-training shows promise, existing methods developed for natural videos…

Computer Vision and Pattern Recognition · Computer Science 2026-03-30 Yuan Zhang , Sihao Dou , Kai Hu , Shuhua Deng , Chunhong Cao , Fen Xiao , Xieping Gao

The emergent technology of Reconfigurable Intelligent Surfaces (RISs) has the potential to transform wireless environments into controllable systems, through programmable propagation of information-bearing signals. Techniques stemming from…

Information Theory · Computer Science 2022-02-17 Kyriakos Stylianopoulos , George Alexandropoulos , Chongwen Huang , Chau Yuen , Mehdi Bennis , and Mérouane Debbah

A novel reinforcement learning scheme to synthesize policies for continuous-space Markov decision processes (MDPs) is proposed. This scheme enables one to apply model-free, off-the-shelf reinforcement learning algorithms for finite MDPs to…

Systems and Control · Electrical Eng. & Systems 2020-03-03 Abolfazl Lavaei , Fabio Somenzi , Sadegh Soudjani , Ashutosh Trivedi , Majid Zamani

We study an approach to offline reinforcement learning (RL) based on optimally solving finitely-represented MDPs derived from a static dataset of experience. This approach can be applied on top of any learned representation and has the…

Machine Learning · Computer Science 2025-02-06 Aayam Shrestha , Stefan Lee , Prasad Tadepalli , Alan Fern