English
Related papers

Related papers: Deep Spectral Q-learning with Application to Mobil…

200 papers

The research explores the utilization of a deep learning model employing an attention mechanism in medical text mining. It targets the challenge of analyzing unstructured text information within medical data. This research seeks to enhance…

Computation and Language · Computer Science 2024-06-04 Lingxi Xiao , Muqing Li , Yinqiu Feng , Meiqi Wang , Ziyi Zhu , Zexi Chen

We propose a new Q-learning variant, called 2RA Q-learning, that addresses some weaknesses of existing Q-learning methods in a principled manner. One such weakness is an underlying estimation bias which cannot be controlled and often…

Optimization and Control · Mathematics 2024-05-30 Peter Schmitt-Förster , Tobias Sutter

Medical treatments often involve a sequence of decisions, each informed by previous outcomes. This process closely aligns with reinforcement learning (RL), a framework for optimizing sequential decisions to maximize cumulative rewards under…

Machine Learning · Computer Science 2024-10-15 Ali Shirali , Alexander Schubert , Ahmed Alaa

Coherent control, a central concept in physics and chemistry, has sparked significant interest due to its ability to fine-tune interference effects in atoms and individual molecules for applications ranging from light-harvesting complexes…

Quantum Physics · Physics 2026-01-07 Juan M. Scarpetta , Omar Calderón-Losada , Morten Hjorth-Jensen , John H. Reina

Principal Component Analysis (PCA) is the workhorse tool for dimensionality reduction in this era of big data. While often overlooked, the purpose of PCA is not only to reduce data dimensionality, but also to yield features that are…

Machine Learning · Computer Science 2021-11-30 Arpita Gang , Waheed U. Bajwa

In this paper, the problem of dynamic spectrum sensing and aggregation is investigated in a wireless network containing N correlated channels, where these channels are occupied or vacant following an unknown joint 2-state Markov model. At…

Signal Processing · Electrical Eng. & Systems 2020-07-29 Yunzeng Li , Wensheng Zhang , Cheng-Xiang Wang , Jian Sun , Yu Liu

We study attention mechanisms through the lens of a canonical unsupervised problem: principal component analysis (PCA). We show that, when trained on Gaussian data, both softmax and linear attention layers learn parameters that align with…

Optimization and Control · Mathematics 2026-05-19 Rodrigo Maulen-Soto , Claire Boyer

We consider the problem of distributed downlink beam scheduling and power allocation for millimeter-Wave (mmWave) cellular networks where multiple base stations (BSs) belonging to different service operators share the same unlicensed…

Information Theory · Computer Science 2021-10-19 Xiang Zhang , Shamik Sarkar , Arupjyoti Bhuyan , Sneha Kumar Kasera , Mingyue Ji

The use of target networks is a common practice in deep reinforcement learning for stabilizing the training; however, theoretical understanding of this technique is still limited. In this paper, we study the so-called periodic Q-learning…

Machine Learning · Computer Science 2020-02-25 Donghwan Lee , Niao He

We present a systematic investigation of deep learning methods applied to quantum error mitigation of noisy output probability distributions from measured quantum circuits. We compare different architectures, from fully connected neural…

Phase recovery, calculating the phase of a light wave from its intensity measurements, is essential for various applications, such as coherent diffraction imaging, adaptive optics, and biomedical imaging. It enables the reconstruction of an…

Image and Video Processing · Electrical Eng. & Systems 2024-09-19 Kaiqiang Wang , Edmund Y. Lam

We study probabilistic cellular automata (PCA) and quantum cellular automata (QCA) as frameworks for solving the Maximum Independent Set (MIS) problem. We first introduce a synchronous PCA whose dynamics drives the system toward the…

Quantum Physics · Physics 2025-12-09 Federico Dell'Anna , Matteo Grotti , Vito Giardinelli

The most important characteristic of a Quantum Key Distribution (QKD) protocol is its security against third-party attacks, and the potential countermeasures available. While new types of attacks are regularly developed in the literature,…

Quantum Physics · Physics 2025-10-21 Théo Lejeune , François Damanet

An improvement of Q-learning is proposed in this paper. It is different from classic Q-learning in that the similarity between different states and actions is considered in the proposed method. During the training, a new updating mechanism…

Artificial Intelligence · Computer Science 2021-06-03 Wei Liao , Xiaohui Wei , Jizhou Lai

In this work, we investigate the phenomenon of spectral bias in quantum machine learning, where, in classical settings, models tend to fit low-frequency components of a target function earlier during training than high-frequency ones,…

Quantum Physics · Physics 2026-01-09 Callum Duffy , Marcin Jastrzebski

Deep Q-learning is investigated as an end-to-end solution to estimate the optimal strategies for acting on time series input. Experiments are conducted on two idealized trading games. 1) Univariate: the only input is a wave-like price time…

Machine Learning · Computer Science 2018-03-13 Xiang Gao

Spectral algorithms leverage spectral regularization techniques to analyze and process data, providing a flexible framework for addressing supervised learning problems. To deepen our understanding of their performance in real-world…

Machine Learning · Statistics 2025-07-23 Jun Fan , Zheng-Chu Guo , Lei Shi

The optimal prophylaxis, and treatment if the prophylaxis fails, for a disease may be best evaluated using a sequential multiple assignment randomised trial (SMART). A SMART is a multi-stage study that randomises a participant to an initial…

Methodology · Statistics 2022-03-25 Robert K. Mahar , Katherine J. Lee , Bibhas Chakraborty , Agus Salim , Julie A. Simpson

The deep Q-network (DQN) and return-based reinforcement learning are two promising algorithms proposed in recent years. DQN brings advances to complex sequential decision problems, while return-based algorithms have advantages in making use…

Machine Learning · Computer Science 2019-12-02 Wenjia Meng , Qian Zheng , Long Yang , Pengfei Li , Gang Pan

In dynamic spectrum access (DSA) networks, secondary users (SUs) need to opportunistically access primary users' (PUs) radio spectrum without causing significant interference. Since the interaction between the SU and the PU systems are…

Signal Processing · Electrical Eng. & Systems 2023-05-22 Ramin Safavinejad , Hao-Hsuan Chang , Lingjia Liu