English
Related papers

Related papers: Uncertainty-Weighted Experience Replay for Continu…

200 papers

Residual error propagation remains a fundamental problem in recurrent models, where small prediction inaccuracies compound over time and degrade long-horizon performance. Accurately modeling the correlation structure of such residuals is…

Machine Learning · Computer Science 2026-05-19 Seyed Mohamad Moghadas , Esther Rodrigo Bonet , Bruno Cornelis , Adrian Munteanu

Wireless communications systems are impacted by multi-path fading and Doppler shift in dynamic environments, where the channel becomes doubly-dispersive and its estimation becomes an arduous task. Only a few pilots are used for channel…

Information Theory · Computer Science 2022-06-07 Abdul Karim Gizzini , Marwa Chafii

Continual learning is the one of the most essential abilities for autonomous agents, which can incrementally learn daily-life skills. For this ultimate goal, a simple but powerful method, dark experience replay (DER), has been proposed…

Machine Learning · Computer Science 2026-02-25 Taisuke Kobayashi

MIMO systems in the context of 6G Vehicle-to-Everything (V2X) will require an accurate channel knowledge to enable efficient communication. Standard channel estimation techniques, such as Unconstrained Maximum Likelihood (U-ML), are…

In wireless communication, accurate channel state information (CSI) is of pivotal importance. In practice, due to processing and feedback delays, estimated CSI can be outdated, which can severely deteriorate the performance of the…

Signal Processing · Electrical Eng. & Systems 2021-04-02 Muhammad Karam Shehzad , Luca Rose , Mohamad Assaad

Estimation is a critical component of synchronization in wireless and signal processing systems. There is a rich body of work on estimator derivation, optimization, and statistical characterization from analytic system models which are used…

Machine Learning · Computer Science 2017-07-21 Timothy J. O'Shea , Kiran Karra , T. Charles Clancy

As a critical component of sixth-generation (6G) wireless networks, ultra-reliable and low-latency communication (URLLC) is expected to support real-time and reliable information exchange in low-altitude environments. However, achieving…

Signal Processing · Electrical Eng. & Systems 2026-05-15 Donggen Li , Chong Huang , Jingfu Li , Pei Xiao , Wenjiang Feng , Dusit Niyato , Zhu Han

\textit{Why does the literature consider the channel-state-information (CSI) as a 2/3-D image? What are the pros-and-cons of this consideration for accuracy-complexity trade-off?} Next generations of wireless communications require…

Information Theory · Computer Science 2020-01-22 Makan Zamanipour

We present a novel approach of 2D to 3D transfer learning based on mapping pre-trained 2D convolutional neural network weights into planar 3D kernels. The method is validated by the proposed planar 3D res-u-net network with encoder…

Computer Vision and Pattern Recognition · Computer Science 2020-11-24 Martin Kolarik , Radim Burget , Carlos M. Travieso-Gonzalez , Jan Kocica

Subsampling techniques can reduce the computational costs of processing big data. Practical subsampling plans typically involve initial uniform sampling and refined sampling. With a subsample, big data inferences are generally built on the…

Methodology · Statistics 2022-09-13 Yan Fan , Yang Liu , Yukun Liu , Jing Qin

Offline Reinforcement Learning promises to learn effective policies from previously-collected, static datasets without the need for exploration. However, existing Q-learning and actor-critic based off-policy RL algorithms fail when…

Machine Learning · Computer Science 2021-05-19 Yue Wu , Shuangfei Zhai , Nitish Srivastava , Joshua Susskind , Jian Zhang , Ruslan Salakhutdinov , Hanlin Goh

Current Semi-supervised Learning (SSL) adopts the pseudo-labeling strategy and further filters pseudo-labels based on confidence thresholds. However, this mechanism has notable drawbacks: 1) setting the reasonable threshold is an open…

Computer Vision and Pattern Recognition · Computer Science 2025-03-14 Jiaqi Wu , Junbiao Pang , Qingming Huang

We present a control method for improved repetitive path following for a ground vehicle that is geared towards long-term operation where the operating conditions can change over time and are initially unknown. We use weighted Bayesian…

Robotics · Computer Science 2019-04-10 Christopher D. McKinnon , Angela P. Schoellig

In online continual learning, a neural network incrementally learns from a non-i.i.d. data stream. Nearly all online continual learning methods employ experience replay to simultaneously prevent catastrophic forgetting and underfitting on…

Machine Learning · Computer Science 2024-07-22 Jason Yoo , Yunpeng Liu , Frank Wood , Geoff Pleiss

Electronic health records (EHR) consist of longitudinal clinical observations portrayed with sparsity, irregularity, and high-dimensionality, which become major obstacles in drawing reliable downstream clinical outcomes. Although there…

Machine Learning · Computer Science 2020-11-17 Ahmad Wisnu Mulyadi , Eunji Jun , Heung-Il Suk

Downlink beamforming is a key technology for cellular networks. However, computing the transmit beamformer that maximizes the weighted sum rate subject to a power constraint is an NP-hard problem. As a result, iterative algorithms that…

Signal Processing · Electrical Eng. & Systems 2020-06-16 Lissy Pellaco , Mats Bengtsson , Joakim Jaldén

The Unscented Kalman Filter (UKF) is a ubiquitous tool for nonlinear state estimation; however, its performance is limited by the static parameterization of the Unscented Transform (UT). Conventional weighting schemes, governed by fixed…

Machine Learning · Computer Science 2026-03-05 Kenan Majewski , Michał Modzelewski , Marcin Żugaj , Piotr Lichota

Downlink beamforming is an essential technology for wireless cellular networks; however, the design of beamforming vectors that maximize the weighted sum rate (WSR) is an NP-hard problem and iterative algorithms are typically applied to…

Signal Processing · Electrical Eng. & Systems 2022-06-28 Jingyuan Xia , Gunduz Deniz

The reliability assessment of a machine learning model's prediction is an important quantity for the deployment in safety critical applications. Not only can it be used to detect novel sceneries, either as out-of-distribution or anomaly…

Machine Learning · Computer Science 2022-05-12 Steve Dias Da Cruz , Bertram Taetz , Thomas Stifter , Didier Stricker

The downlink channel state information (CSI) estimation and low overhead acquisition are the major challenges for massive MIMO systems in frequency division duplex to enable high MIMO gain. Recently, numerous studies have been conducted to…

Information Theory · Computer Science 2023-08-07 Mingming Zhao , Lin Liu , Lifu Liu , Mengke Li , Qi Tian