English
Related papers

Related papers: Regularized adaptive long autoregressive spectral …

200 papers

Shuffled linear regression (SLR) seeks to estimate latent features through a linear transformation, complicated by unknown permutations in the measurement dimensions. This problem extends traditional least-squares (LS) and Least Absolute…

Statistics Theory · Mathematics 2025-04-17 Hang Liu , Anna Scaglione

We propose spectral methods for long-term forecasting of temporal signals stemming from linear and nonlinear quasi-periodic dynamical systems. For linear signals, we introduce an algorithm with similarities to the Fourier transform but…

Machine Learning · Computer Science 2020-04-02 Henning Lange , Steven L. Brunton , Nathan Kutz

Consider semiparametric estimation where a doubly robust estimating function for a low-dimensional parameter is available, depending on two working models. With high-dimensional data, we develop regularized calibrated estimation as a…

Methodology · Statistics 2020-09-28 Satyajit Ghosh , Zhiqiang Tan

Sequence modeling faces challenges in capturing long-range dependencies across diverse tasks. Recent linear and transformer-based forecasters have shown superior performance in time series forecasting. However, they are constrained by their…

Machine Learning · Computer Science 2024-11-25 Bong Gyun Kang , Dongjun Lee , HyunGi Kim , DoHyun Chung , Sungroh Yoon

We present a data-assisted iterative regularization method for solving ill-posed inverse problems. The proposed approach, termed \texttt{IRMGL+\(\Psi\)}, integrates classical iterative techniques with a data-driven regularization term…

Numerical Analysis · Mathematics 2025-10-28 Harshit Bajpai , Gaurav Mittal , Ankik Kumar Giri

Matrix-variate time series data are increasingly popular in economics, statistics, and environmental studies, among other fields. This paper develops regularized estimation methods for analyzing high-dimensional matrix-variate time series…

Methodology · Statistics 2024-10-16 Hangjin Jiang , Baining Shen , Yuzhou Li , Zhaoxing Gao

Since the innovation of the ubiquitous Kalman filter more than five decades back it is well known that to obtain the best possible estimates the tuning of its statistics $X_0$, $P_0$, $\Theta$, $R$ and $Q$ namely initial state and…

Methodology · Statistics 2015-05-28 M. R. Ananthasayanam , Shyam Mohan M , Naren Naik , R. M. O. Gemson

We reformulate the gain correction problem of the radio interferometry as an optimization problem with regularization, which is solved efficiently with an iterative algorithm. Combining this new method with our previously proposed imaging…

Instrumentation and Methods for Astrophysics · Physics 2024-12-05 Shiro Ikeda , Takeshi Nakazato , Takashi Tsukagoshi , Tsutomu T. Takeuchi , Masayuki Yamaguchi

Incorporation of external information into high-dimensional modeling for gene expression data has been shown, both theoretically and empirically, to substantially enhance performance. Such external information, sometimes referred to as…

Methodology · Statistics 2026-04-17 Fuzhi Xu , Weijuan Liang , Shuangge Ma , Qingzhao Zhang

State estimation is a fundamental problem in control and signal processing, for which the Kalman Filter provides an optimal solution under linear dynamics, Gaussian noise, and known noise covariances. However, these assumptions often fail…

Machine Learning · Computer Science 2026-05-27 Vasileios Saketos , Ming Xiao

Kalman filtering is a cornerstone of estimation theory, yet learning the optimal filter under unknown and potentially singular noise covariances remains a fundamental challenge. In this paper, we revisit this problem through the lens of…

Systems and Control · Electrical Eng. & Systems 2026-04-08 Larsen Bier , Shahriar Talebi

This research enhances linear regression models by integrating a Kalman filter and analysing curve areas to minimize loss. The goal is to develop an optimal linear regression equation using stochastic gradient descent (SGD) for weight…

Machine Learning · Computer Science 2023-08-24 Gokulprasath R

In time series analysis, when fitting an autoregressive model, one must solve a Toeplitz ordinary least squares problem numerous times to find an appropriate model, which can severely affect computational times with large data sets. Two…

Machine Learning · Statistics 2021-12-28 Ali Eshragh , Oliver Di Pietro , Michael A. Saunders

We present an iterative framework to improve the amortized approximations of posterior distributions in the context of Bayesian inverse problems, which is inspired by loop-unrolled gradient descent methods and is theoretically grounded in…

Machine Learning · Computer Science 2023-05-16 Rafael Orozco , Ali Siahkoohi , Mathias Louboutin , Felix J. Herrmann

Standard maximum likelihood or Bayesian approaches to parameter estimation for stochastic differential equations are not robust to perturbations in the continuous-in-time data. In this paper, we give a rather elementary explanation of this…

Numerical Analysis · Mathematics 2023-12-20 Sebastian Reich

This paper focuses on the combined radar and communications problem and conducts a thorough analytical investigation on the effect of phase and frequency change on the communication and sensing functionality. First, we consider the…

Information Theory · Computer Science 2024-05-03 Tian Han , Rajitha Senanayake , Peter Smith , Jamie Evans , William Moran , Robin Evans

Spectrum cartography reconstructs spatial radio fields from sparse and heterogeneous wireless measurements, underpinning many sensing and optimization tasks in wireless networks. Attention mechanisms have recently enabled adaptive…

Optimization and Control · Mathematics 2026-04-29 Liping Tao , Chee Wei Tan

Dynamic inference problems in autoregressive (AR/ARMA/ARIMA), exponential smoothing, and navigation are often formulated and solved using state-space models (SSM), which allow a range of statistical distributions to inform innovations and…

Optimization and Control · Mathematics 2019-10-31 Jonathan Jonker , Peng Zheng , Aleksandr Y. Aravkin

This paper investigates unsupervised anomaly detection in multivariate time-series data using reinforcement learning (RL) in the latent space of an autoencoder. A significant challenge is the limited availability of anomalous data, often…

Machine Learning · Computer Science 2025-02-11 Saba Sanami , Amir G. Aghdam

In modern biomedical and econometric studies, longitudinal processes are often characterized by complex time-varying associations and abrupt regime shifts that are shared across correlated outcomes. Standard functional data analysis (FDA)…

Methodology · Statistics 2026-01-28 Baolin Chen , Mengfei Ran