English
Related papers

Related papers: Estimating variances in time series linear regress…

200 papers

Time series prediction is challenging due to our limited understanding of the underlying dynamics. Conventional models such as ARIMA and Holt's linear trend model experience difficulty in identifying nonlinear patterns in time series. In…

Methodology · Statistics 2025-11-13 Thu Nguyen , Lam Si Tung Ho

We study the problem of estimating an unknown deterministic signal that is observed through an unknown deterministic data matrix under additive noise. In particular, we present a minimax optimization framework to the least squares problems,…

Systems and Control · Computer Science 2014-04-28 N. Denizcan Vanli , Mehmet A. Donmez , Suleyman S. Kozat

In this paper, we consider nonconvex optimization problems with nonsmooth nonconvex objective function and nonlinear equality constraints. We assume that both the objective function and the functional constraints can be separated into 2…

Optimization and Control · Mathematics 2025-03-04 Lahcen El Bourkhissi , Ion Necoara

Both linear mixed models (LMMs) and sparse regression models are widely used in genetics applications, including, recently, polygenic modeling in genome-wide association studies. These two approaches make very different assumptions, so are…

Quantitative Methods · Quantitative Biology 2012-11-16 Xiang Zhou , Peter Carbonetto , Matthew Stephens

Monitoring forecasting systems is critical for customer satisfaction, profitability, and operational efficiency in large-scale retail businesses. We propose The Forecast Critic, a system that leverages Large Language Models (LLMs) for…

Artificial Intelligence · Computer Science 2025-12-16 Luke Bhan , Hanyu Zhang , Andrew Gordon Wilson , Michael W. Mahoney , Chuck Arvin

In this study, we present a deep learning-optimization framework to tackle dynamic mixed-integer programs. Specifically, we develop a bidirectional Long Short Term Memory (LSTM) framework that can process information forward and backward in…

Machine Learning · Computer Science 2022-07-08 Dogacan Yilmaz , İ. Esra Büyüktahtakın

We address the solution of time-varying optimization problems characterized by the sum of a time-varying strongly convex function and a time-invariant nonsmooth convex function. We design an online algorithmic framework based on…

Optimization and Control · Mathematics 2024-05-07 Nicola Bastianello , Andrea Simonetto , Ruggero Carli

In this paper, we propose a Two-Step Linear Mixing Model (2LMM) that bridges the gap between model complexity and computational tractability. The model achieves this by introducing two distinct scaling steps: an endmember scaling step…

Image and Video Processing · Electrical Eng. & Systems 2025-12-04 Xander Haijen , Bikram Koirala , Xuanwen Tao , Paul Scheunders

Linear regression with normally distributed errors - including particular cases such as ANOVA, Student's t-test or location-scale inference - is a widely used statistical procedure. In this case the ordinary least squares estimator…

Methodology · Statistics 2019-09-18 Alain Desgagné

Time series forecasting plays a pivotal role in a wide range of applications, including weather prediction, healthcare, structural health monitoring, predictive maintenance, energy systems, and financial markets. While models such as LSTM,…

Machine Learning · Computer Science 2026-04-03 Qianying Cao , Shanqing Liu , Alan John Varghese , Jerome Darbon , Michael Triantafyllou , George Em Karniadakis

We consider the problem of learning predictive models from longitudinal data, consisting of irregularly repeated, sparse observations from a set of individuals over time. Such data often exhibit {\em longitudinal correlation} (LC)…

Machine Learning · Statistics 2019-11-25 Junjie Liang , Dongkuan Xu , Yiwei Sun , Vasant Honavar

In this paper, we have evaluated various methods of time-frequency-selective fading channels estimation in OFDM system and some of them improved under time varying conditions. So, these different techniques will be studied through different…

Other Computer Science · Computer Science 2012-05-16 Zaier Aida , Ridha Bouallegue

SEMMS (Scalable Empirical-Bayes Model for Marker Selection) is a variable-selection procedure for generalized linear models that uses a three-component normal mixture prior on regression coefficients. In its original form, SEMMS assumes…

Computation · Statistics 2026-03-18 Haim Bar , Martin T. Wells

Dynamic line rating (DLR) is a promising solution to increase the utilization of transmission lines by adjusting ratings based on real-time weather conditions. Accurate DLR forecast at the scheduling stage is thus necessary for system…

Systems and Control · Electrical Eng. & Systems 2025-03-11 Minsoo Kim , Vladimir Dvorkin , Jip Kim

The linear regression model with a random variable (RV) measurement matrix, where the mean of the random measurement matrix has full column rank, has been extensively studied. In particular, the quasiconvexity of the maximum likelihood…

Signal Processing · Electrical Eng. & Systems 2025-07-16 Ruohai Guo , Jiang Zhu , Xing Jiang , Fengzhong Qu

We present a computational motivation for restricted maximum likelihood (REML) estimation in linear mixed models using an expectation--maximization (EM) algorithm. At each iteration, maximum likelihood (ML) and REML solve the same…

Computation · Statistics 2026-02-11 Andrew T. Karl

Reservoir computing (RC), is a class of computational methods such as Echo State Networks (ESN) and Liquid State Machines (LSM) describe a generic method to perform pattern recognition and temporal analysis with any non-linear system. This…

Machine Learning · Computer Science 2024-11-19 Anmol Biswas , Sharvari Ashok Medhe , Raghav Singhal , Udayan Ganguly

Long-term time series forecasting (LTSF) offers broad utility in practical settings like energy consumption and weather prediction. Accurately predicting long-term changes, however, is demanding due to the intricate temporal patterns and…

Machine Learning · Computer Science 2025-05-19 Boshi Gao , Qingjian Ni , Fanbo Ju , Yu Chen , Ziqi Zhao

Maximizing the Kullback-Leibler divergence (KLD) is a fundamental problem in waveform design for active sensing and hypothesis testing, as it directly relates to the error exponent of detection probability. However, the associated…

Signal Processing · Electrical Eng. & Systems 2026-01-05 Jeongwoo Park , Seongkyu Jung , Kaiming Shen , Jeonghun Park

Mixtures of Linear Regressions (MLR) is an important mixture model with many applications. In this model, each observation is generated from one of the several unknown linear regression components, where the identity of the generated…

Machine Learning · Computer Science 2020-03-31 Yuanzhi Li , Yingyu Liang