English
Related papers

Related papers: Flexible least squares for temporal data mining an…

200 papers

We introduce a new empirical Bayes approach for large-scale multiple linear regression. Our approach combines two key ideas: (i) the use of flexible "adaptive shrinkage" priors, which approximate the nonparametric family of scale mixture of…

Methodology · Statistics 2024-06-13 Youngseok Kim , Wei Wang , Peter Carbonetto , Matthew Stephens

Spatial-temporal estimation of signals on graph edges is challenging because most conventional Graph Signal Processing techniques are defined on the graph nodes. Leveraging the Line Graph transform, the Line Graph Least Mean Square (LGLMS)…

Signal Processing · Electrical Eng. & Systems 2026-04-20 Yi Yan , Ercan Engin Kuruoglu

Flexible sparsity regularization means stably approximating sparse solutions of operator equations by using coefficient-dependent penalizations. We propose and analyse a general nonconvex approach in this respect, from both theoretical and…

Optimization and Control · Mathematics 2021-11-12 Daria Ghilli , Dirk A. Lorenz , Elena Resmerita

Federated learning (FL) is a promising distributed learning framework where distributed clients collaboratively train a machine learning model coordinated by a server. To tackle the stragglers issue in asynchronous FL, we consider that each…

Machine Learning · Computer Science 2023-11-29 Jiarong Yang , Yuan Liu , Fangjiong Chen , Wen Chen , Changle Li

In this work, we revisit dictionary-based sparse regression, in particular, Sequential Threshold Least Squares (STLS), and propose a score-guided library selection to provide practical guidance for data-driven modeling, with emphasis on…

Machine Learning · Statistics 2025-12-17 Hangjun Cho , Fabio V. G. Amaral , Andrei A. Klishin , Cassio M. Oishi , Steven L. Brunton

We address the numerical solution of minimal norm residuals of {\it nonlinear} equations in finite dimensions. We take inspiration from the problem of finding a sparse vector solution by using greedy algorithms based on iterative residual…

Numerical Analysis · Mathematics 2015-04-28 Juliane Sigl

The aim of this paper is to propose a least mean squares (LMS) strategy for adaptive estimation of signals defined over graphs. Assuming the graph signal to be band-limited, over a known bandwidth, the method enables reconstruction, with…

Machine Learning · Computer Science 2016-11-17 Paolo Di Lorenzo , Sergio Barbarossa , Paolo Banelli , Stefania Sardellitti

In many fields where human understanding plays a crucial role, such as bioprocesses, the capacity of extracting knowledge from data is of critical importance. Within this framework, fuzzy learning methods, if properly used, can greatly help…

Machine Learning · Computer Science 2008-08-22 Sébastien Destercke , Serge Guillaume , Brigitte Charnomordic

Performance forecasting is an age-old problem in economics and finance. Recently, developments in machine learning and neural networks have given rise to non-linear time series models that provide modern and promising alternatives to…

Statistical Finance · Quantitative Finance 2022-01-21 Carmina Fjellström

Driven by recent advances in artificial intelligence (AI), a growing literature has demonstrated the potential for using large language models (LLMs) as scalable surrogates to generate human-like responses in many business applications. Two…

Machine Learning · Computer Science 2025-12-30 Lei Wang , Zikun Ye , Jinglong Zhao

We consider a conditional factor model for a multivariate portfolio of United States equities in the context of analysing a statistical arbitrage trading strategy. A state space framework underlies the factor model whereby asset returns are…

Statistical Finance · Quantitative Finance 2023-09-06 Trent Spears , Stefan Zohren , Stephen Roberts

Linear regression is one of the most prevalent techniques in machine learning, however, it is also common to use linear regression for its \emph{explanatory} capabilities rather than label prediction. Ordinary Least Squares (OLS) is often…

Data Structures and Algorithms · Computer Science 2017-08-23 Or Sheffet

Fitting statistical models to spatiotemporal data requires finding the right balance between imposing smoothness and following the data. In the context of p-splines, we propose a Bayesian framework for choosing the smoothing parameter which…

Applications · Statistics 2013-10-30 A. W. Bowman , L. Evers , D. Molinari , W. R. Jones , M. J. Spence

Partial Least Squares (PLS) regression emerged as an alternative to ordinary least squares for addressing multicollinearity in a wide range of scientific applications. As multidimensional tensor data is becoming more widespread, tensor…

Methodology · Statistics 2024-10-11 Kwangmoon Park , Sündüz Keleş

In order to improve the performance of Least Mean Square (LMS) based system identification of sparse systems, a new adaptive algorithm is proposed which utilizes the sparsity property of such systems. A general approximating approach on…

Information Theory · Computer Science 2015-06-15 Yuantao Gu , Jian Jin , Shunliang Mei

While training fair machine learning models has been studied extensively in recent years, most developed methods rely on the assumption that the training and test data have similar distributions. In the presence of distribution shifts, fair…

Machine Learning · Computer Science 2023-09-22 Sina Baharlouei , Meisam Razaviyayn

Federated learning (FL) scenarios inherently generate a large communication overhead by frequently transmitting neural network updates between clients and server. To minimize the communication cost, introducing sparsity in conjunction with…

Machine Learning · Computer Science 2022-04-12 Daniel Becking , Heiner Kirchhoffer , Gerhard Tech , Paul Haase , Karsten Müller , Heiko Schwarz , Wojciech Samek

This paper studies the question of filtering and maximizing terminal wealth from expected utility in a partially information stochastic volatility models. The special features is that the only information available to the investor is the…

Portfolio Management · Quantitative Finance 2015-07-28 Dalia Ibrahim , Frédéric Abergel

Trend-following strategies underpin many systematic trading approaches yet struggle under nonstationary and nonlinear market regimes. We propose an LSTM-based framework to forecast next-day trend differences ($\Delta_t$) for the top 30 S\&P…

Trading and Market Microstructure · Quantitative Finance 2026-03-17 Harris Buchanan , Eric Benhamou

The partial least squares algorithm for dependent data realisations is considered. Consequences of ignoring the dependence for the algorithm performance are studied both theoretically and in simulations. It is shown that ignoring certain…

Statistics Theory · Mathematics 2016-03-07 Marco Singer , Tatyana Krivobokova , Bert L. de Groot , Axel Munk