English
Related papers

Related papers: Fast estimation of multidimensional adaptive P-spl…

200 papers

We propose a new fast algorithm to estimate any sparse generalized linear model with convex or non-convex separable penalties. Our algorithm is able to solve problems with millions of samples and features in seconds, by relying on…

We present a numerical method for convergence acceleration for multifidelity models of parameterized ordinary differential equations. The hierarchy of models is defined as trajectories computed using different timesteps in a time…

Numerical Analysis · Mathematics 2018-08-13 Vahid Keshavarzzadeh , Robert M. Kirby , Akil Narayan

Generalized additive models (GAMs) are a well-established statistical tool for modeling complex nonlinear relationships between covariates and a response assumed to have a conditional distribution in the exponential family. In this article,…

Methodology · Statistics 2021-03-02 Oswaldo Gressani , Philippe Lambert

We consider the problem of variable selection in high-dimensional settings with missing observations among the covariates. To address this relatively understudied problem, we propose a new synergistic procedure -- adaptive Bayesian SLOPE --…

P-splines provide a flexible and computationally efficient smoothing framework and are commonly used for derivative estimation in functional data. Including an additive penalty term in P-splines has been shown to improve estimates of…

Methodology · Statistics 2026-02-24 Yueyun Zhu , Steven Golovkine , Norma Bargary , Andrew J. Simpkin

Persistent monitoring of a spatiotemporal fluid process requires data sampling and predictive modeling of the process being monitored. In this paper we present PASST algorithm: Predictive-model based Adaptive Sampling of a Spatio-Temporal…

Robotics · Computer Science 2023-04-04 Sandeep Manjanna , Tom Z. Jiahao , M. Ani Hsieh

In the realm of large-scale spatiotemporal data, abrupt changes are commonly occurring across both spatial and temporal domains. This study aims to address the concurrent challenges of detecting change points and identifying spatial…

Methodology · Statistics 2025-05-05 Zerui Zhang , Xin Wang , Xin Zhang , Jing Zhang

Spiking neural networks (SNNs) are recurrent models that can leverage sparsity in input time series to efficiently carry out tasks such as classification. Additional efficiency gains can be obtained if decisions are taken as early as…

Neural and Evolutionary Computing · Computer Science 2023-12-19 Jiechen Chen , Sangwoo Park , Osvaldo Simeone

Latent space models (LSMs) are often used to analyze dynamic (time-varying) networks that evolve in continuous time. Existing approaches to Bayesian inference for these models rely on Markov chain Monte Carlo algorithms, which cannot handle…

Methodology · Statistics 2024-01-19 Joshua Daniel Loyal

We define a SDP framework based on the RLSTD algorithm and multivariate simplex B-splines. We introduce a local forget factor capable of preserving the continuity of the simplex splines. This local forget factor is integrated with the RLSTD…

Machine Learning · Computer Science 2016-07-01 Willem Eerland , Coen de Visser , Erik-Jan van Kampen

In this paper, we derive improved a priori error estimates for families of hybridizable interior penalty discontinuous Galerkin (H-IP) methods using a variable penalty for second-order elliptic problems. The strategy is to use a…

Numerical Analysis · Mathematics 2021-10-06 Gregory Etangsale , Marwan Fahs , Vincent Fontaine , Nalitiana Rajaonison

This work presents the second-order forward and adjoint sensitivity analysis procedures (SO-FSAP and SO-ASAP) for computing exactly and efficiently the second-order functional derivatives of physical (engineering, biological, etc.) system…

Mathematical Physics · Physics 2015-05-20 Dan G. Cacuci

We present a unified framework for estimation and analysis of generalized additive models in high dimensions. The framework defines a large class of penalized regression estimators, encompassing many existing methods. An efficient…

Methodology · Statistics 2019-03-13 Asad Haris , Noah Simon , Ali Shojaie

We consider the problem of locating a jump discontinuity (change-point) in a smooth parametric regression model with a bounded covariate. It is assumed that one can sample the covariate at different values and measure the corresponding…

Statistics Theory · Mathematics 2009-08-14 Yan Lan , Moulinath Banerjee , George Michailidis

In this paper, we propose an adaptive sieving (AS) strategy for solving general sparse machine learning models by effectively exploring the intrinsic sparsity of the solutions, wherein only a sequence of reduced problems with much smaller…

Optimization and Control · Mathematics 2025-04-28 Yancheng Yuan , Meixia Lin , Defeng Sun , Kim-Chuan Toh

We consider the problem of signal estimation in generalized linear models defined via rotationally invariant design matrices. Since these matrices can have an arbitrary spectral distribution, this model is well suited for capturing complex…

Machine Learning · Statistics 2022-06-10 Ramji Venkataramanan , Kevin Kögler , Marco Mondelli

In real-world applications, machine learning models face online label shift, where label distributions change over time. Effective adaptation requires careful learning rate selection: too low slows adaptation and too high causes…

Machine Learning · Computer Science 2025-08-20 Heewon Park , Mugon Joe , Miru Kim , Minhae Kwon

We propose a multiscale approach to time series autoregression, in which linear regressors for the process in question include features of its own path that live on multiple timescales. We take these multiscale features to be the recent…

Methodology · Statistics 2024-12-17 Rafal Baranowski , Yining Chen , Piotr Fryzlewicz

A unified linear algebraic approach to adaptive signal processing (ASP) is presented. Starting from just Ax=b, key ASP algorithms are derived in a simple, systematic, and integrated manner without requiring any background knowledge to the…

Systems and Control · Computer Science 2015-04-24 Muhammad Ali Raza Anjum

Autoregressive models (ARMs) currently hold state-of-the-art performance in likelihood-based modeling of image and audio data. Generally, neural network based ARMs are designed to allow fast inference, but sampling from these models is…

Machine Learning · Computer Science 2020-07-09 Auke Wiggers , Emiel Hoogeboom