English
Related papers

Related papers: Ridge Regression from Poisson Resetting: A Renewal…

200 papers

In this paper, we investigate the effects of stochastic resetting on diffusion in $\R^d\backslash \calU$, where $\calU$ is a bounded obstacle with a partially absorbing surface $\partial \calU$. We begin by considering a Robin boundary…

Statistical Mechanics · Physics 2022-06-29 Paul C. Bressloff

It is well-known that the reparameterisation gradient estimator, which exhibits low variance in practice, is biased for non-differentiable models. This may compromise correctness of gradient-based optimisation methods such as stochastic…

Machine Learning · Computer Science 2024-02-21 Dominik Wagner , Basim Khajwal , C. -H. Luke Ong

Many statistical estimators for high-dimensional linear regression are M-estimators, formed through minimizing a data-dependent square loss function plus a regularizer. This work considers a new class of estimators implicitly defined…

Statistics Theory · Mathematics 2022-02-15 Peng Zhao , Yun Yang , Qiao-Chu He

We show that unconverged stochastic gradient descent can be interpreted as a procedure that samples from a nonparametric variational approximate posterior distribution. This distribution is implicitly defined as the transformation of an…

Machine Learning · Statistics 2015-04-07 Dougal Maclaurin , David Duvenaud , Ryan P. Adams

Recent years have seen a flurry of activities in designing provably efficient nonconvex procedures for solving statistical estimation problems. Due to the highly nonconvex nature of the empirical loss, state-of-the-art procedures often…

Machine Learning · Computer Science 2020-06-09 Cong Ma , Kaizheng Wang , Yuejie Chi , Yuxin Chen

This paper proposes a new design method for a stochastic control policy using a normalizing flow (NF). In reinforcement learning (RL), the policy is usually modeled as a distribution model with trainable parameters. When this…

Robotics · Computer Science 2024-12-18 Taisuke Kobayashi , Takumi Aotani

In system identification, estimating parameters of a model using limited observations results in poor identifiability. To cope with this issue, we propose a new method to simultaneously select and estimate sensitive parameters as key model…

In this work, we address the solution of both linear and nonlinear ill-posed inverse problems by developing a novel graph-based regularization framework, where the regularization term is formulated through an iteratively updated graph…

Numerical Analysis · Mathematics 2026-01-21 Harshit Bajpai , Ankik Kumar Giri

This paper develops a quantitative framework for analyzing the mean-square exponential stabilization of stochastic linear systems with multiplicative noise, focusing specifically on the optimal stabilizing rate, which characterizes the…

Optimization and Control · Mathematics 2025-12-15 Hui Jia , Yuan-Hua Ni , Guangchen Wang

We are concerned with a nonlinear nonautonomous model represented by an equation describing the dynamics of an age-structured population diffusing in a space habitat $O,$ governed by local Lipschitz vital factors and by a stochastic…

Analysis of PDEs · Mathematics 2020-04-22 Gabriela Marinoschi

This work gives a simultaneous analysis of both the ordinary least squares estimator and the ridge regression estimator in the random design setting under mild assumptions on the covariate/response distributions. In particular, the analysis…

Statistics Theory · Mathematics 2014-03-26 Daniel Hsu , Sham M. Kakade , Tong Zhang

We consider the problem of estimating the factors of a rank-$1$ matrix with i.i.d. Gaussian, rank-$1$ measurements that are nonlinearly transformed and corrupted by noise. Considering two prototypical choices for the nonlinearity, we study…

Optimization and Control · Mathematics 2024-10-02 Kabir Aladin Chandrasekher , Mengqi Lou , Ashwin Pananjady

Safety in reinforcement learning (RL) is typically enforced through objective shaping while keeping environment dynamics stationary with respect to observable state-action pairs. Under delayed harm, this can lead to replay: after a washout…

Machine Learning · Computer Science 2026-04-10 Prakul Sunil Hiremath

We study risk-sensitive reinforcement learning (RL) based on an entropic risk measure in episodic non-stationary Markov decision processes (MDPs). Both the reward functions and the state transition kernels are unknown and allowed to vary…

Machine Learning · Computer Science 2022-11-22 Yuhao Ding , Ming Jin , Javad Lavaei

The run-and-tumble particle (RTP) is one of the simplest examples of an active particle in which the direction of constant motion randomly switches. In the one-dimensional (1D) case this means switching between rightward and leftward…

Statistical Mechanics · Physics 2024-11-26 Paul C Bressloff

We consider motion of an overdamped Brownian particle subject to stochastic resetting in one dimension. In contrast to the usual setting where the particle is instantaneously reset to a preferred location (say, the origin), here we consider…

Statistical Mechanics · Physics 2021-05-26 Deepak Gupta , Arnab Pal , Anupam Kundu

Recently, deep neural networks have been found to nearly interpolate training data but still generalize well in various applications. To help understand such a phenomenon, it has been of interest to analyze the ridge estimator and its…

Statistics Theory · Mathematics 2024-05-03 Libin Liang , Zhiqiang Tan

The inference performance of the pseudolikelihood method is discussed in the framework of the inverse Ising problem when the $\ell_2$-regularized (ridge) linear regression is adopted. This setup is introduced for theoretically investigating…

Disordered Systems and Neural Networks · Physics 2021-10-19 Xiangming Meng , Tomoyuki Obuchi , Yoshiyuki Kabashima

In this article, we propose a methodology to reconstruct, in a single step, the mean- and unsteady properties of a flow from very few time-resolved measurements. The procedure is based on the {\it a priori} alignement of Fourier- and…

Fluid Dynamics · Physics 2021-02-09 Lucas Franceschini , Denis Sipp , Olivier Marquet

Multicollinearity produces an inflation in the variance of the Ordinary Least Squares estimators due to the correlation between two or more independent variables (including the constant term). A widely applied solution is to estimate with…

Methodology · Statistics 2021-04-30 Román Salmerón Gómez , Catalina García García , José García Pérez