English
Related papers

Related papers: Adaptive estimation in symmetric location model un…

200 papers

While standard estimation assumes that all datapoints are from probability distribution of the same fixed parameters $\theta$, we will focus on maximum likelihood (ML) adaptive estimation for nonstationary time series: separately estimating…

Machine Learning · Statistics 2020-03-24 Jarek Duda

The estimation of a log-concave density on $\mathbb{R}$ is a canonical problem in the area of shape-constrained nonparametric inference. We present a Bayesian nonparametric approach to this problem based on an exponentiated Dirichlet…

Statistics Theory · Mathematics 2020-07-14 Ester Mariucci , Kolyan Ray , Botond Szabo

We consider an adaptive algorithm for finite element methods for the isogeometric analysis (IGAFEM) of elliptic (possibly non-symmetric) second-order partial differential equations. We employ analysis-suitable T-splines of arbitrary odd…

Numerical Analysis · Mathematics 2020-09-07 Gregor Gantner , Dirk Praetorius

Stochastic minimax optimization on Riemannian manifolds has recently attracted significant attention due to its broad range of applications, such as robust training of neural networks and robust maximum likelihood estimation. Existing…

Optimization and Control · Mathematics 2026-02-11 Hongye Wang , Chang He , Bo Jiang

In this paper, we study a class of non-parametric density estimators under Bayesian settings. The estimators are piecewise constant functions on binary partitions. We analyze the concentration rate of the posterior distribution under a…

Statistics Theory · Mathematics 2015-08-21 Linxi Liu , Wing Hung Wong

Parameter-efficient fine-tuning methods such as LoRA enable practical adaptation of large language models but provide no principled uncertainty estimates, leading to poorly calibrated predictions and unreliable behavior under domain shift.…

Machine Learning · Computer Science 2026-02-23 Ibne Farabi Shihab , Sanjeda Akter , Anuj Sharma

In the usual statistical inference problem, we estimate an unknown parameter of a statistical model using the information in the random sample. A priori information about the parameter is also known in several real-life situations. One such…

Statistics Theory · Mathematics 2024-11-11 Lakshmi Kanta Patra , Constantinos Petropoulos , Shrajal Bajpai , Naresh Garg

In this work we explore the fundamental structure-adaptiveness of state of the art randomized first order algorithms on regularized empirical risk minimization tasks, where the solution has intrinsic low-dimensional structure (such as…

Optimization and Control · Mathematics 2017-12-13 Junqi Tang , Francis Bach , Mohammad Golbabaee , Mike Davies

Current visual detectors, though impressive within their training distribution, often fail to parse out-of-distribution scenes into their constituent entities. Recent test-time adaptation methods use auxiliary self-supervised losses to…

Computer Vision and Pattern Recognition · Computer Science 2023-06-29 Mihir Prabhudesai , Anirudh Goyal , Sujoy Paul , Sjoerd van Steenkiste , Mehdi S. M. Sajjadi , Gaurav Aggarwal , Thomas Kipf , Deepak Pathak , Katerina Fragkiadaki

We study the proximal sampler of Lee, Shen, and Tian (2021) and obtain new convergence guarantees under weaker assumptions than strong log-concavity: namely, our results hold for (1) weakly log-concave targets, and (2) targets satisfying…

Statistics Theory · Mathematics 2022-02-15 Yongxin Chen , Sinho Chewi , Adil Salim , Andre Wibisono

The local regularity of functional time series is studied under $L^p-m-$appro\-ximability assumptions. The sample paths are observed with error at possibly random design points. Non-asymptotic concentration bounds of the regularity…

Statistics Theory · Mathematics 2024-03-21 Hassan Maissoro , Valentin Patilea , Myriam Vimond

Quantum parameter estimation has many applications, from gravitational wave detection to quantum key distribution. We present the first experimental demonstration of the time-symmetric technique of quantum smoothing. We consider both…

In studies involving lifetimes, observed survival times are frequently censored and possibly subject to biased sampling. In this paper, we model survival times under biased sampling (a.k.a., biased survival data) by a semi-parametric model,…

Statistics Theory · Mathematics 2007-06-13 Jiayang Sun , Bin Wang

Many existing covariate shift adaptation methods estimate sample weights given to loss values to mitigate the gap between the source and the target distribution. However, estimating the optimal weights typically involves computationally…

Machine Learning · Statistics 2024-07-01 François Portier , Lionel Truquet , Ikko Yamane

We consider non-parametric estimation problems in the presence of dependent data, notably non-parametric regression with random design and non-parametric density estimation. The proposed estimation procedure is based on a dimension…

Statistics Theory · Mathematics 2016-02-02 Nicolas Asin , Jan Johannes

We consider a misspecified optimization problem that requires minimizing of a convex function $f(x;\theta^*)$ in x over a constraint set represented by $h(x;\theta^*)\leq 0$, where $\theta^*$ is an unknown (or misspecified) vector of…

Optimization and Control · Mathematics 2016-08-17 H. Ahmadi , N. S. Aybat , U. V. Shanbhag

We analyze the adaptive first order algorithm AMSGrad, for solving a constrained stochastic optimization problem with a weakly convex objective. We prove the $\mathcal{\tilde O}(t^{-1/4})$ rate of convergence for the norm of the gradient of…

Machine Learning · Statistics 2020-06-12 Ahmet Alacaoglu , Yura Malitsky , Volkan Cevher

Linear Mixed Effects (LME) models have been widely applied in clustered data analysis in many areas including marketing research, clinical trials, and biomedical studies. Inference can be conducted using maximum likelihood approach if…

Methodology · Statistics 2022-11-10 Hao Chen , Lanshan Han , Alvin Lim

Gaussian mixture models are widely used to study clustering problems. These model-based clustering methods require an accurate estimation of the unknown data density by Gaussian mixtures. In Maugis and Michel (2009), a penalized maximum…

Statistics Theory · Mathematics 2015-03-19 Maugis Cathy , Michel Bertrand

Let y=A\beta+\epsilon, where y is an N\times1 vector of observations, \beta is a p\times1 vector of unknown regression coefficients, A is an N\times p design matrix and \epsilon is a spherically symmetric error term with unknown scale…

Statistics Theory · Mathematics 2010-09-14 Yuzo Maruyama , William E. Strawderman