English
Related papers

Related papers: Stochastic Derivative Estimation for Discontinuous…

200 papers

We propose Path Signatures Logistic Regression (PSLR), a semi-parametric framework for classifying vector-valued functional data with scalar covariates. Classical functional logistic regression models rely on linear assumptions and fixed…

Machine Learning · Statistics 2025-07-10 Pengcheng Zeng , Siyuan Jiang

Score-based diffusion generative models have recently emerged as a powerful tool for modelling complex data distributions. These models aim at learning the score function, which defines a map from a known probability distribution to the…

Machine Learning · Statistics 2025-11-12 Ehsan Mirafzali , Frank Proske , Utkarsh Gupta , Daniele Venturi , Razvan Marinescu

To accurately reproduce measurements from the real world, simulators need to have an adequate model of the physical system and require the parameters of the model be identified. We address the latter problem of estimating parameters through…

Robotics · Computer Science 2022-03-01 Eric Heiden , Christopher E. Denniston , David Millard , Fabio Ramos , Gaurav S. Sukhatme

Stochastic gradient descent is a classic algorithm that has gained great popularity especially in the last decades as the most common approach for training models in machine learning. While the algorithm has been well-studied when…

Machine Learning · Statistics 2025-09-09 Jose Blanchet , Aleksandar Mijatović , Wenhao Yang

There is a difficulty in finding an estimate of variance of the profile likelihood estimator in the joint model of longitudinal and survival data. We solve the difficulty by introducing the ``statistical generalized derivative''. The…

Statistics Theory · Mathematics 2018-07-23 Yuichi Hirose , Ivy Liu

Synthetic likelihood (SL) is a strategy for parameter inference when the likelihood function is analytically or computationally intractable. In SL, the likelihood function of the data is replaced by a multivariate Gaussian density over…

Methodology · Statistics 2022-02-21 Umberto Picchini , Umberto Simola , Jukka Corander

We prove a Leibniz rule for BV functions in a complete metric space that is equipped with a doubling measure and supports a Poincar\'e inequality. Unlike in previous versions of the rule, we do not assume the functions to be locally…

Metric Geometry · Mathematics 2018-11-20 Panu Lahti

We address high dimensional covariance estimation for elliptical distributed samples, which are also known as spherically invariant random vectors (SIRV) or compound-Gaussian processes. Specifically we consider shrinkage methods that are…

Methodology · Statistics 2015-05-20 Yilun Chen , Ami Wiesel , Alfred O. Hero

In this article we consider sampling from log concave distributions in Hamiltonian setting, without assuming that the objective gradient is globally Lipschitz. We propose two algorithms based on monotone polygonal (tamed) Euler schemes, to…

Probability · Mathematics 2023-01-20 Tim Johnston , Iosif Lytras , Sotirios Sabanis

The increasing popularity of regression discontinuity methods for causal inference in observational studies has led to a proliferation of different estimating strategies, most of which involve first fitting non-parametric regression models…

Methodology · Statistics 2018-06-11 Guido Imbens , Stefan Wager

Functional linear regression is an important topic in functional data analysis. It is commonly assumed that samples of the functional predictor are independent realizations of an underlying stochastic process, and are observed over a grid…

Methodology · Statistics 2020-09-15 Cheng Chen , Shaojun Guo , Xinghao Qiao

We propose the Distance-informed Neural Process (DNP), a novel variant of Neural Processes that improves uncertainty estimation by combining global and distance-aware local latent structures. Standard Neural Processes (NPs) often rely on a…

Machine Learning · Computer Science 2025-08-27 Aishwarya Venkataramanan , Joachim Denzler

We study fast algorithms for statistical regression problems under the strong contamination model, where the goal is to approximately optimize a generalized linear model (GLM) given adversarially corrupted samples. Prior works in this line…

Data Structures and Algorithms · Computer Science 2021-06-23 Arun Jambulapati , Jerry Li , Tselil Schramm , Kevin Tian

Nonparametric regression models with locally stationary covariates have received increasing interest in recent years. As a nice relief of "curse of dimensionality" induced by large dimension of covariates, additive regression model is…

Statistics Theory · Mathematics 2016-12-02 Lixia Hu , Tao Huang , Jinhong You

In the first part of this work, we develop a novel scheme for solving nonparametric regression problems. That is the approximation of possibly low regular and noised functions from the knowledge of their approximate values given at some…

Statistics Theory · Mathematics 2021-10-27 Asma Ben Saber , Abderrazek Karoui

Sequential change-point detection in non-Gaussian stochastic processes is challenging because the underlying densities are rarely known in real time. Classical parametric procedures such as CUSUM lose optimality under distributional…

Methodology · Statistics 2026-05-28 Serhii Zabolotnii

Performative prediction is a framework for learning models that influence the data they intend to predict. We focus on finding classifiers that are performatively stable, i.e. optimal for the data distribution they induce. Standard…

Machine Learning · Computer Science 2025-02-07 Mehrnaz Mofakhami , Ioannis Mitliagkas , Gauthier Gidel

We investigate stochastic averaging theory for locally Lipschitz discrete-time nonlinear systems with stochastic perturbation and its applications to convergence analysis of discrete-time stochastic extremum seeking algorithms. Firstly, by…

Optimization and Control · Mathematics 2015-02-18 Shu-Jun Liu , Miroslav Krstic

Log-linear models are arguably the most successful class of graphical models for large-scale applications because of their simplicity and tractability. Learning and inference with these models require calculating the partition function,…

Machine Learning · Statistics 2017-03-16 Ryan Spring , Anshumali Shrivastava

We consider the problem of performing inference on the number of common stochastic trends when data is generated by a cointegrated CKSVAR (a two-regime, piecewise affine SVAR; Mavroeidis, 2021), using a modified version of the Breitung…

Econometrics · Economics 2026-04-10 James A. Duffy , Xiyu Jiao