English
Related papers

Related papers: A unified framework on defining depth for point pr…

200 papers

Diffusion models achieve remarkable generation quality, yet face a fundamental challenge known as memorization, where generated samples can replicate training samples exactly. We develop a theoretical framework to explain this phenomenon by…

Machine Learning · Computer Science 2026-03-31 Xinyu Zhou , Jiawei Zhang , Stephen J. Wright

Smoothed analysis is a framework for analyzing the complexity of an algorithm, acting as a bridge between average and worst-case behaviour. For example, Quicksort and the Simplex algorithm are widely used in practical applications, despite…

Machine Learning · Computer Science 2015-03-29 Bichen Shi , Michel Schellekens , Georgiana Ifrim

Data depth proves successful in the analysis of multivariate data sets, in particular deriving an overall center and assigning ranks to the observed units. Two key features are: the directions of the ordering, from the center towards the…

Methodology · Statistics 2016-01-26 Claudio Agostinelli

A data depth measures the centrality of a point with respect to an empirical distribution. Postulates are formulated, which a depth for functional data should satisfy, and a general approach is proposed to construct multivariate data depths…

Methodology · Statistics 2018-01-31 Karl Mosler , Yulia Polyakova

Randomized smoothing has shown promising certified robustness against adversaries in classification tasks. Despite such success with only zeroth-order access to base models, randomized smoothing has not been extended to a general form of…

Machine Learning · Computer Science 2024-05-16 Aref Miri Rekavandi , Olga Ohrimenko , Benjamin I. P. Rubinstein

This article introduces a general statistical modeling principle called "Density Sharpening" and applies it to the analysis of discrete count data. The underlying foundation is based on a new theory of nonparametric approximation and…

Methodology · Statistics 2021-08-24 Subhadeep Mukhopadhyay

Advances in modern technology have enabled the simultaneous recording of neural spiking activity, which statistically can be represented by a multivariate point process. We characterise the second order structure of this process via the…

Methodology · Statistics 2024-04-30 Carla Pinkney , Carolina Euan , Alex Gibberd , Ali Shojaie

We propose modeling raw functional data as a mixture of a smooth function and a highdimensional factor component. The conventional approach to retrieving the smooth function from the raw data is through various smoothing techniques.…

Methodology · Statistics 2021-02-05 Yuan Gao , Han Lin Shang , Yanrong Yang

The statistical rank tests play important roles in univariate non-parametric data analysis. If one attempts to generalize the rank tests to a multivariate case, the problem of defining a multivariate order will occur. It is not clear how to…

Computational Geometry · Computer Science 2019-05-28 Rasoul Shahsavarifar

The study of provable adversarial robustness has mostly been limited to classification tasks and models with one-dimensional real-valued outputs. We extend the scope of certifiable robustness to problems with more general and structured…

Machine Learning · Computer Science 2022-01-13 Aounon Kumar , Tom Goldstein

Robust estimation of location is a fundamental problem in statistics, particularly in scenarios where data contamination by outliers or model misspecification is a concern. In univariate settings, methods such as the sample median and…

Statistics Theory · Mathematics 2025-05-07 Alejandro Cholaquidis , Ricardo Fraiman , Leonardo Moreno , Gonzalo Perera

We provide a comprehensive study of interrelations between different measures of smoothness of functions on various domains and smoothness properties of approximation processes. Two general approaches to this problem have been developed:…

Classical Analysis and ODEs · Mathematics 2020-03-18 Yu. Kolomoitsev , S. Tikhonov

Discrete stability extends the classical notion of stability to random elements in discrete spaces by defining a scaling operation in a randomised way: an integer is transformed into the corresponding binomial distribution. Similarly…

Probability · Mathematics 2011-08-10 Youri Davydov , Ilya Molchanov , Sergei Zuyev

We present a framework to train a structured prediction model by performing smoothing on the inference algorithm it builds upon. Smoothing overcomes the non-smoothness inherent to the maximum margin structured prediction objective, and…

Machine Learning · Statistics 2019-02-11 Krishna Pillutla , Vincent Roulet , Sham M. Kakade , Zaid Harchaoui

Randomized algorithms, such as randomized sketching or stochastic optimization, are a promising approach to ease the computational burden in analyzing large datasets. However, randomized algorithms also produce non-deterministic outputs,…

Methodology · Statistics 2025-05-13 Zhixiang Zhang , Sokbae Lee , Edgar Dobriban

Optimization methods play a central role in signal processing, serving as the mathematical foundation for inference, estimation, and control. While classical iterative optimization algorithms provide interpretability and theoretical…

Machine Learning · Computer Science 2026-04-01 Nir Shlezinger , Santiago Segarra , Yi Zhang , Dvir Avrahami , Zohar Davidov , Tirza Routtenberg , Yonina C. Eldar

We introduce a sharpness functional for probabilistic models that quantifies sharpness as an intrinsic property of the probability distribution. The measure is derived based on a rank-based concentration principle that tracks upward…

Methodology · Statistics 2026-04-03 Pekka Syrjänen

We develop a novel methodology for detecting abrupt break points in mean functions of functional time series, adaptable to arbitrary sampling schemes. By employing B-spline smoothing, we introduce $\mathcal L_{\infty}$ and $\mathcal L_2$…

Methodology · Statistics 2024-12-31 Leheng Cai , Qirui Hu

This paper investigates how various randomization techniques impact Deep Neural Networks (DNNs). Randomization, like weight noise and dropout, aids in reducing overfitting and enhancing generalization, but their interactions are poorly…

The data functions that are studied in the course of functional data analysis are assembled from discrete data, and the level of smoothing that is used is generally that which is appropriate for accurate approximation of the conceptually…

Statistics Theory · Mathematics 2013-12-19 Raymond J. Carroll , Aurore Delaigle , Peter Hall