English
Related papers

Related papers: Unexpected properties of bandwidth choice when smo…

200 papers

With the growing volume of data in society, the need for privacy protection in data analysis also rises. In particular, private selection tasks, wherein the most important information is retrieved under differential privacy are emphasized…

Data Structures and Algorithms · Computer Science 2024-10-15 Akito Yamamoto , Tetsuo Shibuya

Models with fewer parameters are often easier to interpret and more robust. Parsimony can be achieved through optimizing objectives like the AIC or BIC, which are functions of the the number of free parameters in the model. Optimizing this…

Methodology · Statistics 2026-04-21 Mateen R Shaikh

We propose modeling raw functional data as a mixture of a smooth function and a highdimensional factor component. The conventional approach to retrieving the smooth function from the raw data is through various smoothing techniques.…

Methodology · Statistics 2021-02-05 Yuan Gao , Han Lin Shang , Yanrong Yang

Training and evaluation of fair classifiers is a challenging problem. This is partly due to the fact that most fairness metrics of interest depend on both the sensitive attribute information and label information of the data points. In many…

Machine Learning · Computer Science 2021-02-18 Pranjal Awasthi , Alex Beutel , Matthaeus Kleindessner , Jamie Morgenstern , Xuezhi Wang

The smooth bootstrap for estimating copula functionals in small samples is investigated. It can be used both to gauge the distribution of the estimator in question and to augment the data. Issues arising from kernel density and distribution…

Computation · Statistics 2022-03-28 Maximilian Coblenz , Oliver Grothe , Klaus Herrmann , Marius Hofert

Psychiatric neuroscience is increasingly aware of the need to define psychopathology in terms of abnormal neural computation. The central tool in this endeavour is the fitting of computational models to behavioural data. The most prominent…

Quantitative Methods · Quantitative Biology 2018-03-28 Abraham Nunes , Alexander Rudiuk

In order to circumvent statistical and computational hardness results in sequential decision-making, recent work has considered smoothed online learning, where the distribution of data at each time is assumed to have bounded likeliehood…

Machine Learning · Statistics 2024-02-26 Adam Block , Alexander Rakhlin , Abhishek Shetty

Label smoothing (LS) is a popular regularisation method for training neural networks as it is effective in improving test accuracy and is simple to implement. ``Hard'' one-hot labels are ``smoothed'' by uniformly distributing probability…

Machine Learning · Computer Science 2025-02-21 Guoxuan Xia , Olivier Laurent , Gianni Franchi , Christos-Savvas Bouganis

The generalization and learning speed of a multi-class neural network can often be significantly improved by using soft targets that are a weighted average of the hard targets and the uniform distribution over labels. Smoothing the labels…

Machine Learning · Computer Science 2020-06-12 Rafael Müller , Simon Kornblith , Geoffrey Hinton

Submodularity is a discrete domain functional property that can be interpreted as mimicking the role of the well-known convexity/concavity properties in the continuous domain. Submodular functions exhibit strong structure that lead to…

Signal Processing · Electrical Eng. & Systems 2023-07-19 Ehsan Tohidi , Rouhollah Amiri , Mario Coutino , David Gesbert , Geert Leus , Amin Karbasi

In the context of global optimization of mixed-integer nonlinear optimization formulations, we consider smoothing univariate functions $f$ that satisfy $f(0)=0$, $f$ is increasing and concave on $[0,+\infty)$, $f$ is twice differentiable on…

Optimization and Control · Mathematics 2018-10-12 Luze Xu , Jon Lee , Daphne Skipper

Many innovative applications require establishing correspondences among 3D geometric objects. However, the countless possible deformations of smooth surfaces make shape matching a challenging task. Finding an embedding to represent the…

Computer Vision and Pattern Recognition · Computer Science 2022-06-09 Riccardo Marin , Souhaib Attaiki , Simone Melzi , Emanuele Rodolà , Maks Ovsjanikov

Typical adversarial-training-based unsupervised domain adaptation methods are vulnerable when the source and target datasets are highly-complex or exhibit a large discrepancy between their data distributions. Recently, several…

Computer Vision and Pattern Recognition · Computer Science 2021-08-17 Guanyu Cai , Lianghua He , Mengchu Zhou , Hesham Alhumade , Die Hu

Nonparametric estimators for the mean and the covariance functions of functional data are proposed. The setup covers a wide range of practical situations. The random trajectories are, not necessarily differentiable, have unknown regularity,…

Statistics Theory · Mathematics 2025-02-13 Steven Golovkine , Nicolas Klutchnikoff , Valentin Patilea

We study an estimator for smoothing irregularly sampled data into a smooth map. The estimator has been widely used in astronomy, owing to its low level of noise; it involves a weight function -- or smoothing kernel -- w(\theta). We show…

Astrophysics · Physics 2009-11-06 Marco Lombardi , Peter Schneider

Traditionally, in supervised machine learning, (a significant) part of the available data (usually 50% to 80%) is used for training and the rest for validation. In many problems, however, the data is highly imbalanced in regard to different…

Machine Learning · Computer Science 2020-04-21 Xiaowei Gu , Plamen P Angelov , Eduardo Almeida Soares

This paper proposes a post-model selection inference procedure, called targeted undersmoothing, designed to construct uniformly valid confidence sets for a broad class of functionals of sparse high-dimensional statistical models. These…

Statistics Theory · Mathematics 2018-06-08 Christian Hansen , Damian Kozbur , Sanjog Misra

We consider the problem of global optimization of an unknown non-convex smooth function with zeroth-order feedback. In this setup, an algorithm is allowed to adaptively query the underlying function at different locations and receives noisy…

Machine Learning · Statistics 2018-03-26 Yining Wang , Sivaraman Balakrishnan , Aarti Singh

The top-k error is a common measure of performance in machine learning and computer vision. In practice, top-k classification is typically performed with deep neural networks trained with the cross-entropy loss. Theoretical results indeed…

Machine Learning · Computer Science 2018-02-22 Leonard Berrada , Andrew Zisserman , M. Pawan Kumar

Attaining reliable profile gradients is of utmost relevance for many physical systems. In most situations, the estimation of gradient can be inaccurate due to noise. It is common practice to first estimate the underlying system and then…

Data Analysis, Statistics and Probability · Physics 2021-05-31 Kushani De Silva , Carlo Cafaro , Adom Giffin