English
Related papers

Related papers: Ordered Smoothers With Exponential Weighting

200 papers

The ordered weighted averaging (OWA) operators play a crucial role in aggregating multiple criteria evaluations into an overall assessment supporting the decision makers' choice. One key point steps is to determine the associated weights.…

Artificial Intelligence · Computer Science 2018-09-11 Xiuyan Sha , Zeshui Xu , Chuancun Yin

The purpose of this short article is to prove some potential estimates that naturally arise in the study of subelliptic Sobolev inequalites for functions. This will allow us to prove a local subelliptic Sobolev inequality with the optimal…

Classical Analysis and ODEs · Mathematics 2015-07-14 Po-Lam Yung

Ensembling is among the most popular tools in machine learning (ML) due to its effectiveness in minimizing variance and thus improving generalization. Most ensembling methods for black-box base learners fall under the umbrella of "stacked…

Machine Learning · Computer Science 2025-12-17 Hilaf Hasson , Danielle C. Maddix , Yuyang Wang , Gaurav Gupta , Youngsuk Park

Let $\mathcal{L}_a$ be a Schr\"odinger operator with inverse square potential $a|x|^{-2}$ on $\mathbb{R}^d, d\geq 3$. The main aim of this paper is to prove weighted estimates for fractional powers of $\mathcal{L}_a$. The proof is based on…

Analysis of PDEs · Mathematics 2016-11-15 The Anh Bui , Piero D'Ancona , Xuan Thinh Duong , Ji Li , Fu Ken Ly

In this paper, we consider the problem of online asymptotic variance estimation for particle filtering and smoothing. Current solutions for the particle filter rely on the particle genealogy and are either unstable or hard to tune in…

Methodology · Statistics 2024-11-14 Yazid Janati El idrissi , Sylvain Le Corff , Yohan Petetin

The object of the present paper is to extend the third-order iterative method for solving nonlinear equations into systems of nonlinear equations. Since our motive is to develop the method which improve the order of convergence of Newton's…

Numerical Analysis · Mathematics 2013-09-24 Anuradha Singh , J. P. Jaiswa

The goal of ordinal embedding is to represent items as points in a low-dimensional Euclidean space given a set of constraints in the form of distance comparisons like "item $i$ is closer to item $j$ than item $k$". Ordinal constraints like…

Machine Learning · Statistics 2016-06-24 Lalit Jain , Kevin Jamieson , Robert Nowak

We study a set of regularization methods for high-dimensional linear regression models. These penalized estimators have the square root of the residual sum of squared errors as loss function, and any weakly decomposable norm as penalty…

Statistics Theory · Mathematics 2016-06-28 Benjamin Stucky , Sara van de Geer

Model selection aims to identify a sufficiently well performing model that is possibly simpler than the most complex model among a pool of candidates. However, the decision-making process itself can inadvertently introduce non-negligible…

Methodology · Statistics 2024-08-08 Yann McLatchie , Aki Vehtari

Many common estimators in machine learning and causal inference are linear smoothers, where the prediction is a weighted average of the training outcomes. Some estimators, such as ordinary least squares and kernel ridge regression, allow…

Machine Learning · Computer Science 2026-04-02 David Arbour , Harsh Parikh , Bijan Niknam , Elizabeth Stuart , Kara Rudolph , Avi Feller

We develop a general framework for generating estimators of a given quantity which are unbiased to a given order in the difference between the true value of the underlying quantity and the fiducial position in theory space around which we…

Cosmology and Nongalactic Astrophysics · Physics 2015-06-22 Mathew S. Madhavacheril , Patrick McDonald , Neelima Sehgal , Anže Slosar

We tackle the problem of estimating a regression function observed in an instrumental regression framework. This model is an inverse problem with unknown operator. We provide a spectral cut-off estimation procedure which enables to derive…

Statistics Theory · Mathematics 2009-01-28 Jean-Michel Loubes , Clément Marteau

Multiobjective combinatorial optimization deals with problems considering more than one viewpoint or scenario. The problem of aggregating multiple criteria to obtain a globalizing objective function is of special interest when the number of…

Optimization and Control · Mathematics 2013-06-07 Elena Fernández , Miguel A. Pozo , Justo Puerto

We consider a novel challenge: approximating a distribution without the ability to randomly sample from that distribution. We study how such an approximation can be obtained using *weight queries*. Given some data set of examples, a weight…

Machine Learning · Computer Science 2021-07-15 Nadav Barak , Sivan Sabato

We develop a new family of convex relaxations for $k$-means clustering based on sum-of-squares norms, a relaxation of the injective tensor norm that is efficiently computable using the Sum-of-Squares algorithm. We give an algorithm based on…

Machine Learning · Computer Science 2017-11-21 Pravesh K. Kothari , Jacob Steinhardt

Given a finite collection of estimators or classifiers, we study the problem of model selection type aggregation, that is, we construct a new estimator or classifier, called aggregate, which is nearly as good as the best among them with…

Statistics Theory · Mathematics 2008-11-10 A. Juditsky , P. Rigollet , A. B. Tsybakov

Variational inequalities offer a versatile and straightforward approach to analyzing a broad range of equilibrium problems in both theoretical and practical fields. In this paper, we consider a composite generally non-monotone variational…

Optimization and Control · Mathematics 2025-02-06 Roman Emelyanov , Andrey Tikhomirov , Aleksandr Beznosikov , Alexander Gasnikov

Probability estimation is essential for every statistical data compression algorithm. In practice probability estimation should be adaptive, recent observations should receive a higher weight than older observations. We present a…

Information Theory · Computer Science 2015-01-12 Christopher Mattern

A frequently occurring challenge in experimental and numerical observation is how to resolve features, such as spectral peaks - with center, width, height - and derivatives from measured data with unavoidable noise. Therefore, we develop a…

Data Analysis, Statistics and Probability · Physics 2025-10-03 Bert Mulder , Ad Lagendijk , Willem L. Vos

We study Matching and other related problems in a partial information setting where the agents' utilities for being matched to other agents are hidden and the mechanism only has access to ordinal preference information. Our model is…

Computer Science and Game Theory · Computer Science 2016-08-03 Elliot Anshelevich , Shreyas Sekar