English
Related papers

Related papers: Soft Maximin Estimation for Heterogeneous Data

200 papers

We address the problem of learning an unknown smooth function and its derivatives from noisy pointwise evaluations under the supremum norm. While classical nonparametric regression provides a strong theoretical foundation, traditional…

Machine Learning · Computer Science 2026-03-10 Davide Maran , Marcello Restelli

Many researchers in artificial intelligence are beginning to explore the use of soft constraints to express a set of (possibly conflicting) problem requirements. A soft constraint is a function defined on a collection of variables which…

Artificial Intelligence · Computer Science 2011-07-04 D. Cohen , M. Cooper , P. Jeavons , A. Krokhin

Random samples are lossy summaries which allow queries posed over the data to be approximated by applying an appropriate estimator to the sample. The effectiveness of sampling, however, hinges on estimator selection. The choice of…

Statistics Theory · Mathematics 2014-04-10 Edith Cohen

Broadband wireless channel is a time dispersive and becomes strongly frequency selective. In most cases, the channel is composed of a few dominant coefficients and a large part of coefficients is approximately zero or zero. To exploit the…

Information Theory · Computer Science 2010-05-14 Guan Gui , Wei Peng , Qun Wan , Fumiyuki Adachi

This paper proposes a doubly robust two-stage semiparametric difference-in-difference estimator for estimating heterogeneous treatment effects with high-dimensional data. Our new estimator is robust to model miss-specifications and allows…

Econometrics · Economics 2020-09-08 Yang Ning , Sida Peng , Jing Tao

Recently, it has been demonstrated experimentally that adaptive estimation of a continuously varying optical phase provides superior accuracy in the phase estimate compared to static estimation. Here, we show that the mean-square error in…

Quantum Physics · Physics 2012-12-12 Shibdas Roy , Ian R. Petersen , Elanor H. Huntington

Noisy labels pose a common challenge for training accurate deep neural networks. To mitigate label noise, prior studies have proposed various robust loss functions to achieve noise tolerance in the presence of label noise, particularly…

Machine Learning · Computer Science 2025-08-05 Jialiang Wang , Xiong Zhou , Deming Zhai , Junjun Jiang , Xiangyang Ji , Xianming Liu

We construct a novel estimator for the diffusion coefficient of the limiting homogenized equation, when observing the slow dynamics of a multiscale model, in the case when the slow dynamics are of bounded variation. Previous research…

Statistics Theory · Mathematics 2018-07-04 Theodoros Manikas , Anastasia Papavasiliou

We consider the problem of global optimization of an unknown non-convex smooth function with zeroth-order feedback. In this setup, an algorithm is allowed to adaptively query the underlying function at different locations and receives noisy…

Machine Learning · Statistics 2018-03-26 Yining Wang , Sivaraman Balakrishnan , Aarti Singh

Smoothed analysis is a framework for analyzing the complexity of an algorithm, acting as a bridge between average and worst-case behaviour. For example, Quicksort and the Simplex algorithm are widely used in practical applications, despite…

Machine Learning · Computer Science 2015-03-29 Bichen Shi , Michel Schellekens , Georgiana Ifrim

A wireless network serving multiple users in the millimeter-wave or the sub-terahertz band by a base station is considered. High-throughput multi-user hybrid-transmit beamforming is conceived by maximizing the minimum rate of the users. For…

Information Theory · Computer Science 2023-10-27 W. Zhu , H. D. Tuan , E. Dutkiewicz , H. V. Poor , L. Hanzo

We study some of the most commonly used mutual information estimators, based on histograms of fixed or adaptive bin size, $k$-nearest neighbors and kernels, and focus on optimal selection of their free parameters. We examine the consistency…

Data Analysis, Statistics and Probability · Physics 2015-05-13 Angeliki Papana , Dimitris Kugiumtzis

With an eye towards human-centered automation, we contribute to the development of a systematic means to infer features of human decision-making from behavioral data. Motivated by the common use of softmax selection in models of human…

Optimization and Control · Mathematics 2015-09-01 Paul Reverdy , Naomi E. Leonard

Learning distributed representations, or embeddings, that encode the relational similarity patterns among objects is a relevant task in machine learning. A popular method to learn the embedding matrices $X, Y$ is optimizing a loss function…

Machine Learning · Computer Science 2025-06-03 Lorenzo Dall'Amico , Enrico Maria Belliardo

Ab initio pseudopotentials are a linchpin of modern molecular and condensed matter electronic structure calculations. In this work, we employ multi-objective optimization to maximize pseudopotential softness while maintaining high accuracy…

Chemical Physics · Physics 2022-09-21 Mostafa Faghih Shojaei , John E. Pask , Andrew J. Medford , Phanish Suryanarayana

In this paper, we propose a sparse signal estimation algorithm that is suitable for many wireless communication systems, especially for the future millimeter wave and underwater communication systems. This algorithm is not only…

Information Theory · Computer Science 2018-07-20 Chongwen Huang , Lei Liu , Chau Yuen

In this paper, we consider estimating spot/instantaneous volatility matrices of high-frequency data collected for a large number of assets. We first combine classic nonparametric kernel-based smoothing with a generalised shrinkage technique…

Econometrics · Economics 2026-04-22 Ruijun Bu , Degui Li , Oliver Linton , Hanchao Wang

We propose a framework for computing, optimizing and integrating with respect to a smooth marginal likelihood in statistical models that involve high-dimensional parameters/latent variables and continuous low-dimensional hyperparameters.…

Methodology · Statistics 2026-02-10 Omiros Papaspiliopoulos , Timothée Stumpf-Fétizon , Jonathan Weare

The aim of this paper is to present a new estimation procedure that can be applied in many statistical frameworks including density and regression and which leads to both robust and optimal (or nearly optimal) estimators. In density…

Statistics Theory · Mathematics 2017-01-23 Yannick Baraud , Lucien Birgé , Mathieu Sart

In this paper, we present a novel optimization algorithm designed specifically for estimating state-space models to deal with heavy-tailed measurement noise and constraints. Our algorithm addresses two significant limitations found in…

Signal Processing · Electrical Eng. & Systems 2024-11-19 Yifan Yu , Shengjie Xiu , Daniel P. Palomar