English
Related papers

Related papers: Structural adaptation via $L_p$-norm oracle inequa…

200 papers

An adaptive proximal method for a special class of variational inequalities and related problems is proposed. For example, the so-called mixed variational inequalities and composite saddle problems are considered. Some estimates of the…

Optimization and Control · Mathematics 2020-08-25 Fedor S. Stonyakin

In this work, we study the problem of aggregating a finite number of predictors for nonstationary sub-linear processes. We provide oracle inequalities relying essentially on three ingredients: (1) a uniform bound of the $\ell^1$ norm of the…

Statistics Theory · Mathematics 2015-11-18 Christophe Giraud , François Roueff , Andres Sanchez-Perez

We propose a two-step estimating procedure for generalized additive partially linear models with clustered data using estimating equations. Our proposed method applies to the case that the number of observations per cluster is allowed to…

Statistics Theory · Mathematics 2013-02-20 Shujie Ma

It is common in machine learning to estimate a response $y$ given covariate information $x$. However, these predictions alone do not quantify any uncertainty associated with said predictions. One way to overcome this deficiency is with…

Machine Learning · Statistics 2024-06-25 Chancellor Johnstone , Eugene Ndiaye

In all structural models, the section or fiber response is a relation between the strain measures and the stress resultants. This relation can only be expressed in a simple analytical form when the material response is linear elastic. For…

Classical Physics · Physics 2020-03-18 David Portillo , Bastian Oesterle , Rebecca Thierer , Manfred Bischoff , Ignacio Romero

We consider the problem of locating a jump discontinuity (change-point) in a smooth parametric regression model with a bounded covariate. It is assumed that one can sample the covariate at different values and measure the corresponding…

Statistics Theory · Mathematics 2009-08-14 Yan Lan , Moulinath Banerjee , George Michailidis

This paper presents a simple extension of the binary heap, the List Heap. We use List Heaps to demonstrate the idea of adaptive heaps: heaps whose performance is a function of both the size of the problem instance and the disorder of the…

Data Structures and Algorithms · Computer Science 2018-02-16 Andrew Frohmader

This paper deals with estimation with functional covariates. More precisely, we aim at estimating the regression function $m$ of a continuous outcome $Y$ against a standard Wiener coprocess $W$. Following Cadre and Truquet (2015) and Cadre,…

Statistics Theory · Mathematics 2020-11-23 Karine Bertin , Nicolas Klutchnikoff

We develop new adaptive algorithms for variational inequalities with monotone operators, which capture many problems of interest, notably convex optimization and convex-concave saddle point problems. Our algorithms automatically adapt to…

Machine Learning · Computer Science 2021-08-30 Alina Ene , Huy L. Nguyen

In this contribution we present an abstract framework for adaptive model hierarchies together with several instances of hierarchies for specific applications. The hierarchy is particularly useful when integrated within an outer loop, for…

Numerical Analysis · Mathematics 2024-11-27 Hendrik Kleikamp , Mario Ohlberger

Composite likelihood estimation has an important role in the analysis of multivariate data for which the full likelihood function is intractable. An important issue in composite likelihood inference is the choice of the weights associated…

Methodology · Statistics 2015-12-15 Davide Ferrari , Chao Zheng

The article is devoted to some adaptive methods for variational inequalities with relatively smooth and relatively strongly monotone operators. Starting from the recently proposed proximal variant of the extragradient method for this class…

Optimization and Control · Mathematics 2023-08-02 S. S. Ablaev , F. S. Stonyakin , M. S. Alkousa , D. A. Pasechnyuk

This paper considers the problem of adaptive estimation of a template in a randomly shifted curve model. Using the Fourier transform of the data, we show that this problem can be transformed into a stochastic linear inverse problem. Our aim…

Statistics Theory · Mathematics 2009-11-10 Jérémie Bigot , Sébastien Gadat , Clément Marteau

We investigate model assessment and selection in a changing environment, by synthesizing datasets from both the current time period and historical epochs. To tackle unknown and potentially arbitrary temporal distribution shift, we develop…

Machine Learning · Computer Science 2024-06-05 Elise Han , Chengpiao Huang , Kaizheng Wang

Multi-fidelity methods that use an ensemble of models to compute a Monte Carlo estimator of the expectation of a high-fidelity model can significantly reduce computational costs compared to single-model approaches. These methods use oracle…

Computation · Statistics 2026-03-12 Thomas Dixon , Alex Gorodetsky , John Jakeman , Akil Narayan , Yiming Xu

In a general counting process setting, we consider the problem of obtaining a prognostic on the survival time adjusted on covariates in high-dimension. Towards this end, we construct an estimator of the whole conditional intensity. We…

Statistics Theory · Mathematics 2013-10-15 Sarah Lemler

In modern biomedical and econometric studies, longitudinal processes are often characterized by complex time-varying associations and abrupt regime shifts that are shared across correlated outcomes. Standard functional data analysis (FDA)…

Methodology · Statistics 2026-01-28 Baolin Chen , Mengfei Ran

In the adaptive information gathering problem, a policy is required to select an informative sensing location using the history of measurements acquired thus far. While there is an extensive amount of prior work investigating effective…

Robotics · Computer Science 2017-05-23 Sanjiban Choudhury , Ashish Kapoor , Gireeja Ranade , Sebastian Scherer , Debadeepta Dey

Conformal prediction (CP) for regression can be challenging, especially when the output distribution is heteroscedastic, multimodal, or skewed. Some of the issues can be addressed by estimating a distribution over the output, but in…

Machine Learning · Computer Science 2024-04-15 Etash Guha , Shlok Natarajan , Thomas Möllenhoff , Mohammad Emtiyaz Khan , Eugene Ndiaye

This work includes a number of novel contributions for the multiple-source adaptation problem. We present new normalized solutions with strong theoretical guarantees for the cross-entropy loss and other similar losses. We also provide new…

Machine Learning · Computer Science 2018-05-23 Judy Hoffman , Mehryar Mohri , Ningshan Zhang