English
Related papers

Related papers: Ordered Smoothers With Exponential Weighting

200 papers

We address the new problem of estimating a piece-wise constant signal with the purpose of detecting its change points and the levels of clusters. Our approach is to model it as a nonparametric penalized least square model selection on a…

Machine Learning · Statistics 2019-12-04 Othmane Mazhar , Cristian R. Rojas , Carlo Fischione , Mohammad R. Hesamzadeh

The ordered weighted $\ell_1$ (OWL) norm is a newly developed generalization of the Octogonal Shrinkage and Clustering Algorithm for Regression (OSCAR) norm. This norm has desirable statistical properties and can be used to perform…

Optimization and Control · Mathematics 2015-06-29 Damek Davis

In this paper, we propose a second-order dynamical system with a smoothing effect for solving paramonotone variational inequalities. Under standard assumptions, we prove that the trajectories of this dynamical system converges to a solution…

Optimization and Control · Mathematics 2024-11-25 Pham Viet Hai , Trinh Ngoc Hai

We consider a model selection estimator of the covariance of a random process. Using the Unbiased Risk Estimation (URE) method, we build an estimator of the risk which allows to select an estimator in a collection of model. Then, we present…

Statistics Theory · Mathematics 2011-12-22 Hélène Lescornel , Jean-Michel Loubes , Claudie Chabriac

In this work we consider unconstrained optimization problems. The objective function is known through a zeroth order stochastic oracle that gives an estimate of the true objective function. To solve these problems, we propose a…

Optimization and Control · Mathematics 2025-08-04 Alberto De Santis , Giampaolo Liuzzi , Stefano Lucidi

A newly introduced method called Taylor-based Optimized Recursive Extended Exponential Smoothed Neural Networks Forecasting method is applied and extended in this study to forecast numerical values. Unlike traditional forecasting techniques…

Neural and Evolutionary Computing · Computer Science 2018-11-02 Emna Krichene , Wael Ouarda , Habib Chabchoub , Adel M. Alimi

The problem of adaptive multivariate function estimation in the single-index regression model with random design and weak assumptions on the noise is investigated. A novel estimation procedure that adapts simultaneously to the unknown index…

Statistics Theory · Mathematics 2014-01-29 Oleg Lepski , Nora Serdyukova

Extending generalized estimating equations (GEE) to ordinal response data requires a conversion of the ordinal response to a vector of binary category indicators. That leads to a rather complicated association structure, and the…

Methodology · Statistics 2017-05-23 Aristidis K. Nikoloulopoulos

This paper introduces a weighted generalized inverse framework for Fourier extensions, designed to suppress spurious oscillations in the extended region while maintaining high approximation accuracy on the original interval. By formulating…

Numerical Analysis · Mathematics 2026-01-13 Zhenyu Zhao , Yanfei Wang , Anatoly G. Yagola , Xusheng Li

Shepard method is a fast algorithm that has been classically used to interpolate scattered data in several dimensions. This is an important and well-known technique in numerical analysis founded in the main idea that data that is far away…

Numerical Analysis · Mathematics 2024-12-04 David Levin , José M. Ramón , Juan Ruiz-Alvarez , Dionisio F. Yáñez

A number of regularization methods for discrete inverse problems consist in considering weighted versions of the usual least square solution. However, these so-called filter methods are generally restricted to monotonic transformations,…

Statistics Theory · Mathematics 2011-05-05 Paul Rochet

We study exponential stability for a kind of neural networks having time-varying delay. By extending the auxiliary function-based integral inequality, a novel integral inequality is derived by using weighted orthogonal functions of which…

Optimization and Control · Mathematics 2020-05-14 Seakweng Vong , Kachon Hoi , Chenyang Shi

Empirical studies in various social sciences often involve categorical outcomes with inherent ordering, such as self-evaluations of subjective well-being and self-assessments in health domains. While ordered choice models, such as the…

Econometrics · Economics 2025-08-08 Riccardo Di Francesco

We consider minimizing a smooth and strongly convex objective function using a stochastic Newton method. At each iteration, the algorithm is given an oracle access to a stochastic estimate of the Hessian matrix. The oracle model includes…

Optimization and Control · Mathematics 2022-11-29 Sen Na , Michał Dereziński , Michael W. Mahoney

As quantum machine learning continues to develop at a rapid pace, the importance of ensuring the robustness and efficiency of quantum algorithms cannot be overstated. Our research presents an analysis of quantum randomized smoothing, how…

Quantum Physics · Physics 2024-07-26 Nicola Franco , Marie Kempkes , Jakob Spiegelberg , Jeanette Miriam Lorenz

We address the question of estimating Kullback-Leibler losses rather than squared losses in recovery problems where the noise is distributed within the exponential family. Inspired by Stein unbiased risk estimator (SURE), we exhibit…

Applications · Statistics 2017-08-22 Charles-Alban Deledalle

Achieving invariance to nuisance transformations is a fundamental challenge in the construction of robust and reliable vision systems. Existing approaches to invariance scale exponentially with the dimension of the family of…

Computer Vision and Pattern Recognition · Computer Science 2022-03-11 Sam Buchanan , Jingkai Yan , Ellie Haber , John Wright

We propose an accelerated algorithm with a Frank-Wolfe method as an oracle for solving strongly monotone variational inequality problems. While standard solution approaches, such as projected gradient descent (aka value iteration), involve…

Optimization and Control · Mathematics 2025-10-07 Reza Rahimi Baghbadorani , Peyman Mohajerin Esfahani , Sergio Grammatico

This paper is devoted to the study of stochastic optimization problems under the generalized smoothness assumption. By considering the unbiased gradient oracle in Stochastic Gradient Descent, we provide strategies to achieve in bounds the…

Optimization and Control · Mathematics 2025-05-26 Aleksandr Lobanov , Alexander Gasnikov

We develop a new method to estimate gravitational shear by adopting an elliptical weight function to measure background galaxy images. In doing so, we introduce a new concept of "zero plane" which is an imaginal source plane where shapes of…

Cosmology and Nongalactic Astrophysics · Physics 2015-05-20 Yuki Okura , Toshifumi Futamase