English
Related papers

Related papers: Symmetric Norm Estimation and Regression on Slidin…

200 papers

Given an i.i.d. sample from a distribution $F$ on $\mathbb{R}$ with uniformly continuous density $p_0$, purely data-driven estimators are constructed that efficiently estimate $F$ in sup-norm loss and simultaneously estimate $p_0$ at the…

Statistics Theory · Mathematics 2011-01-10 Evarist Giné , Richard Nickl

We address the problem of learning an unknown smooth function and its derivatives from noisy pointwise evaluations under the supremum norm. While classical nonparametric regression provides a strong theoretical foundation, traditional…

Machine Learning · Computer Science 2026-03-10 Davide Maran , Marcello Restelli

Stochastic mirror descent (SMD) is a fairly new family of algorithms that has recently found a wide range of applications in optimization, machine learning, and control. It can be considered a generalization of the classical stochastic…

Optimization and Control · Mathematics 2019-04-04 Navid Azizan , Babak Hassibi

We design a generic method for reducing the task of finding weighted matchings to that of finding short augmenting paths in unweighted graphs. This method enables us to provide efficient implementations for approximating weighted matchings…

Data Structures and Algorithms · Computer Science 2018-11-08 Buddhima Gamlath , Sagar Kale , Slobodan Mitrović , Ola Svensson

We introduce a statistical physics inspired supervised machine learning algorithm for classification and regression problems. The method is based on the invariances or stability of predicted results when known data is represented as…

Machine Learning · Statistics 2018-11-19 Patrick Chao , Tahereh Mazaheri , Bo Sun , Nicholas B. Weingartner , Zohar Nussinov

The performance of flow matching and diffusion models can be greatly improved at inference time using reward alignment algorithms, yet efficiency remains a major limitation. While several algorithms were proposed, we demonstrate that a…

Machine Learning · Computer Science 2026-02-12 Peter Holderrieth , Uriel Singer , Tommi Jaakkola , Ricky T. Q. Chen , Yaron Lipman , Brian Karrer

A technique introduced by Indyk and Woodruff [STOC 2005] has inspired several recent advances in data-stream algorithms. We show that a number of these results follow easily from the application of a single probabilistic method called…

Data Structures and Algorithms · Computer Science 2011-04-26 Alexandr Andoni , Robert Krauthgamer , Krzysztof Onak

Work on approximate linear algebra has led to efficient distributed and streaming algorithms for problems such as approximate matrix multiplication, low rank approximation, and regression, primarily for the Euclidean norm $\ell_2$. We study…

Data Structures and Algorithms · Computer Science 2018-07-10 Graham Cormode , Charlie Dickens , David P. Woodruff

Estimating the 3D motion of points in a scene, known as scene flow, is a core problem in computer vision. Traditional learning-based methods designed to learn end-to-end 3D flow often suffer from poor generalization. Here we present a…

Computer Vision and Pattern Recognition · Computer Science 2021-04-06 Yair Kittenplon , Yonina C. Eldar , Dan Raviv

We introduce a new regression problem which we call the Sum-Based Hierarchical Smoothing problem. Given a directed acyclic graph and a non-negative value, called target value, for each vertex in the graph, we wish to find non-negative…

Data Structures and Algorithms · Computer Science 2011-08-09 Siavosh Benabbas , Hyun Chul Lee , Joel Oren , Yuli Ye

Prior knowledge on properties of a target model often come as discrete or combinatorial descriptions. This work provides a unified computational framework for defining norms that promote such structures. More specifically, we develop…

Machine Learning · Statistics 2019-04-11 Amin Jalali , Adel Javanmard , Maryam Fazel

Live streaming recommender system is specifically designed to recommend real-time live streaming of interest to users. Due to the dynamic changes of live content, improving the timeliness of the live streaming recommender system is a…

Information Retrieval · Computer Science 2024-02-23 Fengqi Liang , Baigong Zheng , Liqin Zhao , Guorui Zhou , Qian Wang , Yanan Niu

We provide the first proof of convergence for normalized error feedback algorithms across a wide range of machine learning problems. Despite their popularity and efficiency in training deep neural networks, traditional analyses of error…

Machine Learning · Computer Science 2024-10-23 Sarit Khirirat , Abdurakhmon Sadiev , Artem Riabinin , Eduard Gorbunov , Peter Richtárik

In recent years, deep learning-based point cloud normal estimation has made great progress. However, existing methods mainly rely on the PCPNet dataset, leading to overfitting. In addition, the correlation between point clouds with…

Computer Vision and Pattern Recognition · Computer Science 2024-06-25 Wei Jin , Jun Zhou , Nannan Li , Haba Madeline , Xiuping Liu

The support vector machine (SVM) algorithm is well known to the computer learning community for its very good practical results. The goal of the present paper is to study this algorithm from a statistical perspective, using tools of…

Statistics Theory · Mathematics 2008-12-18 Gilles Blanchard , Olivier Bousquet , Pascal Massart

Steerable convolutional neural networks (SCNNs) enhance task performance by modelling geometric symmetries through equivariance constraints on weights. Yet, unknown or varying symmetries can lead to overconstrained weights and decreased…

Machine Learning · Computer Science 2025-05-09 Lars Veefkind , Gabriele Cesa

In this paper we address smoothing-that is, optimisation-based-estimation techniques for localisation problems in the case where motion sensors are very accurate. Our mathematical analysis focuses on the difficult limit case where motion…

Systems and Control · Electrical Eng. & Systems 2022-04-12 Paul Chauchat , Silvere Bonnabel , Axel Barrau

We study the space complexity of the following problem: For a fixed regular language $L$, we receive a stream of symbols and want to test membership of a sliding window of size $n$ in $L$. For deterministic streaming algorithms we prove a…

Formal Languages and Automata Theory · Computer Science 2025-03-12 Moses Ganardi , Danny Hucke , Markus Lohrey , Konstantinos Mamouras , Tatiana Starikovskaya

We study the space complexity of estimating the diameter of a subset of points in an arbitrary metric space in the dynamic (turnstile) streaming model. The input is given as a stream of updates to a frequency vector $x \in \mathbb{Z}_{\geq…

Data Structures and Algorithms · Computer Science 2025-10-07 Sanjeev Khanna , Ashwin Padaki , Krish Singal , Erik Waingarten

We introduce a streaming framework for analyzing stochastic approximation/optimization problems. This streaming framework is analogous to solving optimization problems using time-varying mini-batches that arrive sequentially. We provide…

Machine Learning · Computer Science 2023-04-25 Antoine Godichon-Baggioni , Nicklas Werge , Olivier Wintenberger