English
Related papers

Related papers: Robustly Learning Single-Index Models via Alignmen…

200 papers

Due to the inherent imbalance in real-world datasets, na\"ive Empirical Risk Minimization (ERM) tends to bias the learning process towards the majority classes, hindering generalization to minority classes. To rebalance the learning…

Machine Learning · Computer Science 2025-12-09 Zitai Wang , Qianqian Xu , Zhiyong Yang , Zhikang Xu , Linchao Zhang , Xiaochun Cao , Qingming Huang

Modern multimodal systems deployed in industrial and safety-critical environments must remain reliable under partial sensor failures, signal degradation, or cross-modal inconsistencies. This work introduces a mathematically grounded…

Machine Learning · Computer Science 2026-03-27 Diyar Altinses , Andreas Schwung

Lipschitz constants of neural networks have been explored in various contexts in deep learning, such as provable adversarial robustness, estimating Wasserstein distance, stabilising training of GANs, and formulating invertible neural…

Machine Learning · Statistics 2021-06-10 Hyunjik Kim , George Papamakarios , Andriy Mnih

We consider neural network training, in applications in which there are many possible classes, but at test-time, the task is a binary classification task of determining whether the given example belongs to a specific class, where the class…

Machine Learning · Statistics 2018-09-18 Gil Keren , Sivan Sabato , Björn Schuller

Most existing distance metric learning methods assume perfect side information that is usually given in pairwise or triplet constraints. Instead, in many real-world applications, the constraints are derived from side information, such as…

Machine Learning · Computer Science 2012-03-19 Kaizhu Huang , Rong Jin , Zenglin Xu , Cheng-Lin Liu

Optimization of convex functions under stochastic zeroth-order feedback has been a major and challenging question in online learning. In this work, we consider the problem of optimizing second-order smooth and strongly convex functions…

Machine Learning · Computer Science 2024-07-01 Qian Yu , Yining Wang , Baihe Huang , Qi Lei , Jason D. Lee

We consider a stochastic version of the proximal point algorithm for optimization problems posed on a Hilbert space. A typical application of this is supervised learning. While the method is not new, it has not been extensively analyzed in…

Optimization and Control · Mathematics 2021-09-28 Monika Eisenmann , Tony Stillfjord , Måns Williamson

We introduce a tunable loss function called $\alpha$-loss, parameterized by $\alpha \in (0,\infty]$, which interpolates between the exponential loss ($\alpha = 1/2$), the log-loss ($\alpha = 1$), and the 0-1 loss ($\alpha = \infty$), for…

Machine Learning · Computer Science 2022-12-22 Tyler Sypherd , Mario Diaz , John Kevin Cava , Gautam Dasarathy , Peter Kairouz , Lalitha Sankar

We provide an inference procedure for the sharp regression discontinuity design (RDD) under monotonicity, with possibly multiple running variables. Specifically, we consider the case where the true regression function is monotone with…

Econometrics · Economics 2020-12-01 Koohyun Kwon , Soonwoo Kwon

The article introduces a new algorithm for solving a class ofequilibrium problems involving strongly pseudomonotone bifunctions with Lipschitz-type condition. We describe how to incorporate the proximal-like regularized technique with…

Optimization and Control · Mathematics 2018-04-26 Dang Van Hieu

We consider the problem of learning soft assignments of $N$ items to $K$ categories given two sources of information: an item-category similarity matrix, which encourages items to be assigned to categories they are similar to (and to not be…

Machine Learning · Computer Science 2014-05-26 Miguel Á. Carreira-Perpiñán , Weiran Wang

A sequence of works in unconstrained online convex optimisation have investigated the possibility of adapting simultaneously to the norm $U$ of the comparator and the maximum norm $G$ of the gradients. In full generality, matching upper and…

Machine Learning · Computer Science 2022-06-16 Jack J. Mayo , Hédi Hadiji , Tim van Erven

We study the problem of pure exploration in matching markets under uncertain preferences, where the goal is to identify a stable matching with confidence parameter $\delta$ and minimal sample complexity. Agents learn preferences via…

Computer Science and Game Theory · Computer Science 2025-09-19 Tejas Pagare , Agniv Bandyopadhyay , Sandeep Juneja

We study the algorithmic task of learning Boolean disjunctions in the distribution-free agnostic PAC model. The best known agnostic learner for the class of disjunctions over $\{0, 1\}^n$ is the $L_1$-polynomial regression algorithm,…

Machine Learning · Computer Science 2025-04-22 Ilias Diakonikolas , Daniel M. Kane , Lisheng Ren

We provide full theoretical guarantees for the convergence behaviour of diffusion-based generative models under the assumption of strongly log-concave data distributions while our approximating class of functions used for score estimation…

Machine Learning · Computer Science 2025-02-18 Stefano Bruno , Ying Zhang , Dong-Young Lim , Ömer Deniz Akyildiz , Sotirios Sabanis

Ensuring neural network robustness is essential for the safe and reliable operation of robotic learning systems, especially in perception and decision-making tasks within real-world environments. This paper investigates the robustness of…

Machine Learning · Computer Science 2024-11-01 Abulikemu Abuduweili , Changliu Liu

We consider linear prediction with a convex Lipschitz loss, or more generally, stochastic convex optimization problems of generalized linear form, i.e.~where each instantaneous loss is a scalar convex function of a linear function. We show…

Machine Learning · Computer Science 2022-11-01 Idan Amir , Roi Livni , Nathan Srebro

In linear distance metric learning, we are given data in one Euclidean metric space and the goal is to find an appropriate linear map to another Euclidean metric space which respects certain distance conditions as much as possible. In this…

Machine Learning · Computer Science 2023-12-22 Meysam Alishahi , Anna Little , Jeff M. Phillips

A supervised learning algorithm has access to a distribution of labeled examples, and needs to return a function (hypothesis) that correctly labels the examples. The hypothesis of the learner is taken from some fixed class of functions…

Machine Learning · Computer Science 2020-08-25 Eran Malach , Shai Shalev-Shwartz

We study the problem of learning similarity by using nonlinear embedding models (e.g., neural networks) from all possible pairs. This problem is well-known for its difficulty of training with the extreme number of pairs. For the special…

Machine Learning · Statistics 2021-06-16 Bowen Yuan , Yu-Sheng Li , Pengrui Quan , Chih-Jen Lin
‹ Prev 1 4 5 6 7 8 10 Next ›