English
Related papers

Related papers: Deep Empirical Risk Minimization in finance: looki…

200 papers

In this work we investigate to which extent one can recover class probabilities within the empirical risk minimization (ERM) paradigm. The main aim of our paper is to extend existing results and emphasize the tight relations between…

Machine Learning · Computer Science 2020-07-22 Alexander Mey , Marco Loog

Exponential tilting is a technique commonly used in fields such as statistics, probability, information theory, and optimization to create parametric distribution shifts. Despite its prevalence in related fields, tilting has not seen…

Machine Learning · Computer Science 2023-06-02 Tian Li , Ahmad Beirami , Maziar Sanjabi , Virginia Smith

The well-known empirical risk minimization (ERM) principle is the basis of many widely used machine learning algorithms, and plays an essential role in the classical PAC theory. A common description of a learning algorithm's performance is…

Machine Learning · Statistics 2025-01-31 Steve Hanneke , Mingyue Xu

Empirical risk minimization stands behind most optimization in supervised machine learning. Under this scheme, labeled data is used to approximate an expected cost (risk), and a learning algorithm updates model-defining parameters in search…

Machine Learning · Statistics 2023-05-25 James Schmidt

In a wide range of statistical learning problems such as ranking, clustering or metric learning among others, the risk is accurately estimated by $U$-statistics of degree $d\geq 1$, i.e. functionals of the training data with low variance…

Machine Learning · Statistics 2019-01-25 Stéphan Clémençon , Aurélien Bellet , Igor Colin

We present an extension of Vapnik's classical empirical risk minimizer (ERM) where the empirical risk is replaced by a median-of-means (MOM) estimator, the new estimators are called MOM minimizers. While ERM is sensitive to corruption of…

Statistics Theory · Mathematics 2018-08-10 Guillaume Lecué , Matthieu Lerasle , Timothée Mathieu

The field of Machine Learning has changed significantly since the 1970s. However, its most basic principle, Empirical Risk Minimization (ERM), remains unchanged. We propose Functional Risk Minimization~(FRM), a general framework where…

In real-world applications, the distribution of the data, and our goals, evolve over time. The prevailing theoretical framework for studying machine learning, namely probably approximately correct (PAC) learning, largely ignores time. As a…

Machine Learning · Statistics 2025-01-31 Ashwin De Silva , Rahul Ramesh , Rubing Yang , Siyu Yu , Joshua T Vogelstein , Pratik Chaudhari

We consider robust empirical risk minimization (ERM), where model parameters are chosen to minimize the worst-case empirical loss when each data point varies over a given convex uncertainty set. In some simple cases, such problems can be…

Optimization and Control · Mathematics 2024-09-17 Eric Luxenberg , Dhruv Malik , Yuanzhi Li , Aarti Singh , Stephen Boyd

Networked data, in which every training example involves two objects and may share some common objects with others, is used in many machine learning tasks such as learning to rank and link prediction. A challenge of learning from networked…

Machine Learning · Computer Science 2017-11-23 Yuanhong Wang , Yuyi Wang , Xingwu Liu , Juhua Pu

Empirical risk minimization (ERM) is a fundamental learning rule for statistical learning problems where the data is generated according to some unknown distribution $\mathsf{P}$ and returns a hypothesis $f$ chosen from a fixed class…

Machine Learning · Computer Science 2014-11-25 Nishant A. Mehta , Robert C. Williamson

Trustworthy ML systems should not only return accurate predictions, but also a reliable representation of their uncertainty. Bayesian methods are commonly used to quantify both aleatoric and epistemic uncertainty, but alternative…

Artificial Intelligence · Computer Science 2024-09-11 Mira Jürgens , Nis Meinert , Viktor Bengs , Eyke Hüllermeier , Willem Waegeman

The fundamental theorem of statistical learning states that for binary classification problems, any Empirical Risk Minimization (ERM) learning rule has close to optimal sample complexity. In this paper we seek for a generic optimal learner…

Machine Learning · Computer Science 2014-05-13 Amit Daniely , Shai Shalev-Shwartz

Learning from quantum data presents new challenges to the paradigm of learning from data. This typically entails the use of quantum learning models to learn quantum processes that come with enough subtleties to modify the theoretical…

Quantum Physics · Physics 2025-09-01 Yixian Qiu , Lirandë Pira , Patrick Rebentrost

In order to circumvent statistical and computational hardness results in sequential decision-making, recent work has considered smoothed online learning, where the distribution of data at each time is assumed to have bounded likeliehood…

Machine Learning · Statistics 2024-02-26 Adam Block , Alexander Rakhlin , Abhishek Shetty

Machine learning models have exhibited exceptional results in various domains. The most prevalent approach for learning is the empirical risk minimizer (ERM), which adapts the model's weights to reduce the loss on a training set and…

Machine Learning · Computer Science 2024-12-11 Koby Bibas

We develop a methodology that utilizes deep learning to simultaneously solve and estimate canonical continuous-time general equilibrium models in financial economics. We illustrate our method in two examples: (1) industrial dynamics of…

Computational Finance · Quantitative Finance 2023-05-18 Benjamin Fan , Edward Qiao , Anran Jiao , Zhouzhou Gu , Wenhao Li , Lu Lu

This paper presents machine learning techniques and deep reinforcement learningbased algorithms for the efficient resolution of nonlinear partial differential equations and dynamic optimization problems arising in investment decisions and…

Optimization and Control · Mathematics 2021-04-19 Maximilien Germain , Huyên Pham , Xavier Warin

Empirical Risk Minimization (ERM) is a standard technique in machine learning, where a model is selected by minimizing a loss function over constraint set. When the training dataset consists of private information, it is natural to use a…

Machine Learning · Computer Science 2016-11-22 Kunal Talwar , Abhradeep Thakurta , Li Zhang

Classic supervised learning involves algorithms trained on $n$ labeled examples to produce a hypothesis $h \in \mathcal{H}$ aimed at performing well on unseen examples. Meta-learning extends this by training across $n$ tasks, with $m$…

Machine Learning · Statistics 2024-11-28 Yannay Alon , Steve Hanneke , Shay Moran , Uri Shalit