English
Related papers

Related papers: Empirical Risk Minimization with $f$-Divergence Re…

200 papers

The reconstruction of low-rank matrix from its noisy observation finds its usage in many applications. It can be reformulated into a constrained nuclear norm minimization problem, where the bound $\eta$ of the constraint is explicitly given…

Optimization and Control · Mathematics 2022-04-14 Kexin Li , Hongwei Li , Raymond H. Chan , You-wei Wen

In recent years, multicalibration has emerged as a desirable learning objective for ensuring that a predictor is calibrated across a rich collection of overlapping subpopulations. Existing approaches typically achieve multicalibration by…

Machine Learning · Computer Science 2025-05-26 Hongyi Henry Jin , Zijun Ding , Dung Daniel Ngo , Zhiwei Steven Wu

We study the problem of estimating Dynamic Discrete Choice (DDC) models, also known as offline Maximum Entropy-Regularized Inverse Reinforcement Learning (offline MaxEnt-IRL) in machine learning. The objective is to recover reward or $Q^*$…

Machine Learning · Computer Science 2026-05-06 Enoch H. Kang , Hema Yoganarasimhan , Lalit Jain

Calibration of predicted probabilities is critical for reliable machine learning, yet it is poorly understood how standard training procedures yield well-calibrated models. This work provides the first theoretical proof that canonical…

Machine Learning · Computer Science 2025-10-16 Masahiro Fujisawa , Futoshi Futami

We propose a new parametrization for the estimation and identification of the impulse-response functions (IRFs) of dynamic factor models (DFMs). The theoretical contribution of this paper concerns the problem of observational equivalence…

Econometrics · Economics 2022-02-23 Juho Koistinen , Bernd Funovits

While traditional distributionally robust optimization (DRO) aims to minimize the maximal risk over a set of distributions, Agarwal and Zhang (2022) recently proposed a variant that replaces risk with excess risk. Compared to DRO, the new…

Optimization and Control · Mathematics 2024-05-29 Lijun Zhang , Haomin Bai , Wei-Wei Tu , Ping Yang , Yao Hu

This paper has two main goals: (a) establish several statistical properties---consistency, asymptotic distributions, and convergence rates---of stationary solutions and values of a class of coupled nonconvex and nonsmoothempirical risk…

Statistics Theory · Mathematics 2019-10-08 Zhengling Qi , Ying Cui , Yufeng Liu , Jong-Shi Pang

We present the Shortfall Deviation Risk (SDR), a risk measure that represents the expected loss that occurs with certain probability penalized by the dispersion of results that are worse than such an expectation. SDR combines Expected…

Risk Management · Quantitative Finance 2020-08-04 Marcelo Brutti Righi , Paulo Sergio Ceretta

We present a novel energy-based numerical analysis of semilinear diffusion-reaction boundary value problems. Based on a suitable variational setting, the proposed computational scheme can be seen as an energy minimisation approach. More…

Numerical Analysis · Mathematics 2022-02-16 Mario Amrein , Pascal Heid , Thomas P. Wihler

This paper focuses on the regularization of backward time-fractional diffusion problem on unbounded domain. This problem is well-known to be ill-posed, whence the need of a regularization method in order to recover stable approximate…

Numerical Analysis · Mathematics 2022-01-03 Walter Simo Tao Lee

This article deals with error estimates for the finite element approximation of variational normal derivatives and, as a consequence, error estimates for the finite element approximation of Dirichlet boundary control problems with energy…

Numerical Analysis · Mathematics 2018-08-06 Max Winkler

Recently there has been a surge of interest in understanding implicit regularization properties of iterative gradient-based optimization algorithms. In this paper, we study the statistical guarantees on the excess risk achieved by…

Machine Learning · Statistics 2020-08-28 Tomas Vaškevičius , Varun Kanade , Patrick Rebeschini

Marginal expected shortfall is unquestionably one of the most popular systemic risk measures. Studying its extreme behaviour is particularly relevant for risk protection against severe global financial market downturns. In this context,…

Statistics Theory · Mathematics 2023-04-18 Simone A. Padoan , Stefano Rizzelli , Matteo Schiavone

Machine learning models have exhibited exceptional results in various domains. The most prevalent approach for learning is the empirical risk minimizer (ERM), which adapts the model's weights to reduce the loss on a training set and…

Machine Learning · Computer Science 2024-12-11 Koby Bibas

Using the standard finite element method (FEM) to solve general partial differential equations, the round-off error is found to be proportional to $N^{\beta_{\rm R}}$, with $N$ the number of degrees of freedom (DoFs) and $\beta_{\rm R}$ a…

Numerical Analysis · Mathematics 2022-02-08 Jie Liu , Henk M. Schuttelaars , Matthias Möller

We introduce the Equilibrated Averaging Residual Method (EARM), a unified equilibrated flux-recovery framework for elliptic interface problems that applies to a broad class of finite element discretizations. The method is applicable in both…

Numerical Analysis · Mathematics 2026-01-06 Cuiyu He

Due to the poor generalization performance of traditional empirical risk minimization (ERM) in the case of distributional shift, Out-of-Distribution (OoD) generalization algorithms receive increasing attention. However, OoD generalization…

Machine Learning · Computer Science 2022-06-14 Runpeng Yu , Hong Zhu , Kaican Li , Lanqing Hong , Rui Zhang , Nanyang Ye , Shao-Lun Huang , Xiuqiang He

Overdetermined systems of first kind integral equations appear in many applications. When the right-hand side is discretized, the resulting finite-data problem is ill-posed and admits infinitely many solutions. We propose a numerical method…

Numerical Analysis · Mathematics 2023-07-26 Patricia Díaz de Alba , Luisa Fermo , Federica Pes , Giuseppe Rodriguez

An algorithm is proposed for solving stochastic and finite sum minimization problems. Based on a trust region methodology, the algorithm employs normalized steps, at least as long as the norms of the stochastic gradient estimates are within…

Optimization and Control · Mathematics 2018-06-27 Frank E. Curtis , Katya Scheinberg , Rui Shi

Empirical risk minimization stands behind most optimization in supervised machine learning. Under this scheme, labeled data is used to approximate an expected cost (risk), and a learning algorithm updates model-defining parameters in search…

Machine Learning · Statistics 2023-05-25 James Schmidt