English
Related papers

Related papers: A Minimax Surrogate Loss Approach to Conditional D…

200 papers

We study a natural extension of classical empirical risk minimization, where the hypothesis space is a random subspace of a given space. In particular, we consider possibly data dependent subspaces spanned by a random subset of the data,…

Machine Learning · Statistics 2022-12-09 Andrea Della Vecchia , Ernesto De Vito , Lorenzo Rosasco

We propose a new modeling and estimation approach to select the optimal treatment regime from different options through constructing a robust estimating equation. The method is protected against misspecification of the propensity score…

Methodology · Statistics 2022-11-15 Trinetri Ghosh , Yanyuan Ma , Wensheng Zhu , Yuanjia Wang

Recently, several universal methods have been proposed for online convex optimization, and attain minimax rates for multiple types of convex functions simultaneously. However, they need to design and optimize one surrogate loss for each…

Machine Learning · Computer Science 2024-11-21 Lijun Zhang , Yibo Wang , Guanghui Wang , Jinfeng Yi , Tianbao Yang

Stochastic inverse problems are generally solved by some form of finite sampling of a space of uncertain parameters. For computationally expensive models, surrogate response surfaces are often employed to increase the number of samples used…

Numerical Analysis · Mathematics 2018-07-04 Steven Mattis , Barbara Wohlmuth

Conventional techniques for supervised classification constrain the classification rules considered and use surrogate losses for classification 0-1 loss. Favored families of classification rules are those that enjoy parametric…

Machine Learning · Statistics 2019-06-03 Santiago Mazuelas , Andrea Zanoni , Aritz Perez

Discrete optimization belongs to the set of $\mathcal{NP}$-hard problems, spanning fields such as mixed-integer programming and combinatorial optimization. A current standard approach to solving convex discrete optimization problems is the…

Machine Learning · Computer Science 2024-02-28 Kyle Mana , Fernando Acero , Stephen Mak , Parisa Zehtabi , Michael Cashmore , Daniele Magazzeni , Manuela Veloso

This paper presents a weighted optimization framework that unifies the binary,multi-valued, continuous, as well as mixture of discrete and continuous treatment, under the unconfounded treatment assignment. With a general loss function, the…

Econometrics · Economics 2018-08-20 Chunrong Ai , Oliver Linton , Kaiji Motegi , Zheng Zhang

The increasing penetration of renewable generation introduces uncertainty into power systems, challenging traditional deterministic optimization methods. Chance-constrained optimization offers an approach to balancing cost and risk;…

Optimization and Control · Mathematics 2025-11-06 Amir Bahador Javadi , Amin Kargarian

This Element offers a practical guide to estimating conditional marginal effects-how treatment effects vary with a moderating variable-using modern statistical methods. Commonly used approaches, such as linear interaction models, often…

Methodology · Statistics 2026-05-21 Jiehan Liu , Ziyi Liu , Yiqing Xu

Machine unlearning seeks to remove the influence of designated training data while preserving performance on the remaining data. Approximate unlearning can be viewed as a local editing problem; in min-max unlearning, the key local object is…

Machine Learning · Computer Science 2026-05-08 Junhao Cai , Dohun Kim , Dowon Kim , Sung Il Choi , Chengjun Jin , Juhyun Park , Changhee Joo

Given the long follow-up periods that are often required for treatment or intervention studies, the potential to use surrogate markers to decrease the required follow-up time is a very attractive goal. However, previous studies have shown…

Methodology · Statistics 2016-08-12 Layla Parast , Tianxi Cai , Lu Tian

In classification, the de facto method for aggregating individual losses is the average loss. When the actual metric of interest is 0-1 loss, it is common to minimize the average surrogate loss for some well-behaved (e.g. convex) surrogate.…

Machine Learning · Computer Science 2018-11-06 Bryan He , James Zou

This paper introduces a novel approach for estimating heterogeneous treatment effects of binary treatment in panel data, particularly focusing on short panel data with large cross-sectional data and observed confoundings. In contrast to…

Methodology · Statistics 2024-06-05 Meijia Wang , Ignacio Martinez , P. Richard Hahn

When a black-box optimization objective can only be evaluated with costly or noisy measurements, most standard optimization algorithms are unsuited to find the optimal solution. Specialized algorithms that deal with exactly this situation…

Machine Learning · Computer Science 2021-06-11 Laurens Bliek , Sicco Verwer , Mathijs de Weerdt

Model extraction attacks have become serious issues for service providers using machine learning. We consider an adversarial setting to prevent model extraction under the assumption that attackers will make their best guess on the service…

Machine Learning · Computer Science 2021-03-12 Yuto Mori , Atsushi Nitanda , Akiko Takeda

A probabilistic performance-oriented control design optimization approach is introduced for flight systems. Aiming at estimating rare-event probabilities accurately and efficiently, subset simulation is combined with surrogate modeling…

Systems and Control · Electrical Eng. & Systems 2021-04-20 Dalong Shi , Florian Holzapfel

In decision-making problems under uncertainty, predicting unknown parameters is often considered independent of the optimization part. Decision-focused learning (DFL) is a task-oriented framework that integrates prediction and optimization…

Machine Learning · Computer Science 2025-02-11 Haeun Jeon , Hyunglip Bae , Minsu Park , Chanyeong Kim , Woo Chang Kim

A surrogate function is often employed to reduce the number of objective function evaluations for optimization. However, the effect of using a surrogate model in evolutionary approaches has not been theoretically investigated. This paper…

Neural and Evolutionary Computing · Computer Science 2022-04-07 Youhei Akimoto

This paper introduces a novel approach to contextual stochastic optimization, integrating operations research and machine learning to address decision-making under uncertainty. Traditional methods often fail to leverage contextual…

Machine Learning · Computer Science 2025-05-09 Louis Bouvier , Thibault Prunet , Vincent Leclère , Axel Parmentier

This study focuses on solving group zero-norm regularized robust loss minimization problems. We propose a proximal Majorization-Minimization (PMM) algorithm to address a class of equivalent Difference-of-Convex (DC) surrogate optimization…

Optimization and Control · Mathematics 2025-05-30 Ling Liang , Shujun Bi