English
Related papers

Related papers: MOSIC: Model-Agnostic Optimal Subgroup Identificat…

200 papers

The partially observable constrained optimization problems (POCOPs) impede data-driven optimization techniques since an infeasible solution of POCOPs can provide little information about the objective as well as the constraints. We endeavor…

Machine Learning · Computer Science 2023-12-27 Shengbo Wang , Ke Li

The expansion of machine learning into dynamic environments presents challenges in handling open-world problems where label shift, covariate shift, and unknown classes emerge. Post-training methods have been explored to address these…

Machine Learning · Computer Science 2025-08-26 Miru Kim , Mugon Joe , Minhae Kwon

This article addresses the problem of derivative-free (single- or multi-objective) optimization subject to multiple inequality constraints. Both the objective and constraint functions are assumed to be smooth, non-linear and expensive to…

Computation · Statistics 2017-07-28 Paul Feliot , Julien Bect , Emmanuel Vazquez

Classification tasks are usually evaluated in terms of accuracy. However, accuracy is discontinuous and cannot be directly optimized using gradient ascent. Popular methods minimize cross-entropy, hinge loss, or other surrogate losses, which…

Machine Learning · Computer Science 2024-07-25 Ivan Karpukhin , Stanislav Dereka , Sergey Kolesnikov

Recent empirical and theoretical analyses of several commonly used prediction procedures reveal a peculiar risk behavior in high dimensions, referred to as double/multiple descent, in which the asymptotic risk is a non-monotonic function of…

Statistics Theory · Mathematics 2022-05-26 Pratik Patil , Arun Kumar Kuchibhotla , Yuting Wei , Alessandro Rinaldo

In clinical trials and other applications, we often see regions of the feature space that appear to exhibit interesting behaviour, but it is unclear whether these observed phenomena are reflected at the population level. Focusing on a…

Statistics Theory · Mathematics 2023-09-21 Henry W. J. Reeve , Timothy I. Cannings , Richard J. Samworth

We establish a broad methodological foundation for mixed-integer optimization with learned constraints. We propose an end-to-end pipeline for data-driven decision making in which constraints and objectives are directly learned from data…

Optimization and Control · Mathematics 2023-10-30 Donato Maragno , Holly Wiberg , Dimitris Bertsimas , S. Ilker Birbil , Dick den Hertog , Adejuyigbe Fajemisin

Weakly supervised video anomaly detection (WS-VAD) is to distinguish anomalies from normal events based on discriminative representations. Most existing works are limited in insufficient video representations. In this work, we develop a…

Computer Vision and Pattern Recognition · Computer Science 2021-04-06 Jia-Chang Feng , Fa-Ting Hong , Wei-Shi Zheng

Selective classification is a powerful tool for automated decision-making in high-risk scenarios, allowing classifiers to act only when confident and abstain when uncertainty is high. Given a target accuracy, our goal is to minimize…

Statistics Theory · Mathematics 2025-10-28 Mohamed Ndaoud , Peter Radchenko , Bradley Rava

Adaptive algorithms like AdaGrad and AMSGrad are successful in nonconvex optimization owing to their parameter-agnostic ability -- requiring no a priori knowledge about problem-specific parameters nor tuning of learning rates. However, when…

Optimization and Control · Mathematics 2022-10-17 Junchi Yang , Xiang Li , Niao He

Decentralized optimization is a common paradigm used in distributed signal processing and sensing as well as privacy-preserving and large-scale machine learning. It is assumed that several computational entities locally hold objective…

Optimization and Control · Mathematics 2023-01-12 Alexander Rogozin , Demyan Yarmoshik , Ksenia Kopylova , Alexander Gasnikov

An accurate multiclass classification strategy is crucial to interpreting antibody tests. However, traditional methods based on confidence intervals or receiver operating characteristics lack clear extensions to settings with more than two…

Quantitative Methods · Quantitative Biology 2024-05-07 Rayanne A. Luke , Anthony J. Kearsley , Paul N. Patrone

Finding Minimal Unsatisfiable Subsets (MUSes) of binary constraints is a common problem in infeasibility analysis of over-constrained systems. However, because of the exponential search space of the problem, enumerating MUSes is extremely…

Artificial Intelligence · Computer Science 2024-02-27 Panagiotis Lymperopoulos , Liping Liu

Estimating the conditional average treatment effect (CATE) from observational data plays a crucial role in areas such as e-commerce, healthcare, and economics. Existing studies mainly rely on the strong ignorability assumption that there…

Machine Learning · Computer Science 2025-01-28 Chuan Zhou , Yaxuan Li , Chunyuan Zheng , Haiteng Zhang , Haoxuan Li , Mingming Gong

We develop an inexact primal-dual first-order smoothing framework to solve a class of non-bilinear saddle point problems with primal strong convexity. Compared with existing methods, our framework yields a significant improvement over the…

Optimization and Control · Mathematics 2023-07-25 Le Thi Khanh Hien , Renbo Zhao , William B. Haskell

We propose a unified framework for estimating low-rank matrices through nonconvex optimization based on gradient descent algorithm. Our framework is quite general and can be applied to both noisy and noiseless observations. In the general…

Machine Learning · Statistics 2016-10-18 Lingxiao Wang , Xiao Zhang , Quanquan Gu

We propose a new approach to solving bilevel optimization problems, intermediate between solving full-system optimality conditions with a Newton-type approach, and treating the inner problem as an implicit function. The overall idea is to…

Optimization and Control · Mathematics 2024-05-08 Ensio Suonperä , Tuomo Valkonen

Diagnostic performance in medical AI varies systematically across demographic groups, yet subgroup AUC can mask clinically important disparities. At a fixed inference-time operating point, some groups may exhibit over-diagnostic behaviour,…

In compressed sensing, the sensing matrix is assumed perfectly known. However, there exists perturbation in the sensing matrix in reality due to sensor offsets or noise disturbance. Directions-of-arrival (DoA) estimation with off-grid…

Signal Processing · Electrical Eng. & Systems 2019-06-04 Cheng-Yu Hung , Mostafa Kaveh

Formulating accurate and robust classification strategies is a key challenge of developing diagnostic and antibody tests. Methods that do not explicitly account for disease prevalence and uncertainty therein can lead to significant…

Methodology · Statistics 2022-02-01 Paul N. Patrone , Anthony J. Kearsley