English
Related papers

Related papers: Neyman-Pearson classification, convexity and stoch…

200 papers

In recent years, a myriad of advanced results have been reported in the community of imitation learning, ranging from parametric to non-parametric, probabilistic to non-probabilistic and Bayesian to frequentist approaches. Meanwhile, ample…

Machine Learning · Computer Science 2019-09-18 Yanlong Huang , Darwin G. Caldwell

This paper considers the problem of compact source detection on a Gaussian background in 1D. Two aspects of this problem are considered: the design of the detector and the filtering of the data. Our detection scheme is based on local maxima…

Astrophysics · Physics 2009-11-10 M. Lopez-Caniego , D. Herranz , R. B. Barreiro , J. L. Sanz

Resource-constrained classification tasks are common in real-world applications such as allocating tests for disease diagnosis, hiring decisions when filling a limited number of positions, and defect detection in manufacturing settings…

Machine Learning · Computer Science 2023-11-22 Danit Shifman Abukasis , Izack Cohen , Xiaochen Xian , Kejun Huang , Gonen Singer

Most inverse optimization models impute unspecified parameters of an objective function to make an observed solution optimal for a given optimization problem with a fixed feasible set. We propose two approaches to impute unspecified…

Optimization and Control · Mathematics 2019-07-19 Timothy C. Y. Chan , Neal Kaw

Motivation: Gene selection has become a common task in most gene expression studies. The objective of such research is often to identify the smallest possible set of genes that can still achieve good predictive performance. The problem of…

We propose a novel Riemannian method for solving the Extreme multi-label classification problem that exploits the geometric structure of the sparse low-dimensional local embedding models. A constrained optimization problem is formulated as…

Optimization and Control · Mathematics 2021-10-01 Jayadev Naram , Tanmay Kumar Sinha , Pawan Kumar

In this paper, we present a local information theoretic approach to explicitly learn probabilistic clustering of a discrete random variable. Our formulation yields a convex maximization problem for which it is NP-hard to find the global…

Machine Learning · Computer Science 2018-10-12 David Qiu , Anuran Makur , Lizhong Zheng

We consider high-dimensional binary classification by sparse logistic regression. We propose a model/feature selection procedure based on penalized maximum likelihood with a complexity penalty on the model size and derive the non-asymptotic…

Statistics Theory · Mathematics 2018-11-20 Felix Abramovich , Vadim Grinshtein

Most high-dimensional estimation and prediction methods propose to minimize a cost function (empirical risk) that is written as a sum of losses associated to each data point. In this paper we focus on the case of non-convex losses, which is…

Machine Learning · Statistics 2017-01-17 Song Mei , Yu Bai , Andrea Montanari

We study clustered multitask learning in a semiparametric setting where tasks share a latent cluster structure in their target parameters but exhibit heterogeneous, potentially infinite-dimensional nuisance components. Such heterogeneity…

Machine Learning · Statistics 2026-05-05 Hanxiao Chen , Debarghya Mukherjee

We propose a distributionally robust classification model with a fairness constraint that encourages the classifier to be fair in view of the equality of opportunity criterion. We use a type-$\infty$ Wasserstein ambiguity set centered at…

Machine Learning · Computer Science 2021-07-13 Yijie Wang , Viet Anh Nguyen , Grani A. Hanasusanto

As learning solutions reach critical applications in social, industrial, and medical domains, the need to curtail their behavior has become paramount. There is now ample evidence that without explicit tailoring, learning can lead to biased,…

Machine Learning · Computer Science 2021-02-19 Luiz F. O. Chamon , Alejandro Ribeiro

Generalized linear regressions, such as logistic regressions or Poisson regressions, are long-studied regression analysis approaches, and their applications are widely employed in various classification problems. Our study considers a…

Machine Learning · Statistics 2024-01-17 Vu Duc Anh , Tran Anh Tuan , Tran Ngoc Thang , Nguyen Thi Ngoc Anh

As machine learning applications grow increasingly ubiquitous and complex, they face an increasing set of requirements beyond accuracy. The prevalent approach to handle this challenge is to aggregate a weighted combination of requirement…

Machine Learning · Computer Science 2026-01-07 Aneesh Barthakur , Luiz F. O. Chamon

Devising efficient algorithms to solve continuously-varying strongly convex optimization programs is key in many applications, from control systems to signal processing and machine learning. In this context, solving means to find and track…

Optimization and Control · Mathematics 2020-01-09 Andrea Simonetto

This paper presents a general description of a parameter estimation inverse problem for systems governed by nonlinear differential equations. The inverse problem is presented using optimal control tools with state constraints, where the…

Numerical Analysis · Mathematics 2018-06-28 Mohamed Kamel Riahi , Issam Al Qattan

An unsolved issue in widely used methods such as Support Vector Data Description (SVDD) and Small Sphere and Large Margin SVM (SSLM) for anomaly detection is their nonconvexity, which hampers the analysis of optimal solutions in a manner…

Machine Learning · Computer Science 2025-10-01 Hongying Liu , Hao Wang , Haoran Chu , Yibo Wu

Data analysis in science, e.g., high-energy particle physics, is often subject to an intractable likelihood if the observables and observations span a high-dimensional input space. Typically the problem is solved by reducing the…

Data Analysis, Statistics and Probability · Physics 2021-01-14 Stefan Wunsch , Simon Jörger , Roger Wolf , Günter Quast

We present a fully probabilistic approach for solving binary optimization problems with black-box objective functions and with budget constraints. In the probabilistic approach, the optimization variable is viewed as a random variable and…

Optimization and Control · Mathematics 2024-06-11 Ahmed Attia

In this paper, we propose new proximal Newton-type methods for convex optimization problems in composite form. The applications include model predictive control (MPC) and embedded MPC. Our new methods are computationally attractive since…

Optimization and Control · Mathematics 2020-07-21 Ilan Adler , Zhiyue Tom Hu , Tianyi Lin