English
Related papers

Related papers: Optimal functional supervised classification with …

200 papers

Some statistical models are specified via a data generating process for which the likelihood function cannot be computed in closed form. Standard likelihood-based inference is then not feasible but the model parameters can be inferred by…

Computation · Statistics 2015-02-20 Michael U. Gutmann , Jukka Corander , Ritabrata Dutta , Samuel Kaski

Many expensive black-box optimisation problems are sensitive to their inputs. In these problems it makes more sense to locate a region of good designs, than a single-possibly fragile-optimal design. Expensive black-box functions can be…

Machine Learning · Computer Science 2021-12-16 Nicholas D. Sanders , Richard M. Everson , Jonathan E. Fieldsend , Alma A. M. Rahat

A special class of optimal control problems with complementarity constraints on the control functions is studied. It is shown that such problems possess optimal solutions whenever the underlying control space is a first-order Sobolev space.…

Optimization and Control · Mathematics 2019-11-20 Christian Clason , Yu Deng , Patrick Mehlitz , Uwe Prüfert

We propose a class of models based on Fisher's Linear Discriminant (FLD) in the context of domain adaptation. The class is the convex combination of two hypotheses: i) an average hypothesis representing previously seen source tasks and ii)…

Signal Processing · Electrical Eng. & Systems 2024-03-05 Hayden S. Helm , Ashwin De Silva , Joshua T. Vogelstein , Carey E. Priebe , Weiwei Yang

We study classification problems using binary estimators where the decision boundary is described by horizon functions and where the data distribution satisfies a geometric margin condition. A key novelty of our work is the derivation of…

Machine Learning · Statistics 2026-03-16 Jonathan García , Philipp Petersen

It has been recently shown that, under the margin (or low noise) assumption, there exist classifiers attaining fast rates of convergence of the excess Bayes risk, that is, rates faster than $n^{-1/2}$. The work on this subject has suggested…

Statistics Theory · Mathematics 2009-09-29 Jean-Yves Audibert , Alexandre B. Tsybakov

Budget feasible mechanisms, recently initiated by Singer (FOCS 2010), extend algorithmic mechanism design problems to a realistic setting with a budget constraint. We consider the problem of designing truthful budget feasible mechanisms for…

Computer Science and Game Theory · Computer Science 2010-07-23 Ning Chen , Nick Gravin , Pinyan Lu

In the Naive Bayes classification model the class conditional densities are estimated as the products of their marginal densities along the cardinal basis directions. We study the problem of obtaining an alternative basis for this…

Machine Learning · Statistics 2025-08-19 David P. Hofmeyr , Francois Kamper , Michail C. Melonas

We study the problem of constrained efficient global optimization, where both the objective and constraints are expensive black-box functions that can be learned with Gaussian processes. We propose CONFIG (CONstrained efFIcient Global…

Optimization and Control · Mathematics 2025-02-07 Wenjie Xu , Yuning Jiang , Bratislav Svetozarevic , Colin N. Jones

It has been recently shown that, under the margin (or low noise) assumption, there exist classifiers attaining fast rates of convergence of the excess Bayes risk, i.e., the rates faster than $n^{-1/2}$. The works on this subject suggested…

Statistics Theory · Mathematics 2011-06-01 Jean-Yves Audibert , Alexandre B. Tsybakov

We develop a general framework for margin-based multicategory classification in metric spaces. The basic work-horse is a margin-regularized version of the nearest-neighbor classifier. We prove generalization bounds that match the state of…

Machine Learning · Computer Science 2014-01-31 Aryeh Kontorovich , Roi Weiss

We propose a new methodology for parameterized constrained robust optimization, an important class of optimization problems under uncertainty, based on learning with a self-supervised penalty-based loss function. Whereas supervised learning…

Optimization and Control · Mathematics 2025-03-10 Wyame Benslimane , Paul Grigas

The manifold hypothesis says that natural high-dimensional data lie on or around a low-dimensional manifold. The recent success of statistical and learning-based methods in very high dimensions empirically supports this hypothesis,…

Machine Learning · Computer Science 2025-05-06 Hong Ye Tan , Subhadip Mukherjee , Junqi Tang , Carola-Bibiane Schönlieb

Binary optimization is a fundamental area in computational science, with wide-ranging applications from logistics to cryptography, where the tasks are often formulated as Quadratic or Polynomial Unconstrained Binary Optimization problems…

Quantum Physics · Physics 2024-12-20 Jean Cazalis , Tirth Shah , Yahui Chai , Karl Jansen , Stefan Kühn

We study stochastic optimization problems with objective function given by the expectation of the maximum of two linear functions defined on the component random variables of a multivariate Gaussian distribution. We consider random…

Optimization and Control · Mathematics 2021-12-15 David Bergman , Carlos Cardonha , Jason Imbrogno , Leonardo Lozano

Many researchers in artificial intelligence are beginning to explore the use of soft constraints to express a set of (possibly conflicting) problem requirements. A soft constraint is a function defined on a collection of variables which…

Artificial Intelligence · Computer Science 2011-07-04 D. Cohen , M. Cooper , P. Jeavons , A. Krokhin

We introduce several generalizations of classical computer science problems obtained by replacing simpler objective functions with general submodular functions. The new problems include submodular load balancing, which generalizes load…

Data Structures and Algorithms · Computer Science 2010-06-02 Zoya Svitkina , Lisa Fleischer

The vast majority of statistical theory on binary classification characterizes performance in terms of accuracy. However, accuracy is known in many cases to poorly reflect the practical consequences of classification error, most famously in…

Statistics Theory · Mathematics 2022-09-27 Shashank Singh , Justin Khim

The Poisson model is frequently employed to describe count data, but in a Bayesian context it leads to an analytically intractable posterior probability distribution. In this work, we analyze a variational Gaussian approximation to the…

Numerical Analysis · Mathematics 2018-02-14 Simon Arridge , Kazufumi Ito , Bangti Jin , Chen Zhang

Second-order optimality conditions of the bilevel programming problems are dependent on the second-order directional derivatives of the value functions or the solution mappings of the lower level problems under some regular conditions,…

Optimization and Control · Mathematics 2023-07-24 Xiang Liu , Mengwei Xu , Liwei Zhang