English
Related papers

Related papers: Handling Hard Affine SDP Shape Constraints in RKHS…

200 papers

In the present paper, several types of efficiency conditions are established for vector optimization problems with cone constraints affected by uncertainty, but with no information of stochastic nature about the uncertain data. Following a…

Optimization and Control · Mathematics 2021-02-01 Amos Uderzo

Support vector machines (SVMs) are well-studied supervised learning models for binary classification. In many applications, large amounts of samples can be cheaply and easily obtained. What is often a costly and error-prone process is to…

Optimization and Control · Mathematics 2024-12-20 Veronica Piccialli , Jan Schwiddessen , Antonio M. Sudoso

We propose a stochastic gradient framework for solving stochastic composite convex optimization problems with (possibly) infinite number of linear inclusion constraints that need to be satisfied almost surely. We use smoothing and homotopy…

Optimization and Control · Mathematics 2019-02-04 Olivier Fercoq , Ahmet Alacaoglu , Ion Necoara , Volkan Cevher

Wideband communication receivers often deal with the problems of detecting weak signals from distant sources received together with strong nearby interferers. When the techniques of random modulation are used in communication system…

Information Theory · Computer Science 2018-11-15 Dian Mo , Marco F. Duarte

This paper develops a general framework for solving a variety of convex cone problems that frequently arise in signal processing, machine learning, statistics, and other fields. The approach works as follows: first, determine a conic…

Optimization and Control · Mathematics 2011-12-20 Stephen R. Becker , Emmanuel J. Candès , Michael Grant

Support vector machines (SVMs) are special kernel based methods and belong to the most successful learning methods since more than a decade. SVMs can informally be described as a kind of regularized M-estimators for functions and have…

Machine Learning · Statistics 2010-07-26 Andreas Christmann , Robert Hable

Large collections of matrices arise throughout modern machine learning, signal processing, and scientific computing, where they are commonly compressed by concatenation followed by truncated singular value decomposition (SVD). This strategy…

Numerical Analysis · Mathematics 2026-01-21 Maksym Shamrai

Recently, saddle point problems have received much attention due to their powerful modeling capability for a lot of problems from diverse domains. Applications of these problems occur in many applied areas, such as robust optimization,…

Optimization and Control · Mathematics 2022-02-15 Mohammad Alkousa , Alexander Gasnikov , Pavel Dvurechensky , Abdurakhmon Sadiev , Lama Razouk

While deep learning techniques have become extremely popular for solving a broad range of optimization problems, methods to enforce hard constraints during optimization, particularly on deep neural networks, remain underdeveloped. Inspired…

We introduce and study conic geometric programs (CGPs), which are convex optimization problems that unify geometric programs (GPs) and conic optimization problems such as semidefinite programs (SDPs). A CGP consists of a linear objective…

Optimization and Control · Mathematics 2013-10-14 Venkat Chandrasekaran , Parikshit Shah

This paper studies distributionally robust optimization for a rich class of risk measures with ambiguity sets defined by $\phi$-divergences. The risk measures are allowed to be non-linear in probabilities, are represented by Choquet…

Optimization and Control · Mathematics 2025-04-15 Guanyu Jin , Roger J. A. Laeven , Dick den Hertog

We provide a general framework to construct finite dimensional approximations of the space of convex functions, which also applies to the space of c-convex functions and to the space of support functions of convex bodies. We give estimates…

Numerical Analysis · Mathematics 2014-03-11 Quentin Mérigot , Edouard Oudet

Feature attribution for kernel methods is often heuristic and not individualised for each prediction. To address this, we turn to the concept of Shapley values~(SV), a coalition game theoretical framework that has previously been applied to…

Machine Learning · Statistics 2022-05-27 Siu Lun Chau , Robert Hu , Javier Gonzalez , Dino Sejdinovic

The problem of ensuring constraints satisfaction on the output of machine learning models is critical for many applications, especially in safety-critical domains. Modern approaches rely on penalty-based methods at training time, which do…

Machine Learning · Computer Science 2025-04-14 Gaetano Signorelli , Michele Lombardi

In this paper, we study possible extensions of the main ideas and methods of constrained DC optimization to the case of nonlinear semidefinite programming problems and more general nonlinear and nonsmooth cone constrained optimization…

Optimization and Control · Mathematics 2024-04-23 M. V. Dolgopolik

Recently the shape-restricted inference has gained popularity in statistical and econometric literature in order to relax the linear or quadratic covariate effect in regression analyses. The typical shape-restricted covariate effect…

Methodology · Statistics 2021-07-05 Geng Deng , Guangning Xu , Qiang Fu , Xindong Wang , Jing Qin

Load forecasting is a fundamental task in smart grid. Many techniques have been applied to developing load forecasting models. Due to the challenges such as the Curse of Dimensionality, overfitting, and limited computing resources,…

Machine Learning · Computer Science 2025-03-14 Pengyang Song , Han Feng , Shreyashi Shukla , Jue Wang , Tao Hong

This paper considers stochastic convex optimization problems with two sets of constraints: (a) deterministic constraints on the domain of the optimization variable, which are difficult to project onto; and (b) deterministic or stochastic…

Optimization and Control · Mathematics 2022-05-25 Zeeshan Akhtar , Ketan Rajawat

We develop a novel and single-loop variance-reduced algorithm to solve a class of stochastic nonconvex-convex minimax problems involving a nonconvex-linear objective function, which has various applications in different fields such as…

Optimization and Control · Mathematics 2020-10-27 Quoc Tran-Dinh , Deyi Liu , Lam M. Nguyen

Stochastic optimization of continuous objectives is at the heart of modern machine learning. However, many important problems are of discrete nature and often involve submodular objectives. We seek to unleash the power of stochastic…

Machine Learning · Computer Science 2017-11-07 Mohammad Reza Karimi , Mario Lucic , Hamed Hassani , Andreas Krause