English
Related papers

Related papers: Joint Continuous and Discrete Model Selection via …

200 papers

We consider a class of infinite-dimensional optimization problems in which a distributed vector-valued variable should pointwise almost everywhere take values from a given finite set $\mathcal{M}\subset\mathbb{R}^m$. Such hybrid…

Optimization and Control · Mathematics 2021-11-09 Christian Clason , Carla Tameling , Benedikt Wirth

We propose a novel framework for learning stabilizable nonlinear dynamical systems for continuous control tasks in robotics. The key idea is to develop a new control-theoretic regularizer for dynamics fitting rooted in the notion of…

Systems and Control · Computer Science 2018-11-13 Sumeet Singh , Vikas Sindhwani , Jean-Jacques E. Slotine , Marco Pavone

Deep networks are an integral part of the current machine learning paradigm. Their inherent ability to learn complex functional mappings between data and various target variables, while discovering hidden, task-driven features, makes them a…

Computer Vision and Pattern Recognition · Computer Science 2019-06-14 Riddhish Bhalodia , Shireen Elhabian , Ladislav Kavan , Ross Whitaker

The design of complex engineering systems leads to solving very large optimization problems involving different disciplines. Strategies allowing disciplines to optimize in parallel by providing sub-objectives and splitting the problem into…

Machine Learning · Computer Science 2021-06-14 Jean de Becdelievre , Ilan Kroo

This paper studies $\ell_1$ regularization with high-dimensional features for support vector machines with a built-in reject option (meaning that the decision of classifying an observation can be withheld at a cost lower than that of…

Statistics Theory · Mathematics 2012-01-06 Marten Wegkamp , Ming Yuan

We extend the work of Narasimhan and Bilmes [30] for minimizing set functions representable as a dierence between submodular functions. Similar to [30], our new algorithms are guaranteed to monotonically reduce the objective function at…

Machine Learning · Computer Science 2014-08-12 Rishabh Iyer , Jeff A. Bilmes

In this paper, we focus on applications in machine learning, optimization, and control that call for the resilient selection of a few elements, e.g. features, sensors, or leaders, against a number of adversarial denial-of-service attacks or…

Optimization and Control · Mathematics 2017-11-01 Vasileios Tzoumas , Konstantinos Gatsis , Ali Jadbabaie , George J. Pappas

We define a new class of set functions that in addition to being monotone and subadditive, also admit a very limited form of submodularity defined over a permutation of the ground set. We refer to this permutation as a submodular order.…

Optimization and Control · Mathematics 2024-03-01 Rajan Udwani

Submodular continuous functions are a category of (generally) non-convex/non-concave functions with a wide spectrum of applications. We characterize these functions and demonstrate that they can be maximized efficiently with approximation…

Machine Learning · Computer Science 2019-05-07 Andrew An Bian , Baharan Mirzasoleiman , Joachim M. Buhmann , Andreas Krause

The Column Subset Selection Problem provides a natural framework for unsupervised feature selection. Despite being a hard combinatorial optimization problem, there exist efficient algorithms that provide good approximations. The drawback of…

Machine Learning · Computer Science 2018-04-13 Bruno Ordozgoiti , Alberto Mozo , Jesús García López de Lacalle

In this paper, we consider a class of constrained multiobjective optimization problems, where each objective function can be expressed by adding a possibly nonsmooth nonconvex function and a differentiable function with Lipschitz continuous…

Optimization and Control · Mathematics 2026-01-01 Nguyen Van Tuyen , Minh N. Dao , Tran Van Nghi

We introduce a novel approach to reduce the computational effort of solving mixed-integer convex chance constrained programs through the scenario approach. Instead of reducing the number of required scenarios, we directly minimize the…

Optimization and Control · Mathematics 2020-02-05 Damian Frick , Pier Giuseppe Sessa , Tony A. Wood , Maryam Kamgarpour

We investigate the continuous non-monotone DR-submodular maximization problem subject to a down-closed convex solvable constraint. Our first contribution is to construct an example to demonstrate that (first-order) stationary points can…

Data Structures and Algorithms · Computer Science 2024-03-27 Shengminjie Chen , Donglei Du , Wenguo Yang , Dachuan Xu , Suixiang Gao

Submodularity in combinatorial optimization has been a topic of many studies and various algorithmic techniques exploiting submodularity of a studied problem have been proposed. It is therefore natural to ask, in cases where the cost…

Data Structures and Algorithms · Computer Science 2023-05-19 Martin Böhm , Jarosław Byrka , Mateusz Lewandowski , Jan Marcinkowski

In this paper, we propose a new Fully Composite Formulation of convex optimization problems. It includes, as a particular case, the problems with functional constraints, max-type minimization problems, and problems of Composite…

Optimization and Control · Mathematics 2021-03-24 Nikita Doikov , Yurii Nesterov

Convolution Neural Networks, known as ConvNets exceptionally perform well in many complex machine learning tasks. The architecture of ConvNets demands the huge and rich amount of data and involves with a vast number of parameters that leads…

Computer Vision and Pattern Recognition · Computer Science 2017-12-14 Pushparaja Murugan , Shanmugasundaram Durairaj

In many real world applications of machine learning, models have to meet certain domain-based requirements that can be expressed as constraints (e.g., safety-critical constraints in autonomous driving systems). Such constraints are often…

Machine Learning · Computer Science 2022-06-20 Kshitij Goyal , Sebastijan Dumancic , Hendrik Blockeel

The optimal allocation of resources for maximizing influence, spread of information or coverage, has gained attention in the past years, in particular in machine learning and data mining. But in applications, the parameters of the problem…

Machine Learning · Computer Science 2017-06-14 Matthew Staib , Stefanie Jegelka

Dense image matching is a fundamental low-level problem in Computer Vision, which has received tremendous attention from both discrete and continuous optimization communities. The goal of this paper is to combine the advantages of discrete…

Computer Vision and Pattern Recognition · Computer Science 2016-01-26 Alexander Shekhovtsov , Christian Reinbacher , Gottfried Graber , Thomas Pock

We consider a class of optimization problems that involve determining the maximum value that a function in a particular class can attain subject to a collection of difference constraints. We show that a particular linear programming…

Data Structures and Algorithms · Computer Science 2022-11-16 Sungjin Im , Benjamin Moseley , Hung Q. Ngo , Kirk Pruhs , Alireza Samadian