English
Related papers

Related papers: Unveiling The Tree: A Convex Framework for Sparse …

200 papers

Consider convex optimization problems subject to a large number of constraints. We focus on stochastic problems in which the objective takes the form of expected values and the feasible set is the intersection of a large number of convex…

Machine Learning · Statistics 2015-11-13 Mengdi Wang , Yichen Chen , Jialin Liu , Yuantao Gu

In sparse coding, we attempt to extract features of input vectors, assuming that the data is inherently structured as a sparse superposition of basic building blocks. Similarly, neural networks perform a given task by learning features of…

Machine Learning · Computer Science 2022-02-16 Deborah Pereg , Israel Cohen , Anthony A. Vassiliou

Why do neurons encode information the way they do? Normative answers to this question model neural activity as the solution to an optimisation problem; for example, the celebrated efficient coding hypothesis frames neural activity as the…

Neurons and Cognition · Quantitative Biology 2026-03-06 William Dorrell , Peter E. Latham , James Whittington

Sparse coding techniques for image processing traditionally rely on a processing of small overlapping patches separately followed by averaging. This has the disadvantage that the reconstructed image no longer obeys the sparsity prior used…

Image and Video Processing · Electrical Eng. & Systems 2018-12-31 Elad Plaut , Raja Giryes

Synthesis of optimization algorithms typically follows a {\em design-then-analyze\/} approach, which can obscure fundamental performance limits and hinder the systematic development of algorithms that operate near these limits. Recently, a…

Optimization and Control · Mathematics 2025-09-26 Ibrahim K. Ozaslan , Wuwei Wu , Jie Chen , Tryphon T. Georgiou , Mihailo R. Jovanovic

This paper describes a simple framework for structured sparse recovery based on convex optimization. We show that many structured sparsity models can be naturally represented by linear matrix inequalities on the support of the unknown…

Machine Learning · Computer Science 2015-03-04 Marwa El Halabi , Volkan Cevher

Supercomputers are equipped with an increasingly large number of cores to use computational power as a way of solving problems that are otherwise intractable. Unfortunately, getting serial algorithms to run in parallel to take advantage of…

Distributed, Parallel, and Cluster Computing · Computer Science 2013-12-31 Faisal N. Abu-Khzam , Khuzaima Daudjee , Amer E. Mouawad , Naomi Nishimura

We consider a network topology design problem in which an initial undirected graph underlying the network is given and the objective is to select a set of edges to add to the graph to optimize the coherence of the resulting network. We show…

Optimization and Control · Mathematics 2014-11-19 Tyler Summers , Iman Shames , John Lygeros , Florian Dörfler

We introduce a class of budgeted prize-collecting covering subgraph problems. For an input graph with prizes on the vertices and costs on the edges, the aim of these problems is to find a connected subgraph such that the cost of its edges…

Optimization and Control · Mathematics 2021-08-05 Nicola Morandi , Roel Leus , Hande Yaman

Patriksson (2008) provided a then up-to-date survey on the continuous,separable, differentiable and convex resource allocation problem with a single resource constraint. Since the publication of that paper the interest in the problem has…

Optimization and Control · Mathematics 2015-01-29 Michael Patriksson , Christoffer Strömberg

Graph partition is a fundamental problem of parallel computing for big graph data. Many graph partition algorithms have been proposed to solve the problem in various applications, such as matrix computations and PageRank, etc., but none has…

Social and Information Networks · Computer Science 2015-01-05 Xiaoming Liu , Yadong Zhou , Xiaohong Guan

We develop two different methods to achieve subexponential time parameterized algorithms for problems on sparse directed graphs. We exemplify our approaches with two well studied problems. For the first problem, {\sc $k$-Leaf…

Data Structures and Algorithms · Computer Science 2010-01-07 Frederic Dorn , Fedor V. Fomin , Daniel Lokshtanov , Venkatesh Raman , Saket Saurabh

It was recently established that for convex optimization problems with sparse optimal solutions (be it entry-wise sparsity or matrix rank-wise sparsity) it is possible to design first-order methods with linear convergence rates that depend…

Optimization and Control · Mathematics 2026-03-20 Dan Garber

An approach to obtaining a parsimonious polynomial model from time series is proposed. An optimal minimal nonuniform time series embedding schema is used to obtain a time delay kernel. This scheme recursively optimizes an objective…

Chaotic Dynamics · Physics 2014-05-13 Chetan Nichkawde

The problem of deciding whether CSP instances admit solutions has been deeply studied in the literature, and several structural tractability results have been derived so far. However, constraint satisfaction comes in practice as a…

Artificial Intelligence · Computer Science 2013-07-19 Gianluigi Greco , Francesco Scarcello

The sparsity constrained rank-one matrix approximation problem is a difficult mathematical optimization problem which arises in a wide array of useful applications in engineering, machine learning and statistics, and the design of…

Optimization and Control · Mathematics 2012-06-27 Ronny Luss , Marc Teboulle

This work introduces a new method to efficiently solve optimization problems constrained by partial differential equations (PDEs) with uncertain coefficients. The method leverages two sources of inexactness that trade accuracy for speed:…

Optimization and Control · Mathematics 2019-05-20 Matthew J. Zahr , Kevin T. Carlberg , Drew P. Kouri

Convex relaxations of non-convex optimal power flow (OPF) problems have recently attracted significant interest. While existing relaxations globally solve many OPF problems, there are practical problems for which existing relaxations fail…

Optimization and Control · Mathematics 2014-11-18 Daniel K. Molzahn , Ian A. Hiskens

We explore the problem of step-wise explaining how to solve constraint satisfaction problems, with a use case on logic grid puzzles. More specifically, we study the problem of explaining the inference steps that one can take during…

Logic in Computer Science · Computer Science 2021-07-06 Bart Bogaerts , Emilio Gamba , Tias Guns

Sparsity-constrained optimization is an important and challenging problem that has wide applicability in data mining, machine learning, and statistics. In this paper, we focus on sparsity-constrained optimization in cases where the cost…

Machine Learning · Computer Science 2016-12-19 Feng Chen , Baojian Zhou