English
Related papers

Related papers: A Novel Convex Relaxation for Non-Binary Discrete …

200 papers

We study iterative regularization for linear models, when the bias is convex but not necessarily strongly convex. We characterize the stability properties of a primal-dual gradient based approach, analyzing its convergence in the presence…

Machine Learning · Statistics 2020-10-30 Cesare Molinari , Mathurin Massias , Lorenzo Rosasco , Silvia Villa

Finding efficient and provable methods to solve non-convex optimization problems is an outstanding challenge in machine learning and optimization theory. A popular approach used to tackle non-convex problems is to use convex relaxation…

Machine Learning · Statistics 2016-10-31 Mohammad Gheshlaghi Azar , Eva Dyer , Konrad Kording

Recent results in Compressive Sensing have shown that, under certain conditions, the solution to an underdetermined system of linear equations with sparsity-based regularization can be accurately recovered by solving convex relaxations of…

Computer Vision and Pattern Recognition · Computer Science 2012-01-19 Dheeraj Singaraju , Ehsan Elhamifar , Roberto Tron , Allen Y. Yang , S. Shankar Sastry

The problem of super-resolution is concerned with the reconstruction of temporally/spatially localized events (or spikes) from samples of their convolution with a low-pass filter. Distinct from prior works which exploit sparsity in…

Signal Processing · Electrical Eng. & Systems 2023-03-06 Pulak Sarangi , Ryoma Hattori , Takaki Komiyama , Piya Pal

The paper introduces a new technique for compressing Binary Decision Diagrams in those cases where random access is not required. Using this technique, compression and decompression can be done in linear time in the size of the BDD and…

Artificial Intelligence · Computer Science 2008-12-18 Esben Rune Hansen , S. Srinivasa Rao , Peter Tiedemann

The aim of this paper is to develop an efficient algorithm for solving a class of unconstrained nondifferentiable convex optimization problems in finite dimensional spaces. To this end we formulate first its Fenchel dual problem and…

Optimization and Control · Mathematics 2012-03-12 Radu Ioan Bot , Christopher Hendrich

In computer vision, many problems such as image segmentation, pixel labelling, and scene parsing can be formulated as binary quadratic programs (BQPs). For submodular problems, cuts based methods can be employed to efficiently solve…

Computer Vision and Pattern Recognition · Computer Science 2016-11-17 Peng Wang , Chunhua Shen , Anton van den Hengel , Philip H. S. Torr

We study iterative signal reconstruction in computed tomography (CT), wherein measurements are produced by a linear transformation of the unknown signal followed by an exponential nonlinear map. Approaches based on pre-processing the data…

Optimization and Control · Mathematics 2024-07-19 Vasileios Charisopoulos , Rebecca Willett

Finite elasticity problems commonly include material and geometric nonlinearities and are solved using various numerical methods. However, for highly nonlinear problems, achieving convergence is relatively difficult and requires small load…

Numerical Analysis · Mathematics 2018-05-01 Yue Mei , Daniel E. Hurtado , Sanjay Pant , Ankush Aggarwal

Our work considers the optimization of the sum of a non-smooth convex function and a finite family of composite convex functions, each one of which is composed of a convex function and a bounded linear operator. This type of problem is…

Optimization and Control · Mathematics 2019-08-30 Yu-Chao Tang , Chuan-Xi Zhu , Meng Wen , Ji-Gen Peng

When a physical system is modeled by a nonlinear function, the unknown parameters can be estimated by fitting experimental observations by a least-squares approach. Newton's method and its variants are often used to solve problems of this…

Numerical Analysis · Mathematics 2021-09-20 Federica Pes , Giuseppe Rodriguez

We prove weak duality between two recent convex relaxation methods for bounding the optimal value of a constrained variational problem in which the objective is an integral functional. The first approach, proposed by Valmorbida et al. (IEEE…

Optimization and Control · Mathematics 2019-07-01 Giovanni Fantuzzi

Graph-based variational methods have recently shown to be highly competitive for various classification problems of high-dimensional data, but are inherently difficult to handle from an optimization perspective. This paper proposes a convex…

Optimization and Control · Mathematics 2017-02-17 Egil Bae , Ekaterina Merkurjev

Our goal is to extract meaningful transformations from raw images, such as varying the thickness of lines in handwriting or the lighting in a portrait. We propose an unsupervised approach to learn such transformations by attempting to…

Machine Learning · Statistics 2017-11-08 Tatsunori B. Hashimoto , John C. Duchi , Percy Liang

This paper presents an algorithm to solve non-convex optimal control problems, where non-convexity can arise from nonlinear dynamics, and non-convex state and control constraints. This paper assumes that the state and control constraints…

Optimization and Control · Mathematics 2017-05-05 Yuanqi Mao , Michael Szmuk , Behcet Acikmese

Motivated by modern regression applications, in this paper, we study the convexification of a class of convex optimization problems with indicator variables and combinatorial constraints on the indicators. Unlike most of the previous work…

Optimization and Control · Mathematics 2021-06-17 Linchuan Wei , Andres Gomez , Simge Kucukyavuz

We present the framework of slowly varying regression under sparsity, allowing sparse regression models to exhibit slow and sparse variations. The problem of parameter estimation is formulated as a mixed-integer optimization problem. We…

Machine Learning · Computer Science 2023-11-14 Dimitris Bertsimas , Vassilis Digalakis , Michael Linghzi Li , Omar Skali Lami

This paper suggests two novel ideas to develop new proximal variable-metric methods for solving a class of composite convex optimization problems. The first idea is a new parameterization of the optimality condition which allows us to…

Optimization and Control · Mathematics 2018-12-14 Quoc Tran-Dinh , Liang Ling , Kim-Chuan Toh

We propose a flexible convex relaxation for the phase retrieval problem that operates in the natural domain of the signal. Therefore, we avoid the prohibitive computational cost associated with "lifting" and semidefinite programming (SDP)…

Information Theory · Computer Science 2017-03-17 Sohail Bahmani , Justin Romberg

We propose an approach for dense semantic 3D reconstruction which uses a data term that is defined as potentials over viewing rays, combined with continuous surface area penalization. Our formulation is a convex relaxation which we augment…

Computer Vision and Pattern Recognition · Computer Science 2019-08-27 Nikolay Savinov , Christian Haene , Lubor Ladicky , Marc Pollefeys