English
Related papers

Related papers: Efficient Linear Programming for Dense CRFs

200 papers

Parameterized complexity enables the practical solution of generally intractable NP-hard problems when certain parameters are small, making it particularly useful in real-world applications. The study of string problems in this framework…

Quantum Physics · Physics 2025-10-20 Josh Cudby , Sergii Strelchuk

Linear programming (LP) is an extremely useful tool and has been successfully applied to solve various problems in a wide range of areas, including operations research, engineering, economics, or even more abstract mathematical areas such…

Data Structures and Algorithms · Computer Science 2020-03-19 Agniva Chowdhury , Palma London , Haim Avron , Petros Drineas

We propose a general and versatile framework that significantly speeds-up graphical model optimization while maintaining an excellent solution accuracy. The proposed approach relies on a multi-scale pruning scheme that is able to…

Computer Vision and Pattern Recognition · Computer Science 2014-09-16 B. Conejo , N. Komodakis , S. Leprince , J. P. Avouac

In this work, we study a novel class of projection-based algorithms for linearly constrained problems (LCPs) which have a lot of applications in statistics, optimization, and machine learning. Conventional primal gradient-based methods for…

Optimization and Control · Mathematics 2021-01-06 Xiang Li , Zhihua Zhang

This paper treats the problem of minimizing a general continuously differentiable function subject to sparsity constraints. We present and analyze several different optimality criteria which are based on the notions of stationarity and…

Information Theory · Computer Science 2012-03-22 Amir Beck , Yonina C. Eldar

We present a computationally-efficient method for recovering sparse signals from a series of noisy observations, known as the problem of compressed sensing (CS). CS theory requires solving a convex constrained minimization problem. We…

Information Theory · Computer Science 2010-06-22 Avishy Carmi , Pini Gurfil

In many learning settings, it is beneficial to augment the main features with pairwise interactions. Such interaction models can be often enhanced by performing variable selection under the so-called strong hierarchy constraint: an…

Machine Learning · Statistics 2020-07-15 Hussein Hazimeh , Rahul Mazumder

This paper considers a generic convex minimization template with affine constraints over a compact domain, which covers key semidefinite programming applications. The existing conditional gradient methods either do not apply to our template…

Optimization and Control · Mathematics 2019-01-16 Alp Yurtsever , Olivier Fercoq , Volkan Cevher

We examine LDPC codes decoded using linear programming (LP). Four contributions to the LP framework are presented. First, a new method of tightening the LP relaxation, and thus improving the LP decoder, is proposed. Second, we present an…

Information Theory · Computer Science 2016-11-17 David Burshtein , Idan Goldenberg

Estimating probability distribution is one of the core issues in the NLP field. However, in both deep learning (DL) and pre-DL eras, unlike the vast applications of linear-chain CRF in sequence labeling tasks, very few works have applied…

Computation and Language · Computer Science 2020-08-11 Yu Zhang , Houquan Zhou , Zhenghua Li

This paper focuses on radar waveform optimization for minimizing the Cram\'er-Rao bound (CRB) in a multiple-input multiple-output (MIMO) radar system. In contrast to conventional approaches relying on semi-definite programming (SDP) and…

Signal Processing · Electrical Eng. & Systems 2024-09-20 Xiaohua Zhou , Xu Du , Yijie Mao

The Laplacian-constrained Gaussian Markov Random Field (LGMRF) is a common multivariate statistical model for learning a weighted sparse dependency graph from given data. This graph learning problem can be formulated as a maximum likelihood…

Machine Learning · Computer Science 2024-04-15 Yakov Medvedovsky , Eran Treister , Tirza Routtenberg

In this paper, we consider the optimization problem of minimizing a continuously differentiable function subject to both convex constraints and sparsity constraints. By exploiting a mixed-integer reformulation from the literature, we define…

Optimization and Control · Mathematics 2021-04-28 M. Lapucci , T. Levato , F. Rinaldi , M. Sciandrone

We address the problem of semantic segmentation using deep learning. Most segmentation systems include a Conditional Random Field (CRF) to produce a structured output that is consistent with the image's visual features. Recent deep learning…

Computer Vision and Pattern Recognition · Computer Science 2016-08-01 Anurag Arnab , Sadeep Jayasumana , Shuai Zheng , Philip Torr

Approximate linear programming (ALP) is an efficient approach to solving large factored Markov decision processes (MDPs). The main idea of the method is to approximate the optimal value function by a set of basis functions and optimize…

Artificial Intelligence · Computer Science 2012-06-18 Branislav Kveton , Milos Hauskrecht

This paper considers the decentralized convex optimization problem, which has a wide range of applications in large-scale machine learning, sensor networks, and control theory. We propose novel algorithms that achieve optimal computation…

Machine Learning · Computer Science 2023-10-11 Haishan Ye , Luo Luo , Ziang Zhou , Tong Zhang

Coordinate-wise minimization is a simple popular method for large-scale optimization. Unfortunately, for general (non-differentiable) convex problems it may not find global minima. We present a class of linear programs that coordinate-wise…

Optimization and Control · Mathematics 2020-09-15 Tomáš Dlask , Tomáš Werner

The overfitting is one of the cursing subjects in the deep learning field. To solve this challenge, many approaches were proposed to regularize the learning models. They add some hyper-parameters to the model to extend the generalization;…

Machine Learning · Computer Science 2020-05-06 Mohammad Mahdi Bejani , Mehdi Ghatee

We study the $L_1$-regularized maximum likelihood estimator/estimation (MLE) problem for discrete Markov random fields (MRFs), where efficient and scalable learning requires both sparse regularization and approximate inference. To address…

Machine Learning · Computer Science 2020-05-14 Sinong Geng , Zhaobin Kuang , Jie Liu , Stephen Wright , David Page

Image segmentation is considered to be one of the critical tasks in hyperspectral remote sensing image processing. Recently, convolutional neural network (CNN) has established itself as a powerful model in segmentation and classification by…

Computer Vision and Pattern Recognition · Computer Science 2017-12-29 Fahim Irfan Alam , Jun Zhou , Alan Wee-Chung Liew , Xiuping Jia , Jocelyn Chanussot , Yongsheng Gao