English
Related papers

Related papers: Efficient Relaxations for Dense CRFs with Sparse H…

200 papers

We consider Conditional Random Fields (CRFs) with pattern-based potentials defined on a chain. In this model the energy of a string (labeling) $x_1...x_n$ is the sum of terms over intervals $[i,j]$ where each term is non-zero only if the…

Machine Learning · Computer Science 2017-01-23 Rustem Takhanov , Vladimir Kolmogorov

We study offline Reinforcement Learning in large infinite-horizon discounted Markov Decision Processes (MDPs) when the reward and transition models are linearly realizable under a known feature map. Starting from the classic linear-program…

Machine Learning · Computer Science 2024-05-24 Gergely Neu , Nneka Okolo

We study convex relaxations of the image labeling problem on a continuous domain with regularizers based on metric interaction potentials. The generic framework ensures existence of minimizers and covers a wide range of relaxations of the…

Computer Vision and Pattern Recognition · Computer Science 2011-03-02 Jan Lellmann , Christoph Schnörr

Quadratic assignment problems (QAPs) arise in a wide variety of domains, ranging from operations research to graph theory to computer vision to neuroscience. In the age of big data, graph valued data is becoming more prominent, and with it,…

This paper considers stochastic convex optimization problems with two sets of constraints: (a) deterministic constraints on the domain of the optimization variable, which are difficult to project onto; and (b) deterministic or stochastic…

Optimization and Control · Mathematics 2022-05-25 Zeeshan Akhtar , Ketan Rajawat

Maximum a posteriori (MAP) inference is a fundamental computational paradigm for statistical inference. In the setting of graphical models, MAP inference entails solving a combinatorial optimization problem to find the most likely…

Machine Learning · Computer Science 2020-03-03 Jonathan N. Lee , Aldo Pacchiano , Michael I. Jordan

Frank-Wolfe methods (FW) have gained significant interest in the machine learning community due to its ability to efficiently solve large problems that admit a sparse structure (e.g. sparse vectors and low-rank matrices). However the…

Machine Learning · Statistics 2018-03-22 Edward Cheung , Yuying Li

Deep Neural Networks are known to be very demanding in terms of computing and memory requirements. Due to the ever increasing use of embedded systems and mobile devices with a limited resource budget, designing low-complexity models without…

Machine Learning · Computer Science 2020-11-06 Khaled Koutini , Florian Henkel , Hamid Eghbal-zadeh , Gerhard Widmer

This paper studies the problem of sampling vector and tensor signals, which is the process of choosing sites in vectors and tensors to place sensors for better recovery. A small core tensor and multiple factor matrices can be used to…

Optimization and Control · Mathematics 2024-07-03 Hao Li , Dong Liang , Zixi Zhou , Zheng Xie

While Markov Random Fields (MRFs) are widely used in computer vision, they present a quite challenging inference problem. MRF inference can be accelerated by pre-processing techniques like Dead End Elimination (DEE) or QPBO-based approaches…

Computer Vision and Pattern Recognition · Computer Science 2017-08-10 Chen Wang , Charles Herrmann , Ramin Zabih

Pruning has become a promising technique used to compress and accelerate neural networks. Existing methods are mainly evaluated on spare labeling applications. However, dense labeling applications are those closer to real world problems…

Computer Vision and Pattern Recognition · Computer Science 2021-01-19 Po-Hsiang Yu , Sih-Sian Wu , Liang-Gee Chen

The essence of distantly supervised relation extraction is that it is an incomplete multi-label classification problem with sparse and noisy features. To tackle the sparsity and noise challenges, we propose solving the classification…

Computation and Language · Computer Science 2014-11-18 Miao Fan , Deli Zhao , Qiang Zhou , Zhiyuan Liu , Thomas Fang Zheng , Edward Y. Chang

A fast algorithm for the approximation of a low rank LU decomposition is presented. In order to achieve a low complexity, the algorithm uses sparse random projections combined with FFT-based random projections. The asymptotic approximation…

Numerical Analysis · Mathematics 2016-01-19 Yariv Aizenbud , Gil Shabat , Amir Averbuch

We study the Sparse Plus Low-Rank decomposition problem (SLR), which is the problem of decomposing a corrupted data matrix into a sparse matrix of perturbations plus a low-rank matrix containing the ground truth. SLR is a fundamental…

Machine Learning · Statistics 2023-11-15 Dimitris Bertsimas , Ryan Cory-Wright , Nicholas A. G. Johnson

Fully connected pairwise Conditional Random Fields (Full-CRF) with Gaussian edge weights can achieve superior results compared to sparsely connected CRFs. However, traditional methods for Full-CRFs are too expensive. Previous work develops…

Computer Vision and Pattern Recognition · Computer Science 2018-09-14 Olga Veksler

Pixel-level labelling tasks, such as semantic segmentation, play a central role in image understanding. Recent approaches have attempted to harness the capabilities of deep learning techniques for image recognition to tackle pixel-level…

Computer Vision and Pattern Recognition · Computer Science 2016-04-15 Shuai Zheng , Sadeep Jayasumana , Bernardino Romera-Paredes , Vibhav Vineet , Zhizhong Su , Dalong Du , Chang Huang , Philip H. S. Torr

We present a computationally-efficient method for recovering sparse signals from a series of noisy observations, known as the problem of compressed sensing (CS). CS theory requires solving a convex constrained minimization problem. We…

Information Theory · Computer Science 2010-06-22 Avishy Carmi , Pini Gurfil

In this work we introduce a fully-connected graph structure in the Deep Gaussian Conditional Random Field (G-CRF) model. For this we express the pairwise interactions between pixels as the inner-products of low-dimensional embeddings,…

Computer Vision and Pattern Recognition · Computer Science 2016-11-29 Siddhartha Chandra , Iasonas Kokkinos

Various static analysis problems are reformulated as instances of the Context-Free Language Reachability (CFL-r) problem. One promising way to make solving CFL-r more practical for large-scale interprocedural graphs is to reduce CFL-r to…

Programming Languages · Computer Science 2024-01-23 Ilia Muravev

Most image labeling problems such as segmentation and image reconstruction are fundamentally ill-posed and suffer from ambiguities and noise. Higher order image priors encode high level structural dependencies between pixels and are key to…

Computer Vision and Pattern Recognition · Computer Science 2011-09-08 Alexander Shekhovtsov , Pushmeet Kohli , Carsten Rother