English
Related papers

Related papers: Learning Deep Structured Models

200 papers

Image segmentation is considered to be one of the critical tasks in hyperspectral remote sensing image processing. Recently, convolutional neural network (CNN) has established itself as a powerful model in segmentation and classification by…

Computer Vision and Pattern Recognition · Computer Science 2017-12-29 Fahim Irfan Alam , Jun Zhou , Alan Wee-Chung Liew , Xiuping Jia , Jocelyn Chanussot , Yongsheng Gao

A fundamental challenge in developing high-impact machine learning technologies is balancing the need to model rich, structured domains with the ability to scale to big data. Many important problem areas are both richly structured and large…

Machine Learning · Computer Science 2017-11-20 Stephen H. Bach , Matthias Broecheler , Bert Huang , Lise Getoor

This paper studies a combination of generative Markov random field (MRF) models and discriminatively trained deep convolutional neural networks (dCNNs) for synthesizing 2D images. The generative MRF acts on higher-levels of a dCNN feature…

Computer Vision and Pattern Recognition · Computer Science 2016-01-19 Chuan Li , Michael Wand

Kernel learning methods are among the most effective learning methods and have been vigorously studied in the past decades. However, when tackling with complicated tasks, classical kernel methods are not flexible or "rich" enough to…

Machine Learning · Computer Science 2019-10-08 Jiaxuan Xie , Fanghui Liu , Kaijie Wang , Xiaolin Huang

We consider the task of building compact deep learning pipelines suitable for deployment on storage and power constrained mobile devices. We propose a unified framework to learn a broad family of structured parameter matrices that are…

Machine Learning · Statistics 2015-10-07 Vikas Sindhwani , Tara N. Sainath , Sanjiv Kumar

Deep classifiers are known to rely on spurious features $\unicode{x2013}$ patterns which are correlated with the target on the training data but not inherently relevant to the learning problem, such as the image backgrounds when classifying…

Machine Learning · Computer Science 2022-10-21 Pavel Izmailov , Polina Kirichenko , Nate Gruver , Andrew Gordon Wilson

Markov random fields (MRFs) appear in many problems in machine learning and statistics. From a computational learning theory point of view, a natural problem of learning MRFs arises: given samples from an MRF from a restricted class, learn…

Quantum Physics · Physics 2021-09-07 Liming Zhao , Siyi Yang , Patrick Rebentrost

Estimating dense correspondences between images is a long-standing image under-standing task. Recent works introduce convolutional neural networks (CNNs) to extract high-level feature maps and find correspondences through feature matching.…

Computer Vision and Pattern Recognition · Computer Science 2020-08-14 Hao Huang , Jianchun Chen , Xiang Li , Lingjing Wang , Yi Fang

Often we wish to predict a large number of variables that depend on each other as well as on other observed variables. Structured prediction methods are essentially a combination of classification and graphical modeling, combining the…

Machine Learning · Statistics 2010-11-19 Charles Sutton , Andrew McCallum

Currently, Markov-Gibbs random field (MGRF) image models which include high-order interactions are almost always built by modelling responses of a stack of local linear filters. Actual interaction structure is specified implicitly by the…

Computer Vision and Pattern Recognition · Computer Science 2015-12-01 Ralph Versteegen , Georgy Gimel'farb , Patricia Riddle

We consider deep multivariate models for heterogeneous collections of random variables. In the context of computer vision, such collections may e.g. consist of images, segmentations, image attributes, and latent variables. When developing…

Machine Learning · Computer Science 2026-02-03 Dmitrij Schlesinger , Boris Flach , Alexander Shekhovtsov

We learn the structure of a Markov Network between two groups of random variables from joint observations. Since modelling and learning the full MN structure may be hard, learning the links between two groups directly may be a preferable…

Machine Learning · Statistics 2016-05-30 Song Liu , Taiji Suzuki , Masashi Sugiyama , Kenji Fukumizu

Many deep learning architectures for semantic segmentation involve a Fully Convolutional Neural Network (FCN) followed by a Conditional Random Field (CRF) to carry out inference over an image. These models typically involve unary potentials…

Computer Vision and Pattern Recognition · Computer Science 2018-05-25 Cristina Mata , Guy Ben-Yosef , Boris Katz

Machine Learning (ML) is increasingly being used for computer aided diagnosis of brain related disorders based on structural magnetic resonance imaging (MRI) data. Most of such work employs biologically and medically meaningful hand-crafted…

Machine Learning · Computer Science 2018-05-04 Ayush Jaiswal , Dong Guo , Cauligi S. Raghavendra , Paul Thompson

Graphical models for structured domains are powerful tools, but the computational complexities of combinatorial prediction spaces can force restrictions on models, or require approximate inference in order to be tractable. Instead of…

Machine Learning · Computer Science 2013-09-27 Stephen Bach , Bert Huang , Ben London , Lise Getoor

Learning the distance metric between pairs of examples is of great importance for learning and visual recognition. With the remarkable success from the state of the art convolutional neural networks, recent works have shown promising…

Computer Vision and Pattern Recognition · Computer Science 2015-11-23 Hyun Oh Song , Yu Xiang , Stefanie Jegelka , Silvio Savarese

Model-based methods and deep neural networks have both been tremendously successful paradigms in machine learning. In model-based methods, problem domain knowledge can be built into the constraints of the model, typically at the expense of…

Machine Learning · Computer Science 2014-11-21 John R. Hershey , Jonathan Le Roux , Felix Weninger

The success of machine learning algorithms generally depends on data representation, and we hypothesize that this is because different representations can entangle and hide more or less the different explanatory factors of variation behind…

Machine Learning · Computer Science 2014-04-24 Yoshua Bengio , Aaron Courville , Pascal Vincent

Deep learning has attracted great attention recently and yielded the state of the art performance in dimension reduction and classification problems. However, it cannot effectively handle the structured output prediction, e.g. sequential…

Machine Learning · Computer Science 2015-05-05 Gang Chen , Ran Xu , Sargur Srihari

Gaussian Markov random fields (GMRFs) are probabilistic graphical models widely used in spatial statistics and related fields to model dependencies over spatial structures. We establish a formal connection between GMRFs and convolutional…

Machine Learning · Statistics 2020-08-11 Per Sidén , Fredrik Lindsten