English
Related papers

Related papers: Disentangling images with Lie group transformation…

200 papers

Many transformations in deep learning architectures are sparsely connected. When such transformations cannot be designed by hand, they can be learned, even through plain backpropagation, for instance in attention mechanisms. However, during…

Machine Learning · Statistics 2018-10-23 Peter Bloem

Sparse coding (SC) is an automatic feature extraction and selection technique that is widely used in unsupervised learning. However, conventional SC vectorizes the input images, which breaks apart the local proximity of pixels and destructs…

Computer Vision and Pattern Recognition · Computer Science 2017-03-29 Fei Jiang , Xiao-Yang Liu , Hongtao Lu , Ruimin Shen

Sparse coding is a common approach to learning local features for object recognition. Recently, there has been an increasing interest in learning features from spatio-temporal, binocular, or other multi-observation data, where the goal is…

Computer Vision and Pattern Recognition · Computer Science 2012-06-22 Roland Memisevic

Modeling group actions on latent representations enables controllable transformations of high-dimensional image data. Prior works applying group-theoretic priors or modeling transformations typically operate in the high-dimensional data…

Computer Vision and Pattern Recognition · Computer Science 2025-12-16 Farhana Hossain Swarnali , Miaomiao Zhang , Tonmoy Hossain

In disentangled representation learning, a model is asked to tease apart a dataset's underlying sources of variation and represent them independently of one another. Since the model is provided with no ground truth information about these…

Machine Learning · Computer Science 2023-10-24 Kyle Hsu , Will Dorrell , James C. R. Whittington , Jiajun Wu , Chelsea Finn

Sparse representation with respect to an overcomplete dictionary is often used when regularizing inverse problems in signal and image processing. In recent years, the Convolutional Sparse Coding (CSC) model, in which the dictionary consists…

Image and Video Processing · Electrical Eng. & Systems 2019-09-13 Dror Simon , Michael Elad

We develop the sparse VAE for unsupervised representation learning on high-dimensional data. The sparse VAE learns a set of latent factors (representations) which summarize the associations in the observed data features. The underlying…

Machine Learning · Statistics 2025-04-16 Gemma E. Moran , Dhanya Sridhar , Yixin Wang , David M. Blei

Given an image dataset, we are often interested in finding data generative factors that encode semantic content independently from pose variables such as rotation and translation. However, current disentanglement approaches do not impose…

Computer Vision and Pattern Recognition · Computer Science 2019-09-27 Tristan Bepler , Ellen D. Zhong , Kotaro Kelley , Edward Brignole , Bonnie Berger

Learning semantically meaningful image transformations (i.e. rotation, thickness, blur) directly from examples can be a challenging task. Recently, the Manifold Autoencoder (MAE) proposed using a set of Lie group operators to learn image…

Image and Video Processing · Electrical Eng. & Systems 2025-04-22 Brighton Ancelin , Yenho Chen , Peimeng Guan , Chiraag Kaushik , Belen Martin-Urcelay , Alex Saad-Falcon , Nakul Singh

Learned data models based on sparsity are widely used in signal processing and imaging applications. A variety of methods for learning synthesis dictionaries, sparsifying transforms, etc., have been proposed in recent years, often imposing…

Machine Learning · Computer Science 2018-10-22 Saiprasad Ravishankar , Brendt Wohlberg

This work presents an approach for image reconstruction in clinical low-dose tomography that combines principles from sparse signal processing with ideas from deep learning. First, we describe sparse signal representation in terms of…

Machine Learning · Statistics 2023-11-27 Jevgenija Rudzusika , Thomas Koehler , Ozan Öktem

Sparse representations of images are useful in many computer vision applications. Sparse coding with an $l_1$ penalty and a learned linear dictionary requires regularization of the dictionary to prevent a collapse in the $l_1$ norms of the…

Computer Vision and Pattern Recognition · Computer Science 2022-09-09 Katrina Evtimova , Yann LeCun

Learning disentangled representations of data is a fundamental problem in artificial intelligence. Specifically, disentangled latent representations allow generative models to control and compose the disentangled factors in the synthesis…

Computer Vision and Pattern Recognition · Computer Science 2020-10-20 Yotam Nitzan , Amit Bermano , Yangyan Li , Daniel Cohen-Or

Signal modeling lies at the core of numerous signal and image processing applications. A recent approach that has drawn considerable attention is sparse representation modeling, in which the signal is assumed to be generated as a…

Information Theory · Computer Science 2016-11-17 Tomer Peleg , Yonina C. Eldar , Michael Elad

Latent traversal is a popular approach to visualize the disentangled latent representations. Given a bunch of variations in a single unit of the latent representation, it is expected that there is a change in a single factor of variation of…

Computer Vision and Pattern Recognition · Computer Science 2020-07-28 Xinqi Zhu , Chang Xu , Dacheng Tao

Sparse modeling for signal processing and machine learning has been at the focus of scientific research for over two decades. Among others, supervised sparsity-aware learning comprises two major paths paved by: a) discriminative methods and…

Machine Learning · Statistics 2022-11-23 Lei Cheng , Feng Yin , Sergios Theodoridis , Sotirios Chatzis , Tsung-Hui Chang

In this paper, we study weakly-supervised laparoscopic image segmentation with sparse annotations. We introduce a novel Bayesian deep learning approach designed to enhance both the accuracy and interpretability of the model's segmentation,…

Computer Vision and Pattern Recognition · Computer Science 2024-10-14 Zhou Zheng , Yuichiro Hayashi , Masahiro Oda , Takayuki Kitasaka , Kensaku Mori

Sparse representation-based classifiers have shown outstanding accuracy and robustness in image classification tasks even with the presence of intense noise and occlusion. However, it has been discovered that the performance degrades…

Computer Vision and Pattern Recognition · Computer Science 2015-12-22 Xiaoxia Sun , Nasser M. Nasrabadi , Trac D. Tran

Sparse coding, which is the decomposition of a vector using only a few basis elements, is widely used in machine learning and image processing. The basis set, also called dictionary, is learned to adapt to specific data. This approach has…

Machine Learning · Computer Science 2011-12-13 Louise Benoît , Julien Mairal , Francis Bach , Jean Ponce

Images are composed as a hierarchy of object parts. We use this insight to create a generative graphical model that defines a hierarchical distribution over image parts. Typically, this leads to intractable inference due to loops in the…

Computer Vision and Pattern Recognition · Computer Science 2018-08-15 Sebastian Kaltwang , Sina Samangooei , John Redford , Andrew Blake