English
Related papers

Related papers: Latent Space Factorisation and Manipulation via Ma…

200 papers

The current methods for learning representations with auto-encoders almost exclusively employ vectors as the latent representations. In this work, we propose to employ a tensor product structure for this purpose. This way, the obtained…

Machine Learning · Computer Science 2023-09-01 Michael Rotman , Amit Dekel , Shir Gur , Yaron Oz , Lior Wolf

Generative modeling of 3D shapes has become an important problem due to its relevance to many applications across Computer Vision, Graphics, and VR. In this paper we build upon recently introduced 3D mesh-convolutional Variational…

Machine Learning · Computer Science 2019-06-11 Jake Levinson , Avneesh Sud , Ameesh Makadia

We consider the problem of learning a low-rank matrix, constrained to lie in a linear subspace, and introduce a novel factorization for modeling such matrices. A salient feature of the proposed factorization scheme is it decouples the…

Machine Learning · Statistics 2018-06-18 Pratik Jawanpuria , Bamdev Mishra

Image generating neural networks are mostly viewed as black boxes, where any change in the input can have a number of globally effective changes on the output. In this work, we propose a method for learning disentangled representations to…

Computer Vision and Pattern Recognition · Computer Science 2019-08-27 Maren Awiszus , Hanno Ackermann , Bodo Rosenhahn

Discrete latent spaces in variational autoencoders have been shown to effectively capture the data distribution for many real-world problems such as natural language understanding, human intent prediction, and visual scene representation.…

Machine Learning · Computer Science 2021-01-19 Masha Itkina , Boris Ivanovic , Ransalu Senanayake , Mykel J. Kochenderfer , Marco Pavone

Matrix factorization exploits the idea that, in complex high-dimensional data, the actual signal typically lies in lower-dimensional structures. These lower dimensional objects provide useful insight, with interpretability favored by sparse…

Methodology · Statistics 2022-12-14 Lorenzo Schiavon , Bernardo Nipoti , Antonio Canale

Disentangled representations, where the higher level data generative factors are reflected in disjoint latent dimensions, offer several benefits such as ease of deriving invariant representations, transferability to other tasks,…

Machine Learning · Computer Science 2018-12-31 Abhishek Kumar , Prasanna Sattigeri , Avinash Balakrishnan

We explore a framework for protein sequence representation learning that decomposes the task between manifold learning and distributional modelling. Specifically we present a Latent Space Diffusion architecture which combines a protein…

Machine Learning · Computer Science 2025-03-25 Eoin Quinn , Ghassene Jebali , Maxime Seince , Oliver Bent

Noting the importance of factorizing (or disentangling) the latent space, we propose a novel, non-probabilistic disentangling framework for autoencoders, based on the principles of symmetry transformations in group-theory. To the best of…

Machine Learning · Computer Science 2022-04-14 Jaehoon Cha , Jeyan Thiyagalingam

To analyze high-dimensional and complex data in the real world, deep generative models, such as variational autoencoder (VAE) embed data in a low-dimensional space (latent space) and learn a probabilistic model in the latent space. However,…

Machine Learning · Computer Science 2020-09-01 Keizo Kato , Jing Zhou , Tomotake Sasaki , Akira Nakagawa

The problem of feature disentanglement has been explored in the literature, for the purpose of image and video processing and text analysis. State-of-the-art methods for disentangling feature representations rely on the presence of many…

Machine Learning · Computer Science 2017-11-28 Ershad Banijamali , Amir-Hossein Karimi , Alexander Wong , Ali Ghodsi

In this article, we focus on decomposing latent representations in generative adversarial networks or learned feature representations in deep autoencoders into semantically controllable factors in a semisupervised manner, without modifying…

Machine Learning · Computer Science 2021-02-25 Jee Seok Yoon , Myung-Cheol Roh , Heung-Il Suk

We introduce a framework for unsupervised learning of structured predictors with overlapping, global features. Each input's latent representation is predicted conditional on the observable data using a feature-rich conditional random field.…

Machine Learning · Computer Science 2014-11-11 Waleed Ammar , Chris Dyer , Noah A. Smith

Weakly-supervised anomaly detection aims at learning an anomaly detector from a limited amount of labeled data and abundant unlabeled data. Recent works build deep neural networks for anomaly detection by discriminatively mapping the normal…

Machine Learning · Computer Science 2021-08-29 Yingjie Zhou , Xucheng Song , Yanru Zhang , Fanxing Liu , Ce Zhu , Lingqiao Liu

Multiple rotation averaging plays a crucial role in computer vision and robotics domains. The conventional optimization-based methods optimize a nonlinear cost function based on certain noise assumptions, while most previous learning-based…

Computer Vision and Pattern Recognition · Computer Science 2024-09-17 Shiqi Li , Jihua Zhu , Yifan Xie , Naiwen Hu , Mingchen Zhu , Zhongyu Li , Di Wang

Generative models have demonstrated strong performance in conditional settings and can be viewed as a form of data compression, where the condition serves as a compact representation. However, their limited controllability and…

Machine Learning · Computer Science 2025-07-04 Xiao Li , Liangji Zhu , Anand Rangarajan , Sanjay Ranka

Unsupervised landmark learning is the task of learning semantic keypoint-like representations without the use of expensive input keypoint-level annotations. A popular approach is to factorize an image into a pose and appearance data stream,…

Computer Vision and Pattern Recognition · Computer Science 2020-01-28 Aysegul Dundar , Kevin J. Shih , Animesh Garg , Robert Pottorf , Andrew Tao , Bryan Catanzaro

Disentangling complex data to its latent factors of variation is a fundamental task in representation learning. Existing work on sequential disentanglement mostly provides two factor representations, i.e., it separates the data to…

Machine Learning · Computer Science 2023-03-31 Nimrod Berman , Ilan Naiman , Omri Azencot

Modeling group actions on latent representations enables controllable transformations of high-dimensional image data. Prior works applying group-theoretic priors or modeling transformations typically operate in the high-dimensional data…

Computer Vision and Pattern Recognition · Computer Science 2025-12-16 Farhana Hossain Swarnali , Miaomiao Zhang , Tonmoy Hossain

We extend the framework of variational autoencoders to represent transformations explicitly in the latent space. In the family of hierarchical graphical models that emerges, the latent space is populated by higher order objects that are…

Machine Learning · Computer Science 2020-04-24 Giorgio Giannone , Saeed Saremi , Jonathan Masci , Christian Osendorfer