English
Related papers

Related papers: Sequential Disentanglement by Extracting Static In…

200 papers

In this paper, we propose an effective training strategy to ex-tract robust speaker representations from a speech signal. Oneof the key challenges in speaker recognition tasks is to learnlatent representations or embeddings containing…

Audio and Speech Processing · Electrical Eng. & Systems 2020-08-05 Yoohwan Kwon , Soo-Whan Chung , Hong-Goo Kang

We propose a method to disentangle linear-encoded facial semantics from StyleGAN without external supervision. The method derives from linear regression and sparse representation learning concepts to make the disentangled latent…

Computer Vision and Pattern Recognition · Computer Science 2021-04-01 Yutong Zheng , Yu-Kai Huang , Ran Tao , Zhiqiang Shen , Marios Savvides

We seek to learn a representation on a large annotated data source that generalizes to a target domain using limited new supervision. Many prior approaches to this problem have focused on learning "disentangled" representations so that as…

Machine Learning · Computer Science 2020-02-28 Or Litany , Ari Morcos , Srinath Sridhar , Leonidas Guibas , Judy Hoffman

Learning to disentangle the hidden factors of variations within a set of observations is a key task for artificial intelligence. We present a unified formulation for class and content disentanglement and use it to illustrate the limitations…

Machine Learning · Computer Science 2020-02-19 Aviv Gabbay , Yedid Hoshen

Deep-embedding methods aim to discover representations of a domain that make explicit the domain's class structure and thereby support few-shot learning. Disentangling methods aim to make explicit compositional or factorial structure. We…

Machine Learning · Computer Science 2018-05-22 Karl Ridgeway , Michael C. Mozer

This work introduces a novel principle for disentanglement we call mechanism sparsity regularization, which applies when the latent factors of interest depend sparsely on observed auxiliary variables and/or past latent factors. We propose a…

Improving controllability or the ability to manipulate one or more attributes of the generated data has become a topic of interest in the context of deep generative models of music. Recent attempts in this direction have relied on learning…

Sound · Computer Science 2021-08-04 Ashis Pati , Alexander Lerch

For speaker recognition, it is difficult to extract an accurate speaker representation from speech because of its mixture of speaker traits and content. This paper proposes a disentanglement framework that simultaneously models speaker…

Audio and Speech Processing · Electrical Eng. & Systems 2023-11-02 Tianchi Liu , Kong Aik Lee , Qiongqiong Wang , Haizhou Li

Controlling the style of natural language by disentangling the latent space is an important step towards interpretable machine learning. After the latent space is disentangled, the style of a sentence can be transformed by tuning the style…

Computation and Language · Computer Science 2021-08-04 Lei Sha , Thomas Lukasiewicz

Domain adaptation is an important but challenging task. Most of the existing domain adaptation methods struggle to extract the domain-invariant representation on the feature space with entangling domain information and semantic information.…

Computer Vision and Pattern Recognition · Computer Science 2020-12-23 Ruichu Cai , Zijian Li , Pengfei Wei , Jie Qiao , Kun Zhang , Zhifeng Hao

Human motion data is inherently rich and complex, containing both semantic content and subtle stylistic features that are challenging to model. We propose a novel method for effective disentanglement of the style and content in human motion…

Computer Vision and Pattern Recognition · Computer Science 2026-02-27 Fatemeh Zargarbashi , Dhruv Agrawal , Jakob Buhmann , Martin Guay , Stelian Coros , Robert W. Sumner

While representation learning aims to derive interpretable features for describing visual data, representation disentanglement further results in such features so that particular image attributes can be identified and manipulated. However,…

Computer Vision and Pattern Recognition · Computer Science 2018-05-02 Yen-Cheng Liu , Yu-Ying Yeh , Tzu-Chien Fu , Sheng-De Wang , Wei-Chen Chiu , Yu-Chiang Frank Wang

Isolating different types of motion in video data is a highly relevant problem in video analysis. Applications can be found, for example, in dynamic medical or biological imaging, where the analysis and further processing of the dynamics of…

Image and Video Processing · Electrical Eng. & Systems 2023-05-18 Abdullah Abdullah , Martin Holler , Karl Kunisch , Malena Sabate Landman

In order to build language technologies for majority of the languages, it is important to leverage the resources available in public domain on the internet - commonly referred to as `Found Data'. However, such data is characterized by the…

Audio and Speech Processing · Electrical Eng. & Systems 2019-09-27 Nishant Gurunath , Sai Krishna Rallabandi , Alan Black

Disentangled representations support a range of downstream tasks including causal reasoning, generative modeling, and fair machine learning. Unfortunately, disentanglement has been shown to be impossible without the incorporation of…

Computer Vision and Pattern Recognition · Computer Science 2021-12-16 Matthew J. Vowels , Necati Cihan Camgoz , Richard Bowden

We propose a method for learning dynamical systems from high-dimensional empirical data that combines variational autoencoders and (spatio-)temporal attention within a framework designed to enforce certain scientifically-motivated…

Machine Learning · Computer Science 2023-06-22 Kai Lagemann , Christian Lagemann , Sach Mukherjee

Scene text images contain not only style information (font, background) but also content information (character, texture). Different scene text tasks need different information, but previous representation learning methods use tightly…

Computer Vision and Pattern Recognition · Computer Science 2024-05-08 Boqiang Zhang , Hongtao Xie , Zuan Gao , Yuxin Wang

We propose a sequential variational autoencoder to learn disentangled representations of sequential data (e.g., videos and audios) under self-supervision. Specifically, we exploit the benefits of some readily accessible supervisory signals…

Computer Vision and Pattern Recognition · Computer Science 2020-05-26 Yizhe Zhu , Martin Renqiang Min , Asim Kadav , Hans Peter Graf

Learning rich representation from data is an important task for deep generative models such as variational auto-encoder (VAE). However, by extracting high-level abstractions in the bottom-up inference process, the goal of preserving all…

Machine Learning · Computer Science 2020-02-26 Zhiyuan Li , Jaideep Vitthal Murkute , Prashnna Kumar Gyawali , Linwei Wang

Developing meaningful and efficient representations that separate the fundamental structure of the data generation mechanism is crucial in representation learning. However, Disentangled Representation Learning has not fully shown its…

Computer Vision and Pattern Recognition · Computer Science 2025-06-27 Jacopo Dapueto , Nicoletta Noceti , Francesca Odone