English
Related papers

Related papers: Disentangling Representations of Text by Masking T…

200 papers

Representation learning for text via pretraining a language model on a large corpus has become a standard starting point for building NLP systems. This approach stands in contrast to autoencoders, also trained on raw text, but with the…

Computation and Language · Computer Science 2021-09-14 Ivan Montero , Nikolaos Pappas , Noah A. Smith

We present MetricBERT, a BERT-based model that learns to embed text under a well-defined similarity metric while simultaneously adhering to the ``traditional'' masked-language task. We focus on downstream tasks of learning similarities for…

Computation and Language · Computer Science 2022-08-16 Itzik Malkiel , Dvir Ginzburg , Oren Barkan , Avi Caciularu , Yoni Weill , Noam Koenigstein

Intelligent perception and interaction with the world hinges on internal representations that capture its underlying structure (''disentangled'' or ''abstract'' representations). Disentangled representations serve as world models, isolating…

Machine Learning · Computer Science 2025-03-04 Pantelis Vafidis , Aman Bhargava , Antonio Rangel

This paper tackles the problem of disentangling the latent variables of style and content in language models. We propose a simple yet effective approach, which incorporates auxiliary multi-task and adversarial objectives, for label…

Computation and Language · Computer Science 2018-09-12 Vineet John , Lili Mou , Hareesh Bahuleyan , Olga Vechtomova

While representation learning aims to derive interpretable features for describing visual data, representation disentanglement further results in such features so that particular image attributes can be identified and manipulated. However,…

Computer Vision and Pattern Recognition · Computer Science 2018-05-02 Yen-Cheng Liu , Yu-Ying Yeh , Tzu-Chien Fu , Sheng-De Wang , Wei-Chen Chiu , Yu-Chiang Frank Wang

From the intuitive notion of disentanglement, the image variations corresponding to different factors should be distinct from each other, and the disentangled representation should reflect those variations with separate dimensions. To…

Computer Vision and Pattern Recognition · Computer Science 2022-02-15 Xuanchi Ren , Tao Yang , Yuwang Wang , Wenjun Zeng

We introduce a self-supervised vision representation model BEiT, which stands for Bidirectional Encoder representation from Image Transformers. Following BERT developed in the natural language processing area, we propose a masked image…

Computer Vision and Pattern Recognition · Computer Science 2022-09-07 Hangbo Bao , Li Dong , Songhao Piao , Furu Wei

Deep learning models exhibit limited generalizability across different domains. Specifically, transferring knowledge from available entangled domain features(source/target domain) and categorical features to new unseen categorical features…

Computer Vision and Pattern Recognition · Computer Science 2020-03-03 Qingjie Meng , Daniel Rueckert , Bernhard Kainz

This paper describes a language representation model which combines the Bidirectional Encoder Representations from Transformers (BERT) learning mechanism described in Devlin et al. (2018) with a generalization of the Universal Transformer…

Computation and Language · Computer Science 2019-05-17 Alon Rozental , Zohar Kelrich , Daniel Fleischer

When working with textual data, a natural application of disentangled representations is fair classification where the goal is to make predictions without being biased (or influenced) by sensitive attributes that may be present in the data…

Computation and Language · Computer Science 2022-10-10 Pierre Colombo , Guillaume Staerman , Nathan Noiry , Pablo Piantanida

We make two theoretical contributions to disentanglement learning by (a) defining precise semantics of disentangled representations, and (b) establishing robust metrics for evaluation. First, we characterize the concept "disentangled…

Machine Learning · Computer Science 2021-03-22 Kien Do , Truyen Tran

Language model pre-training has proven to be useful in learning universal language representations. As a state-of-the-art language model pre-training model, BERT (Bidirectional Encoder Representations from Transformers) has achieved amazing…

Computation and Language · Computer Science 2020-02-06 Chi Sun , Xipeng Qiu , Yige Xu , Xuanjing Huang

Neural networks have greatly boosted performance in computer vision by learning powerful representations of input data. The drawback of end-to-end training for maximal overall performance are black-box models whose hidden representations…

Computer Vision and Pattern Recognition · Computer Science 2020-04-29 Patrick Esser , Robin Rombach , Björn Ommer

Controlling the style of natural language by disentangling the latent space is an important step towards interpretable machine learning. After the latent space is disentangled, the style of a sentence can be transformed by tuning the style…

Computation and Language · Computer Science 2021-08-04 Lei Sha , Thomas Lukasiewicz

We present an efficient method of utilizing pretrained language models, where we learn selective binary masks for pretrained weights in lieu of modifying them through finetuning. Extensive evaluations of masking BERT and RoBERTa on a series…

Computation and Language · Computer Science 2020-10-13 Mengjie Zhao , Tao Lin , Fei Mi , Martin Jaggi , Hinrich Schütze

Disentanglement is a difficult property to enforce in neural representations. This might be due, in part, to a formalization of the disentanglement problem that focuses too heavily on separating relevant factors of variation of the data in…

Machine Learning · Computer Science 2022-05-23 Andrea Valenti , Davide Bacciu

We present a framework for learning disentangled representation of CapsNet by information bottleneck constraint that distills information into a compact form and motivates to learn an interpretable factorized capsule. In our $\beta$-CapsNet…

Computer Vision and Pattern Recognition · Computer Science 2022-09-13 Ming-fei Hu , Jian-wei Liu

This work presents a framework based on feature disentanglement to learn speaker embeddings that are robust to environmental variations. Our framework utilises an auto-encoder as a disentangler, dividing the input speaker embedding into…

Sound · Computer Science 2024-06-21 KiHyun Nam , Hee-Soo Heo , Jee-weon Jung , Joon Son Chung

The success of deep learning heavily relies on large-scale data with comprehensive labels, which is more expensive and time-consuming to fetch in 3D compared to 2D images or natural languages. This promotes the potential of utilizing models…

Computer Vision and Pattern Recognition · Computer Science 2023-02-03 Runpei Dong , Zekun Qi , Linfeng Zhang , Junbo Zhang , Jianjian Sun , Zheng Ge , Li Yi , Kaisheng Ma

A disentangled representation encodes information about the salient factors of variation in the data independently. Although it is often argued that this representational format is useful in learning to solve many real-world down-stream…

Machine Learning · Computer Science 2020-01-08 Sjoerd van Steenkiste , Francesco Locatello , Jürgen Schmidhuber , Olivier Bachem