English
Related papers

Related papers: Style Feature Extraction Using Contrastive Conditi…

200 papers

Learning a discriminative semantic space using unlabelled and noisy data remains unaddressed in a multi-label setting. We present a contrastive self-supervised learning method which is robust to data noise, grounded in the domain of…

Computer Vision and Pattern Recognition · Computer Science 2024-05-09 Mehmet Can Yavuz , Berrin Yanikoglu

Event extraction (EE) has considerably benefited from pre-trained language models (PLMs) by fine-tuning. However, existing pre-training methods have not involved modeling event characteristics, resulting in the developed EE models cannot…

Computation and Language · Computer Science 2021-06-01 Ziqi Wang , Xiaozhi Wang , Xu Han , Yankai Lin , Lei Hou , Zhiyuan Liu , Peng Li , Juanzi Li , Jie Zhou

In this study, we propose a feature extraction framework based on contrastive learning with adaptive positive and negative samples (CL-FEFA) that is suitable for unsupervised, supervised, and semi-supervised single-view feature extraction.…

Machine Learning · Computer Science 2022-01-12 Hongjie Zhang

Large and well-annotated datasets are essential for advancing deep learning applications, however often costly or impossible to obtain by a single entity. In many areas, including the medical domain, approaches relying on data sharing have…

Machine Learning · Computer Science 2024-08-02 Francesco Di Salvo , David Tafler , Sebastian Doerrich , Christian Ledig

For real-world applications of machine learning (ML), it is essential that models make predictions based on well-generalizing features rather than spurious correlations in the data. The identification of such spurious correlations, also…

Machine Learning · Computer Science 2023-07-24 Nicolas M. Müller , Simon Roschmann , Shahbaz Khan , Philip Sperl , Konstantin Böttinger

Multi-label classification (MLC) is a prediction task where each sample can have more than one label. We propose a novel contrastive learning boosted multi-label prediction model based on a Gaussian mixture variational autoencoder…

Machine Learning · Computer Science 2022-06-13 Junwen Bai , Shufeng Kong , Carla P. Gomes

We introduce the variational graph auto-encoder (VGAE), a framework for unsupervised learning on graph-structured data based on the variational auto-encoder (VAE). This model makes use of latent variables and is capable of learning…

Machine Learning · Statistics 2016-11-23 Thomas N. Kipf , Max Welling

Masked Image Modeling (MIM) methods, like Masked Autoencoders (MAE), efficiently learn a rich representation of the input. However, for adapting to downstream tasks, they require a sufficient amount of labeled data since their rich features…

Computer Vision and Pattern Recognition · Computer Science 2023-09-15 Johannes Lehner , Benedikt Alkin , Andreas Fürst , Elisabeth Rumetshofer , Lukas Miklautz , Sepp Hochreiter

Feature extraction is an efficient approach for alleviating the issue of dimensionality in high-dimensional data. As a popular self-supervised learning method, contrastive learning has recently garnered considerable attention. In this…

Machine Learning · Computer Science 2021-09-14 Hongjie Zhang

In this paper, we introduce a learning model able to conceals personal information (e.g. gender, age, ethnicity, etc.) from an image, while maintaining any additional information present in the image (e.g. smile, hair-style, brightness).…

Machine Learning · Computer Science 2019-09-23 Moshe Hanukoglu , Nissan Goldberg , Aviv Rovshitz , Amos Azaria

This study investigates the stylistic differences among various Bible translations using a Variational Autoencoder (VAE) model. By embedding textual data into high-dimensional vectors, the study aims to detect and analyze stylistic…

Computation and Language · Computer Science 2025-02-14 InJin Kong , Shinyee Kang , Yuna Park , Sooyong Kim , Sanghyun Park

The cosmic microwave background power spectra are a primary window into the early universe. However, achieving interpretable, likelihood-compatible compression and fast inference under weak model assumptions remains challenging. We propose…

Cosmology and Nongalactic Astrophysics · Physics 2025-11-03 Tian-Yang Sun , Tian-Nuo Li , He Wang , Jing-Fei Zhang , Xin Zhang

We present a new flavor of Variational Autoencoder (VAE) that interpolates seamlessly between unsupervised, semi-supervised and fully supervised learning domains. We show that unlabeled datapoints not only boost unsupervised tasks, but also…

Machine Learning · Computer Science 2019-11-15 Felix Berkhahn , Richard Keys , Wajih Ouertani , Nikhil Shetty , Dominik Geißler

The variational autoencoder (VAE) is a popular probabilistic generative model. However, one shortcoming of VAEs is that the latent variables cannot be discrete, which makes it difficult to generate data from different modes of a…

Machine Learning · Statistics 2017-11-21 Jay A. Hennig , Akash Umakantha , Ryan C. Williamson

We present a novel method for constructing Variational Autoencoder (VAE). Instead of using pixel-by-pixel loss, we enforce deep feature consistency between the input and the output of a VAE, which ensures the VAE's output to preserve the…

Computer Vision and Pattern Recognition · Computer Science 2024-03-21 Xianxu Hou , Linlin Shen , Ke Sun , Guoping Qiu

In the contrastive analysis (CA) setting, machine learning practitioners are specifically interested in discovering patterns that are enriched in a target dataset as compared to a background dataset generated from sources of variation…

Machine Learning · Computer Science 2022-02-23 Ethan Weinberger , Nicasia Beebe-Wang , Su-In Lee

In dermatological disease diagnosis, the private data collected by mobile dermatology assistants exist on distributed mobile devices of patients. Federated learning (FL) can use decentralized data to train models while keeping data local.…

Machine Learning · Computer Science 2022-08-25 Yawen Wu , Dewen Zeng , Zhepeng Wang , Yi Sheng , Lei Yang , Alaina J. James , Yiyu Shi , Jingtong Hu

Unsupervised text style transfer is full of challenges due to the lack of parallel data and difficulties in content preservation. In this paper, we propose a novel neural approach to unsupervised text style transfer, which we refer to as…

Computer Vision and Pattern Recognition · Computer Science 2020-10-05 Yufang Huang , Wentao Zhu , Deyi Xiong , Yiye Zhang , Changjian Hu , Feiyu Xu

Due to the advantages of leveraging unlabeled data and learning meaningful representations, semi-supervised learning and contrastive learning have been progressively combined to achieve better performances in popular applications with few…

Computer Vision and Pattern Recognition · Computer Science 2023-12-27 Bowen Tao , Lan Li , Xin-Chun Li , De-Chuan Zhan

We propose a new family of optimization criteria for variational auto-encoding models, generalizing the standard evidence lower bound. We provide conditions under which they recover the data distribution and learn latent features, and…

Machine Learning · Computer Science 2017-03-01 Shengjia Zhao , Jiaming Song , Stefano Ermon