English
Related papers

Related papers: GEDI: GEnerative and DIscriminative Training for S…

200 papers

This paper introduces "GAIDE: Generative AI for Instructional Development and Education," a novel framework for using Generative AI (GenAI) to enhance educational content creation. GAIDE stands out by offering a practical approach for…

Computers and Society · Computer Science 2025-03-18 Ethan Dickey , Andres Bejarano

Semi-supervised learning through deep generative models and multi-lingual pretraining techniques have orchestrated tremendous success across different areas of NLP. Nonetheless, their development has happened in isolation, while the…

Computation and Language · Computer Science 2021-01-27 Yi Zhu , Ehsan Shareghi , Yingzhen Li , Roi Reichart , Anna Korhonen

A distinguishing characteristic of federated learning is that the (local) client data could have statistical heterogeneity. This heterogeneity has motivated the design of personalized learning, where individual (personalized) models are…

Machine Learning · Computer Science 2022-07-06 Kaan Ozkara , Antonious M. Girgis , Deepesh Data , Suhas Diggavi

Recently, transformation-based self-supervised learning has been applied to generative adversarial networks (GANs) to mitigate catastrophic forgetting in the discriminator by introducing a stationary learning environment. However, the…

Machine Learning · Computer Science 2022-01-19 Liang Hou , Huawei Shen , Qi Cao , Xueqi Cheng

In this work, we consider the task of classifying binary positive-unlabeled (PU) data. The existing discriminative learning based PU models attempt to seek an optimal reweighting strategy for U data, so that a decent decision boundary can…

Machine Learning · Computer Science 2018-04-05 Ming Hou , Brahim Chaib-draa , Chao Li , Qibin Zhao

Self-training based unsupervised domain adaptation (UDA) has shown great potential to address the problem of domain shift, when applying a trained deep learning model in a source domain to unlabeled target domains. However, while the…

Computer Vision and Pattern Recognition · Computer Science 2021-06-24 Xiaofeng Liu , Fangxu Xing , Maureen Stone , Jiachen Zhuo , Reese Timothy , Jerry L. Prince , Georges El Fakhri , Jonghye Woo

Ensembling a neural network is a widely recognized approach to enhance model performance, estimate uncertainty, and improve robustness in deep supervised learning. However, deep ensembles often come with high computational costs and memory…

This work proposes an overview of the recent semi-supervised learning approaches and related works. Despite the remarkable success of neural networks in various applications, there exist a few formidable constraints, including the need for…

Machine Learning · Computer Science 2024-08-09 Gyeongho Kim

Semi-supervised learning methods based on generative adversarial networks (GANs) obtained strong empirical results, but it is not clear 1) how the discriminator benefits from joint training with a generator, and 2) why good semi-supervised…

Machine Learning · Computer Science 2017-11-06 Zihang Dai , Zhilin Yang , Fan Yang , William W. Cohen , Ruslan Salakhutdinov

In this paper, we propose a deep invertible hybrid model which integrates discriminative and generative learning at a latent space level for semi-supervised few-shot classification. Various tasks for classifying new species from image data…

Computer Vision and Pattern Recognition · Computer Science 2021-05-25 Yusuke Ohtsubo , Tetsu Matsukawa , Einoshin Suzuki

Representations learned by self-supervised approaches are generally considered to possess sufficient generalizability and discriminability. However, we disclose a nontrivial mutual-exclusion relationship between these critical…

Artificial Intelligence · Computer Science 2024-12-03 Jiangmeng Li , Zehua Zang , Qirui Ji , Chuxiong Sun , Wenwen Qiang , Junge Zhang , Changwen Zheng , Fuchun Sun , Hui Xiong

Unsupervised learning has always been appealing to machine learning researchers and practitioners, allowing them to avoid an expensive and complicated process of labeling the data. However, unsupervised learning of complex data is…

Computer Vision and Pattern Recognition · Computer Science 2020-11-10 Evgenii Zheltonozhskii , Chaim Baskin , Alex M. Bronstein , Avi Mendelson

Federated Learning has gained attention for its ability to enable multiple nodes to collaboratively train machine learning models without sharing raw data. At the same time, Generative AI -- particularly Generative Adversarial Networks…

Machine Learning · Computer Science 2026-01-19 Youssef Tawfilis , Hossam Amer , Minar El-Aasser , Tallal Elshabrawy

Deep convolutional networks have proven to be very successful in learning task specific features that allow for unprecedented performance on various computer vision tasks. Training of such networks follows mostly the supervised learning…

Machine Learning · Computer Science 2015-06-22 Alexey Dosovitskiy , Philipp Fischer , Jost Tobias Springenberg , Martin Riedmiller , Thomas Brox

As a kind of generative self-supervised learning methods, generative adversarial nets have been widely studied in the field of anomaly detection. However, the representation learning ability of the generator is limited since it pays too…

Computer Vision and Pattern Recognition · Computer Science 2021-07-28 Xuan Xia , Xizhou Pan , Xing He , Jingfei Zhang , Ning Ding , Lin Ma

Generalized category discovery (GCD) is a recently proposed open-world task. Given a set of images consisting of labeled and unlabeled instances, the goal of GCD is to automatically cluster the unlabeled samples using information…

Computer Vision and Pattern Recognition · Computer Science 2023-10-31 Xiangli Yang , Xinglin Pan , Irwin King , Zenglin Xu

Self-training is an effective approach to semi-supervised learning. The key idea is to let the learner itself iteratively generate "pseudo-supervision" for unlabeled instances based on its current hypothesis. In combination with consistency…

Machine Learning · Statistics 2021-11-05 Julian Lienen , Eyke Hüllermeier

Federated learning is gaining popularity as a distributed machine learning method that can be used to deploy AI-dependent IoT applications while protecting client data privacy and security. Due to the differences of clients, a single global…

Machine Learning · Computer Science 2022-02-21 Xingjian Cao , Gang Sun , Hongfang Yu , Mohsen Guizani

Neural networks often make predictions relying on the spurious correlations from the datasets rather than the intrinsic properties of the task of interest, facing sharp degradation on out-of-distribution (OOD) test data. Existing de-bias…

Machine Learning · Computer Science 2023-01-20 Xinzhe Han , Shuhui Wang , Chi Su , Qingming Huang , Qi Tian

There has been a growing trend in employing generative artificial intelligence (GenAI) techniques to support learning. Moreover, scholars have reached a consensus on the critical role of self-regulated learning (SRL) in ensuring learning…

Computers and Society · Computer Science 2026-01-27 Jie Gao , Shasha Li , Jianhua Zhang , Shan Li , Tingting Wang