English
Related papers

Related papers: Frequency-Masked Embedding Inference: A Non-Contra…

200 papers

For the Facial Action Unit (AU) detection task, accurately capturing the subtle facial differences between distinct AUs is essential for reliable detection. Additionally, AU detection faces challenges from class imbalance and the presence…

Computer Vision and Pattern Recognition · Computer Science 2025-12-01 Ziqiao Shang , Bin Liu , Fengmao Lv , Fei Teng , Tianrui Li , Lan-Zhe Guo

Self-supervised representation learning has made significant leaps fueled by progress in contrastive learning, which seeks to learn transformations that embed positive input pairs nearby, while pushing negative pairs far apart. While…

Computer Vision and Pattern Recognition · Computer Science 2022-01-04 Tri Huynh , Simon Kornblith , Matthew R. Walter , Michael Maire , Maryam Khademi

The rapid growth of unlabeled time series data, driven by the Internet of Things (IoT), poses significant challenges in uncovering underlying patterns. Traditional unsupervised clustering methods often fail to capture the complex nature of…

Machine Learning · Computer Science 2025-03-31 Congyu Wang , Mingjing Du , Xiang Jiang , Yongquan Dong

Learning transferable representations from unlabeled time series is crucial for improving performance in data-scarce classification. Existing self-supervised methods often operate at the point level and rely on unidirectional encoding,…

Machine Learning · Computer Science 2026-03-02 Mingyue Cheng , Xiaoyu Tao , Zhiding Liu , Qi Liu , Hao Zhang , Rujiao Zhang , Enhong Chen

Unpaired image-to-image translation involves learning mappings between source domain and target domain in the absence of aligned or corresponding samples. Score based diffusion models have demonstrated state-of-the-art performance in…

Computer Vision and Pattern Recognition · Computer Science 2025-10-07 Venkata Narendra Kotyada , Revanth Eranki , Nagesh Bhattu Sristy

Self-supervised learning has recently shown great potential in vision tasks through contrastive learning, which aims to discriminate each image, or instance, in the dataset. However, such instance-level learning ignores the semantic…

Computer Vision and Pattern Recognition · Computer Science 2022-03-17 Tsai-Shien Chen , Wei-Chih Hung , Hung-Yu Tseng , Shao-Yi Chien , Ming-Hsuan Yang

Multivariate Time-Series (MTS) clustering is crucial for signal processing and data analysis. Although deep learning approaches, particularly those leveraging Contrastive Learning (CL), are prominent for MTS representation, existing…

Machine Learning · Computer Science 2026-01-13 Zexi Tan , Tao Xie , Haoyi Xiao , Baoyao Yang , Yuzhu Ji , An Zeng , Xiang Zhang , Yiqun Zhang

We propose a self-supervised contrastive learning approach for facial expression recognition (FER) in videos. We propose a novel temporal sampling-based augmentation scheme to be utilized in addition to standard spatial augmentations used…

Computer Vision and Pattern Recognition · Computer Science 2021-08-09 Shuvendu Roy , Ali Etemad

Deep learning has played a significant role in the success of facial expression recognition (FER), thanks to large models and vast amounts of labelled data. However, obtaining labelled data requires a tremendous amount of human effort,…

Computer Vision and Pattern Recognition · Computer Science 2023-07-07 Shuvendu Roy , Ali Etemad

Contrastive learning, commonly applied in large-scale multimodal models, often relies on data from diverse and often unreliable sources, which can include misaligned or mislabeled text-image pairs. This frequently leads to robustness issues…

Machine Learning · Computer Science 2025-02-04 Lijie Hu , Chenyang Ren , Huanyi Xie , Khouloud Saadi , Shu Yang , Zhen Tan , Jingfeng Zhang , Di Wang

The pursuit of learning robust representations without human supervision is a longstanding challenge. The recent advancements in self-supervised contrastive learning approaches have demonstrated high performance across various…

Computer Vision and Pattern Recognition · Computer Science 2024-03-29 Ozgu Goksu , Nicolas Pugeault

Most of previous deepfake detection researches bent their efforts to describe and discriminate artifacts in human perceptible ways, which leave a bias in the learned networks of ignoring some critical invariance features intra-class and…

Computer Vision and Pattern Recognition · Computer Science 2022-05-17 Ruiqi Zha , Zhichao Lian , Qianmu Li , Siqi Gu

Acoustic word embeddings (AWEs) are fixed-dimensional representations of variable-length speech segments. For zero-resource languages where labelled data is not available, one AWE approach is to use unsupervised autoencoder-based recurrent…

Computation and Language · Computer Science 2021-03-22 Christiaan Jacobs , Yevgen Matusevych , Herman Kamper

Recent self-supervised contrastive methods have been able to produce impressive transferable visual representations by learning to be invariant to different data augmentations. However, these methods implicitly assume a particular set of…

Computer Vision and Pattern Recognition · Computer Science 2021-03-22 Tete Xiao , Xiaolong Wang , Alexei A. Efros , Trevor Darrell

Unsupervised sentence embedding aims to obtain the most appropriate embedding for a sentence to reflect its semantic. Contrastive learning has been attracting developing attention. For a sentence, current models utilize diverse data…

Computation and Language · Computer Science 2022-03-03 Hao Wang , Yangguang Li , Zhen Huang , Yong Dou , Lingpeng Kong , Jing Shao

Unsupervised learning has recently made exceptional progress because of the development of more effective contrastive learning methods. However, CNNs are prone to depend on low-level features that humans deem non-semantic. This dependency…

Computer Vision and Pattern Recognition · Computer Science 2022-01-04 Songwei Ge , Shlok Mishra , Haohan Wang , Chun-Liang Li , David Jacobs

Machine unlearning aims to eliminate the influence of a subset of training samples (i.e., unlearning samples) from a trained model. Effectively and efficiently removing the unlearning samples without negatively impacting the overall model…

Machine Learning · Computer Science 2024-01-22 Hong kyu Lee , Qiuchen Zhang , Carl Yang , Jian Lou , Li Xiong

Test-time defenses are used to improve the robustness of deep neural networks to adversarial examples during inference. However, existing methods either require an additional trained classifier to detect and correct the adversarial samples,…

Machine Learning · Computer Science 2024-08-26 Anurag Singh , Mahalakshmi Sabanayagam , Krikamol Muandet , Debarghya Ghoshdastidar

Learning fair representation is crucial for achieving fairness or debiasing sensitive information. Most existing works rely on adversarial representation learning to inject some invariance into representation. However, adversarial learning…

Machine Learning · Computer Science 2022-06-20 Changdae Oh , Heeji Won , Junhyuk So , Taero Kim , Yewon Kim , Hosik Choi , Kyungwoo Song

The popularity of deep learning methods in the time series domain boosts interest in interpretability studies, including counterfactual (CF) methods. CF methods identify minimal changes in instances to alter the model predictions. Despite…

Machine Learning · Computer Science 2024-10-11 Ziwen Kan , Shahbaz Rezaei , Xin Liu