English
Related papers

Related papers: CSSL-RHA: Contrastive Self-Supervised Learning for…

200 papers

We propose an effective Hybrid Deep Learning (HDL) architecture for the task of determining the probability that a questioned handwritten word has been written by a known writer. HDL is an amalgamation of Auto-Learned Features (ALF) and…

Computer Vision and Pattern Recognition · Computer Science 2019-10-08 Mohammad Abuzar Shaikh , Mihir Chauhan , Jun Chu , Sargur Srihari

One main challenge in time series anomaly detection (TSAD) is the lack of labelled data in many real-life scenarios. Most of the existing anomaly detection methods focus on learning the normal behaviour of unlabelled time series in an…

Machine Learning · Computer Science 2024-09-04 Zahra Zamanzadeh Darban , Geoffrey I. Webb , Shirui Pan , Charu C. Aggarwal , Mahsa Salehi

Contrastive learning is commonly used as a method of self-supervised learning with the "anchor" and "positive" being two random augmentations of a given input image, and the "negative" is the set of all other images. However, the…

Computer Vision and Pattern Recognition · Computer Science 2022-08-16 Rishab Balasubramanian , Kunal Rathore

Self-supervised learning (SSL) provides a promising alternative for representation learning on hypergraphs without costly labels. However, existing hypergraph SSL models are mostly based on contrastive methods with the instance-level…

Machine Learning · Computer Science 2024-04-19 Fan Li , Xiaoyang Wang , Dawei Cheng , Wenjie Zhang , Ying Zhang , Xuemin Lin

Contrastive Self-supervised Learning (CSL) is a practical solution that learns meaningful visual representations from massive data in an unsupervised approach. The ordinary CSL embeds the features extracted from neural networks onto…

Computer Vision and Pattern Recognition · Computer Science 2022-08-19 Shentong Mo , Zhun Sun , Chao Li

We present a contrasting learning approach with data augmentation techniques to learn document representations in an unsupervised manner. Inspired by recent contrastive self-supervised learning algorithms used for image and NLP pretraining,…

Computation and Language · Computer Science 2021-03-29 Dongsheng Luo , Wei Cheng , Jingchao Ni , Wenchao Yu , Xuchao Zhang , Bo Zong , Yanchi Liu , Zhengzhang Chen , Dongjin Song , Haifeng Chen , Xiang Zhang

Sequential recommendation methods play a crucial role in modern recommender systems because of their ability to capture a user's dynamic interest from her/his historical interactions. Despite their success, we argue that these approaches…

Information Retrieval · Computer Science 2021-03-02 Xu Xie , Fei Sun , Zhaoyang Liu , Shiwen Wu , Jinyang Gao , Bolin Ding , Bin Cui

Some of the threats in the dynamic environment include the unpredictability of the motion of objects and interferences to the robotic grasp. In such conditions the traditional supervised and reinforcement learning approaches are ill suited…

Robotics · Computer Science 2024-10-18 Ankit Shaw

Cell identification within the H&E slides is an essential prerequisite that can pave the way towards further pathology analyses including tissue classification, cancer grading, and phenotype prediction. However, performing such a task using…

Computer Vision and Pattern Recognition · Computer Science 2023-01-18 Ramin Nakhli , Amirali Darbandsari , Hossein Farahani , Ali Bashashati

Unsupervised learning has recently made exceptional progress because of the development of more effective contrastive learning methods. However, CNNs are prone to depend on low-level features that humans deem non-semantic. This dependency…

Computer Vision and Pattern Recognition · Computer Science 2022-01-04 Songwei Ge , Shlok Mishra , Haohan Wang , Chun-Liang Li , David Jacobs

Unsupervised aspect detection (UAD) aims at automatically extracting interpretable aspects and identifying aspect-specific segments (such as sentences) from online reviews. However, recent deep learning-based topic models, specifically…

Computation and Language · Computer Science 2021-01-01 Tian Shi , Liuqing Li , Ping Wang , Chandan K. Reddy

Self-supervised Learning (SSL) including the mainstream contrastive learning has achieved great success in learning visual representations without data annotations. However, most of methods mainly focus on the instance level information…

Computer Vision and Pattern Recognition · Computer Science 2021-07-26 Mingkai Zheng , Shan You , Fei Wang , Chen Qian , Changshui Zhang , Xiaogang Wang , Chang Xu

Contrastive learning (CL) has recently emerged as an effective approach to learning representation in a range of downstream tasks. Central to this approach is the selection of positive (similar) and negative (dissimilar) sets to provide the…

Machine Learning · Computer Science 2021-10-25 Anh Bui , Trung Le , He Zhao , Paul Montague , Seyit Camtepe , Dinh Phung

A major bottleneck in training robust Human-Activity Recognition models (HAR) is the need for large-scale labeled sensor datasets. Because labeling large amounts of sensor data is an expensive task, unsupervised and semi-supervised learning…

Machine Learning · Computer Science 2022-02-03 Yash Jain , Chi Ian Tang , Chulhong Min , Fahim Kawsar , Akhil Mathur

Ransomware has become a critical threat to cybersecurity due to its rapid evolution, the necessity for early detection, and growing diversity, posing significant challenges to traditional detection methods. While AI-based approaches had…

Cryptography and Security · Computer Science 2025-10-28 Zhixin Pan , Ziyu Shu , Amberbir Alemayoh

Anomaly detection aims at identifying deviant samples from the normal data distribution. Contrastive learning has provided a successful way to sample representation that enables effective discrimination on anomalies. However, when…

Computer Vision and Pattern Recognition · Computer Science 2022-07-26 Gaoang Wang , Yibing Zhan , Xinchao Wang , Mingli Song , Klara Nahrstedt

Selective classification enables models to make predictions only when they are sufficiently confident, aiming to enhance safety and reliability, which is important in high-stakes scenarios. Previous methods mainly use deep neural networks…

Machine Learning · Computer Science 2024-06-10 Yu-Chang Wu , Shen-Huan Lyu , Haopu Shang , Xiangyu Wang , Chao Qian

Learning visual representation of high quality is essential for image classification. Recently, a series of contrastive representation learning methods have achieved preeminent success. Particularly, SupCon outperformed the dominant methods…

Computer Vision and Pattern Recognition · Computer Science 2022-03-31 Sungho Park , Jewook Lee , Pilhyeon Lee , Sunhee Hwang , Dohyung Kim , Hyeran Byun

Contrastive learning is a representational learning paradigm in which a neural network maps data elements to feature vectors. It improves the feature space by forming lots with an anchor and examples that are either positive or negative…

Computer Vision and Pattern Recognition · Computer Science 2025-05-26 Fabian Deuser , Philipp Hausenblas , Hannah Schieber , Daniel Roth , Martin Werner , Norbert Oswald

Representation learning has significantly been developed with the advance of contrastive learning methods. Most of those methods have benefited from various data augmentations that are carefully designated to maintain their identities so…

Computer Vision and Pattern Recognition · Computer Science 2022-01-24 Xiao Wang , Guo-Jun Qi