English
Related papers

Related papers: Contrastive Learning for View Classification of Ec…

200 papers

Convolutional networks have marked their place over the last few years as the best performing model for various visual tasks. They are, however, most suited for supervised learning from large amounts of labeled data. Previous attempts have…

Machine Learning · Computer Science 2018-12-05 Elad Hoffer , Itay Hubara , Nir Ailon

Few-Shot learning aims to train and optimize a model that can adapt to unseen visual classes with only a few labeled examples. The existing few-shot learning (FSL) methods, heavily rely only on visual data, thus fail to capture the semantic…

Computer Vision and Pattern Recognition · Computer Science 2022-10-21 Mohamed Afham , Ranga Rodrigo

Most deep neural networks (DNNs) based ultrasound (US) medical image analysis models use pretrained backbones (e.g., ImageNet) for better model generalization. However, the domain gap between natural and medical images causes an inevitable…

Computer Vision and Pattern Recognition · Computer Science 2021-09-03 Yixiong Chen , Chunhui Zhang , Li Liu , Cheng Feng , Changfeng Dong , Yongfang Luo , Xiang Wan

Traditional supervised learning methods are hitting a bottleneck because of their dependency on expensive manually labeled data and their weaknesses such as limited generalization ability and vulnerability to adversarial attacks. A…

Machine Learning · Computer Science 2021-06-08 Ran Liu

Among different existing graph self-supervised learning strategies, graph contrastive learning (GCL) has been one of the most prevalent approaches to this problem. Despite the remarkable performance those GCL methods have achieved, existing…

Machine Learning · Computer Science 2022-10-27 Qianlong Wen , Zhongyu Ouyang , Chunhui Zhang , Yiyue Qian , Yanfang Ye , Chuxu Zhang

As one of the most effective self-supervised representation learning methods, contrastive learning (CL) relies on multiple negative pairs to contrast against each positive pair. In the standard practice of contrastive learning, data…

Machine Learning · Computer Science 2024-01-18 Lu Wang , Chao Du , Pu Zhao , Chuan Luo , Zhangchi Zhu , Bo Qiao , Wei Zhang , Qingwei Lin , Saravan Rajmohan , Dongmei Zhang , Qi Zhang

Most existing graph-based semi-supervised hyperspectral image classification methods rely on superpixel partitioning techniques. However, they suffer from misclassification of certain pixels due to inaccuracies in superpixel boundaries,…

Computer Vision and Pattern Recognition · Computer Science 2025-03-21 Yuqing Zhang , Qi Han , Ligeng Wang , Kai Cheng , Bo Wang , Kun Zhan

Methods based on supervised learning using annotations in an end-to-end fashion have been the state-of-the-art for classification problems. However, they may be limited in their generalization capability, especially in the low data regime.…

Sound · Computer Science 2023-08-14 Ilyass Moummad , Nicolas Farrugia

Self-supervised representation learning on image-text data facilitates crucial medical applications, such as image classification, visual grounding, and cross-modal retrieval. One common approach involves contrasting semantically similar…

Machine Learning · Computer Science 2023-08-15 Peiqi Wang , Yingcheng Liu , Ching-Yun Ko , William M. Wells , Seth Berkowitz , Steven Horng , Polina Golland

Ultrasound (US) image segmentation embraced its significant improvement in deep learning era. However, the lack of sharp boundaries in US images still remains an inherent challenge for segmentation. Previous methods often resort to global…

Image and Video Processing · Electrical Eng. & Systems 2020-10-13 Haoming Li , Xin Yang , Jiamin Liang , Wenlong Shi , Chaoyu Chen , Haoran Dou , Rui Li , Rui Gao , Guangquan Zhou , Jinghui Fang , Xiaowen Liang , Ruobing Huang , Alejandro Frangi , Zhiyi Chen , Dong Ni

Contrastive learning is an approach to representation learning that utilizes naturally occurring similar and dissimilar pairs of data points to find useful embeddings of data. In the context of document classification under topic modeling…

Machine Learning · Computer Science 2020-03-05 Christopher Tosh , Akshay Krishnamurthy , Daniel Hsu

In standard supervised machine learning, it is necessary to provide a label for every input in the data. While raw data in many application domains is easily obtainable on the Internet, manual labelling of this data is prohibitively…

Machine Learning · Computer Science 2023-09-07 Konstantinos Christopher Tsiolis

Self-supervised learning is a machine learning approach that generates implicit labels by learning underlined patterns and extracting discriminative features from unlabeled data without manual labelling. Contrastive learning introduces the…

Computer Vision and Pattern Recognition · Computer Science 2025-10-13 Asifullah Khan , Laiba Asmatullah , Anza Malik , Shahzaib Khan , Hamna Asif

Predicting the neural response to natural images in the visual cortex requires extracting relevant features from the images and relating those feature to the observed responses. In this work, we optimize the feature extraction in order to…

Computer Vision and Pattern Recognition · Computer Science 2024-10-10 Alex Mulrooney , Austin J. Brockmeier

In this work, we aim to consider the application of contrastive learning in the scenario of the recommendation system adequately, making it more suitable for recommendation task. We propose a learning paradigm called supervised contrastive…

Information Retrieval · Computer Science 2022-04-20 Chun Yang

Recently, contrastive learning approaches (e.g., CLIP (Radford et al., 2021)) have received huge success in multimodal learning, where the model tries to minimize the distance between the representations of different views (e.g., image and…

Machine Learning · Computer Science 2023-04-10 Yunwei Ren , Yuanzhi Li

The success of deep learning is usually accompanied by the growth in neural network depth. However, the traditional training method only supervises the neural network at its last layer and propagates the supervision layer-by-layer, which…

Computer Vision and Pattern Recognition · Computer Science 2022-07-13 Linfeng Zhang , Xin Chen , Junbo Zhang , Runpei Dong , Kaisheng Ma

Self supervised contrastive learning based pretraining allows development of robust and generalized deep learning models with small, labeled datasets, reducing the burden of label generation. This paper aims to evaluate the effect of CL…

Image and Video Processing · Electrical Eng. & Systems 2022-08-25 Minhaj Nur Alam , Rikiya Yamashita , Vignav Ramesh , Tejas Prabhune , Jennifer I. Lim , R. V. P. Chan , Joelle Hallak , Theodore Leng , Daniel Rubin

Acceleration of machine learning research in healthcare is challenged by lack of large annotated and balanced datasets. Furthermore, dealing with measurement inaccuracies and exploiting unsupervised data are considered to be central to…

Signal Processing · Electrical Eng. & Systems 2019-01-11 Deepta Rajan , David Beymer , Girish Narayan

Contrastive learning has been widely applied to graph representation learning, where the view generators play a vital role in generating effective contrastive samples. Most of the existing contrastive learning methods employ pre-defined…

Machine Learning · Computer Science 2022-01-04 Yihang Yin , Qingzhong Wang , Siyu Huang , Haoyi Xiong , Xiang Zhang