English
Related papers

Related papers: Contrastive Representation Learning for Hand Shape…

200 papers

The self-supervised ultrasound (US) video model pretraining can use a small amount of labeled data to achieve one of the most promising results on US diagnosis. However, it does not take full advantage of multi-level knowledge for learning…

Computer Vision and Pattern Recognition · Computer Science 2022-10-14 Chunhui Zhang , Yixiong Chen , Li Liu , Qiong Liu , Xi Zhou

Learning good representations involves capturing the diverse ways in which data samples relate. Contrastive loss - an objective matching related samples - underlies methods from self-supervised to multimodal learning. Contrastive losses,…

Computer Vision and Pattern Recognition · Computer Science 2024-09-13 Vlad Sobal , Mark Ibrahim , Randall Balestriero , Vivien Cabannes , Diane Bouchacourt , Pietro Astolfi , Kyunghyun Cho , Yann LeCun

Tremendous progress has been made in visual representation learning, notably with the recent success of self-supervised contrastive learning methods. Supervised contrastive learning has also been shown to outperform its cross-entropy…

Computer Vision and Pattern Recognition · Computer Science 2021-08-17 Ashraful Islam , Chun-Fu Chen , Rameswar Panda , Leonid Karlinsky , Richard Radke , Rogerio Feris

Contrastive, self-supervised learning of object representations recently emerged as an attractive alternative to reconstruction-based training. Prior approaches focus on contrasting individual object representations (slots) against one…

Computer Vision and Pattern Recognition · Computer Science 2020-11-23 Sindy Löwe , Klaus Greff , Rico Jonschkowski , Alexey Dosovitskiy , Thomas Kipf

This paper presents a hand shape classification approach employing multiscale template matching. The integration of background subtraction is utilized to derive a binary image of the hand object, enabling the extraction of key features such…

Computer Vision and Pattern Recognition · Computer Science 2024-02-16 Ketan Suhaas Saichandran

Multi-view representation learning has developed rapidly over the past decades and has been applied in many fields. However, most previous works assumed that each view is complete and aligned. This leads to an inevitable deterioration in…

Computer Vision and Pattern Recognition · Computer Science 2022-11-10 Yiming Wang , Dongxia Chang , Zhiqiang Fu , Jie Wen , Yao Zhao

Multimodal imaging and correlative analysis typically require image alignment. Contrastive learning can generate representations of multimodal images, reducing the challenging task of multimodal image registration to a monomodal one.…

Computer Vision and Pattern Recognition · Computer Science 2023-03-02 Elisabeth Wetzer , Joakim Lindblad , Nataša Sladoje

We introduce TempCLR, a new time-coherent contrastive learning approach for the structured regression task of 3D hand reconstruction. Unlike previous time-contrastive methods for hand pose estimation, our framework considers temporal…

Computer Vision and Pattern Recognition · Computer Science 2022-09-02 Andrea Ziani , Zicong Fan , Muhammed Kocabas , Sammy Christen , Otmar Hilliges

Representation learning is a fundamental aspect of modern artificial intelligence, driving substantial improvements across diverse applications. While selfsupervised contrastive learning has led to significant advancements in fields like…

Machine Learning · Computer Science 2024-11-19 Suiyao Chen , Jing Wu , Yunxiao Wang , Cheng Ji , Tianpei Xie , Daniel Cociorva , Michael Sharps , Cecile Levasseur , Hakan Brunzell

Trained classification models can unintentionally lead to biased representations and predictions, which can reinforce societal preconceptions and stereotypes. Existing debiasing methods for classification models, such as adversarial…

Computation and Language · Computer Science 2021-09-23 Aili Shen , Xudong Han , Trevor Cohn , Timothy Baldwin , Lea Frermann

Heterogeneous graph neural networks (HGNNs) as an emerging technique have shown superior capacity of dealing with heterogeneous information network (HIN). However, most HGNNs follow a semi-supervised learning manner, which notably limits…

Machine Learning · Computer Science 2021-05-20 Xiao Wang , Nian Liu , Hui Han , Chuan Shi

Contrastive learning is commonly used as a method of self-supervised learning with the "anchor" and "positive" being two random augmentations of a given input image, and the "negative" is the set of all other images. However, the…

Computer Vision and Pattern Recognition · Computer Science 2022-08-16 Rishab Balasubramanian , Kunal Rathore

Unsupervised visual representation learning has gained much attention from the computer vision community because of the recent achievement of contrastive learning. Most of the existing contrastive learning frameworks adopt the instance…

Computer Vision and Pattern Recognition · Computer Science 2021-10-12 Mingkai Zheng , Fei Wang , Shan You , Chen Qian , Changshui Zhang , Xiaogang Wang , Chang Xu

Understanding the severity of conditions shown in images in medical diagnosis is crucial, serving as a key guide for clinical assessment, treatment, as well as evaluating longitudinal progression. This paper proposes Con- PrO: a novel…

Computer Vision and Pattern Recognition · Computer Science 2024-04-30 Hong Nguyen , Hoang Nguyen , Melinda Chang , Hieu Pham , Shrikanth Narayanan , Michael Pazzani

Contrastive learning methods for unsupervised visual representation learning have reached remarkable levels of transfer performance. We argue that the power of contrastive learning has yet to be fully unleashed, as current methods are…

Computer Vision and Pattern Recognition · Computer Science 2021-03-10 Zhenda Xie , Yutong Lin , Zheng Zhang , Yue Cao , Stephen Lin , Han Hu

Recently, multi-modal vision-language foundation models have gained significant attention in the medical field. While these models offer great opportunities, they still face crucial challenges, such as the requirement for fine-grained…

Computer Vision and Pattern Recognition · Computer Science 2024-09-05 Weijian Huang , Cheng Li , Hong-Yu Zhou , Hao Yang , Jiarun Liu , Yong Liang , Hairong Zheng , Shaoting Zhang , Shanshan Wang

The success of most advanced facial expression recognition works relies heavily on large-scale annotated datasets. However, it poses great challenges in acquiring clean and consistent annotations for facial expression datasets. On the other…

Computer Vision and Pattern Recognition · Computer Science 2022-10-11 Yuxuan Shu , Xiao Gu , Guang-Zhong Yang , Benny Lo

Face analysis tasks have a wide range of applications, but the universal facial representation has only been explored in a few works. In this paper, we explore high-performance pre-training methods to boost the face analysis tasks such as…

Computer Vision and Pattern Recognition · Computer Science 2023-09-08 Yue Wang , Jinlong Peng , Jiangning Zhang , Ran Yi , Liang Liu , Yabiao Wang , Chengjie Wang

Hand pose estimation from the monocular 2D image is challenging due to the variation in lighting, appearance, and background. While some success has been achieved using deep neural networks, they typically require collecting a large dataset…

Computer Vision and Pattern Recognition · Computer Science 2019-04-17 Yikang Li , Chris Twigg , Yuting Ye , Lingling Tao , Xiaogang Wang

This paper presents a self-supervised feature learning method for hyperspectral image classification. Our method tries to construct two different views of the raw hyperspectral image through a cross-representation learning method. And then…

Computer Vision and Pattern Recognition · Computer Science 2024-12-05 Anyu Zhang , Haotian Wu , Zeyu Cao