English
Related papers

Related papers: Learning Common Rationale to Improve Self-Supervis…

200 papers

This paper explores the possibility of learning custom tokens for representing new concepts in Vision-Language Models (VLMs). Our aim is to learn tokens that can be effective for both discriminative and generative tasks while composing well…

Computer Vision and Pattern Recognition · Computer Science 2025-02-18 Pramuditha Perera , Matthew Trager , Luca Zancato , Alessandro Achille , Stefano Soatto

Semi-supervised learning (SSL) is effectively used for numerous classification problems, thanks to its ability to make use of abundant unlabeled data. The main assumption of various SSL algorithms is that the nearby points on the data…

Machine Learning · Computer Science 2019-09-30 Xuan Wu , Lingxiao Zhao , Leman Akoglu

As fine-grained visual classification (FGVC) being developed for decades, great works related have exposed a key direction -- finding discriminative local regions and revealing subtle differences. However, unlike identifying visual contents…

Computer Vision and Pattern Recognition · Computer Science 2022-06-03 Ruoyi Du , Wenqing Yu , Heqing Wang , Dongliang Chang , Ting-En Lin , Yongbin Li , Zhanyu Ma

The success of self-supervised learning (SSL) has mostly been attributed to the availability of unlabeled yet large-scale datasets. However, in a specialized domain such as medical imaging which is a lot different from natural images, the…

Computer Vision and Pattern Recognition · Computer Science 2023-06-30 Soumitri Chattopadhyay , Soham Ganguly , Sreejit Chaudhury , Sayan Nag , Samiran Chattopadhyay

As a new paradigm in machine learning, self-supervised learning (SSL) is capable of learning high-quality representations of complex data without relying on labels. In addition to eliminating the need for labeled data, research has found…

Cryptography and Security · Computer Science 2023-08-15 Changjiang Li , Ren Pang , Zhaohan Xi , Tianyu Du , Shouling Ji , Yuan Yao , Ting Wang

Recent advancements in reinforcement learning with verifiable rewards (RLVR) have significantly improved the complex reasoning ability of vision-language models (VLMs). However, its outcome-level supervision is too coarse to diagnose and…

Computer Vision and Pattern Recognition · Computer Science 2026-04-28 Yingqian Min , Kun Zhou , Yifan Li , Yuhuan Wu , Han Peng , Yifan Du , Wayne Xin Zhao , Min Yang , Ji-Rong Wen

The success of deep learning in computer vision is rooted in the ability of deep networks to scale up model complexity as demanded by challenging visual tasks. As complexity is increased, so is the need for large amounts of labeled data to…

Computer Vision and Pattern Recognition · Computer Science 2017-08-22 Gustav Larsson

Although foundational vision-language models (VLMs) have proven to be very successful for various semantic discrimination tasks, they still struggle to perform faithfully for fine-grained categorization. Moreover, foundational models…

Computer Vision and Pattern Recognition · Computer Science 2024-09-10 Soumitri Chattopadhyay , Sanket Biswas , Emanuele Vivoli , Josep Lladós

Linear probing (LP) (and $k$-NN) on the upstream dataset with labels (e.g., ImageNet) and transfer learning (TL) to various downstream datasets are commonly employed to evaluate the quality of visual representations learned via…

Computer Vision and Pattern Recognition · Computer Science 2023-04-10 Jae-Hun Lee , Doyoung Yoon , ByeongMoon Ji , Kyungyul Kim , Sangheum Hwang

Most of the saliency methods are evaluated on their ability to generate saliency maps, and not on their functionality in a complete vision pipeline, like for instance, image classification. In the current paper, we propose an approach which…

Computer Vision and Pattern Recognition · Computer Science 2021-02-04 Carola Figueroa-Flores , Bogdan Raducanu , David Berga , Joost van de Weijer

It is a recognized fact that the classification accuracy of unseen classes in the setting of Generalized Zero-Shot Learning (GZSL) is much lower than that of traditional Zero-Shot Leaning (ZSL). One of the reasons is that an instance is…

Computer Vision and Pattern Recognition · Computer Science 2020-06-12 Xinpeng Li

Self-supervised contrastive learning (SSCL) has achieved significant milestones in remote sensing image (RSI) understanding. Its essence lies in designing an unsupervised instance discrimination pretext task to extract image features from a…

Machine Learning · Computer Science 2023-11-29 Zhaoyang Zhang , Zhen Ren , Chao Tao , Yunsheng Zhang , Chengli Peng , Haifeng Li

Sign language recognition (SLR) plays a vital role in facilitating communication for the hearing-impaired community. SLR is a weakly supervised task where entire videos are annotated with glosses, making it challenging to identify the…

Computer Vision and Pattern Recognition · Computer Science 2024-01-23 Hao Chen , Jiaze Wang , Ziyu Guo , Jinpeng Li , Donghao Zhou , Bian Wu , Chenyong Guan , Guangyong Chen , Pheng-Ann Heng

Contrastive self-supervised learning (CSL) has managed to match or surpass the performance of supervised learning in image and video classification. However, it is still largely unknown if the nature of the representations induced by the…

Computer Vision and Pattern Recognition · Computer Science 2022-11-22 Rohit Gupta , Naveed Akhtar , Ajmal Mian , Mubarak Shah

Federated learning (FL) has emerged as a promising paradigm for privacy-preserving multi-camera video understanding. However, applying FL to cross-view scenarios faces three major challenges: (i) heterogeneous viewpoints and backgrounds…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Shenghan Zhang , Run Ling , Ke Cao , Ao Ma , Zhanjie Zhang

Self-Supervised Learning (SSL) has emerged as the solution of choice to learn transferable representations from unlabeled data. However, SSL requires to build samples that are known to be semantically akin, i.e. positive views. Requiring…

Machine Learning · Computer Science 2023-10-02 Vivien Cabannes , Leon Bottou , Yann Lecun , Randall Balestriero

Few-shot learning (FSL) aims to learn novel visual categories from very few samples, which is a challenging problem in real-world applications. Many methods of few-shot classification work well on general images to learn global…

Computer Vision and Pattern Recognition · Computer Science 2020-12-15 Xiaojian He , Jinfu Lin , Junming Shen

Recent advances in self-supervised learning (SSL) have largely closed the gap with supervised ImageNet pretraining. Despite their success these methods have been primarily applied to unlabeled ImageNet images, and show marginal gains when…

Computer Vision and Pattern Recognition · Computer Science 2020-12-09 Ramprasaath R. Selvaraju , Karan Desai , Justin Johnson , Nikhil Naik

Large Multimodal Models (LMMs), or Vision-Language Models (VLMs), have shown impressive capabilities in a wide range of visual tasks. However, they often struggle with fine-grained visual reasoning, failing to identify domain-specific…

Computer Vision and Pattern Recognition · Computer Science 2025-02-26 Yucheng Shi , Quanzheng Li , Jin Sun , Xiang Li , Ninghao Liu

Deep Reinforcement Learning (deep RL) has made several breakthroughs in recent years in applications ranging from complex control tasks in unmanned vehicles to game playing. Despite their success, deep RL still lacks several important…

Machine Learning · Computer Science 2018-04-24 Artur d'Avila Garcez , Aimore Resende Riquetti Dutra , Eduardo Alonso