English
Related papers

Related papers: Consistency Beyond Contrast: Enhancing Open-Vocabu…

200 papers

We tackle open-world semantic segmentation, which aims at learning to segment arbitrary visual concepts in images, by using only image-text pairs without dense annotations. Existing open-world segmentation methods have shown impressive…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Junbum Cha , Jonghwan Mun , Byungseok Roh

In high-stakes medical applications, consistent answering across diverse question phrasings is essential for reliable diagnosis. However, we reveal that current Medical Vision-Language Models (Med-VLMs) exhibit concerning fragility in…

Computation and Language · Computer Science 2025-08-27 Songtao Jiang , Yuxi Chen , Sibo Song , Yan Zhang , Yeying Jin , Yang Feng , Jian Wu , Zuozhu Liu

One of the successful approaches in semi-supervised learning is based on the consistency regularization. Typically, a student model is trained to be consistent with teacher prediction for the inputs under different perturbations. To be…

Computer Vision and Pattern Recognition · Computer Science 2021-05-10 Lu Liu , Robby T. Tan

Self-supervised video Object-Centric Learning (OCL) aims to discover distinct objects and associate them across time, whereas self-supervised Multi-Object Tracking (MOT) focuses on associating pre-defined object detections or segmentations.…

Computer Vision and Pattern Recognition · Computer Science 2026-05-29 Rongzhen Zhao , Zhiyuan Li , Ruonan Wei , Juho Kannala , Joni Pajarinen

The proliferation of digital news media necessitates robust methods for verifying content veracity, particularly regarding the consistency between visual and textual information. Traditional approaches often fall short in addressing the…

Computer Vision and Pattern Recognition · Computer Science 2025-08-12 Sihan Ma , Qiming Wu , Ruotong Jiang , Frank Burns

Unsupervised object-centric learning from videos is a promising approach to extract structured representations from large, unlabeled collections of videos. To support downstream tasks like autonomous control, these representations must be…

Computer Vision and Pattern Recognition · Computer Science 2025-03-19 Anna Manasyan , Maximilian Seitzer , Filip Radovic , Georg Martius , Andrii Zadaianchuk

Cross-lingual in-context learning (XICL) has emerged as a transformative paradigm for leveraging large language models (LLMs) to tackle multilingual tasks, especially for low-resource languages. However, existing approaches often rely on…

Computation and Language · Computer Science 2024-12-13 Mateo Alejandro Rojas , Rafael Carranza

Learning a deep model from small data is yet an opening and challenging problem. We focus on one-shot classification by deep learning approach based on a small quantity of training samples. We proposed a novel deep learning approach named…

Machine Learning · Computer Science 2018-02-13 Chuanyun Xu , Yang Zhang , Xin Feng , YongXing Ge , Yihao Zhang , Jianwu Long

Contrastive learning has gained popularity and pushes state-of-the-art performance across numerous large-scale benchmarks. In contrastive learning, the contrastive loss function plays a pivotal role in discerning similarities between…

Computer Vision and Pattern Recognition · Computer Science 2025-12-03 Haojin Deng , Yimin Yang

Contrastive learning has emerged as a competitive pretraining method for object detection. Despite this progress, there has been minimal investigation into the robustness of contrastively pretrained detectors when faced with domain shifts.…

Computer Vision and Pattern Recognition · Computer Science 2022-12-12 Kyle Buettner , Adriana Kovashka

Multi-task Vehicle Routing Problems (VRPs) aim to minimize routing costs while satisfying diverse constraints. Existing solvers typically adopt a unified reinforcement learning (RL) framework to learn generalizable patterns across tasks.…

Artificial Intelligence · Computer Science 2026-03-03 Shuangchun Gui , Suyu Liu , Xuehe Wang , Zhiguang Cao

Although Multimodal Large Language Models (MLLMs) have advanced rapidly, they still face notable challenges in fine-grained multi-image understanding, often exhibiting spatial hallucination, attention leakage, and failures in object…

Computer Vision and Pattern Recognition · Computer Science 2026-04-27 Lihao Zheng , Zhenwei Shao , Yu Zhou , Yan Yang , Xintian Shen , Jiawei Chen , Hao Ma , Tao Wei

Diffusion Language Models (DLMs) have recently achieved significant success due to their any-order generation capabilities. However, existing inference methods typically rely on local, immediate-step metrics such as confidence or entropy…

Computation and Language · Computer Science 2025-12-03 Kecheng Chen , Ziru Liu , Xijia Tao , Hui Liu , Xinyu Fu , Suiyun Zhang , Dandan Tu , Lingpeng Kong , Rui Liu , Haoliang Li

Recent years have witnessed a significant increase in the performance of Vision and Language tasks. Foundational Vision-Language Models (VLMs), such as CLIP, have been leveraged in multiple settings and demonstrated remarkable performance…

Computer Vision and Pattern Recognition · Computer Science 2024-03-04 Santiago Castro , Amir Ziai , Avneesh Saluja , Zhuoning Yuan , Rada Mihalcea

Contrastive Learning (CL) has been proved to be a powerful self-supervised approach for a wide range of domains, including computer vision and graph representation learning. However, the incremental learning issue of CL has rarely been…

Machine Learning · Computer Science 2023-01-31 Cheng Ji , Jianxin Li , Hao Peng , Jia Wu , Xingcheng Fu , Qingyun Sun , Phillip S. Yu

Contrastive learning has revolutionized self-supervised image representation learning field, and recently been adapted to video domain. One of the greatest advantages of contrastive learning is that it allows us to flexibly define powerful…

Computer Vision and Pattern Recognition · Computer Science 2021-08-06 Haofei Kuang , Yi Zhu , Zhi Zhang , Xinyu Li , Joseph Tighe , Sören Schwertfeger , Cyrill Stachniss , Mu Li

In-context learning (ICL) has transformed the use of large language models (LLMs) for NLP tasks, enabling few-shot learning by conditioning on labeled examples without finetuning. Despite its effectiveness, ICL is prone to errors,…

Computation and Language · Computer Science 2025-03-21 Mario Sanz-Guerrero , Katharina von der Wense

Contrastive self-supervised learning (SSL) learns an embedding space that maps similar data pairs closer and dissimilar data pairs farther apart. Despite its success, one issue has been overlooked: the fairness aspect of representations…

Obtaining labelled ECG data for developing supervised models is challenging. Contrastive learning (CL) has emerged as a promising pretraining approach that enables effective transfer learning with limited labelled data. However, existing CL…

Machine Learning · Computer Science 2026-01-23 Muhammad Ilham Rizqyawan , Peter Macfarlane , Stathis Hadjidemetriou , Fani Deligianni

Semi-supervised learning in medical image segmentation leverages unlabeled data to reduce annotation burdens through consistency learning. However, current methods struggle with class imbalance and high uncertainty from pathology…

Computer Vision and Pattern Recognition · Computer Science 2025-04-08 Maregu Assefa , Muzammal Naseer , Iyyakutti Iyappan Ganapathi , Syed Sadaf Ali , Mohamed L Seghier , Naoufel Werghi