English
Related papers

Related papers: Learning with Difference Attention for Visually Gr…

200 papers

Unsupervised domain adaptation (UDA) aims to transfer and adapt knowledge from a labeled source domain to an unlabeled target domain. Traditionally, subspace-based methods form an important class of solutions to this problem. Despite their…

Machine Learning · Computer Science 2022-01-07 Kowshik Thopalli , Jayaraman J Thiagarajan , Rushil Anirudh , Pavan K Turaga

Video object segmentation is a fundamental research problem in computer vision. Recent techniques have often applied attention mechanism to object representation learning from video sequences. However, due to temporal changes in the video…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Quang-Trung Truong , Duc Thanh Nguyen , Binh-Son Hua , Sai-Kit Yeung

Self-supervision has shown outstanding results for natural language processing, and more recently, for image recognition. Simultaneously, vision transformers and its variants have emerged as a promising and scalable alternative to…

Computer Vision and Pattern Recognition · Computer Science 2022-02-01 Prarthana Bhattacharyya , Chenge Li , Xiaonan Zhao , István Fehérvári , Jason Sun

While huge volumes of unlabeled data are generated and made available in many domains, the demand for automated understanding of visual data is higher than ever before. Most existing machine learning models typically rely on massive amounts…

Computer Vision and Pattern Recognition · Computer Science 2021-12-14 Youshan Zhang

Supervised deep learning requires massive labeled datasets, but obtaining annotations is not always easy or possible, especially for dense tasks like semantic segmentation. To overcome this issue, numerous works explore Unsupervised Domain…

Computer Vision and Pattern Recognition · Computer Science 2024-12-02 Daniel Morales-Brotons , Grigorios Chrysos , Stratis Tzoumas , Volkan Cevher

Semi-Supervised Domain Adaptation (SSDA) is a recently emerging research topic that extends from the widely-investigated Unsupervised Domain Adaptation (UDA) by further having a few target samples labeled, i.e., the model is trained with…

Computer Vision and Pattern Recognition · Computer Science 2023-04-24 mengqun Jin , Kai Li , Shuyan Li , Chunming He , Xiu Li

Visual attention has been extensively studied for learning fine-grained features in both facial expression recognition (FER) and Action Unit (AU) detection. A broad range of previous research has explored how to use attention modules to…

Computer Vision and Pattern Recognition · Computer Science 2022-03-24 Xiaotian Li , Zhihua Li , Huiyuan Yang , Geran Zhao , Lijun Yin

Self-supervised learning holds promise in leveraging large numbers of unlabeled data. However, its success heavily relies on the highly-curated dataset, e.g., ImageNet, which still needs human cleaning. Directly learning representations…

Computer Vision and Pattern Recognition · Computer Science 2023-02-24 Meilin Chen , Yizhou Wang , Shixiang Tang , Feng Zhu , Haiyang Yang , Lei Bai , Rui Zhao , Donglian Qi , Wanli Ouyang

Visual domain adaptation (DA) seeks to transfer trained models to unseen, unlabeled domains across distribution shift, but approaches typically focus on adapting convolutional neural network architectures initialized with supervised…

Computer Vision and Pattern Recognition · Computer Science 2022-06-17 Viraj Prabhu , Sriram Yenamandra , Aaditya Singh , Judy Hoffman

In Recommender systems, data representation techniques play a great role as they have the power to entangle, hide and reveal explanatory factors embedded within datasets. Hence, they influence the quality of recommendations. Specifically,…

Information Retrieval · Computer Science 2020-11-11 Bereket Abera Yilma , Najib Aghenda , Marcelo Romero , Yannick Naudet , Herve Panetto

Joint-embedding self-supervised learning (SSL), the key paradigm for unsupervised representation learning from visual data, learns from invariances between semantically-related data pairs. We study the one-to-many mapping problem in SSL,…

Machine Learning · Computer Science 2026-02-03 Yipeng Zhang , Hafez Ghaemi , Jungyoon Lee , Shahab Bakhtiari , Eilif B. Muller , Laurent Charlin

Visual Question and Answering (VQA) problems are attracting increasing interest from multiple research disciplines. Solving VQA problems requires techniques from both computer vision for understanding the visual contents of a presented…

Computer Vision and Pattern Recognition · Computer Science 2016-04-07 Ilija Ilievski , Shuicheng Yan , Jiashi Feng

Deep learning approaches for semantic segmentation rely primarily on supervised learning approaches and require substantial efforts in producing pixel-level annotations. Further, such approaches may perform poorly when applied to unseen…

Computer Vision and Pattern Recognition · Computer Science 2021-10-22 Ying Chen , Xu Ouyang , Kaiyue Zhu , Gady Agam

We introduce ViDaS, a two-stream, fully convolutional Video, Depth-Aware Saliency network to address the problem of attention modeling ``in-the-wild", via saliency prediction in videos. Contrary to existing visual saliency approaches using…

Computer Vision and Pattern Recognition · Computer Science 2023-05-22 Ioanna Diamanti , Antigoni Tsiami , Petros Koutras , Petros Maragos

This paper studies the task of matching image and sentence, where learning appropriate representations across the multi-modal data appears to be the main challenge. Unlike previous approaches that predominantly deploy symmetrical…

Computer Vision and Pattern Recognition · Computer Science 2021-05-03 Zhong Ji , Haoran Wang , Jungong Han , Yanwei Pang

In this work, we propose a novel methodology for self-supervised learning for generating global and local attention-aware visual features. Our approach is based on training a model to differentiate between specific image transformations of…

Computer Vision and Pattern Recognition · Computer Science 2021-08-03 Trung X. Pham , Rusty John Lloyd Mina , Dias Issa , Chang D. Yoo

We address the task of weakly-supervised few-shot image classification and segmentation, by leveraging a Vision Transformer (ViT) pretrained with self-supervision. Our proposed method takes token representations from the self-supervised ViT…

Computer Vision and Pattern Recognition · Computer Science 2023-07-10 Dahyun Kang , Piotr Koniusz , Minsu Cho , Naila Murray

Vision Transformers (ViTs) have become a universal backbone for both image recognition and image generation. Yet their Multi-Head Self-Attention (MHSA) layer still performs a quadratic query-key interaction for every token pair, spending…

Computer Vision and Pattern Recognition · Computer Science 2025-11-04 Yifan Pu , Jixuan Ying , Qixiu Li , Tianzhu Ye , Dongchen Han , Xiaochen Wang , Ziyi Wang , Xinyu Shao , Gao Huang , Xiu Li

Self-supervised learning (SSL) has rapidly emerged as a transformative approach in computer vision, enabling the extraction of rich feature representations from vast amounts of unlabeled data and reducing reliance on costly manual…

Computer Vision and Pattern Recognition · Computer Science 2025-05-19 Nikolaos Giakoumoglou , Tania Stathaki , Athanasios Gkelias

Semantic segmentation suffers from significant performance degradation when the trained network is applied to a different domain. To address this issue, unsupervised domain adaptation (UDA) has been extensively studied. Despite the…

Computer Vision and Pattern Recognition · Computer Science 2025-12-09 Wangkai Li , Rui Sun , Huayu Mai , Tianzhu Zhang