English
Related papers

Related papers: ClusterFormer: Clustering As A Universal Visual Le…

200 papers

Unsupervised semantic segmentation aims to categorize each pixel in an image into a corresponding class without the use of annotated data. It is a widely researched area as obtaining labeled datasets is expensive. While previous works in…

Computer Vision and Pattern Recognition · Computer Science 2024-01-01 Yau Shing Jonathan Cheung , Xi Chen , Lihe Yang , Hengshuang Zhao

Transformers have been extensively studied in medical image segmentation to build pairwise long-range dependence. Yet, relatively limited well-annotated medical image data makes transformers struggle to extract diverse global features,…

Image and Video Processing · Electrical Eng. & Systems 2023-09-13 Xian Lin , Zengqiang Yan , Xianbo Deng , Chuansheng Zheng , Li Yu

Image clustering is an important but challenging task in machine learning. As in most image processing areas, the latest improvements came from models based on the deep learning approach. However, classical deep learning methods have…

Computer Vision and Pattern Recognition · Computer Science 2019-10-25 Thiago V. M. Souza , Cleber Zanchettin

We introduce a novel end-to-end approach for learning to cluster in the absence of labeled examples. Our clustering objective is based on optimizing normalized cuts, a criterion which measures both intra-cluster similarity as well as…

Machine Learning · Computer Science 2019-10-18 Azade Nazi , Will Hang , Anna Goldie , Sujith Ravi , Azalia Mirhoseini

Given a large unlabeled set of images, how to efficiently and effectively group them into clusters based on extracted visual representations remains a challenging problem. To address this problem, we propose a convolutional neural network…

Computer Vision and Pattern Recognition · Computer Science 2017-08-14 Chih-Chung Hsu , Chia-Wen Lin

Transformers have excelled in many tasks including vision. However, efficient deployment of transformer models in low-latency or high-throughput applications is hindered by the computation in the attention mechanism which involves expensive…

Computer Vision and Pattern Recognition · Computer Science 2024-06-12 John Yang , Le An , Su Inn Park

Transformers have become the dominant architecture across a wide range of domains, largely due to the effectiveness of multi-head attention in capturing diverse representation subspaces. However, standard multi-head attention activates all…

Machine Learning · Computer Science 2026-04-27 Bilal Faye , Abdoulaye Mbaye , Hanane Azzag , Mustapha Lebbah

In recent years, various applications in computer vision have achieved substantial progress based on deep learning, which has been widely used for image fusion and shown to achieve adequate performance. However, suffering from limited…

Computer Vision and Pattern Recognition · Computer Science 2022-08-16 Zhengwen Shen , Jun Wang , Zaiyu Pan , Yulian Li , Jiangyu Wang

Graph clustering is a fundamental and challenging learning task, which is conventionally approached by grouping similar vertices based on edge structure and feature similarity.In contrast to previous methods, in this paper, we investigate…

Machine Learning · Computer Science 2024-08-13 Zhixuan Duan , Zuo Wang , Fanghui Bi

Generating robust and reliable correspondences across images is a fundamental task for a diversity of applications. To capture context at both global and local granularity, we propose ASpanFormer, a Transformer-based detector-free matcher…

Computer Vision and Pattern Recognition · Computer Science 2022-08-31 Hongkai Chen , Zixin Luo , Lei Zhou , Yurun Tian , Mingmin Zhen , Tian Fang , David Mckinnon , Yanghai Tsin , Long Quan

Incomplete multi-view clustering is a challenging and non-trivial task to provide effective data analysis for large amounts of unlabeled data in the real world. All incomplete multi-view clustering methods need to address the problem of how…

Machine Learning · Computer Science 2023-05-22 Sifan Fang

Deep learning, especially convolutional neural networks (CNNs) and Transformer architectures, have become the focus of extensive research in medical image segmentation, achieving impressive results. However, CNNs come with inductive biases…

Image and Video Processing · Electrical Eng. & Systems 2024-09-20 Xiao Liu , Peng Gao , Tao Yu , Fei Wang , Ru-Yue Yuan

Online continual learning (online CL) studies the problem of learning sequential tasks from an online data stream without task boundaries, aiming to adapt to new data while alleviating catastrophic forgetting on the past tasks. This paper…

Machine Learning · Computer Science 2022-07-28 Zhen Wang , Liu Liu , Yajing Kong , Jiaxian Guo , Dacheng Tao

The recently developed vision transformer (ViT) has achieved promising results on image classification compared to convolutional neural networks. Inspired by this, in this paper, we study how to learn multi-scale feature representations in…

Computer Vision and Pattern Recognition · Computer Science 2021-08-24 Chun-Fu Chen , Quanfu Fan , Rameswar Panda

Convolutional Neural Networks (CNNs) and Transformers have achieved remarkable success in computer vision tasks. However, their deep architectures often lead to high computational redundancy, making them less suitable for…

Computer Vision and Pattern Recognition · Computer Science 2024-10-03 Novendra Setyawan , Ghufron Wahyu Kurniawan , Chi-Chia Sun , Jun-Wei Hsieh , Jing-Ming Guo , Wen-Kai Kuo

Clustering is crucial for many computer vision applications such as robust tracking, object detection and segmentation. This work presents a real-time clustering technique that takes advantage of the unique properties of event-based vision…

Robotics · Computer Science 2018-07-11 Francisco Barranco , Cornelia Fermuller , Eduardo Ros

Transformers are increasingly dominating multi-modal reasoning tasks, such as visual question answering, achieving state-of-the-art results thanks to their ability to contextualize information using the self-attention and co-attention…

Computer Vision and Pattern Recognition · Computer Science 2021-03-30 Hila Chefer , Shir Gur , Lior Wolf

Query-based transformer has shown great potential in constructing long-range attention in many image-domain tasks, but has rarely been considered in LiDAR-based 3D object detection due to the overwhelming size of the point cloud data. In…

Computer Vision and Pattern Recognition · Computer Science 2022-09-14 Zixiang Zhou , Xiangchen Zhao , Yu Wang , Panqu Wang , Hassan Foroosh

Currently, one main research line in designing a more efficient vision transformer is reducing the computational cost of self attention modules by adopting sparse attention or using local attention windows. In contrast, we propose a…

Computer Vision and Pattern Recognition · Computer Science 2023-03-21 Haokui Zhang , Wenze Hu , Xiaoyu Wang

Vision transformers have been successfully applied to image recognition tasks due to their ability to capture long-range dependencies within an image. However, there are still gaps in both performance and computational cost between…

Computer Vision and Pattern Recognition · Computer Science 2022-06-15 Jianyuan Guo , Kai Han , Han Wu , Yehui Tang , Xinghao Chen , Yunhe Wang , Chang Xu