English
Related papers

Related papers: QASA: Quality-Guided K-Adaptive Slot Attention for…

200 papers

Zero-Shot Learning (ZSL) aims to recognise unseen object classes, which are not observed during the training phase. The existing body of works on ZSL mostly relies on pretrained visual features and lacks the explicit attribute localisation…

Computer Vision and Pattern Recognition · Computer Science 2021-08-03 Faisal Alamri , Anjan Dutta

Diffusion Transformers (DiTs) set the state of the art in visual generation, yet their quadratic self-attention cost fundamentally limits scaling to long token sequences. Recent Top-K sparse attention approaches reduce the computation of…

Computer Vision and Pattern Recognition · Computer Science 2025-12-19 Yifan Zhou , Zeqi Xiao , Tianyi Wei , Shuai Yang , Xingang Pan

Unsupervised extraction of objects from low-level visual data is an important goal for further progress in machine learning. Existing approaches for representing objects without labels use structured generative models with static images.…

Machine Learning · Computer Science 2020-07-21 Evan Racah , Sarath Chandar

Slot attention is a powerful method for object-centric modeling in images and videos. However, its set-equivariance limits its ability to handle videos with a dynamic number of objects because it cannot break ties. To overcome this…

Machine Learning · Computer Science 2023-06-01 Yan Zhang , David W. Zhang , Simon Lacoste-Julien , Gertjan J. Burghouts , Cees G. M. Snoek

Attention mechanisms are ubiquitous components in neural architectures applied to natural language processing. In addition to yielding gains in predictive accuracy, attention weights are often claimed to confer interpretability, purportedly…

Computation and Language · Computer Science 2020-04-08 Danish Pruthi , Mansi Gupta , Bhuwan Dhingra , Graham Neubig , Zachary C. Lipton

We present a method to stop the evaluation of a decision making process when the result of the full evaluation is obvious. This trait is highly desirable for online margin-based machine learning algorithms where a classifier traditionally…

Machine Learning · Computer Science 2011-05-03 Raphael Pelossof , Zhiliang Ying

Video Diffusion Transformers have revolutionized high-fidelity video generation but suffer from the massive computational burden of self-attention. While sparse attention provides a promising acceleration solution, existing methods…

Computer Vision and Pattern Recognition · Computer Science 2026-04-15 Wentai Zhang , Ronghui Xi , Shiyao Peng , Jiayu Huang , Haoran Luo , Zichen Tang , Haihong E

Recent methods for long-tailed instance segmentation still struggle on rare object classes with few training data. We propose a simple yet effective method, Feature Augmentation and Sampling Adaptation (FASA), that addresses the data…

Computer Vision and Pattern Recognition · Computer Science 2021-10-01 Yuhang Zang , Chen Huang , Chen Change Loy

It is a common paradigm in object detection frameworks to treat all samples equally and target at maximizing the performance on average. In this work, we revisit this paradigm through a careful study on how different samples contribute to…

Computer Vision and Pattern Recognition · Computer Science 2019-09-17 Yuhang Cao , Kai Chen , Chen Change Loy , Dahua Lin

Self-attention in Transformers relies on globally normalized softmax weights, causing all tokens to compete for influence at every layer. When composed across depth, this interaction pattern induces strong synchronization dynamics that…

Machine Learning · Computer Science 2026-05-26 Jingkun Liu , Yisong Yue , Max Welling , Yue Song

The diversity of retinal imaging devices poses a significant challenge: domain shift, which leads to performance degradation when applying the deep learning models trained on one domain to new testing domains. In this paper, we propose a…

Image and Video Processing · Electrical Eng. & Systems 2021-10-07 Peng Liu , Charlie T. Tran , Bin Kong , Ruogu Fang

Arbitrary-oriented object detection is a relatively emerging but challenging task. Although remarkable progress has been made, there still remain many unsolved issues due to the large diversity of patterns in orientation, scale, aspect…

Computer Vision and Pattern Recognition · Computer Science 2023-07-11 Peng Sun , Yongbin Zheng , Wenqi Wu , Wanying Xu , Shengjian Bai

Few-Shot Learning (FSL) has attracted growing attention in computer vision due to its capability in model training without the need for excessive data. FSL is challenging because the training and testing categories (the base vs. novel sets)…

Computer Vision and Pattern Recognition · Computer Science 2022-12-14 Ying-Yu Chen , Jun-Wei Hsieh , Ming-Ching Chang

Attention mechanisms, which enable a neural network to accurately focus on all the relevant elements of the input, have become an essential component to improve the performance of deep neural networks. There are mainly two attention…

Computer Vision and Pattern Recognition · Computer Science 2021-02-02 Qing-Long Zhang Yu-Bin Yang

Object detection is essential in space applications targeting Space Domain Awareness and also applications involving relative navigation scenarios. Current deep learning models for Object Detection in space applications are often trained on…

Computer Vision and Pattern Recognition · Computer Science 2025-09-23 Samet Hicsonmez , Abd El Rahman Shabayek , Arunkumar Rathinam , Djamila Aouada

Zero-shot object counting (ZSOC) aims to enumerate objects of arbitrary categories specified by text descriptions without requiring visual exemplars. However, existing methods often treat counting as a coarse retrieval task, suffering from…

Computer Vision and Pattern Recognition · Computer Science 2026-03-18 Da Zhang , Bingyu Li , Feiyu Wang , Zhiyuan Zhao , Junyu Gao

This paper proposes a method for visually explaining the decision-making process of video recognition networks with a temporal extension of occlusion sensitivity analysis, called Adaptive Occlusion Sensitivity Analysis (AOSA). The key idea…

Computer Vision and Pattern Recognition · Computer Science 2023-08-21 Tomoki Uchiyama , Naoya Sogi , Satoshi Iizuka , Koichiro Niinuma , Kazuhiro Fukui

Recent domain adaptation methods have demonstrated impressive improvement on unsupervised domain adaptation problems. However, in the semi-supervised domain adaptation (SSDA) setting where the target domain has a few labeled instances…

Computer Vision and Pattern Recognition · Computer Science 2020-12-08 Bingyu Liu , Yuhong Guo , Jieping Ye , Weihong Deng

Fine-tuning large language models is essential for task-specific adaptation, yet it remains computationally prohibitive. Parameter-Efficient Fine-Tuning (PEFT) methods have emerged as a solution, but current approaches typically ignore the…

Computation and Language · Computer Science 2025-12-01 Dayan Pan , Jingyuan Wang , Yilong Zhou , Jiawei Cheng , Pengyue Jia , Xiangyu Zhao

Incremental object detection is fundamentally challenged by catastrophic forgetting. A major factor contributing to this issue is background shift, where background categories in sequential tasks may overlap with either previously learned…

Computer Vision and Pattern Recognition · Computer Science 2025-04-01 Mingyi Guo , Yuyang Liu , Zhiyuan Yan , Zongying Lin , Peixi Peng , Yonghong Tian