English
Related papers

Related papers: AdaSFormer: Adaptive Serialized Transformers for M…

200 papers

Recently, Transformers have gained significant popularity in image restoration tasks such as image super-resolution and denoising, owing to their superior performance. However, balancing performance and computational burden remains a…

Computer Vision and Pattern Recognition · Computer Science 2026-03-04 Leheng Zhang , Wei Long , Yawei Li , Xingyu Zhou , Xiaorui Zhao , Shuhang Gu

Intra-sentential code-switching (CS) refers to the alternation between languages that happens within a single utterance and is a significant challenge for Automatic Speech Recognition (ASR) systems. For example, when a Vietnamese speaker…

Computation and Language · Computer Science 2025-01-14 The Chuong Chu , Vu Tuan Dat Pham , Kien Dao , Hoang Nguyen , Quoc Hung Truong

Many service computing applications require real-time dataset collection from multiple devices, necessitating efficient sampling techniques to reduce bandwidth and storage pressure. Compressive sensing (CS) has found wide-ranging…

Image and Video Processing · Electrical Eng. & Systems 2024-07-03 Kuiyuan Zhang , Zhongyun Hua , Yuanman Li , Yushu Zhang , Yicong Zhou

To analyze multivariate time series, most previous methods assume regular subsampling of time series, where the interval between adjacent measurements and the number of samples remain unchanged. Practically, data collection systems could…

Machine Learning · Computer Science 2023-10-18 Yuxi Wei , Juntong Peng , Tong He , Chenxin Xu , Jian Zhang , Shirui Pan , Siheng Chen

Transformers have made great progress in dealing with computer vision tasks. However, existing vision transformers do not yet possess the ability of building the interactions among features of different scales, which is perceptually…

Computer Vision and Pattern Recognition · Computer Science 2021-10-11 Wenxiao Wang , Lu Yao , Long Chen , Binbin Lin , Deng Cai , Xiaofei He , Wei Liu

Recently, transformer-based models have demonstrated remarkable performance on audio-visual segmentation (AVS) tasks. However, their expensive computational cost makes real-time inference impractical. By characterizing attention maps of the…

Computer Vision and Pattern Recognition · Computer Science 2024-08-06 Zili Wang , Qi Yang , Linsu Shi , Jiazhong Yu , Qinghua Liang , Fei Li , Shiming Xiang

Recently, a variety of vision transformers have been developed as their capability of modeling long-range dependency. In current transformer-based backbones for medical image segmentation, convolutional layers were replaced with pure…

Computer Vision and Pattern Recognition · Computer Science 2022-08-01 Huimin Huang , Shiao Xie1 , Lanfen Lin , Yutaro Iwamoto , Xianhua Han , Yen-Wei Chen , Ruofeng Tong

The ability to synthesize realistic and diverse indoor furniture layouts automatically or based on partial input, unlocks many applications, from better interactive 3D tools to data synthesis for training and simulation. In this paper, we…

Computer Vision and Pattern Recognition · Computer Science 2021-10-08 Despoina Paschalidou , Amlan Kar , Maria Shugrina , Karsten Kreis , Andreas Geiger , Sanja Fidler

Recent mainstream weakly supervised semantic segmentation (WSSS) approaches are mainly based on Class Activation Map (CAM) generated by a CNN (Convolutional Neural Network) based image classifier. In this paper, we propose a novel…

Computer Vision and Pattern Recognition · Computer Science 2022-10-27 Junliang Chen , Xiaodong Zhao , Cheng Luo , Linlin Shen

Although transformer-based methods have achieved great success in multi-scale temporal pattern interaction modeling, two key challenges limit their further development: (1) Individual time points contain less semantic information, and…

Machine Learning · Computer Science 2024-11-01 Zongjiang Shang , Ling Chen , Binqing wu , Dongliang Cui

Scene analysis is essential for enabling autonomous systems, such as mobile robots, to operate in real-world environments. However, obtaining a comprehensive understanding of the scene requires solving multiple tasks, such as panoptic…

Computer Vision and Pattern Recognition · Computer Science 2026-01-05 Söhnke Benedikt Fischedick , Daniel Seichter , Robin Schmidt , Leonard Rabes , Horst-Michael Gross

Embodied 3D Semantic Scene Completion (SSC) infers dense geometry and semantics from continuous egocentric observations. Most existing Gaussian-based methods rely on random initialization of many primitives within predefined spatial bounds,…

Computer Vision and Pattern Recognition · Computer Science 2025-12-02 Rui Qian , Haozhi Cao , Tianchen Deng , Tianxin Hu , Weixiang Guo , Shenghai Yuan , Lihua Xie

Change detection (CD) in remote sensing aims to identify semantic differences between satellite images captured at different times. While deep learning has significantly advanced this field, existing approaches based on convolutional neural…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Durgesh Ameta , Ujjwal Mishra , Praful Hambarde , Amit Shukla

Aerial Image Segmentation is a top-down perspective semantic segmentation and has several challenging characteristics such as strong imbalance in the foreground-background distribution, complex background, intra-class heterogeneity,…

Computer Vision and Pattern Recognition · Computer Science 2023-10-03 Kashu Yamazaki , Taisei Hanyu , Minh Tran , Adrian de Luis , Roy McCann , Haitao Liao , Chase Rainwater , Meredith Adkins , Jackson Cothren , Ngan Le

Transformers have emerged as viable alternatives to convolutional neural networks owing to their ability to learn non-local region relationships in the spatial domain. The self-attention mechanism of the transformer enables transformers to…

Image and Video Processing · Electrical Eng. & Systems 2023-08-09 Rahul G. S. , Sriprabha Ramnarayanan , Mohammad Al Fahim , Keerthi Ram , Preejith S. P , Mohanasankar Sivaprakasam

Transformer-based models have greatly pushed the boundaries of time series forecasting recently. Existing methods typically encode time series data into $\textit{patches}$ using one or a fixed set of patch lengths. This, however, could…

Machine Learning · Computer Science 2024-02-09 Linfeng Du , Ji Xin , Alex Labach , Saba Zuberi , Maksims Volkovs , Rahul G. Krishnan

Transformer has achieved satisfactory results in the field of hyperspectral image (HSI) classification. However, existing Transformer models face two key challenges when dealing with HSI scenes characterized by diverse land cover types and…

Computer Vision and Pattern Recognition · Computer Science 2025-02-27 Yichu Xu , Di Wang , Lefei Zhang , Liangpei Zhang

Remote sensing images contain complex spatial patterns and semantic structures, which makes the captioning model difficult to accurately describe. Encoder-decoder architectures have become the widely used approach for RSIC by translating…

Computer Vision and Pattern Recognition · Computer Science 2026-05-01 Swadhin Das , Raksha Sharma

Transformer has achieved extraordinary performance in Natural Language Processing and Computer Vision tasks thanks to its powerful self-attention mechanism, and its variant Conformer has become a state-of-the-art architecture in the field…

Audio and Speech Processing · Electrical Eng. & Systems 2023-01-18 Dexin Liao , Tao Jiang , Feng Wang , Lin Li , Qingyang Hong

Surgical phase recognition from video enables various downstream applications. Transformer-based sliding window approaches have set the state-of-the-art by capturing rich spatial-temporal features. However, while transformers can…

Computer Vision and Pattern Recognition · Computer Science 2025-03-04 Hao Ding , Xu Lian , Mathias Unberath