中文
相关论文

相关论文: SegMaFormer: A Hybrid State-Space and Transformer …

200 篇论文

Convolutional neural networks (CNN) and Transformers have made impressive progress in the field of remote sensing change detection (CD). However, both architectures have inherent shortcomings: CNN are constrained by a limited receptive…

图像与视频处理 · 电气工程与系统科学 2024-12-31 Hongruixuan Chen , Jian Song , Chengxi Han , Junshi Xia , Naoto Yokoya

State space models (SSMs) have emerged as an efficient alternative to Transformer models for language modeling, offering linear computational complexity and constant memory usage as context length increases. However, despite their…

Multi-modality image fusion aims to integrate the merits of images from different sources and render high-quality fusion images. However, existing feature extraction and fusion methods are either constrained by inherent local reduction bias…

计算机视觉与模式识别 · 计算机科学 2024-09-06 Chenguang Zhu , Shan Gao , Huafeng Chen , Guangqian Guo , Chaowei Wang , Yaoxing Wang , Chen Shu Lei , Quanjiang Fan

Remote sensing change detection (CD) has made significant advancements with the adoption of Convolutional Neural Networks (CNNs) and Transformers. While CNNs offer powerful feature extraction, they are constrained by receptive field…

计算机视觉与模式识别 · 计算机科学 2025-03-04 JunYao Kaung , HongWei Ge

The CNN-based methods have achieved impressive results in medical image segmentation, but they failed to capture the long-range dependencies due to the inherent locality of the convolution operation. Transformer-based methods are recently…

计算机视觉与模式识别 · 计算机科学 2021-12-21 Xiaohong Huang , Zhifang Deng , Dandan Li , Xueguang Yuan

State Space Models (SSMs) have recently demonstrated outstanding performance in long-sequence modeling, particularly in natural language processing. However, their direct application to medical image segmentation poses several challenges.…

图像与视频处理 · 电气工程与系统科学 2025-03-25 Bin Xie , Yan Yan , Gady Agam

Learned Image Compression (LIC) has explored various architectures, such as Convolutional Neural Networks (CNNs) and transformers, in modeling image content distributions in order to achieve compression effectiveness. However, achieving…

图像与视频处理 · 电气工程与系统科学 2025-02-10 Zhuojie Wu , Heming Du , Shuyun Wang , Ming Lu , Haiyang Sun , Yandong Guo , Xin Yu

In recent years, transformer-based methods have achieved remarkable progress in medical image segmentation due to their superior ability to capture long-range dependencies. However, these methods typically suffer from two major limitations.…

计算机视觉与模式识别 · 计算机科学 2025-08-07 Zunhui Xia , Hongxing Li , Libin Lan

Video understanding is a complex challenge that requires effective modeling of spatial-temporal dynamics. With the success of image foundation models (IFMs) in image understanding, recent approaches have explored parameter-efficient…

计算机视觉与模式识别 · 计算机科学 2025-07-01 Yuhuan Yang , Chaofan Ma , Zhenjie Mao , Jiangchao Yao , Ya Zhang , Yanfeng Wang

Convolutional neural network (CNN) based methods have achieved great successes in medical image segmentation, but their capability to learn global representations is still limited due to using small effective receptive fields of convolution…

计算机视觉与模式识别 · 计算机科学 2022-11-17 Pengfei Gu , Yejia Zhang , Chaoli Wang , Danny Z. Chen

Brain tumors exhibit high heterogeneity in morphology and multimodal contrast, making manual slice-by-slice de lineation time-consuming and experience-dependent, thus necessitating efficient and stable automated segmentation methods. To…

计算机视觉与模式识别 · 计算机科学 2026-05-19 Hanjun Tao , Hua Wang , Fan Zhang

In the field of multi-source remote sensing image classification, remarkable progress has been made by using Convolutional Neural Network (CNN) and Transformer. Recently, Mamba-based methods built upon the State Space Model (SSM) have shown…

图像与视频处理 · 电气工程与系统科学 2025-01-28 Feng Gao , Xuepeng Jin , Xiaowei Zhou , Junyu Dong , Qian Du

Deep learning has revolutionized medical imaging by providing innovative solutions to complex healthcare challenges. Traditional models often struggle to dynamically adjust feature importance, resulting in suboptimal representation,…

图像与视频处理 · 电气工程与系统科学 2024-04-29 Kazi Shahriar Sanjid , Md. Tanzim Hossain , Md. Shakib Shahariar Junayed , M. Monir Uddin

Recently, Mamba-based super-resolution (SR) methods have demonstrated the ability to capture global receptive fields with linear complexity, addressing the quadratic computational cost of Transformer-based SR approaches. However, existing…

计算机视觉与模式识别 · 计算机科学 2026-04-24 Sichen Guo , Wenjie Li , Yuanyang Liu , Guangwei Gao , Jian Yang , Chia-Wen Lin

Medical time series are central to healthcare, enabling continuous monitoring and supporting timely clinical decisions. Despite recent progress, existing methods struggle to jointly model local-global dynamics and handle nonstationarities…

机器学习 · 计算机科学 2026-05-26 Da Zhang , Bingyu Li , Zhiyuan Zhao , Hongyuan Zhang , Junyu Gao , Xuelong Li

The diffusion model has long been plagued by scalability and quadratic complexity issues, especially within transformer-based structures. In this study, we aim to leverage the long sequence modeling capability of a State-Space Model called…

计算机视觉与模式识别 · 计算机科学 2024-11-26 Vincent Tao Hu , Stefan Andreas Baumann , Ming Gui , Olga Grebenkova , Pingchuan Ma , Johannes Schusterbauer , Björn Ommer

In the era of large-scale pre-trained models, effectively adapting general knowledge to specific affective computing tasks remains a challenge, particularly regarding computational efficiency and multimodal heterogeneity. While…

人工智能 · 计算机科学 2026-03-20 Yan Li , Yifei Xing , Xiangyuan Lan , Xin Li , Haifeng Chen , Dongmei Jiang

An ecosystem of Transformer-based models has been established by building large models with extensive data. Parameter-efficient fine-tuning (PEFT) is a crucial technology for deploying these models to downstream tasks with minimal cost…

计算与语言 · 计算机科学 2025-04-02 Masakazu Yoshimura , Teruaki Hayashi , Yota Maeda

Diffusion Models have become very popular for Semantic Image Synthesis (SIS) of human faces. Nevertheless, their training and inference is computationally expensive and their computational requirements are high due to the quadratic…

计算机视觉与模式识别 · 计算机科学 2025-09-23 Filippo Botti , Alex Ergasti , Tomaso Fontanini , Claudio Ferrari , Massimo Bertozzi , Andrea Prati

In scene text detection, Transformer-based methods have addressed the global feature extraction limitations inherent in traditional convolution neural network-based methods. However, most directly rely on native Transformer attention layers…

计算机视觉与模式识别 · 计算机科学 2025-12-09 Qiyan Zhao , Yue Yan , Da-Han Wang