English
Related papers

Related papers: Inter2Former: Dynamic Hybrid Attention for Efficie…

200 papers

Rectified flow (RF) models have recently demonstrated superior generative performance compared to DDIM-based diffusion models. However, in real-world applications, they suffer from two major challenges: (1) low inversion accuracy that…

Computer Vision and Pattern Recognition · Computer Science 2025-09-17 Weiming Chen , Zhihan Zhu , Yijia Wang , Zhihai He

Unsupervised domain adaptation(UDA) has been applied to image semantic segmentation to solve the problem of domain offset. However, in some difficult categories with poor recognition accuracy, the segmentation effects are still not ideal.…

Computer Vision and Pattern Recognition · Computer Science 2022-10-21 Xuewei Li , Weilun Zhang , Jie Gao , Xuzhou Fu , Jian Yu

Long-context agentic workflows have emerged as a defining use case for large language models, making attention efficiency critical for both inference speed and serving cost. Sparse attention addresses this challenge effectively, and…

Computation and Language · Computer Science 2026-03-13 Yushi Bai , Qian Dong , Ting Jiang , Xin Lv , Zhengxiao Du , Aohan Zeng , Jie Tang , Juanzi Li

We propose an augmented Parallel-Pyramid Net ($P^2~Net$) with feature refinement by dilated bottleneck and attention module. During data preprocessing, we proposed a differentiable auto data augmentation ($DA^2$) method. We formulate the…

Computer Vision and Pattern Recognition · Computer Science 2020-10-28 Luanxuan Hou , Jie Cao , Yuan Zhao , Haifeng Shen , Jian Tang , Ran He

We propose a novel framework, Continuous_Time Attention, which infuses partial differential equations (PDEs) into the Transformer's attention mechanism to address the challenges of extremely long input sequences. Instead of relying solely…

Machine Learning · Computer Science 2025-12-30 Yukun Zhang , Xueqing Zhou

Partial differential equations (PDEs) are fundamental for modeling complex physical systems, yet classical numerical solvers face prohibitive computational costs in high-dimensional and multi-scale regimes. While Transformer-based neural…

Machine Learning · Computer Science 2026-03-04 Pengyu Lai , Yixiao Chen , Dewu Yang , Rui Wang , Feng Wang , Hui Xu

Looped Transformers (LT) have emerged as a powerful architecture by iterating their layers multiple times before decoding the final token. However, pairing them with full attention retains quadratic complexity, making them computationally…

Machine Learning · Computer Science 2026-05-26 Chunyuan Deng , Yizhe Zhang , Rui-Jie Zhu , Yuanyuan Xu , Jiarui Liu , T. S. Eugene Ng , Hanjie Chen

While modern text-to-image models excel at prompt-based generation, they often lack the fine-grained control necessary for specific user requirements like spatial layouts or subject appearances. Multi-condition control addresses this, yet…

Computer Vision and Pattern Recognition · Computer Science 2026-02-09 Chao Zhou , Tianyi Wei , Yiling Chen , Wenbo Zhou , Nenghai Yu

Semantic segmentation involves assigning a specific category to each pixel in an image. While Vision Transformer-based models have made significant progress, current semantic segmentation methods often struggle with precise predictions in…

Computer Vision and Pattern Recognition · Computer Science 2024-08-13 Guoan Xu , Wenfeng Huang , Tao Wu , Ligeng Chen , Wenjing Jia , Guangwei Gao , Xiatian Zhu , Stuart Perry

Breast ultrasound imaging is a valuable tool for early breast cancer detection, but automated tumor segmentation is challenging due to inherent noise, variations in scale of lesions, and fuzzy boundaries. To address these challenges, we…

Image and Video Processing · Electrical Eng. & Systems 2025-06-23 Muhammad Azeem Aslam , Asim Naveed , Nisar Ahmed

Semantic segmentation has achieved remarkable results with high computational cost and a large number of parameters. However, real-world applications require efficient inference speed on embedded devices. Most previous works address the…

Computer Vision and Pattern Recognition · Computer Science 2020-10-22 Xinneng Yang , Yan Wu , Junqiao Zhao , Feilin Liu

Vision transformers have achieved leading performance on various visual tasks yet still suffer from high computational complexity. The situation deteriorates in dense prediction tasks like semantic segmentation, as high-resolution inputs…

Computer Vision and Pattern Recognition · Computer Science 2023-09-29 Quan Tang , Bowen Zhang , Jiajun Liu , Fagui Liu , Yifan Liu

Understanding user intent is essential for situational and context-aware decision-making. Motivated by a real-world scenario, this work addresses intent predictions of smart device users in the vicinity of vehicles by modeling sequential…

Recently, transformer-based networks have shown impressive results in semantic segmentation. Yet for real-time semantic segmentation, pure CNN-based approaches still dominate in this field, due to the time-consuming computation mechanism of…

Computer Vision and Pattern Recognition · Computer Science 2022-10-14 Jian Wang , Chenhui Gou , Qiman Wu , Haocheng Feng , Junyu Han , Errui Ding , Jingdong Wang

While recent semantic segmentation networks heavily rely on powerful pretrained encoders, most employ simplistic decoders, leading to suboptimal trade-offs between semantic context and fine-grained detail preservation. To address this, we…

Computer Vision and Pattern Recognition · Computer Science 2025-10-27 Guoan Xu , Yang Xiao , Wenjing Jia , Guangwei Gao , Guo-Jun Qi , Chia-Wen Lin

Many deep learning based automated medical image segmentation systems, in reality, face difficulties in deployment due to the cost of massive data annotation and high latency in model iteration. We propose a dynamic interactive learning…

Computer Vision and Pattern Recognition · Computer Science 2023-12-12 Mu Tian , Xiaohui Chen , Yi Gao

The Transformer-based detectors (i.e., DETR) have demonstrated impressive performance on end-to-end object detection. However, transferring DETR to different data distributions may lead to a significant performance degradation. Existing…

Computer Vision and Pattern Recognition · Computer Science 2023-07-04 Peidong Jia , Jiaming Liu , Senqiao Yang , Jiarui Wu , Xiaodong Xie , Shanghang Zhang

Deep learning has achieved impressive results in nuclei segmentation, but the massive requirement for pixel-wise labels remains a significant challenge. To alleviate the annotation burden, existing methods generate pseudo masks for model…

Computer Vision and Pattern Recognition · Computer Science 2024-06-25 Ziyue Wang , Ye Zhang , Yifeng Wang , Linghan Cai , Yongbing Zhang

Automated segmentation of structural defects from visual inspection imagery remains challenging due to the diversity of damage types, extreme class imbalance, and the need for precise boundary delineation. This paper presents DeltaSeg, a…

Computer Vision and Pattern Recognition · Computer Science 2026-04-22 Enrique Hernandez Noguera , Md Meftahul Ferdaus , Elias Ioup , Mahdi Abdelguerfi

Referring Remote Sensing Image Segmentation (RRSIS) aims to segment target objects in remote sensing (RS) images based on textual descriptions. Although Segment Anything Model 2 (SAM2) has shown remarkable performance in various…

Computer Vision and Pattern Recognition · Computer Science 2026-01-16 Fu Rong , Meng Lan , Qian Zhang , Lefei Zhang