English
Related papers

Related papers: Mixed-Query Transformer: A Unified Image Segmentat…

200 papers

Chart comprehension presents significant challenges for machine learning models due to the diverse and intricate shapes of charts. Existing multimodal methods often overlook these visual features or fail to integrate them effectively for…

Computation and Language · Computer Science 2024-08-01 Hanwen Zheng , Sijia Wang , Chris Thomas , Lifu Huang

We propose a unified Transformer-based architecture for wireless signal processing tasks, offering a low-latency, task-adaptive alternative to conventional receiver pipelines. Unlike traditional modular designs, our model integrates channel…

Signal Processing · Electrical Eng. & Systems 2025-09-11 Yuto Kawai , Rajeev Koodli

In many real-world systems, such as adaptive robotics, achieving a single, optimised solution may be insufficient. Instead, a diverse set of high-performing solutions is often required to adapt to varying contexts and requirements. This is…

Machine Learning · Computer Science 2023-11-06 Garðar Ingvarsson , Mikayel Samvelyan , Bryan Lim , Manon Flageat , Antoine Cully , Tim Rocktäschel

Transformers have achieved great success in effectively processing sequential data such as text. Their architecture consisting of several attention and feedforward blocks can model relations between elements of a sequence in parallel…

Machine Learning · Computer Science 2025-02-20 Jaemu Heo , Eldor Fozilov , Hyunmin Song , Taehwan Kim

Medical image segmentation remains challenging in low-data regimes, where scarce annotations often yield poor generalization and ambiguous boundaries with missing fine structures. Recent self-supervised pretraining has improved…

Computer Vision and Pattern Recognition · Computer Science 2026-05-15 Zhiquan Chen , Haitao Wang , Guowei Zou , Hejun Wu

Models based on U-like structures have improved the performance of medical image segmentation. However, the single-layer decoder structure of U-Net is too "thin" to exploit enough information, resulting in large semantic differences between…

Image and Video Processing · Electrical Eng. & Systems 2023-09-08 Haoyuan Chen , Yufei Han , Pin Xu , Yanyi Li , Kuan Li , Jianping Yin

Diffusion Transformers (DiTs) have emerged as a highly scalable and effective backbone for image generation, outperforming U-Net architectures in both scalability and performance. However, their real-world deployment remains challenging due…

Computer Vision and Pattern Recognition · Computer Science 2025-12-09 Kaicheng Yang , Kaisen Yang , Baiting Wu , Xun Zhang , Qianrui Yang , Haotong Qin , He Zhang , Yulun Zhang

Recent advancements in Single-Image Super-Resolution (SISR) using deep learning have significantly improved image restoration quality. However, the high computational cost of processing high-resolution images due to the large number of…

Quantum Physics · Physics 2026-01-09 Siddhant Dutta , Nouhaila Innan , Khadijeh Najafi , Sadok Ben Yahia , Muhammad Shafique

Transformer architecture has emerged to be successful in a number of natural language processing tasks. However, its applications to medical vision remain largely unexplored. In this study, we present UTNet, a simple yet powerful hybrid…

Computer Vision and Pattern Recognition · Computer Science 2021-09-29 Yunhe Gao , Mu Zhou , Dimitris Metaxas

In crisis management and remote sensing, image segmentation plays a crucial role, enabling tasks like disaster response and emergency planning by analyzing visual data. Neural networks are able to analyze satellite acquisitions and…

Computer Vision and Pattern Recognition · Computer Science 2025-05-06 Daniele Rege Cambrin , Luca Colomba , Paolo Garza

Medical Visual Question Answering (VQA) systems play a supporting role to understand clinic-relevant information carried by medical images. The questions to a medical image include two categories: close-end (such as Yes/No question) and…

Computer Vision and Pattern Recognition · Computer Science 2023-06-06 Yunyi Liu , Zhanyu Wang , Dong Xu , Luping Zhou

Question Generation (QG), as a challenging Natural Language Processing task, aims at generating questions based on given answers and context. Existing QG methods mainly focus on building or training models for specific QG datasets. These…

Computation and Language · Computer Science 2022-12-06 Wei Yuan , Hongzhi Yin , Tieke He , Tong Chen , Qiufeng Wang , Lizhen Cui

The generalization of the Transformer architecture via MetaFormer has reshaped our understanding of its success in computer vision. By replacing self-attention with simpler token mixers, MetaFormer provides strong baselines for vision…

Computer Vision and Pattern Recognition · Computer Science 2026-04-27 Ron Keuth , Paul Kaftan , Mattias P. Heinrich

Skin cancer segmentation poses a significant challenge in medical image analysis. Numerous existing solutions, predominantly CNN-based, face issues related to a lack of global contextual understanding. Alternatively, some approaches resort…

Computer Vision and Pattern Recognition · Computer Science 2024-09-06 Shehan Perera , Yunus Erzurumlu , Deepak Gulati , Alper Yilmaz

Recent progress in multimodal generation has increasingly combined autoregressive (AR) and diffusion-based approaches, leveraging their complementary strengths: AR models capture long-range dependencies and produce fluent, context-aware…

Computer Vision and Pattern Recognition · Computer Science 2025-06-10 Junhao Chen , Yulia Tsvetkov , Xiaochuang Han

Uncertainty Quantification (UQ) is crucial for ensuring the reliability of automated image segmentations in safety-critical domains like biomedical image analysis or autonomous driving. In segmentation, UQ generates pixel-wise uncertainty…

Multimodal medical imaging provides complementary information that is crucial for accurate delineation of pathology, but the development of deep learning models is limited by the scarcity of large datasets in which different modalities are…

Computer Vision and Pattern Recognition · Computer Science 2025-12-29 Arunkumar V , Firos V M , Senthilkumar S , Gangadharan G R

Automated medical image segmentation can assist doctors to diagnose faster and more accurate. Deep learning based models for medical image segmentation have made great progress in recent years. However, the existing models fail to…

Image and Video Processing · Electrical Eng. & Systems 2023-04-26 Lei Shi , Tianyu Gao , Zheng Zhang , Junxing Zhang

Although two-stage Vector Quantized (VQ) generative models allow for synthesizing high-fidelity and high-resolution images, their quantization operator encodes similar patches within an image into the same index, resulting in a repeated…

Computer Vision and Pattern Recognition · Computer Science 2022-09-20 Chuanxia Zheng , Long Tung Vuong , Jianfei Cai , Dinh Phung

Image fusion is a technique to integrate information from multiple source images with complementary information to improve the richness of a single image. Due to insufficient task-specific training data and corresponding ground truth, most…

Computer Vision and Pattern Recognition · Computer Science 2022-01-20 Linhao Qu , Shaolei Liu , Manning Wang , Shiman Li , Siqi Yin , Qin Qiao , Zhijian Song