English
Related papers

Related papers: MEDUSA: Multi-scale Encoder-Decoder Self-Attention…

200 papers

Medical image segmentation methods downsample images for feature extraction and then upsample them to restore resolution for pixel-level predictions. In such a schema, upsample technique is vital in restoring information for better…

Computer Vision and Pattern Recognition · Computer Science 2022-11-28 Yijiang Li , Wentian Cai , Ying Gao , Chengming Li , Xiping Hu

Medical imaging plays a crucial role in modern healthcare by providing non-invasive visualisation of internal structures and abnormalities, enabling early disease detection, accurate diagnosis, and treatment planning. This study aims to…

Image and Video Processing · Electrical Eng. & Systems 2023-09-25 Walid Ehab , Yongmin Li

Labeling medical images depends on professional knowledge, making it difficult to acquire large amount of annotated medical images with high quality in a short time. Thus, making good use of limited labeled samples in a small dataset to…

Computer Vision and Pattern Recognition · Computer Science 2022-10-04 Peng Jiang , Juan Liu , Lang Wang , Zhihui Ynag , Hongyu Dong , Jing Feng

Over the past decade, Deep Convolutional Neural Networks have been widely adopted for medical image segmentation and shown to achieve adequate performance. However, due to the inherent inductive biases present in the convolutional…

Computer Vision and Pattern Recognition · Computer Science 2021-07-08 Jeya Maria Jose Valanarasu , Poojan Oza , Ilker Hacihaliloglu , Vishal M. Patel

In healthcare, medical image segmentation is crucial for accurate disease diagnosis and the development of effective treatment strategies. Early detection can significantly aid in managing diseases and potentially prevent their progression.…

Computer Vision and Pattern Recognition · Computer Science 2024-09-04 Bobby Azad , Pourya Adibfar , Kaiqun Fu

Multi-modal learning has shown exceptional performance in various tasks, especially in medical applications, where it integrates diverse medical information for comprehensive diagnostic evidence. However, there still are several challenges…

Machine Learning · Computer Science 2024-11-19 Lin Fan , Yafei Ou , Cenyang Zheng , Pengyu Dai , Tamotsu Kamishima , Masayuki Ikebe , Kenji Suzuki , Xun Gong

In sequence to sequence learning, the self-attention mechanism proves to be highly effective, and achieves significant improvements in many tasks. However, the self-attention mechanism is not without its own flaws. Although self-attention…

Computation and Language · Computer Science 2019-11-22 Guangxiang Zhao , Xu Sun , Jingjing Xu , Zhiyuan Zhang , Liangchen Luo

Models based on U-like structures have improved the performance of medical image segmentation. However, the single-layer decoder structure of U-Net is too "thin" to exploit enough information, resulting in large semantic differences between…

Image and Video Processing · Electrical Eng. & Systems 2023-09-08 Haoyuan Chen , Yufei Han , Pin Xu , Yanyi Li , Kuan Li , Jianping Yin

This paper presents a new network architecture called multi-head decoder for end-to-end speech recognition as an extension of a multi-head attention model. In the multi-head attention model, multiple attentions are calculated, and then,…

Computation and Language · Computer Science 2018-07-31 Tomoki Hayashi , Shinji Watanabe , Tomoki Toda , Kazuya Takeda

Medical images play an important role in clinical applications. Multimodal medical images could provide rich information about patients for physicians to diagnose. The image fusion technique is able to synthesize complementary information…

Computer Vision and Pattern Recognition · Computer Science 2022-12-12 Meng Zhou , Xiaolan Xu , Yuxuan Zhang

In multi-turn dialogue generation, response is usually related with only a few contexts. Therefore, an ideal model should be able to detect these relevant contexts and produce a suitable response accordingly. However, the widely used…

Computation and Language · Computer Science 2019-07-12 Hainan Zhang , Yanyan Lan , Liang Pang , Jiafeng Guo , Xueqi Cheng

Recent medical image segmentation models are mostly hybrid, which integrate self-attention and convolution layers into the non-isomorphic architecture. However, one potential drawback of these approaches is that they failed to provide an…

Image and Video Processing · Electrical Eng. & Systems 2022-10-28 Jiansen Guo , Hong-Yu Zhou , Liansheng Wang , Yizhou Yu

Stereo image super-resolution aims to generate high-resolution images by leveraging complementary information from binocular systems. Although previous studies have achieved impressive results, the potential of intra-view and cross-view…

Computer Vision and Pattern Recognition · Computer Science 2026-05-22 Liyi Xu , Lin Qi

Convolutional Neural Networks have played a significant role in various medical imaging tasks like classification and segmentation. They provide state-of-the-art performance compared to classical image processing algorithms. However, the…

Computer Vision and Pattern Recognition · Computer Science 2022-10-03 Rakshith Sathish , Swanand Khare , Debdoot Sheet

One of the common and promising deep learning approaches used for medical image segmentation is transformers, as they can capture long-range dependencies among the pixels by utilizing self-attention. Despite being successful in medical…

Computer Vision and Pattern Recognition · Computer Science 2023-11-01 Md Motiur Rahman , Shiva Shokouhmand , Smriti Bhatt , Miad Faezipour

While significant advances in deep learning has resulted in state-of-the-art performance across a large number of complex visual perception tasks, the widespread deployment of deep neural networks for TinyML applications involving…

Computer Vision and Pattern Recognition · Computer Science 2020-10-01 Alexander Wong , Mahmoud Famouri , Mohammad Javad Shafiee

This thesis works to address a pivotal challenge in medical image analysis: the reliance on extensive labeled datasets, which are often limited due to the need for expert annotation and constrained by privacy and legal issues. By focusing…

Computer Vision and Pattern Recognition · Computer Science 2025-10-28 Cristian Simionescu

Accurate segmentation of heterogeneous anatomical structures is pivotal for computer-aided diagnosis and subsequent clinical decision-making. Although U-Net based convolutional neural networks have achieved remarkable progress, their…

Computer Vision and Pattern Recognition · Computer Science 2026-01-01 Jun Ding , Shang Gao

Deep learning models have gained increasing adoption in medical image analysis. However, these models often produce overconfident predictions, which can compromise clinical accuracy and reliability. Bridging the gap between high-performance…

Image and Video Processing · Electrical Eng. & Systems 2026-03-24 Jutika Borah , Hidam Kumarjit Singh

The research explores the utilization of a deep learning model employing an attention mechanism in medical text mining. It targets the challenge of analyzing unstructured text information within medical data. This research seeks to enhance…

Computation and Language · Computer Science 2024-06-04 Lingxi Xiao , Muqing Li , Yinqiu Feng , Meiqi Wang , Ziyi Zhu , Zexi Chen