English
Related papers

Related papers: Convolutional-LSTM for Multi-Image to Single Outpu…

200 papers

Vision-language models (VLMs) have shown promise in 2D medical image analysis, but extending them to 3D remains challenging due to the high computational demands of volumetric data and the difficulty of aligning 3D spatial features with…

Computer Vision and Pattern Recognition · Computer Science 2025-12-17 Yu Xin , Gorkem Can Ates , Kuang Gong , Wei Shao

Deep learning for medical image classification faces three major challenges: 1) the number of annotated medical images for training are usually small; 2) regions of interest (ROIs) are relatively small with unclear boundaries in the whole…

Computer Vision and Pattern Recognition · Computer Science 2019-10-23 Shaohua Li , Yong Liu , Xiuchao Sui , Cheng Chen , Gabriel Tjio , Daniel Shu Wei Ting , Rick Siow Mong Goh

The world is currently experiencing an ongoing pandemic of an infectious disease named coronavirus disease 2019 (i.e., COVID-19), which is caused by the severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2). Computed Tomography (CT)…

Image and Video Processing · Electrical Eng. & Systems 2021-12-10 Qinghao Ye , Yuan Gao , Weiping Ding , Zhangming Niu , Chengjia Wang , Yinghui Jiang , Minhao Wang , Evandro Fei Fang , Wade Menpes-Smith , Jun Xia , Guang Yang

Medical image analysis is essential in modern healthcare. Deep learning has redirected research focus toward complex medical multimodal tasks, including report generation and visual question answering. Traditional task-specific models often…

Computer Vision and Pattern Recognition · Computer Science 2025-09-15 Yiming Shi , Shaoshuai Yang , Xun Zhu , Haoyu Wang , Xiangling Fu , Miao Li , Ji Wu

Multi-modal images play a crucial role in comprehensive evaluations in medical image analysis providing complementary information for identifying clinically important biomarkers. However, in clinical practice, acquiring multiple modalities…

Image and Video Processing · Electrical Eng. & Systems 2024-10-02 Jonghun Kim , Hyunjin Park

Since the era of deep learning, convolutional neural networks (CNNs) and vision transformers (ViTs) have been extensively studied and widely used in medical image classification tasks. Unfortunately, CNN's limitations in modeling long-range…

Image and Video Processing · Electrical Eng. & Systems 2024-10-01 Yubiao Yue , Zhenzhang Li

Clinical outcome or severity prediction from medical images has largely focused on learning representations from single-timepoint or snapshot scans. It has been shown that disease progression can be better characterized by temporal imaging.…

Image and Video Processing · Electrical Eng. & Systems 2022-04-01 Aishik Konwer , Xuan Xu , Joseph Bae , Chao Chen , Prateek Prasanna

Segmentation in 3D scans is playing an increasingly important role in current clinical practice supporting diagnosis, tissue quantification, or treatment planning. The current 3D approaches based on convolutional neural networks usually…

Computer Vision and Pattern Recognition · Computer Science 2019-03-12 Alexey Novikov , David Major , Maria Wimmer , Dimitrios Lenis , Katja Bühler

We present a convolutional neural network for joint 3D shape prediction and viewpoint estimation from a single input image. During training, our network gets the learning signal from a silhouette of an object in the input image - a form of…

Robotics · Computer Science 2019-10-18 Oier Mees , Maxim Tatarchenko , Thomas Brox , Wolfram Burgard

Purpose: Conventional automated segmentation of the head anatomy in MRI distinguishes different brain and non-brain tissues based on image intensities and prior tissue probability maps (TPM). This works well for normal head anatomies, but…

Image and Video Processing · Electrical Eng. & Systems 2021-05-20 Lukas Hirsch , Yu Huang , Lucas C Parra

The development of 3D medical vision-language models holds significant potential for disease diagnosis and patient treatment. However, compared to 2D medical images, 3D medical images, such as CT scans, face challenges related to limited…

Image and Video Processing · Electrical Eng. & Systems 2024-10-21 Haoran Lai , Zihang Jiang , Qingsong Yao , Rongsheng Wang , Zhiyang He , Xiaodong Tao , Wei Wei , Weifu Lv , S. Kevin Zhou

Silent Speech Interfaces aim to reconstruct the acoustic signal from a sequence of ultrasound tongue images that records the articulatory movement. The extraction of information about the tongue movement requires us to efficiently process…

Human-Computer Interaction · Computer Science 2022-06-28 Amin Honarmandi Shandiz , Laszlo Toth

In the field of medical imaging, AI-assisted techniques such as object detection, segmentation, and classification are widely employed to alleviate the workload of physicians and doctors. However, single-task models are predominantly used,…

Image and Video Processing · Electrical Eng. & Systems 2025-11-18 Fan Li , Arun Iyengar , Lanyu Xu

Three-dimensional (3D) reconstruction of head Computed Tomography (CT) images elucidates the intricate spatial relationships of tissue structures, thereby assisting in accurate diagnosis. Nonetheless, securing an optimal head CT scan…

Computer Vision and Pattern Recognition · Computer Science 2023-09-18 Bowen Zheng , Chenxi Huang , Yuemei Luo

Remarkable progress has been made in image recognition, primarily due to the availability of large-scale annotated datasets and the revival of deep CNN. CNNs enable learning data-driven, highly representative, layered hierarchical image…

Computer Vision and Pattern Recognition · Computer Science 2016-02-11 Hoo-Chang Shin , Holger R. Roth , Mingchen Gao , Le Lu , Ziyue Xu , Isabella Nogues , Jianhua Yao , Daniel Mollura , Ronald M. Summers

A method of a Convolutional Neural Networks (CNN) for image classification with image preprocessing and hyperparameters tuning was proposed. The method aims at increasing the predictive performance for COVID-19 diagnosis while more complex…

Image and Video Processing · Electrical Eng. & Systems 2023-06-06 Kenan Morani , Devrim Unay

In this paper, an innovative multi-modal deep learning model is proposed to deeply integrate heterogeneous information from medical images and clinical reports. First, for medical images, convolutional neural networks were used to extract…

Machine Learning · Computer Science 2024-05-29 Ziyan Yao , Fei Lin , Sheng Chai , Weijie He , Lu Dai , Xinghui Fei

Due to the limitations in the accuracy and robustness of current electroencephalogram (EEG) classification algorithms, applying motor imagery (MI) for practical Brain-Computer Interface (BCI) applications remains challenging. This paper…

Human-Computer Interaction · Computer Science 2023-12-21 Shiwei Cheng , Yuejiang Hao

The great challenge for the humanity of the year 2020 is the fight against COVID-19. The whole world is making a huge effort to find an effective vaccine with purpose to protect people not yet infected. The alternative solution remains…

Image and Video Processing · Electrical Eng. & Systems 2020-12-03 Mario Manzo , Simone Pellino

This paper proposes a novel deep learning framework named bidirectional-convolutional long short term memory (Bi-CLSTM) network to automatically learn the spectral-spatial feature from hyperspectral images (HSIs). In the network, the issue…

Computer Vision and Pattern Recognition · Computer Science 2017-03-24 Qingshan Liu , Feng Zhou , Renlong Hang , Xiaotong Yuan