English
Related papers

Related papers: Multi-scale Spatio-temporal Transformer-based Imba…

200 papers

Video prediction is a pixel-wise dense prediction task to infer future frames based on past frames. Missing appearance details and motion blur are still two major problems for current predictive models, which lead to image distortion and…

Computer Vision and Pattern Recognition · Computer Science 2020-05-25 Beibei Jin , Yu Hu , Qiankun Tang , Jingyu Niu , Zhiping Shi , Yinhe Han , Xiaowei Li

In medical image segmentation, specialized computer vision techniques, notably transformers grounded in attention mechanisms and residual networks employing skip connections, have been instrumental in advancing performance. Nonetheless,…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Fuchen Zheng , Xuhang Chen , Weihuang Liu , Haolun Li , Yingtie Lei , Jiahui He , Chi-Man Pun , Shounjun Zhou

Cell image analysis is crucial in Alzheimer's research to detect the presence of A$\beta$ protein inhibiting cell function. Deep learning speeds up the process by making only low-level data sufficient for fruitful inspection. We first found…

Image and Video Processing · Electrical Eng. & Systems 2021-08-04 Wooseok Jung

Analyzing temporal developments is crucial for the accurate prognosis of many medical conditions. Temporal changes that occur over short time scales are key to assessing the health of physiological functions, such as the cardiac cycle.…

Computer Vision and Pattern Recognition · Computer Science 2024-10-29 Chengzhi Shen , Martin J. Menten , Hrvoje Bogunović , Ursula Schmidt-Erfurth , Hendrik Scholl , Sobha Sivaprasad , Andrew Lotery , Daniel Rueckert , Paul Hager , Robbie Holland

In the complex landscape of multivariate time series forecasting, achieving both accuracy and interpretability remains a significant challenge. This paper introduces the Fuzzy Transformer (Fuzzformer), a novel recurrent neural network…

Artificial Intelligence · Computer Science 2025-10-02 Miha Ožbot , Igor Škrjanc , Vitomir Štruc

We propose a new method for training convolutional neural networks which integrates reinforcement learning along with supervised learning and use ti for transfer learning for classification of glaucoma from colored fundus images. The…

Image and Video Processing · Electrical Eng. & Systems 2021-05-19 Hardit Singh , Simarjeet Saini , Vasudevan Lakshminarayanan

Perfusion MRI (pMRI) offers valuable insights into tumor vascularity and promises to predict tumor genotypes, thus benefiting prognosis for glioma patients, yet effective models tailored to 4D pMRI are still lacking. This study presents the…

Image and Video Processing · Electrical Eng. & Systems 2024-06-11 Ruodan Yan , Carola-Bibiane Schönlieb , Chao Li

Medical image segmentation plays a crucial role in clinical diagnosis and treatment planning. Although models based on convolutional neural networks (CNNs) and Transformers have achieved remarkable success in medical image segmentation…

Image and Video Processing · Electrical Eng. & Systems 2024-10-04 Jiashu Xu

Glaucoma is a major cause of irreversible blindness, with significant diagnostic subjectivity. This inherent uncertainty, combined with the overconfidence of models optimized solely for accuracy can lead to fatal issues such as…

Image and Video Processing · Electrical Eng. & Systems 2025-11-04 Taejin Jeong , Joohyeok Kim , Jaehoon Joo , Seong Jae Hwang

In this paper, a self-supervised model that simultaneously predicts a sequence of future frames from video-input with a novel spatial-temporal attention (ST) network is proposed. The ST transformer network allows constraining both temporal…

Computer Vision and Pattern Recognition · Computer Science 2023-03-03 Houssem Boulahbal , Adrian Voicila , Andrew Comport

Brain transcriptomics provides insights into the molecular mechanisms by which the brain coordinates its functions and processes. However, existing multimodal methods for predicting Alzheimer's disease (AD) primarily rely on imaging and…

Artificial Intelligence · Computer Science 2025-04-03 Shan Cong , Zhoujie Fan , Hongwei Liu , Yinghan Zhang , Xin Wang , Haoran Luo , Xiaohui Yao

U-shaped architectures have long dominated the field of medical image segmentation, while Transformers are widely employed for modeling long-range dependencies. The former typically handles scale variations implicitly by aggregating…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Yanhua Zhang , Ke Zhang , Jingyu Wang , Gabriella Balestra , Samanta Rosati , Yulin Wu , Wuwei Wang , Valentina Giannini

Transformer-based models, capable of learning better global dependencies, have recently demonstrated exceptional representation learning capabilities in computer vision and medical image analysis. Transformer reformats the image into…

Falls are a major cause of injuries and deaths among older adults worldwide. Accurate fall detection can help reduce potential injuries and additional health complications. Different types of video modalities can be used in a home setting…

Computer Vision and Pattern Recognition · Computer Science 2023-11-07 Stefan Denkovski , Shehroz S. Khan , Alex Mihailidis

Longitudinal imaging is able to capture both static anatomical structures and dynamic changes in disease progression toward earlier and better patient-specific pathology management. However, conventional approaches rarely take advantage of…

Medical image segmentation is a critical step in computer-aided diagnosis, and convolutional neural networks are popular segmentation networks nowadays. However, the inherent local operation characteristics make it difficult to focus on the…

Computer Vision and Pattern Recognition · Computer Science 2023-05-18 Fenghe Tang , Jianrui Ding , Lingtao Wang , Min Xian , Chunping Ning

Recent studies have indicated that vision models pre-trained on images can serve as time series foundation models (TSFMs) by reformulating time series forecasting (TSF) as image reconstruction. However, effective cross-modal transfer from…

Computer Vision and Pattern Recognition · Computer Science 2025-10-13 Lefei Shen , Mouxiang Chen , Xu Liu , Han Fu , Xiaoxue Ren , Jianling Sun , Zhuo Li , Chenghao Liu

The automatic early diagnosis of prodromal stages of Alzheimer's disease is of great relevance for patient treatment to improve quality of life. We address this problem as a multi-modal classification task. Multi-modal data provides richer…

In this paper, we proposed Transferable Ranking Convolutional Neural Network (TRk-CNN) that can be effectively applied when the classes of images to be classified show a high correlation with each other. The multi-class classification…

Computer Vision and Pattern Recognition · Computer Science 2019-05-17 Tae Joon Jun , Youngsub Eom , Dohyeun Kim , Cherry Kim , Ji-Hye Park , Hoang Minh Nguyen , Daeyoung Kim

Alzheimer's disease and Frontotemporal dementia are common types of neurodegenerative disorders that present overlapping clinical symptoms, making their differential diagnosis very challenging. Numerous efforts have been done for the…

Image and Video Processing · Electrical Eng. & Systems 2023-09-07 Huy-Dung Nguyen , Michaël Clément , Boris Mansencal , Pierrick Coupé