English
Related papers

Related papers: Self-Supervised Transformers for fMRI representati…

200 papers

While filtered back projection (FBP) is still the method of choice for fast tomographic reconstruction, its performance degrades noticeably in the presence of noise, incomplete sampling, or non-standard scan geometries. We propose a…

Numerical Analysis · Mathematics 2026-02-16 Hamid Fathi , Alexander Skorikov , Tristan van Leeuwen

Depth map enhancement using paired high-resolution RGB images offers a cost-effective solution for improving low-resolution depth data from lightweight ToF sensors. Nevertheless, naively adopting a depth estimation pipeline to fuse the two…

Computer Vision and Pattern Recognition · Computer Science 2025-06-18 Laiyan Ding , Hualie Jiang , Jiwei Chen , Rui Huang

In this work, we focus on the challenging task, neuro-disease classification, using functional magnetic resonance imaging (fMRI). In population graph-based disease analysis, graph convolutional neural networks (GCNs) have achieved…

Machine Learning · Computer Science 2022-11-29 Liang Peng , Nan Wang , Jie Xu , Xiaofeng Zhu , Xiaoxiao Li

Pretraining with large-scale 3D volumes has a potential for improving the segmentation performance on a target medical image dataset where the training images and annotations are limited. Due to the high cost of acquiring pixel-level…

Computer Vision and Pattern Recognition · Computer Science 2023-06-30 Guotai Wang , Jianghao Wu , Xiangde Luo , Xinglong Liu , Kang Li , Shaoting Zhang

Deep learning models have shown their advantage in many different tasks, including neuroimage analysis. However, to effectively train a high-quality deep learning model, the aggregation of a significant amount of patient information is…

Machine Learning · Computer Science 2020-12-08 Xiaoxiao Li , Yufeng Gu , Nicha Dvornek , Lawrence Staib , Pamela Ventola , James S. Duncan

Supervised fine-tuning (SFT) is a standard approach to adapting large language models (LLMs) to new domains. In this work, we improve the statistical efficiency of SFT by selecting an informative subset of training examples. Specifically,…

Machine Learning · Computer Science 2025-05-22 Rohan Deb , Kiran Thekumparampil , Kousha Kalantari , Gaurush Hiranandani , Shoham Sabach , Branislav Kveton

Reconstructing observed images from fMRI brain recordings is challenging. Unfortunately, acquiring sufficient "labeled" pairs of {Image, fMRI} (i.e., images with their corresponding fMRI responses) to span the huge space of natural images…

Image and Video Processing · Electrical Eng. & Systems 2021-06-11 Roman Beliy , Guy Gaziv , Assaf Hoogi , Francesca Strappini , Tal Golan , Michal Irani

Foundation models (FMs) have emerged as a transformative paradigm in medical image analysis, offering the potential to provide generalizable, task-agnostic solutions across a wide range of clinical tasks and imaging modalities. Their…

Computer Vision and Pattern Recognition · Computer Science 2025-11-04 Karma Phuntsho , Abdullah , Kyungmi Lee , Ickjai Lee , Euijoon Ahn

Vision foundation models (FMs) are accelerating the development of digital pathology algorithms and transforming biomedical research. These models learn, in a self-supervised manner, to represent histological features in highly…

Self-supervised learning has emerged as a highly effective approach in the fields of natural language processing and computer vision. It is also applicable to brain signals such as electroencephalography (EEG) data, given the abundance of…

Signal Processing · Electrical Eng. & Systems 2024-01-22 Yuqi Chen , Kan Ren , Kaitao Song , Yansen Wang , Yifan Wang , Dongsheng Li , Lili Qiu

Hyperspectral images (HSIs) contain rich spectral and spatial information. Motivated by the success of transformers in the field of natural language processing and computer vision where they have shown the ability to learn long range…

Computer Vision and Pattern Recognition · Computer Science 2024-01-05 Shaheer Mohamed , Maryam Haghighat , Tharindu Fernando , Sridha Sridharan , Clinton Fookes , Peyman Moghadam

Reconstructing high-quality images from substantially undersampled k-space data for accelerated MRI presents a challenging ill-posed inverse problem. While supervised deep learning has revolutionized this field, it relies heavily on large…

Image and Video Processing · Electrical Eng. & Systems 2025-12-22 Xinzhe Luo , Yingzhen Li , Chen Qin

Emotion recognition is a challenging task due to limited availability of in-the-wild labeled datasets. Self-supervised learning has shown improvements on tasks with limited labeled datasets in domains like speech and natural language.…

Computation and Language · Computer Science 2021-04-08 Aparna Khare , Srinivas Parthasarathy , Shiva Sundaram

The great success of Deep Neural Networks (DNNs) has inspired the algorithmic development of DNN-based Fixed-Point (DNN-FP) for computer vision tasks. DNN-FP methods, trained by Back-Propagation Through Time or computing the inaccurate…

Computer Vision and Pattern Recognition · Computer Science 2023-01-31 Peng Qiao , Sidun Liu , Tao Sun , Ke Yang , Yong Dou

Deep learning methods are increasingly being used with neuroimaging data like structural and function magnetic resonance imaging (MRI) to predict the diagnosis of neuropsychiatric and neurological disorders. For psychiatric disorders in…

Neurons and Cognition · Quantitative Biology 2019-07-03 Ahmed El Gazzar , Leonardo Cerliani , Guido van Wingen , Rajat Mani Thomas

Recent self-supervised stereo matching methods have made significant progress. They typically rely on the photometric consistency assumption, which presumes corresponding points across views share the same appearance. However, this…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Yun Wang , Zhengjie Yang , Jiahao Zheng , Zhanjie Zhang , Dapeng Oliver Wu , Yulan Guo

Time-frequency representation (TFR) allowing for mode reconstruction plays a significant role in interpreting and analyzing the nonstationary signal constituted of various modes. However, it is difficult for most previous methods to handle…

Signal Processing · Electrical Eng. & Systems 2021-09-01 Haijian Zhang , Guang Hua

In Fringe Projection Profilometry (FPP), achieving robust and accurate 3D reconstruction with a limited number of fringe patterns remains a challenge in structured light 3D imaging. Conventional methods require a set of fringe images, but…

Computer Vision and Pattern Recognition · Computer Science 2024-02-05 Won-Hoe Kim , Bongjoong Kim , Hyung-Gun Chi , Jae-Sang Hyun

Magnetic Resonance Imaging (MRI) produces excellent soft tissue contrast, albeit it is an inherently slow imaging modality. Promising deep learning methods have recently been proposed to reconstruct accelerated MRI scans. However, existing…

Image and Video Processing · Electrical Eng. & Systems 2024-04-17 Yilmaz Korkmaz , Tolga Cukur , Vishal M. Patel

Magnetic Resonance Fingerprinting (MRF) is a new approach to quantitative magnetic resonance imaging that allows simultaneous measurement of multiple tissue properties in a single, time-efficient acquisition. Standard MRF reconstructs…

Computer Vision and Pattern Recognition · Computer Science 2018-12-20 Ilkay Oksuz , Gastao Cruz , James Clough , Aurelien Bustin , Nicolo Fuin , Rene M. Botnar , Claudia Prieto , Andrew P. King , Julia A. Schnabel