English
Related papers

Related papers: brat: Aligned Multi-View Embeddings for Brain MRI …

200 papers

In neuroscience, understanding inter-individual differences has recently emerged as a major challenge, for which functional magnetic resonance imaging (fMRI) has proven invaluable. For this, neuroscientists rely on basic methods such as…

Computer Vision and Pattern Recognition · Computer Science 2020-04-07 Akrem Sellami , François-Xavier Dupé , Bastien Cagna , Hachem Kadri , Stéphane Ayache , Thierry Artières , Sylvain Takerkart

To address the problem of medical image recognition, computer vision techniques like convolutional neural networks (CNN) are frequently used. Recently, 3D CNN-based models dominate the field of magnetic resonance image (MRI) analytics. Due…

Computer Vision and Pattern Recognition · Computer Science 2023-02-27 Yuxuan Zhang , Qingzhong Wang , Jiang Bian , Yi Liu , Yanwu Xu , Dejing Dou , Haoyi Xiong

Accurate quantification of cerebral blood flow (CBF) is essential for the diagnosis and assessment of cerebrovascular diseases such as Moyamoya, carotid stenosis, aneurysms, and stroke. Positron emission tomography (PET) is currently…

Image and Video Processing · Electrical Eng. & Systems 2022-02-15 Ramy Hussein , Moss Zhao , David Shin , Jia Guo , Kevin T. Chen , Rui D. Armindo , Guido Davidzon , Michael Moseley , Greg Zaharchuk

Automated retinal image medical description generation is crucial for streamlining medical diagnosis and treatment planning. Existing challenges include the reliance on learned retinal image representations, difficulties in handling…

Computer Vision and Pattern Recognition · Computer Science 2024-12-24 Nagur Shareef Shaik , Teja Krishna Cherukuri , Dong Hye Ye

\emph{Objective and Impact Statement}. With the renaissance of deep learning, automatic diagnostic systems for computed tomography (CT) have achieved many successful applications. However, they are mostly attributed to careful expert…

Computer Vision and Pattern Recognition · Computer Science 2021-08-19 Penghua Zhai , Huaiwei Cong , Gangming Zhao , Chaowei Fang , Jinpeng Li , Ting Cai , Huiguang He

Foundation models pretrained on large-scale datasets via self-supervised learning demonstrate exceptional versatility across various tasks. Due to the heterogeneity and hard-to-collect medical data, this approach is especially beneficial…

Computational Engineering, Finance, and Science · Computer Science 2024-03-05 Yanwu Yang , Chenfei Ye , Guinan Su , Ziyao Zhang , Zhikai Chang , Hairui Chen , Piu Chan , Yue Yu , Ting Ma

Multi-modal large language models (MLLMs) have been given free rein to explore exciting medical applications with a primary focus on radiology report generation. Nevertheless, the preliminary success in 2D radiology captioning is…

Self-supervised deep learning has accelerated 2D natural image analysis but remains difficult to translate into 3D MRI, where data are scarce and pre-trained 2D backbones cannot capture volumetric context. We present a…

Computer Vision and Pattern Recognition · Computer Science 2025-07-30 Liam Chalcroft , Jenny Crinion , Cathy J. Price , John Ashburner

Quantitative, volumetric analysis of Magnetic Resonance Imaging (MRI) is a fundamental way researchers study the brain in a host of neurological conditions including normal maturation and aging. Despite the availability of open-source brain…

Quantitative Methods · Quantitative Biology 2019-11-15 Aakash Kaku , Chaitra V. Hegde , Jeffrey Huang , Sohae Chung , Xiuyuan Wang , Matthew Young , Alireza Radmanesh , Yvonne W. Lui , Narges Razavian

Machine learning has been widely adopted for medical image analysis in recent years given its promising performance in image segmentation and classification tasks. The success of machine learning, in particular supervised learning, depends…

Computer Vision and Pattern Recognition · Computer Science 2022-06-03 Chengliang Dai , Shuo Wang , Yuanhan Mo , Elsa Angelini , Yike Guo , Wenjia Bai

Recent advances in deep learning have led to robust automated tools for segmentation of abdominal computed tomography (CT). Meanwhile, segmentation of magnetic resonance imaging (MRI) is substantially more challenging due to the inherent…

Image and Video Processing · Electrical Eng. & Systems 2025-07-28 Deepa Krishnaswamy , Cosmin Ciausu , Steve Pieper , Ron Kikinis , Benjamin Billot , Andrey Fedorov

Fast MRI aims to reconstruct a high fidelity image from partially observed measurements. Exuberant development in fast MRI using deep learning has been witnessed recently. Meanwhile, novel deep learning paradigms, e.g., Transformer based…

Computer Vision and Pattern Recognition · Computer Science 2022-07-07 Jiahao Huang , Xiaodan Xing , Zhifan Gao , Guang Yang

LLMs have demonstrated remarkable capabilities in linguistic reasoning and are increasingly adept at vision-language tasks. The integration of image tokens into transformers has enabled direct visual input and output, advancing research…

Computer Vision and Pattern Recognition · Computer Science 2026-04-06 Jonghun Kim , Sinyoung Ra , Hyunjin Park

Developing and validating artificial intelligence models in medical imaging requires datasets that are large, granular, and diverse. To date, the majority of publicly available breast imaging datasets lack in one or more of these areas.…

Previous brain decoding research primarily involves single-subject studies, reconstructing stimuli via fMRI activity from the same subject. Our study aims to introduce a generalization technique for cross-subject brain decoding, facilitated…

Neurons and Cognition · Quantitative Biology 2023-09-06 Matteo Ferrante , Tommaso Boccato , Nicola Toschi

Decoding visual content from fMRI signals recorded while a person views images, and specifically answering questions about the seen images, is a long-standing challenge. While significant progress has been made in recent years in visual…

Computer Vision and Pattern Recognition · Computer Science 2026-05-29 Roman Beliy , Matias Cosarinsky , Oliver Heinimann , Navve Wasserman , Michal Irani

Segmentation models are important tools for the detection and analysis of lesions in brain MRI. Depending on the type of brain pathology that is imaged, MRI scanners can acquire multiple, different image modalities (contrasts). Most…

Computer Vision and Pattern Recognition · Computer Science 2025-09-12 Anthony P. Addison , Felix Wagner , Wentian Xu , Natalie Voets , Konstantinos Kamnitsas

Reconstructing images seen by people from their fMRI brain recordings provides a non-invasive window into the human brain. Despite recent progress enabled by diffusion models, current methods often lack faithfulness to the actual seen…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Roman Beliy , Amit Zalcher , Jonathan Kogman , Navve Wasserman , Michal Irani

Deep-learning-based brain magnetic resonance imaging (MRI) reconstruction methods have the potential to accelerate the MRI acquisition process. Nevertheless, the scientific community lacks appropriate benchmarks to assess MRI reconstruction…

Despite variations in architecture and pretraining strategies, recent studies indicate that large-scale AI models often converge toward similar internal representations that also align with neural activity. We propose that scale-invariance,…

Neurons and Cognition · Quantitative Biology 2025-06-17 Junjie Yu , Wenxiao Ma , Jianyu Zhang , Haotian Deng , Zihan Deng , Yi Guo , Quanying Liu