English
Related papers

Related papers: Cortex-Grounded Diffusion Models for Brain Image G…

200 papers

3D-aware image generative modeling aims to generate 3D-consistent images with explicitly controllable camera poses. Recent works have shown promising results by training neural radiance field (NeRF) generators on unstructured 2D images, but…

Computer Vision and Pattern Recognition · Computer Science 2022-08-24 Yu Deng , Jiaolong Yang , Jianfeng Xiang , Xin Tong

Monitoring diseases that affect the brain's structural integrity requires automated analysis of magnetic resonance (MR) images, e.g., for the evaluation of volumetric changes. However, many of the evaluation tools are optimized for…

Visual microscopic study of diseased tissue by pathologists has been the cornerstone for cancer diagnosis and prognostication for more than a century. Recently, deep learning methods have made significant advances in the analysis and…

Image and Video Processing · Electrical Eng. & Systems 2022-09-30 Puria Azadi Moghadam , Sanne Van Dalen , Karina C. Martin , Jochen Lennerz , Stephen Yip , Hossein Farahani , Ali Bashashati

We introduce CORTEX, an algorithmic framework designed for large-scale brain simulation. Leveraging the computational capacity of the Fugaku Supercomputer, CORTEX maximizes available problem size and processing performance. Our primary…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-06-07 Tianxiang Lyu , Mitsuhisa Sato , Shigeki Aoki , Ryutaro Himeno , Zhe Sun

Text to image latent diffusion models have recently advanced medical image synthesis, but applications to 3D CT generation remain limited. Existing approaches rely on simplified prompts, neglecting the rich semantic detail in full radiology…

Computer Vision and Pattern Recognition · Computer Science 2025-09-19 Sina Amirrajab , Zohaib Salahuddin , Sheng Kuang , Henry C. Woodruff , Philippe Lambin

Recent literature has effectively leveraged diffusion models trained on continuous variables as priors for solving inverse problems. Notably, discrete diffusion models with discrete latent codes have shown strong performance, particularly…

Computer Vision and Pattern Recognition · Computer Science 2025-09-22 Naoki Murata , Chieh-Hsin Lai , Yuhta Takida , Toshimitsu Uesaka , Bac Nguyen , Stefano Ermon , Yuki Mitsufuji

Multimodal medical imaging integrates diverse data types, such as structural and functional neuroimaging, to provide complementary insights that enhance deep learning predictions and improve outcomes. This study focuses on a neuroimaging…

Image and Video Processing · Electrical Eng. & Systems 2025-06-17 Bi Yuda , Jia Sihan , Gao Yutong , Abrol Anees , Fu Zening , Calhoun Vince

Tissue mechanics--stiffness, density and impedance contrast--are broadly informative biomarkers across diseases, yet routine CT, MRI, and B-mode ultrasound rarely quantify them directly. While ultrasound tomography (UT) is intrinsically…

Computer Vision and Pattern Recognition · Computer Science 2025-11-11 Zhijun Zeng , Youjia Zheng , Chang Su , Qianhang Wu , Hao Hu , Zeyuan Dong , Shan Gao , Yang Lv , Rui Tang , Ligang Cui , Zhiyong Hou , Weijun Lin , Zuoqiang Shi , Yubing Li , He Sun

Recent advances in generative modeling have enabled the generation of high-quality synthetic data that is applicable in a variety of domains, including face recognition. Here, state-of-the-art generative models typically rely on…

Computer Vision and Pattern Recognition · Computer Science 2025-10-14 Darian Tomašević , Fadi Boutros , Chenhao Lin , Naser Damer , Vitomir Štruc , Peter Peer

Directly reconstructing 3D CT volume from few-view 2D X-rays using an end-to-end deep learning network is a challenging task, as X-ray images are merely projection views of the 3D CT volume. In this work, we facilitate complex 2D X-ray…

Image and Video Processing · Electrical Eng. & Systems 2025-03-25 Xing Xie , Jiawei Liu , Huijie Fan , Zhi Han , Yandong Tang , Liangqiong Qu

We present Text2Tex, a novel method for generating high-quality textures for 3D meshes from the given text prompts. Our method incorporates inpainting into a pre-trained depth-aware image diffusion model to progressively synthesize high…

Computer Vision and Pattern Recognition · Computer Science 2023-03-22 Dave Zhenyu Chen , Yawar Siddiqui , Hsin-Ying Lee , Sergey Tulyakov , Matthias Nießner

Diffusion models demonstrate remarkable capabilities in capturing complex data distributions and have achieved compelling results in many generative tasks. While they have recently been extended to dense prediction tasks such as depth…

Computer Vision and Pattern Recognition · Computer Science 2025-12-16 Haorui Ji , Taojun Lin , Hongdong Li

We present PathoSyn, a unified generative framework for Magnetic Resonance Imaging (MRI) image synthesis that reformulates imaging-pathology as a disentangled additive deviation on a stable anatomical manifold. Current generative models…

Computer Vision and Pattern Recognition · Computer Science 2026-01-14 Jian Wang , Sixing Rong , Jiarui Xing , Yuling Xu , Weide Liu

Deep generative models have shown success in generating 3D shapes with different representations. In this work, we propose Neural Volumetric Mesh Generator(NVMG) which can generate novel and high-quality volumetric meshes. Unlike the…

Computer Vision and Pattern Recognition · Computer Science 2022-10-10 Yan Zheng , Lemeng Wu , Xingchao Liu , Zhen Chen , Qiang Liu , Qixing Huang

Medical image segmentation models struggle with rare abnormalities due to scarce annotated pathological data. We propose DiffAug a novel framework that combines textguided diffusion-based generation with automatic segmentation validation to…

Computer Vision and Pattern Recognition · Computer Science 2025-08-26 Maham Nazir , Muhammad Aqeel , Francesco Setti

A surface-based diffeomorphic algorithm to generate 3D coordinate grids in the cortical ribbon is described. In the grid, normal coordinate lines are generated by the diffeomorphic evolution from the grey/white (inner) surface to the…

Computer Vision and Pattern Recognition · Computer Science 2019-07-16 J. Tilak Ratnanather , Sylvain Arguillère , Kwame S. Kutten , Peter Hubka , Andrej Kral , Laurent Younes

Vision-language models have demonstrated impressive capabilities in generating 2D images under various conditions; however, the success of these models is largely enabled by extensive, readily available pretrained foundation models.…

Image and Video Processing · Electrical Eng. & Systems 2025-10-02 Mohamed Mohamed , Brennan Nichyporuk , Douglas L. Arnold , Tal Arbel

Diffusion models have emerged as the best approach for generative modeling of 2D images. Part of their success is due to the possibility of training them on millions if not billions of images with a stable learning objective. However,…

Computer Vision and Pattern Recognition · Computer Science 2023-05-23 Animesh Karnewar , Andrea Vedaldi , David Novotny , Niloy Mitra

Recent studies in speech-driven talking face generation achieve promising results, but their reliance on fixed-driven speech limits further applications (e.g., face-voice mismatch). Thus, we extend the task to a more challenging setting:…

Sound · Computer Science 2025-07-28 Fang Kang , Yin Cao , Haoyu Chen

Understanding individual cortical development is essential for identifying deviations linked to neurodevelopmental disorders. However, current normative modelling frameworks struggle to capture fine-scale anatomical details due to their…

Quantitative Methods · Quantitative Biology 2025-08-14 Nashira Baena , Mariana da Silva , Irina Grigorescu , Aakash Saboo , Saga Masui , Jaques-Donald Tournier , Emma C. Robinson