English
Related papers

Related papers: Spatio-Temporal Conditional Diffusion Models for F…

200 papers

Generative modeling of anatomical structures plays a crucial role in virtual imaging trials, which allow researchers to perform studies without the costs and constraints inherent to in vivo and phantom studies. For clinical relevance,…

Computer Vision and Pattern Recognition · Computer Science 2025-04-07 Bram de Wilde , Max T. Rietberg , Guillaume Lajoinie , Jelmer M. Wolterink

Neural demyelination and brain damage accumulated in white matter appear as hyperintense areas on T2-weighted MRI scans in the form of lesions. Modeling binary images at the population level, where each voxel represents the existence of a…

Methodology · Statistics 2023-05-29 Anna Menacher , Thomas E. Nichols , Chris Holmes , Habib Ganjgahi

Temporal volume images with 3D+t (4D) information are often used in medical imaging to statistically analyze temporal dynamics or capture disease progression. Although deep-learning-based generative models for natural images have been…

Image and Video Processing · Electrical Eng. & Systems 2022-06-28 Boah Kim , Jong Chul Ye

Observational astronomy relies on visual feature identification to detect critical astrophysical phenomena. While machine learning (ML) increasingly automates this process, models often struggle with generalization in large-scale surveys…

Astrophysics of Galaxies · Physics 2026-01-15 Chenrui Ma , Zechang Sun , Tao Jing , Zheng Cai , Yuan-Sen Ting , Song Huang , Mingyu Li

We introduce MATEX (Multi-scale Attention and Text-guided Explainability), a novel framework that advances interpretability in medical vision-language models by incorporating anatomically informed spatial reasoning. MATEX synergistically…

Computer Vision and Pattern Recognition · Computer Science 2026-01-21 Muhammad Imran , Chi Lee , Yugyung Lee

We introduce a dynamical spatio-temporal model formalized as a recurrent neural network for forecasting time series of spatial processes, i.e. series of observations sharing temporal and spatial dependencies. The model learns these…

Machine Learning · Computer Science 2018-04-24 Ali Ziat , Edouard Delasalles , Ludovic Denoyer , Patrick Gallinari

Diffusion models have shown great promise for image generation, beating GANs in terms of generation diversity, with comparable image quality. However, their application to 3D shapes has been limited to point or voxel representations that…

Computer Vision and Pattern Recognition · Computer Science 2022-12-16 Gimin Nam , Mariem Khlifi , Andrew Rodriguez , Alberto Tono , Linqi Zhou , Paul Guerrero

Analyzing temporal developments is crucial for the accurate prognosis of many medical conditions. Temporal changes that occur over short time scales are key to assessing the health of physiological functions, such as the cardiac cycle.…

Computer Vision and Pattern Recognition · Computer Science 2024-10-29 Chengzhi Shen , Martin J. Menten , Hrvoje Bogunović , Ursula Schmidt-Erfurth , Hendrik Scholl , Sobha Sivaprasad , Andrew Lotery , Daniel Rueckert , Paul Hager , Robbie Holland

Diffusion Probabilistic Models (DPMs) have demonstrated significant potential in 3D medical image segmentation tasks. However, their high computational cost and inability to fully capture global 3D contextual information limit their…

Image and Video Processing · Electrical Eng. & Systems 2025-04-17 Kangbo Ma

In model-based reinforcement learning, generative and temporal models of environments can be leveraged to boost agent performance, either by tuning the agent's representations during training or via use as part of an explicit planning…

In this work, a two-dimensional time-fractional subdiffusion model is developed to investigate the underlying transport phenomena evolving in a binary medium comprised of two sub-domains occupied by homogeneous material. We utilise an…

Numerical Analysis · Mathematics 2021-02-05 Libo Feng , Ian Turner , Patrick Perre , Kevin Burrage

Cell motion and appearance have a strong correlation with cell cycle and disease progression. Many contemporary efforts in machine learning utilize spatio-temporal models to predict a cell's physical state and, consequently, the advancement…

Computer Vision and Pattern Recognition · Computer Science 2018-04-03 Narita Pandhe , Balazs Rada , Shannon Quinn

We introduce the Aging Multiverse, a framework for generating multiple plausible facial aging trajectories from a single image, each conditioned on external factors such as environment, health, and lifestyle. Unlike prior methods that model…

Computer Vision and Pattern Recognition · Computer Science 2025-08-07 Bang Gong , Luchao Qi , Jiaye Wu , Zhicheng Fu , Chunbo Song , David W. Jacobs , John Nicholson , Roni Sengupta

Despite significant progress in Text-to-Image (T2I) generative models, even lengthy and complex text descriptions still struggle to convey detailed controls. In contrast, Layout-to-Image (L2I) generation, aiming to generate realistic and…

Computer Vision and Pattern Recognition · Computer Science 2024-03-14 Chengyou Jia , Minnan Luo , Zhuohang Dang , Guang Dai , Xiaojun Chang , Mengmeng Wang , Jingdong Wang

Text-driven human motion generation is a multimodal task that synthesizes human motion sequences conditioned on natural language. It requires the model to satisfy textual descriptions under varying conditional inputs, while generating…

Computer Vision and Pattern Recognition · Computer Science 2024-10-01 Xingyu Chen

The tremendous progress in neural image generation, coupled with the emergence of seemingly omnipotent vision-language models has finally enabled text-based interfaces for creating and editing images. Handling generic images requires a…

Computer Vision and Pattern Recognition · Computer Science 2023-07-27 Omri Avrahami , Ohad Fried , Dani Lischinski

Long-tailed class distributions are pervasive in multi-class medical datasets and pose significant challenges for deep learning models which typically underperform on tail classes with limited samples. This limitation is particularly…

Computer Vision and Pattern Recognition · Computer Science 2026-05-06 Jiaxiang Jiang , Mahesh Subedar , Omesh Tickoo

Text-to-Time Series generation holds significant potential to address challenges such as data sparsity, imbalance, and limited availability of multimodal time series datasets across domains. While diffusion models have achieved remarkable…

Machine Learning · Computer Science 2025-05-09 Yunfeng Ge , Jiawei Li , Yiji Zhao , Haomin Wen , Zhao Li , Meikang Qiu , Hongyan Li , Ming Jin , Shirui Pan

Diffusion models achieve remarkable success in processing images and text, and have been extended to special domains such as time series forecasting (TSF). Existing diffusion-based approaches for TSF primarily focus on modeling…

Computation and Language · Computer Science 2025-04-29 Chen Su , Yuanhe Tian , Yan Song

Pre-trained segmentation models are a powerful and flexible tool for segmenting images. Recently, this trend has extended to medical imaging. Yet, often these methods only produce a single prediction for a given image, neglecting inherent…

Computer Vision and Pattern Recognition · Computer Science 2025-03-14 Benjamin Towle , Xin Chen , Ke Zhou