English
Related papers

Related papers: Pretraining Transformer-Based Models on Diffusion-…

200 papers

Recent advances in generative modeling have positioned diffusion models as state-of-the-art tools for sampling from complex data distributions. While these models have shown remarkable success across single-modality domains such as images…

Computer Vision and Pattern Recognition · Computer Science 2025-10-28 Nimrod Berman , Omkar Joglekar , Eitan Kosman , Dotan Di Castro , Omri Azencot

Diffusion model has become a main paradigm for synthetic data generation in many subfields of modern machine learning, including computer vision, language model, or speech synthesis. In this paper, we leverage the power of diffusion model…

Machine Learning · Statistics 2023-11-20 Namjoon Suh , Xiaofeng Lin , Din-Yin Hsieh , Merhdad Honarkhah , Guang Cheng

Machine Learning (ML) has emerged as a promising approach in healthcare, outperforming traditional statistical techniques. However, to establish ML as a reliable tool in clinical practice, adherence to best practices regarding data…

Image and Video Processing · Electrical Eng. & Systems 2023-09-15 Rosanna Turrisi , Alessandro Verri , Annalisa Barla

Missing modalities pose a major issue in Alzheimer's Disease (AD) diagnosis, as many subjects lack full imaging data due to cost and clinical constraints. While multi-modal learning leverages complementary information, most existing methods…

Image and Video Processing · Electrical Eng. & Systems 2025-08-28 Yanfei Li , Teng Yin , Wenyi Shang , Jingyu Liu , Xi Wang , Kaiyang Zhao

Alzheimer's Disease (AD) is a neurodegenerative disease affecting millions of individuals across the globe. As the prevalence of this disease continues to rise, early diagnosis is crucial to improve clinical outcomes. Neural networks,…

Image and Video Processing · Electrical Eng. & Systems 2024-09-06 Akshay Sunkara , Rajiv Morthala , Anav Jain , Srinjoy Ghose , Santosh Morthala

We study the problem of generating graph signals from unknown distributions defined over given graphs, relevant to domains such as recommender systems or sensor networks. Our approach builds on generative diffusion models, which are well…

Machine Learning · Computer Science 2025-10-07 Sergio Rozada , Vimal K. B. , Andrea Cavallo , Antonio G. Marques , Hadi Jamali-Rad , Elvin Isufi

Diffusion Probabilistic Models (DPMs) have recently demonstrated impressive results on various generative tasks.Despite its promises, the learned representations of pre-trained DPMs, however, have not been fully understood. In this paper,…

Computer Vision and Pattern Recognition · Computer Science 2023-08-23 Xingyi Yang , Xinchao Wang

The traditional techniques for extracting polycrystalline grain structures from microscopy images, such as transmission electron microscopy (TEM) and scanning electron microscopy (SEM), are labour-intensive, subjective, and time-consuming,…

Machine Learning · Computer Science 2025-04-22 Ahmed Sobhi Saleh , Kristof Croes , Hajdin Ceric , Ingrid De Wolf , Houman Zahedmanesh

Predicting conversion from Mild Cognitive Impairment (MCI) to Alzheimer's Disease (AD) is critical for early intervention. Current deep learning paradigms predominantly rely on cross-sectional structural MRI, neglecting prognostic value in…

Computer Vision and Pattern Recognition · Computer Science 2026-05-28 Alireza Moayedikia , Sara Fin , Alicia Troncoso Lora , Uffe Kock Wiil

AI fairness seeks to improve the transparency and explainability of AI systems by ensuring that their outcomes genuinely reflect the best interests of users. Data augmentation, which involves generating synthetic data from existing…

Machine Learning · Computer Science 2024-10-22 Christina Hastings Blow , Lijun Qian , Camille Gibson , Pamela Obiomon , Xishuang Dong

Imbalanced datasets pose a difficulty in fraud detection, as classifiers are often biased toward the majority class and perform poorly on rare fraudulent transactions. Synthetic data generation is therefore commonly used to mitigate this…

Machine Learning · Statistics 2026-05-01 En-Ya Kuo , Sebastien Motsch

The prediction of subjects with mild cognitive impairment (MCI) who will progress to Alzheimer's disease (AD) is clinically relevant, and may above all have a significant impact on accelerate the development of new treatments. In this…

Image and Video Processing · Electrical Eng. & Systems 2019-07-16 Kilian Hett , Vinh-Thong Ta , José V. Manjón , Pierrick Coupé

Alzheimer's disease (AD) is a heterogeneous, multifactorial neurodegenerative disorder characterized by beta-amyloid, pathologic tau, and neurodegeneration. There are no effective treatments for Alzheimer's disease at a late stage, urging…

Quantitative Methods · Quantitative Biology 2023-08-28 Enze Xu , Jingwen Zhang , Jiadi Li , Qianqian Song , Defu Yang , Guorong Wu , Minghan Chen

Deep learning (DL)-based methods have recently shown great promise in bitemporal change detection (CD). Existing discriminative methods based on Convolutional Neural Networks (CNNs) and Transformers rely on discriminative representation…

Computer Vision and Pattern Recognition · Computer Science 2024-03-05 Yihan Wen , Xianping Ma , Xiaokang Zhang , Man-On Pun

Diffusion-based tabular data synthesis models have yielded promising results. However, when the data dimensionality increases, existing models tend to degenerate and may perform even worse than simpler, non-diffusion-based models. This is…

Machine Learning · Computer Science 2025-11-12 Zuqing Li , Junhao Gan , Jianzhong Qi

Cross-modal fusion of different types of neuroimaging data has shown great promise for predicting the progression of Alzheimer's Disease(AD). However, most existing methods applied in neuroimaging can not efficiently fuse the functional and…

Image and Video Processing · Electrical Eng. & Systems 2022-07-15 Junren Pan , Shuqiang Wang

In this paper, we introduce the first diffusion model designed to generate complete synthetic human genotypes, which, by standard protocols, one can straightforwardly expand into full-length, DNA-level genomes. The synthetic genotypes mimic…

Computational Engineering, Finance, and Science · Computer Science 2025-01-31 Philip Kenneweg , Raghuram Dandinasivara , Xiao Luo , Barbara Hammer , Alexander Schönhuth

This paper presents a general framework for obtaining interpretable multivariate discriminative models that allow efficient statistical inference for neuroimage analysis. The framework, termed generative discriminative machine (GDM),…

Applications · Statistics 2019-06-04 Erdem Varol , Aristeidis Sotiras , Ke Zeng , Christos Davatzikos

Glaucoma is a progressive optic neuropathy characterized by structural damage to the optic nerve head and functional changes in the visual field. Detecting glaucoma early is crucial to preventing loss of eyesight. However, medical datasets…

Image and Video Processing · Electrical Eng. & Systems 2024-12-09 Youssof Nawar , Nouran Soliman , Moustafa Wassel , Mohamed ElHabebe , Noha Adly , Marwan Torki , Ahmed Elmassry , Islam Ahmed

Machine learning models have demonstrated remarkable efficacy and efficiency in a wide range of stock forecasting tasks. However, the inherent challenges of data scarcity, including low signal-to-noise ratio (SNR) and data homogeneity, pose…

Statistical Finance · Quantitative Finance 2024-02-13 Yuan Gao , Haokun Chen , Xiang Wang , Zhicai Wang , Xue Wang , Jinyang Gao , Bolin Ding