English
Related papers

Related papers: Generative-based Fusion Mechanism for Multi-Modal …

200 papers

The emergence of deep generative models has recently enabled the automatic generation of massive amounts of graphical content, both in 2D and in 3D. Generative Adversarial Networks (GANs) and style control mechanisms, such as Adaptive…

Graphics · Computer Science 2020-04-28 Omry Sendik , Dani Lischinski , Daniel Cohen-Or

We introduce the first continuous-time score-based generative model that leverages fractional diffusion processes for its underlying dynamics. Although diffusion models have excelled at capturing data distributions, they still suffer from…

Existing domain generalization (DG) methods for cross-person generalization tasks often face challenges in capturing intra- and inter-domain style diversity, resulting in domain gaps with the target domain. In this study, we explore a novel…

Machine Learning · Computer Science 2024-07-02 Junru Zhang , Lang Feng , Zhidan Liu , Yuhan Wu , Yang He , Yabo Dong , Duanqing Xu

Over the past decade, there has been tremendous progress in creating synthetic media, mainly thanks to the development of powerful methods based on generative adversarial networks (GAN). Very recently, methods based on diffusion models (DM)…

Computer Vision and Pattern Recognition · Computer Science 2022-11-03 Riccardo Corvi , Davide Cozzolino , Giada Zingarini , Giovanni Poggi , Koki Nagano , Luisa Verdoliva

Spoofing detection in financial trading is crucial, especially for identifying complex behaviors such as conspiracy spoofing. Traditional machine-learning approaches primarily focus on isolated node features, often overlooking the broader…

Machine Learning · Computer Science 2025-10-08 Sheng Xiang , Yidong Jiang , Yunting Chen , Dawei Cheng , Guoping Zhao , Changjun Jiang

Physics-inspired Generative Models (GMs), in particular Diffusion Models (DMs) and Poisson Flow Models (PFMs), enhance Bayesian methods and promise great utility in medical imaging. This review examines the transformative role of such…

Image and Video Processing · Electrical Eng. & Systems 2024-08-26 Dennis Hein , Afshin Bozorgpour , Dorit Merhof , Ge Wang

Multi-modal generative AI (Artificial Intelligence) has attracted increasing attention from both academia and industry. Particularly, two dominant families of techniques have emerged: i) Multi-modal large language models (LLMs) demonstrate…

Artificial Intelligence · Computer Science 2025-11-26 Xin Wang , Yuwei Zhou , Bin Huang , Hong Chen , Wenwu Zhu

Auto-encoding generative adversarial networks (GANs) combine the standard GAN algorithm, which discriminates between real and model-generated data, with a reconstruction loss given by an auto-encoder. Such models aim to prevent mode…

Machine Learning · Statistics 2017-10-24 Mihaela Rosca , Balaji Lakshminarayanan , David Warde-Farley , Shakir Mohamed

Medical generative models, acknowledged for their high-quality sample generation ability, have accelerated the fast growth of medical applications. However, recent works concentrate on separate medical generation models for distinct medical…

Image and Video Processing · Electrical Eng. & Systems 2024-03-08 Chenlu Zhan , Yu Lin , Gaoang Wang , Hongwei Wang , Jian Wu

Many scientific and engineering systems exhibit intrinsically multimodal behavior arising from latent regime switching and non-unique physical mechanisms. In such settings, learning the full conditional distribution of admissible outcomes…

Machine Learning · Computer Science 2026-02-12 Jinkyo Han , Bahador Bahmani

Generative models have shown great promise in generating 3D geometric systems, which is a fundamental problem in many natural science domains such as molecule and protein design. However, existing approaches only operate on static…

Computer Vision and Pattern Recognition · Computer Science 2024-10-18 Jiaqi Han , Minkai Xu , Aaron Lou , Haotian Ye , Stefano Ermon

The ability to learn robust multi-modality representation has played a critical role in the development of RGBT tracking. However, the regular fusion paradigm and the invariable tracking template remain restrictive to the feature…

Computer Vision and Pattern Recognition · Computer Science 2025-08-26 Ruichao Hou , Boyue Xu , Tongwei Ren , Gangshan Wu

Large diffusion-based Text-to-Image (T2I) models have shown impressive generative powers for text-to-image generation as well as spatially conditioned image generation. For most applications, we can train the model end-toend with paired…

Computer Vision and Pattern Recognition · Computer Science 2024-04-16 Nithin Gopalakrishnan Nair , Jeya Maria Jose Valanarasu , Vishal M Patel

Learning dynamical systems from sparse observations is critical in numerous fields, including biology, finance, and physics. Even if tackling such problems is standard in general information fusion, it remains challenging for contemporary…

Machine Learning · Computer Science 2024-06-04 Ella Tamir , Arno Solin

Anomaly detection (AD) has attracted considerable attention in both academia and industry. Due to the lack of anomalous data in many practical cases, AD is usually solved by first modeling the normal data pattern and then determining if…

Machine Learning · Computer Science 2022-11-17 Jingxuan Pang , Chunguang Li

Training deep learning methods on small time series datasets that also include corrupted samples is challenging. Diffusion models have shown to be effective to generate realistic and synthetic data, and correct corrupted samples through…

Machine Learning · Computer Science 2025-09-17 Julian Ripper , Ousama Esbel , Rafael Fietzek , Max Mühlhäuser , Thomas Kreutz

One of the most significant challenges in statistical signal processing and machine learning is how to obtain a generative model that can produce samples of large-scale data distribution, such as images and speeches. Generative Adversarial…

Computer Vision and Pattern Recognition · Computer Science 2020-05-28 Pegah Salehi , Abdolah Chalechale , Maryam Taghizadeh

Object detection has been extensively utilized in autonomous systems in recent years, encompassing both 2D and 3D object detection. Recent research in this field has primarily centered around multimodal approaches for addressing this…

Computer Vision and Pattern Recognition · Computer Science 2023-04-20 Wendong Zhang

Generative Adversarial Networks (GANs) have been shown to produce realistically looking synthetic images with remarkable success, yet their performance seems less impressive when the training set is highly diverse. In order to provide a…

Machine Learning · Computer Science 2018-08-31 Matan Ben-Yosef , Daphna Weinshall

In addition to enhancing traffic safety and facilitating prompt emergency response, traffic incident detection plays an indispensable role in intelligent transportation systems by providing real-time traffic status information. This enables…

Machine Learning · Computer Science 2024-03-05 Xinying Lu , Doudou Zhang , Jianli Xiao