English
Related papers

Related papers: A joint diffusion approach to multi-modal inferenc…

200 papers

Metal-organic frameworks (MOFs) are of immense interest in applications such as gas storage and carbon capture due to their exceptional porosity and tunable chemistry. Their modular nature has enabled the use of template-based methods to…

Chemical Physics · Physics 2023-10-19 Xiang Fu , Tian Xie , Andrew S. Rosen , Tommi Jaakkola , Jake Smith

Differential item functioning (DIF) detection is an important yet understudied problem in computerized adaptive testing (CAT). In this article, we proposed a two-level logistic model to improve DIF detection in CAT by explicitly accounting…

Applications · Statistics 2026-05-05 Dandan Chen Kaptur , Justin Kern , Chingwei David Shin , Jinming Zhang

Purely RGB-based vision models often fail to provide reliable cues in challenging scenarios such as nighttime and fog, leading to degraded performance and safety risks. Infrared imaging captures heat-emitting sources and provides critical…

Computer Vision and Pattern Recognition · Computer Science 2026-05-08 Yuchen Guo , Junli Gong , Wenjun Dong , Yiuming Cheung , Weifeng Su

Multi-satellite, multi-modality in-orbit fusion is a challenging task as it explores the fusion representation of complex high-dimensional data under limited computational resources. Deep neural networks can reveal the underlying…

Computer Vision and Pattern Recognition · Computer Science 2023-12-05 DaiXun Li , Weiying Xie , Yunsong Li , Leyuan Fang

Modeling and reconstructing multidimensional physical dynamics from sparse and off-grid observations presents a fundamental challenge in scientific research. Recently, diffusion-based generative modeling shows promising potential for…

Machine Learning · Computer Science 2025-09-30 Panqi Chen , Yifan Sun , Lei Cheng , Yang Yang , Weichang Li , Yang Liu , Weiqing Liu , Jiang Bian , Shikai Fang

Generative models are increasingly used to augment medical imaging datasets for fairer AI. Yet a key assumption often goes unexamined: that generators themselves produce equally high-quality images across demographic groups. Models trained…

Computer Vision and Pattern Recognition · Computer Science 2026-03-18 Mahmoud Ibrahim , Bart Elen , Chang Sun , Gokhan Ertaylan , Michel Dumontier

The existing generative adversarial fusion methods generally concatenate source images and extract local features through convolution operation, without considering their global characteristics, which tends to produce an unbalanced result…

Computer Vision and Pattern Recognition · Computer Science 2022-04-12 Zhishe Wang , Wenyu Shao , Yanlin Chen , Jiawei Xu , Xiaoqin Zhang

The diffusion model presents a powerful ability to capture the entire (conditional) data distribution. However, due to the lack of sufficient training and data to learn to cover low-probability areas, the model will be penalized for failing…

Computer Vision and Pattern Recognition · Computer Science 2026-04-01 Xingyu Zhou , Qifan Li , Xiaobin Hu , Hai Chen , Shuhang Gu

The integration of machine learning techniques into Inertial Confinement Fusion (ICF) simulations has emerged as a powerful approach for enhancing computational efficiency. By replacing the costly Non-Local Thermodynamic Equilibrium (NLTE)…

In an era where scientific experimentation is often costly, multi-fidelity emulation provides a powerful tool for predictive scientific computing. While there has been notable work on multi-fidelity modeling, existing models do not…

Beyond high-fidelity image synthesis, diffusion models have recently exhibited promising results in dense visual perception tasks. However, most existing work treats diffusion models as a standalone component for perception tasks, employing…

Computer Vision and Pattern Recognition · Computer Science 2025-12-18 Shuhong Zheng , Zhipeng Bao , Ruoyu Zhao , Martial Hebert , Yu-Xiong Wang

Collaborative 3D object detection holds significant importance in the field of autonomous driving, as it greatly enhances the perception capabilities of each individual agent by facilitating information exchange among multiple agents.…

Computer Vision and Pattern Recognition · Computer Science 2025-09-05 Zhe Huang , Shuo Wang , Yongcai Wang , Lei Wang

Prompt learning has demonstrated promising results in fine-tuning pre-trained multimodal models. However, the performance improvement is limited when applied to more complex and fine-grained tasks. The reason is that most existing methods…

Computer Vision and Pattern Recognition · Computer Science 2025-05-01 Weicai Yan , Wang Lin , Zirun Guo , Ye Wang , Fangming Feng , Xiaoda Yang , Zehan Wang , Tao Jin

We introduce Interleaved Gibbs Diffusion (IGD), a novel generative modeling framework for discrete-continuous data, focusing on problems with important, implicit and unspecified constraints in the data. Most prior works on discrete and…

Machine Learning · Computer Science 2025-07-04 Gautham Govind Anil , Sachin Yadav , Dheeraj Nagaraj , Karthikeyan Shanmugam , Prateek Jain

The recent popularity of text-to-image diffusion models (DM) can largely be attributed to the intuitive interface they provide to users. The intended generation can be expressed in natural language, with the model producing faithful…

Spatial profiling technologies in biology, such as imaging mass cytometry (IMC) and spatial transcriptomics (ST), generate high-dimensional, multi-channel data with strong spatial alignment and complex inter-channel relationships.…

Machine Learning · Computer Science 2025-07-08 Haoran Zhang , Mingyuan Zhou , Wesley Tansey

Diffusion probabilistic models have recently achieved remarkable success in generating high-quality images. However, balancing high perceptual quality and low distortion remains challenging in application of diffusion models in image…

Image and Video Processing · Electrical Eng. & Systems 2025-12-23 Juan Song , Jiaxiang He , Lijie Yang , Mingtao Feng , Keyan Wang

Solving medical imaging data scarcity through semantic image generation has attracted growing attention in recent years. However, existing generative models mainly focus on synthesizing whole-organ or large-tissue structures, showing…

Image and Video Processing · Electrical Eng. & Systems 2025-12-19 Jiahao Xia , Yutao Hu , Yaolei Qi , Zhenliang Li , Wenqi Shao , Junjun He , Ying Fu , Longjiang Zhang , Guanyu Yang

Generative modeling within constrained sets is essential for scientific and engineering applications involving physical, geometric, or safety requirements (e.g., molecular generation, robotics). We present a unified framework for…

Machine Learning · Computer Science 2026-04-21 Kijung Jeon , Michael Muehlebach , Molei Tao

Diffusion models are the standard toolkit for generative modelling of 3D atomic systems. However, for different types of atomic systems -- such as molecules and materials -- the generative processes are usually highly specific to the target…