English
Related papers

Related papers: Multimodal Diffusion to Mutually Enhance Polarized…

200 papers

Multi-target detection (MTD) is the problem of estimating an image from a large, noisy measurement that contains randomly translated and rotated copies of the image. Motivated by the single-particle cryo-electron microscopy technology, we…

Signal Processing · Electrical Eng. & Systems 2023-12-15 Alon Zabatani , Shay Kreymer , Tamir Bendory

In ill-posed inverse problems, it is commonly desirable to obtain insight into the full spectrum of plausible solutions, rather than extracting only a single reconstruction. Information about the plausible solutions and their likelihoods is…

Computer Vision and Pattern Recognition · Computer Science 2024-05-14 Omer Yair , Elias Nehme , Tomer Michaeli

Score-based diffusion models learn to reverse a stochastic differential equation that maps data to noise. However, for complex tasks, numerical error can compound and result in highly unnatural samples. Previous work mitigates this drift…

Machine Learning · Statistics 2023-06-12 Aaron Lou , Stefano Ermon

Electron back-scatter diffraction (EBSD) has traditionally relied upon methods such as the Hough transform and dictionary Indexing to interpret diffraction patterns and extract crystallographic orientation. However, these methods encounter…

Materials Science · Physics 2025-11-04 Meghraj Prajapat , Alankar Alankar

Previous raw image-based low-light image enhancement methods predominantly relied on feed-forward neural networks to learn deterministic mappings from low-light to normally-exposed images. However, they failed to capture critical…

Computer Vision and Pattern Recognition · Computer Science 2023-08-16 Yufei Wang , Yi Yu , Wenhan Yang , Lanqing Guo , Lap-Pui Chau , Alex C. Kot , Bihan Wen

Using diffusion models to solve inverse problems is a growing field of research. Current methods assume the degradation to be known and provide impressive results in terms of restoration quality and diversity. In this work, we leverage the…

Computer Vision and Pattern Recognition · Computer Science 2025-06-02 Charles Laroche , Andrés Almansa , Eva Coupete

Training diffusion models requires large datasets. However, acquiring large volumes of high-quality data can be challenging, for example, collecting large numbers of high-resolution images and long videos. On the other hand, there are many…

Computer Vision and Pattern Recognition · Computer Science 2025-05-20 Xudong Ma

While many approaches exist in the literature to learn low-dimensional representations for data collections in multiple modalities, the generalizability of multi-modal nonlinear embeddings to previously unseen data is a rather overlooked…

Machine Learning · Computer Science 2021-05-05 Semih Kaya , Elif Vural

When inverting solar spectra, image degradation effects that are present in the data are usually approximated or not considered. We develop a data reduction method that takes these issues into account and minimizes the resulting errors. By…

Instrumentation and Methods for Astrophysics · Physics 2015-06-11 M. van Noort

Multi-modal image fusion aims to consolidate complementary information from diverse source images into a unified representation. The fused image is expected to preserve fine details and maintain high visual fidelity. While diffusion models…

Computer Vision and Pattern Recognition · Computer Science 2026-01-29 Xingxin Xu , Bing Cao , DongDong Li , Qinghua Hu , Pengfei Zhu

Diffusion probabilistic models have achieved remarkable success in generative tasks across diverse data types. While recent studies have explored alternative degradation processes beyond Gaussian noise, this paper bridges two key diffusion…

Computer Vision and Pattern Recognition · Computer Science 2025-11-24 Hao-Chien Hsueh , Chi-En Yen , Wen-Hsiao Peng , Ching-Chun Huang

Generating multiview images from a single view facilitates the rapid generation of a 3D mesh conditioned on a single image. Recent methods that introduce 3D global representation into diffusion models have shown the potential to generate…

Computer Vision and Pattern Recognition · Computer Science 2024-04-03 Zehuan Huang , Hao Wen , Junting Dong , Yaohui Wang , Yangguang Li , Xinyuan Chen , Yan-Pei Cao , Ding Liang , Yu Qiao , Bo Dai , Lu Sheng

Electron Backscatter Diffraction (EBSD) is a technique to obtain microcrystallographic information from materials by collecting large-angle Kikuchi patterns in the scanning electron microscope (SEM). An important fundamental question…

Materials Science · Physics 2019-03-06 Aimo Winkelmann , T. Ben Britton , Gert Nolze

Precession of a converged beam during acquisition of a 4D-STEM dataset improves strain, orientation, and phase mapping accuracy by averaging over continuous angles of illumination. Precession experiments usually rely on integrated systems,…

Instrumentation and Detectors · Physics 2025-10-20 Stephanie M. Ribet , Rohan Dhall , Colin Ophus , Karen C. Bustillo

Diffusion models have gained attention for their ability to represent complex distributions and incorporate uncertainty, making them ideal for robust predictions in the presence of noisy or incomplete data. In this study, we develop and…

Machine Learning · Computer Science 2024-11-05 Yilin Zhuang , Sibo Cheng , Karthik Duraisamy

Diffusion models have demonstrated exceptional ability in modeling complex image distributions, making them versatile plug-and-play priors for solving imaging inverse problems. However, their reliance on large-scale clean datasets for…

Computer Vision and Pattern Recognition · Computer Science 2024-10-16 Weimin Bai , Weiheng Tang , Enze Ye , Siyi Chen , Wenzheng Chen , He Sun

In this two-part paper, we present a novel framework and methodology to analyze data from certain image-based biochemical assays, e.g., ELISPOT and Fluorospot assays. In this first part, we start by presenting a physical partial…

Signal Processing · Electrical Eng. & Systems 2018-10-19 Pol del Aguila Pla , Joakim Jaldén

The use of highly sensitive pixelated direct detectors has dramatically improved the performance of high energy instrumentation such as transmission electron microscopy. Here, we describe a recently developed monolithic active pixel sensor…

Conditional diffusion probabilistic models can model the distribution of natural images and can generate diverse and realistic samples based on given conditions. However, oftentimes their results can be unrealistic with observable color…

Computer Vision and Pattern Recognition · Computer Science 2022-12-15 Kangfu Mei , Nithin Gopalakrishnan Nair , Vishal M. Patel

Advances in microscopy imaging enable researchers to visualize structures at the nanoscale level thereby unraveling intricate details of biological organization. However, challenges such as image noise, photobleaching of fluorophores, and…

Image and Video Processing · Electrical Eng. & Systems 2024-09-19 Pamela Osuna-Vargas , Maren H. Wehrheim , Lucas Zinz , Johanna Rahm , Ashwin Balakrishnan , Alexandra Kaminer , Mike Heilemann , Matthias Kaschube