English
Related papers

Related papers: Information loss, entropy production and time reve…

200 papers

While diffusion models excel at generating high-quality samples, their latent variables typically lack semantic meaning and are not suitable for representation learning. Here, we propose InfoDiffusion, an algorithm that augments diffusion…

Machine Learning · Computer Science 2023-06-16 Yingheng Wang , Yair Schiff , Aaron Gokaslan , Weishen Pan , Fei Wang , Christopher De Sa , Volodymyr Kuleshov

In this paper, we propose a method to solve the image restoration problem, which tries to restore the details of a corrupted image, especially due to the loss caused by JPEG compression. We have treated an image in the frequency domain to…

Computer Vision and Pattern Recognition · Computer Science 2018-05-24 Jaeyoung Yoo , Sang-ho Lee , Nojun Kwak

1. Strong and weak notions of erasure are distinguished according to whether the single erasure procedure does or does not leave the environment in the same state independently of the pre-erasure state. 2. Purely thermodynamic…

History and Philosophy of Physics · Physics 2025-02-26 John D. Norton

Dynamic modulation of material properties in space and time enables powerful control over wave propagation, yet existing theories largely rely on idealized, nondispersive models. In realistic media, frequency dispersion can strongly reshape…

Optics · Physics 2026-04-02 Klaas De Kinder , Christophe Caloz

Spatial resolution of most imaging devices is fundamentally restricted by diffraction. This limitation is manifested in the loss of high spatial frequency information contained in evanescent waves. As a result, conventional far-field optics…

Optics · Physics 2010-03-16 Leonid Alekseyev , Evgenii Narimanov , Jacob Khurgin

From the earth's crust to the human brain, remitted waves are used for sensing and imaging in a diverse range of diffusive media. Separating the source and detector increases the penetration depth of remitted light, yet rapidly decreases…

Changing the microstructure properties of a space-time metamaterial while a wave is propagating through it, in general requires addition or removal of energy, which can be of exponential form depending on the type of modulation. This limits…

Classical Physics · Physics 2022-08-10 Kshiteej J. Deshmukh , Graeme W. Milton

For sensory networks, we determine the rate with which they acquire information about the changing external conditions. Comparing this rate with the thermodynamic entropy production that quantifies the cost of maintaining the network, we…

Statistical Mechanics · Physics 2013-04-08 A. C. Barato , D Hartich , U. Seifert

Denoising diffusion models enable conditional generation and density modeling of complex relationships like images and text. However, the nature of the learned relationships is opaque making it difficult to understand precisely what…

Machine Learning · Computer Science 2024-05-21 Xianghao Kong , Ollie Liu , Han Li , Dani Yogatama , Greg Ver Steeg

Denoising diffusion models (DDMs) have recently attracted increasing attention by showing impressive synthesis quality. DDMs are built on a diffusion process that pushes data to the noise distribution and the models learn to denoise. In…

Machine Learning · Computer Science 2023-05-16 Jaemoo Choi , Yesom Park , Myungjoo Kang

Observable scattering processes entail emission-absorption of soft photons. As these degrees of freedom go undetected, some information is lost. Whether some of this information can be recovered in the observation of the hard photons,…

High Energy Physics - Theory · Physics 2023-05-04 Xuan-Lin Su , Alioscia Hamma , Antonino Marciano

The diffusion-based adversarial purification methods attempt to drown adversarial perturbations into a part of isotropic noise through the forward process, and then recover the clean images through the reverse process. Due to the lack of…

Computer Vision and Pattern Recognition · Computer Science 2025-12-09 Gaozheng Pei , Ke Ma , Yingfei Sun , Qianqian Xu , Qingming Huang

In this paper we consider the problem of acoustic inversion in the context of the optoacoustic tomography image reconstruction problem. By leveraging the ability of the recently proposed diffusion models for image generative tasks among…

Image and Video Processing · Electrical Eng. & Systems 2024-04-17 M. G. González , M. Vera , A. Dreszman , L. J. Rey Vega

Image restoration is a classic low-level problem aimed at recovering high-quality images from low-quality images with various degradations such as blur, noise, rain, haze, etc. However, due to the inherent complexity and non-uniqueness of…

Computer Vision and Pattern Recognition · Computer Science 2024-07-08 Yuhong Zhang , Hengsheng Zhang , Xinning Chai , Zhengxue Cheng , Rong Xie , Li Song , Wenjun Zhang

Established image recovery methods in fast ultrasound imaging, e.g. delay-and-sum, trade the image quality for the high frame rate. Cutting-edge inverse scattering methods based on compressed sensing (CS) disrupt this tradeoff via a priori…

Medical Physics · Physics 2019-03-15 Martin F. Schiffner

Generative diffusion models have achieved remarkable success in producing high-quality images. However, these models typically operate in continuous intensity spaces, diffusing independently across pixels and color channels. As a result,…

Graphics · Computer Science 2025-05-20 Javier E. Santos , Agnese Marcato , Roman Colman , Nicholas Lubbers , Yen Ting Lin

We present the first diffusion-based framework that can learn an unknown distribution using only highly-corrupted samples. This problem arises in scientific applications where access to uncorrupted samples is impossible or expensive to…

Machine Learning · Computer Science 2023-05-31 Giannis Daras , Kulin Shah , Yuval Dagan , Aravind Gollakota , Alexandros G. Dimakis , Adam Klivans

Light microscopy is a widespread and inexpensive imaging technique facilitating biomedical discovery and diagnostics. However, light diffraction barrier and imperfections in optics limit the level of detail of the acquired images. The…

Quantitative Methods · Quantitative Biology 2026-03-24 Rui Li , Gabriel della Maggiora , Vardan Andriasyan , Anthony Petkidis , Artsemi Yushkevich , Mikhail Kudryashev , Artur Yakimovich

Non-destructive testing using ultrasound is based on the interaction of sound waves with the object being tested and any defects it may contain. The aim is to extract as much information as possible about the object and its defects from the…

Signal Processing · Electrical Eng. & Systems 2026-04-01 Frank Schubert

Standard diffusion models involve an image transform -- adding Gaussian noise -- and an image restoration operator that inverts this degradation. We observe that the generative behavior of diffusion models is not strongly dependent on the…

Computer Vision and Pattern Recognition · Computer Science 2022-08-22 Arpit Bansal , Eitan Borgnia , Hong-Min Chu , Jie S. Li , Hamid Kazemi , Furong Huang , Micah Goldblum , Jonas Geiping , Tom Goldstein