English
Related papers

Related papers: Inverting Data Transformations via Diffusion Sampl…

200 papers

Inverting visual representations within deep neural networks (DNNs) presents a challenging and important problem in the field of security and privacy for deep learning. The main goal is to invert the features of an unidentified target image…

Computer Vision and Pattern Recognition · Computer Science 2024-12-17 Sai Qian Zhang , Ziyun Li , Chuan Guo , Saeed Mahloujifar , Deeksha Dangwal , Edward Suh , Barbara De Salvo , Chiao Liu

We introduce a general framework for solving partial differential equations (PDEs) using generative diffusion models. In particular, we focus on the scenarios where we do not have the full knowledge of the scene necessary to apply classical…

Machine Learning · Computer Science 2024-11-04 Jiahe Huang , Guandao Yang , Zichen Wang , Jeong Joon Park

Extrapolation remains a grand challenge in deep neural networks across all application domains. We propose an operator learning method to solve time-dependent partial differential equations (PDEs) continuously and with extrapolation in time…

Machine Learning · Computer Science 2023-12-12 Oded Ovadia , Vivek Oommen , Adar Kahana , Ahmad Peyvan , Eli Turkel , George Em Karniadakis

In this paper, we propose Test-Time Training, a general approach for improving the performance of predictive models when training and test data come from different distributions. We turn a single unlabeled test sample into a self-supervised…

Machine Learning · Computer Science 2020-07-03 Yu Sun , Xiaolong Wang , Zhuang Liu , John Miller , Alexei A. Efros , Moritz Hardt

Training Data Attribution (TDA) seeks to trace model predictions back to influential training examples, enhancing interpretability and safety. We formulate TDA as a Bayesian information-theoretic problem: subsets are scored by the…

Machine Learning · Computer Science 2026-04-10 Dharmesh Tailor , Nicolò Felicioni , Kamil Ciosek

We study variance reduction for score estimation and diffusion-based sampling in settings where the clean (target) score is available or can be approximated. Starting from the Target Score Identity (TSI), which expresses the noisy marginal…

Machine Learning · Statistics 2026-01-26 Alois Duston , Tan Bui-Thanh

This paper considers the inverse problem of recovering state-dependent source terms in a reaction-diffusion system from overposed data consisting of the values of the state variables either at a fixed finite time (census-type data) or a…

Numerical Analysis · Mathematics 2020-08-26 Barbara Kaltenbacher , William Rundell

Diffusion or score-based models recently showed high performance in image generation. They rely on a forward and a backward stochastic differential equations (SDE). The sampling of a data distribution is achieved by numerically solving the…

Machine Learning · Computer Science 2025-06-04 Emile Pierret , Bruno Galerne

Causal language models have demonstrated remarkable capabilities, but their size poses significant challenges for deployment in resource-constrained environments. Knowledge distillation, a widely-used technique for transferring knowledge…

Machine Learning · Computer Science 2025-03-03 Makoto Shing , Kou Misaki , Han Bao , Sho Yokoi , Takuya Akiba

Real-world data generation often involves complex inter-dependencies among instances, violating the IID-data hypothesis of standard learning paradigms and posing a challenge for uncovering the geometric structures for learning desired…

Machine Learning · Computer Science 2023-05-30 Qitian Wu , Chenxiao Yang , Wentao Zhao , Yixuan He , David Wipf , Junchi Yan

Electrical impedance tomography (EIT) is a non-invasive imaging technique, capable of reconstructing images of the electrical conductivity of tissues and materials. It is popular in diverse application areas, from medical imaging to…

Computer Vision and Pattern Recognition · Computer Science 2024-12-24 Shuaikai Shi , Ruiyuan Kang , Panos Liatsis

Learning-based Text-to-Image (TTI) models like Stable Diffusion have revolutionized the way visual content is generated in various domains. However, recent research has shown that nonnegligible social bias exists in current state-of-the-art…

Computer Vision and Pattern Recognition · Computer Science 2024-02-23 Ruifei He , Chuhui Xue , Haoru Tan , Wenqing Zhang , Yingchen Yu , Song Bai , Xiaojuan Qi

We propose $\textit{iterative inversion}$ -- an algorithm for learning an inverse function without input-output pairs, but only with samples from the desired output distribution and access to the forward function. The key challenge is a…

Machine Learning · Computer Science 2023-05-31 Gal Leibovich , Guy Jacob , Or Avner , Gal Novik , Aviv Tamar

Diffusion models generate high-dimensional data such as images by learning a process that gradually removes noise from corrupted data. Recent studies have shown that the backward dynamics of diffusion models exhibit two characteristic…

Statistical Mechanics · Physics 2026-04-14 Tomoei Takahashi , Takashi Takahashi , Yoshiyuki Kabashima

Hiding data using neural networks (i.e., neural steganography) has achieved remarkable success across both discriminative classifiers and generative adversarial networks. However, the potential of data hiding in diffusion models remains…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Haoyu Chen , Yunqiao Yang , Nan Zhong , Kede Ma

We present a mechanism to steer the sampling diversity of denoising diffusion and flow matching models, allowing users to sample from a sharper or broader distribution than the training distribution. We build on the observation that these…

Machine Learning · Computer Science 2026-05-26 Yanbo Xu , Yu Wu , Sungjae Park , Zhizhuo Zhou , Shubham Tulsiani

Score-based diffusion models have recently emerged as state-of-the-art generative models for a variety of data modalities. Nonetheless, it remains unclear how to adapt these models to generate long multivariate time series. Viewing a time…

Machine Learning · Computer Science 2025-02-28 Barbora Barancikova , Zhuoyue Huang , Cristopher Salvi

The proliferation of diffusion models trained on web-scale, provenance-uncertain image collections has made it essential, yet technically unresolved, to determine whether a model has learned from specific copyrighted data without…

Machine Learning · Computer Science 2026-04-06 Muxing Li , Zesheng Ye , Sharon Li , Andy Song , Guangquan Zhang , Feng Liu

As diffusion models become increasingly popular, the misuse of copyrighted and private images has emerged as a major concern. One promising solution to mitigate this issue is identifying the contribution of specific training samples in…

Machine Learning · Computer Science 2025-03-24 Jinxu Lin , Linwei Tao , Minjing Dong , Chang Xu

Real-world datasets are inherently heterogeneous, yet how per-class structural differences and sampling imbalance shape the training dynamics of diffusion models-and potentially exacerbate disparities-remains poorly understood. While models…

Machine Learning · Statistics 2026-05-08 Flavio Nicoletti , Chenxiao Ma , Enrico Ventura , Luca Saglietti , Stefano Sarao Mannelli