English
Related papers

Related papers: ContinualFlow: Learning and Unlearning with Neural…

200 papers

Continual learning is the ability to sequentially learn over time by accommodating knowledge while retaining previously learned experiences. Neural networks can learn multiple tasks when trained on them jointly, but cannot maintain…

Machine Learning · Computer Science 2018-10-26 Frantzeska Lavda , Jason Ramapuram , Magda Gregorova , Alexandros Kalousis

Generative machine learning models have been demonstrated to be able to learn low dimensional representations of data that preserve information required for downstream tasks. In this work, we demonstrate that flow matching based generative…

Cosmology and Nongalactic Astrophysics · Physics 2025-07-17 Sidharth Kannan , Tian Qiu , Carolina Cuesta-Lazaro , Haewon Jeong

Diffusion and flow matching approaches to generative modeling have shown promise in domains where the state space is continuous, such as image generation or protein folding & design, and discrete, exemplified by diffusion large language…

Reinforcement learning has emerged as a promising paradigm for aligning diffusion and flow-matching models with human preferences, yet practitioners face fragmented codebases, model-specific implementations, and engineering complexity. We…

Machine Learning · Computer Science 2026-03-17 Bowen Ping , Chengyou Jia , Minnan Luo , Hangwei Qian , Ivor Tsang

Inferring physical fields from sparse observations while strictly satisfying partial differential equations (PDEs) is a fundamental challenge in computational physics. Recently, deep generative models offer powerful data-driven priors for…

Machine Learning · Computer Science 2026-01-29 Zichao Yu , Ming Li , Wenyi Zhang , Difan Zou , Weiguo Gao

Generative modeling provides a powerful framework for learning data distributions. These models initially relied on probabilistic methods such as Gaussian Processes (GP) for uncertainty-aware predictions and shifted towards larger trainable…

Flow-based generative models are composed of invertible transformations between two random variables of the same dimension. Therefore, flow-based models cannot be adequately trained if the dimension of the data distribution does not match…

Computer Vision and Pattern Recognition · Computer Science 2020-11-17 Hyeongju Kim , Hyeonseung Lee , Woo Hyun Kang , Joun Yeop Lee , Nam Soo Kim

Coarse-grained (CG) molecular simulations have become a standard tool to study molecular processes on time- and length-scales inaccessible to all-atom simulations. Parameterizing CG force fields to match all-atom simulations has mainly…

Computational Physics · Physics 2023-02-07 Jonas Köhler , Yaoyi Chen , Andreas Krämer , Cecilia Clementi , Frank Noé

Recent advances in generative machine learning models rekindled research interest in the area of password guessing. Data-driven password guessing approaches based on GANs, language models and deep latent variable models have shown…

Cryptography and Security · Computer Science 2021-12-15 Giulio Pagnotta , Dorjan Hitaj , Fabio De Gaspari , Luigi V. Mancini

Continuous normalizing flows (CNFs) learn an ordinary differential equation to transform prior samples into data. Flow matching (FM) has recently emerged as a simulation-free approach for training CNFs by regressing a velocity model towards…

Machine Learning · Statistics 2024-05-28 Tianyu Xie , Yu Zhu , Longlin Yu , Tong Yang , Ziheng Cheng , Shiyue Zhang , Xiangyu Zhang , Cheng Zhang

Modern machine learning systems need to be able to cope with constantly arriving and changing data. Two main areas of research dealing with such scenarios are continual learning and data stream mining. Continual learning focuses on…

Machine Learning · Computer Science 2021-04-27 Łukasz Korycki , Bartosz Krawczyk

In this work, we introduce JDCL - a new method for continual learning with generative rehearsal based on joint diffusion models. Neural networks suffer from catastrophic forgetting defined as abrupt loss in the model's performance when…

Machine Learning · Computer Science 2025-10-07 Paweł Skierś , Kamil Deja

Conformal unlearning aims to ensure that a trained conformal predictor miscovers data points with specific shared characteristics, such as those from a particular label class, associated with a specific user, or belonging to a defined…

Machine Learning · Computer Science 2026-02-13 Yahya Alkhatib , Muhammad Ahmar Jamal , Wee Peng Tay

We introduce a dynamics-level approach to watermarking generative models. Rather than embedding signals into model weights or outputs, we embed the watermark directly into the learned continuous dynamics -- the velocity field of a flow…

Machine Learning · Computer Science 2026-05-18 Shuchan Wang

Text-to-image (T2I) diffusion models have achieved impressive image generation quality and are increasingly fine-tuned for personalized applications. However, these models often inherit unsafe behaviors from toxic pretraining data, raising…

Machine Learning · Computer Science 2025-12-09 Boheng Li , Renjie Gu , Junjie Wang , Leyi Qi , Yiming Li , Run Wang , Zhan Qin , Tianwei Zhang

Continual learning remains a fundamental challenge in artificial intelligence, with catastrophic forgetting posing a significant barrier to deploying neural networks in dynamic environments. Inspired by biological memory consolidation…

Machine Learning · Computer Science 2025-12-19 Goutham Nalagatla , Shreyas Grandhe

Continuous diffusion has been the foundation of high-fidelity, controllable, and few-step generation of many data modalities such as images. However, in language modeling, prior continuous diffusion language models (DLMs) lag behind…

Computation and Language · Computer Science 2026-04-16 Yuxin Chen , Chumeng Liang , Hangke Sui , Ruihan Guo , Chaoran Cheng , Jiaxuan You , Ge Liu

Generative models, particularly diffusion model, have emerged as powerful tools for sequential recommendation. However, accurately modeling user preferences remains challenging due to the noise perturbations inherent in the forward and…

Information Retrieval · Computer Science 2025-05-23 Feng Liu , Lixin Zou , Xiangyu Zhao , Min Tang , Liming Dong , Dan Luo , Xiangyang Luo , Chenliang Li

Machine unlearning aims to remove the influence of specific training data from a learned model without full retraining. While recent work has begun to explore unlearning in quantum machine learning, existing approaches largely rely on…

Machine Learning · Computer Science 2026-02-10 Nausherwan Malik , Zubair Khalid , Muhammad Faryad

Strong semantic representations improve the convergence and generation quality of diffusion and flow models. Existing approaches largely rely on external models, which require separate training, operate on misaligned objectives, and exhibit…

Computer Vision and Pattern Recognition · Computer Science 2026-03-09 Hila Chefer , Patrick Esser , Dominik Lorenz , Dustin Podell , Vikash Raja , Vinh Tong , Antonio Torralba , Robin Rombach