English
Related papers

Related papers: Retrieval Augmented Diffusion Model for Structure-…

200 papers

Medical image segmentation models struggle with rare abnormalities due to scarce annotated pathological data. We propose DiffAug a novel framework that combines textguided diffusion-based generation with automatic segmentation validation to…

Computer Vision and Pattern Recognition · Computer Science 2025-08-26 Maham Nazir , Muhammad Aqeel , Francesco Setti

Denoising diffusion models (DDMs) have recently attracted increasing attention by showing impressive synthesis quality. DDMs are built on a diffusion process that pushes data to the noise distribution and the models learn to denoise. In…

Machine Learning · Computer Science 2023-05-16 Jaemoo Choi , Yesom Park , Myungjoo Kang

Learning-based planners generate natural human-like driving behaviors by learning to reason about nuanced interactions from data, overcoming the rigid behaviors that arise from rule-based planners. Nonetheless, data-driven approaches often…

Robotics · Computer Science 2025-06-02 Wenhao Ding , Sushant Veer , Yuxiao Chen , Yulong Cao , Chaowei Xiao , Marco Pavone

Diffusion Probabilistic Models (DPMs) have recently shown remarkable performance in image generation tasks, which are capable of generating highly realistic images. When adopting DPMs for image restoration tasks, the crucial aspect lies in…

Computer Vision and Pattern Recognition · Computer Science 2023-06-01 Yi Zhang , Xiaoyu Shi , Dasong Li , Xiaogang Wang , Jian Wang , Hongsheng Li

Current deep learning approaches in computer vision primarily focus on RGB data sacrificing information. In contrast, RAW images offer richer representation, which is crucial for precise recognition, particularly in challenging conditions…

Computer Vision and Pattern Recognition · Computer Science 2024-11-21 Christoph Reinders , Radu Berdan , Beril Besbinar , Junji Otsuka , Daisuke Iso

3D human motion generation is crucial for creative industry. Recent advances rely on generative models with domain knowledge for text-driven motion generation, leading to substantial progress in capturing common motions. However, the…

Computer Vision and Pattern Recognition · Computer Science 2023-04-04 Mingyuan Zhang , Xinying Guo , Liang Pan , Zhongang Cai , Fangzhou Hong , Huirong Li , Lei Yang , Ziwei Liu

Retrieval-Augmented Generation (RAG) systems have recently shown remarkable advancements by integrating retrieval mechanisms into language models, enhancing their ability to produce more accurate and contextually relevant responses.…

Computation and Language · Computer Science 2025-01-14 Siran Li , Linus Stenzel , Carsten Eickhoff , Seyed Ali Bahrainian

Generative models for structure-based molecular design hold significant promise for drug discovery, with the potential to speed up the hit-to-lead development cycle, while improving the quality of drug candidates and reducing costs. Data…

Machine Learning · Statistics 2022-04-25 Lucian Chan , Rajendra Kumar , Marcel Verdonk , Carl Poelking

Diffusion models offer a powerful means of capturing the manifold of realistic protein structures, enabling rapid design for protein engineering tasks. However, existing approaches observe critical failure modes when precise constraints are…

Biomolecules · Quantitative Biology 2026-03-27 Jacob K. Christopher , Austin Seamann , Jingyi Cui , Sagar Khare , Ferdinando Fioretto

Distributed search problems are ubiquitous in Artificial Life (ALife). Many distributed search problems require identifying a rare and previously unseen event and producing a rapid response. This challenge amounts to finding and removing an…

Neural and Evolutionary Computing · Computer Science 2011-02-25 Melanie Moses , Soumya Banerjee

As the deep learning revolution marches on, masked modeling has emerged as a distinctive approach that involves predicting parts of the original data that are proportionally masked during training, and has demonstrated exceptional…

Image and Video Processing · Electrical Eng. & Systems 2025-06-25 Qinrong Cai , Yu Guan , Zhibo Chen , Dong Liang , Qiuyun Fan , Qiegen Liu

Unsupervised anomaly detection (UAD) based on deep generative modelling has been increasingly explored for identifying pathological brain abnormalities without requiring voxel-level annotations. By learning the distribution of healthy…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Youwan Mahé , Elise Bannier , Stéphanie Leplaideur , Elisa Fromont , Francesca Galassi

The rational design of molecules with desired properties is a long-standing challenge in chemistry. Generative neural networks have emerged as a powerful approach to sample novel molecules from a learned distribution. Here, we propose a…

In recent decades, antibodies have emerged as indispensable therapeutics for combating diseases, particularly viral infections. However, their development has been hindered by limited structural information and labor-intensive engineering…

Biomolecules · Quantitative Biology 2023-09-01 Hongtai Jing , Zhengtao Gao , Sheng Xu , Tao Shen , Zhangzhi Peng , Shwai He , Tao You , Shuang Ye , Wei Lin , Siqi Sun

Retrieval-augmented generation (RAG) has emerged to address the knowledge-intensive visual question answering (VQA) task. Current methods mainly employ separate retrieval and generation modules to acquire external knowledge and generate…

Computer Vision and Pattern Recognition · Computer Science 2025-02-25 Xinwei Long , Zhiyuan Ma , Ermo Hua , Kaiyan Zhang , Biqing Qi , Bowen Zhou

Imputation of missing images via source-to-target modality translation can improve diversity in medical imaging protocols. A pervasive approach for synthesizing target images involves one-shot mapping through generative adversarial networks…

Image and Video Processing · Electrical Eng. & Systems 2023-04-03 Muzaffer Özbey , Onat Dalmaz , Salman UH Dar , Hasan A Bedel , Şaban Özturk , Alper Güngör , Tolga Çukur

Despite the success of deep learning across various domains, it remains vulnerable to adversarial attacks. Although many existing adversarial attack methods achieve high success rates, they typically rely on $\ell_{p}$-norm perturbation…

Computer Vision and Pattern Recognition · Computer Science 2025-10-31 Chihan Huang , Hao Tang

Generative AI has the potential to revolutionize drug discovery. Yet, despite recent advances in deep learning, existing models cannot generate molecules that satisfy all desired physicochemical properties. Herein, we describe IDOLpro, a…

Chemical Physics · Physics 2025-04-29 Amit Kadan , Kevin Ryczko , Erika Lloyd , Adrian Roitberg , Takeshi Yamazaki

The reconstruction of unsteady flow fields from limited measurements is a challenging and crucial task for many engineering applications. Machine learning models are gaining popularity for solving this problem due to their ability to learn…

Fluid Dynamics · Physics 2026-01-09 Marc Amorós-Trepat , Luis Medrano-Navarro , Qiang Liu , Luca Guastoni , Nils Thuerey

Retrieval-Augmented Generation (RAG), by integrating non-parametric knowledge from external knowledge bases into models, has emerged as a promising approach to enhancing response accuracy while mitigating factual errors and hallucinations.…

Information Retrieval · Computer Science 2025-09-12 Qitao Qin , Yucong Luo , Yihang Lu , Zhibo Chu , Xiaoman Liu , Xianwei Meng