English
Related papers

Related papers: Mask prior-guided denoising diffusion improves inv…

200 papers

Inverse protein folding, the process of designing sequences that fold into a specific 3D structure, is crucial in bio-engineering and drug discovery. Traditional methods rely on experimentally resolved structures, but these cover only a…

Biomolecules · Quantitative Biology 2023-11-27 Igor Melnyk , Aurelie Lozano , Payel Das , Vijil Chenthamarakshan

Code generation is increasingly critical for real-world applications. Still, diffusion-based large language models continue to struggle with this demand. Unlike free-form text, code requires syntactic precision; even minor structural…

Computation and Language · Computer Science 2026-01-07 Yiming Zeng , Jinghan Cao , Zexin Li , Yiming Chen , Tao Ren , Zhuochun Li , Dawei Xiang , Xidong Wu , Shangqian Gao , Tingting Yu

Inverse protein folding is a fundamental task in computational protein design, which aims to design protein sequences that fold into the desired backbone structures. While the development of machine learning algorithms for this task has…

Machine Learning · Computer Science 2024-11-05 Yiheng Zhu , Jialu Wu , Qiuyi Li , Jiahuan Yan , Mingze Yin , Wei Wu , Mingyang Li , Jieping Ye , Zheng Wang , Jian Wu

Generative models have recently undergone significant advancement due to the diffusion models. The success of these models can be often attributed to their use of guidance techniques, such as classifier or classifier-free guidance, which…

Computer Vision and Pattern Recognition · Computer Science 2023-01-31 Gyeongnyeon Kim , Wooseok Jang , Gyuseong Lee , Susung Hong , Junyoung Seo , Seungryong Kim

Protein inverse folding-that is, predicting an amino acid sequence that will fold into the desired 3D structure-is an important problem for structure-based protein design. Machine learning based methods for inverse folding typically use…

Artificial Intelligence · Computer Science 2024-10-23 Yasha Ektefaie , Olivia Viessmann , Siddharth Narayanan , Drew Dresser , J. Mark Kim , Armen Mkrtchyan

Masked (or absorbing) diffusion is actively explored as an alternative to autoregressive models for generative modeling of discrete data. However, existing work in this area has been hindered by unnecessarily complex model formulations and…

Machine Learning · Computer Science 2025-01-17 Jiaxin Shi , Kehang Han , Zhe Wang , Arnaud Doucet , Michalis K. Titsias

Inpainting arbitrary missing regions is challenging because learning valid features for various masked regions is nontrivial. Though U-shaped encoder-decoder frameworks have been witnessed to be successful, most of them share a common…

Computer Vision and Pattern Recognition · Computer Science 2021-05-19 Manyu Zhu , Dongliang He , Xin Li , Chao Li , Fu Li , Xiao Liu , Errui Ding , Zhaoxiang Zhang

Dynamic point cloud pretraining is still dominated by masked reconstruction objectives. However, these objectives inherit two key limitations. Existing methods inject ground-truth tube centers as decoder positional embeddings, causing…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Zhuoyue Zhang , Jihua Zhu , Chaowei Fang , Jian Liu , Ajmal Saeed Mian

Protein inverse folding is a fundamental problem in bioinformatics, aiming to recover the amino acid sequences from a given protein backbone structure. Despite the success of existing methods, they struggle to fully capture the intricate…

Machine Learning · Computer Science 2024-12-13 Chenglin Wang , Yucheng Zhou , Zijie Zhai , Jianbing Shen , Kai Zhang

Deep learning models can predict protein properties with unprecedented accuracy but rarely offer mechanistic insight or actionable guidance for engineering improved variants. When a model flags an antibody as unstable, the protein engineer…

Machine Learning · Computer Science 2026-03-12 Weronika Kłos , Sidney Bender , Lukas Kades

Discrete diffusion models have recently shown great promise for modeling complex discrete data, with masked diffusion models (MDMs) offering a compelling trade-off between quality and generation speed. MDMs denoise by progressively…

Machine Learning · Computer Science 2026-04-15 Tianyu Xie , Shuchen Xue , Zijin Feng , Tianyang Hu , Jiacheng Sun , Zhenguo Li , Cheng Zhang

Structure-based drug design (SBDD), which aims to generate molecules that can bind tightly to the target protein, is an essential problem in drug discovery, and previous approaches have achieved initial success. However, most existing…

Machine Learning · Computer Science 2024-04-04 Xinze Li , Penglei Wang , Tianfan Fu , Wenhao Gao , Chengtao Li , Leilei Shi , Junhong Liu

Deep MRI reconstruction is commonly performed with conditional models that de-alias undersampled acquisitions to recover images consistent with fully-sampled data. Since conditional models are trained with knowledge of the imaging operator,…

Image and Video Processing · Electrical Eng. & Systems 2023-09-19 Alper Güngör , Salman UH Dar , Şaban Öztürk , Yilmaz Korkmaz , Gokberk Elmas , Muzaffer Özbey , Tolga Çukur

Crack Segmentation in industrial concrete surfaces is a challenging task because cracks usually exhibit intricate morphology with slender appearances. Traditional segmentation methods often struggle to accurately locate such cracks, leading…

Computer Vision and Pattern Recognition · Computer Science 2025-01-23 Xianglong Shi , Yunhan Jiang , Xiaoheng Jiang , Mingling Xu , Yang Liu

Generating protein sequences that fold into a intended 3D structure is a fundamental step in de novo protein design. De facto methods utilize autoregressive generation, but this eschews higher order interactions that could be exploited to…

Biomolecules · Quantitative Biology 2023-12-06 John J. Yang , Jason Yim , Regina Barzilay , Tommi Jaakkola

In this work, we propose a novel framework to enable diffusion models to adapt their generation quality based on real-time network bandwidth constraints. Traditional diffusion models produce high-fidelity images by performing a fixed number…

Computer Vision and Pattern Recognition · Computer Science 2026-04-10 Xi Zhang , Hanwei Zhu , Yan Zhong , Jiamang Wang , Weisi Lin

This paper introduces TopoDiffuser, a diffusion-based framework for multimodal trajectory prediction that incorporates topometric maps to generate accurate, diverse, and road-compliant future motion forecasts. By embedding structural cues…

Robotics · Computer Science 2025-08-04 Zehui Xu , Junhui Wang , Yongliang Shi , Chao Gao , Guyue Zhou

Denoising diffusion models are a powerful type of generative models used to capture complex distributions of real-world signals. However, their applicability is limited to scenarios where training samples are readily available, which is not…

Computer Vision and Pattern Recognition · Computer Science 2023-11-20 Ayush Tewari , Tianwei Yin , George Cazenavette , Semon Rezchikov , Joshua B. Tenenbaum , Frédo Durand , William T. Freeman , Vincent Sitzmann

Recent video inpainting methods have achieved encouraging improvements by leveraging optical flow to guide pixel propagation from reference frames either in the image space or feature space. However, they would produce severe artifacts in…

Computer Vision and Pattern Recognition · Computer Science 2025-01-22 Chaohao Xie , Kai Han , Kwan-Yee K. Wong

Designing protein sequences that fold into a target 3D structure, known as protein inverse folding, is a fundamental challenge in protein engineering. While recent deep learning methods have achieved impressive performance by recovering…

Biomolecules · Quantitative Biology 2025-06-03 Mengdi Liu , Xiaoxue Cheng , Zhangyang Gao , Hong Chang , Cheng Tan , Shiguang Shan , Xilin Chen