English
Related papers

Related papers: Fast non-autoregressive inverse folding with discr…

200 papers

Computational elucidation of membrane protein (MP) structures is challenging partially due to lack of sufficient solved structures for homology modeling. Here we describe a high-throughput deep transfer learning method that first predicts…

Biomolecules · Quantitative Biology 2017-08-29 Sheng Wang , Zhen Li , Yizhou Yu , Jinbo Xu

MOTIVATION: Proteins fold into complex structures that are crucial for their biological functions. Experimental determination of protein structures is costly and therefore limited to a small fraction of all known proteins. Hence, different…

Biomolecules · Quantitative Biology 2018-04-18 David Menéndez Hurtado , Karolis Uziela , Arne Elofsson

Denoising diffusion probabilistic models (DDPMs) have recently achieved leading performances in many generative tasks. However, the inherited iterative sampling process costs hinder their applications to text-to-speech deployment. Through…

Audio and Speech Processing · Electrical Eng. & Systems 2022-07-14 Rongjie Huang , Zhou Zhao , Huadai Liu , Jinglin Liu , Chenye Cui , Yi Ren

This work introduces the generative fractional diffusion model for protein generation (ProT-GFDM), a novel generative framework that employs fractional stochastic dynamics for protein backbone structure modeling. This approach builds on the…

Quantitative Methods · Quantitative Biology 2025-05-01 Xiao Liang , Wentao Ma , Eric Paquet , Herna Lydia Viktor , Wojtek Michalowski

Modeling the interaction between proteins and ligands and accurately predicting their binding structures is a critical yet challenging task in drug discovery. Recent advancements in deep learning have shown promise in addressing this…

Machine Learning · Computer Science 2024-01-10 Qizhi Pei , Kaiyuan Gao , Lijun Wu , Jinhua Zhu , Yingce Xia , Shufang Xie , Tao Qin , Kun He , Tie-Yan Liu , Rui Yan

Proteins are miniature machines whose function depends on their three-dimensional (3D) structure. Determining this structure computationally remains an unsolved grand challenge. A major bottleneck involves selecting the most accurate…

Quantitative Methods · Quantitative Biology 2020-11-30 Stephan Eismann , Patricia Suriana , Bowen Jing , Raphael J. L. Townshend , Ron O. Dror

Lightweight inference is critical for biomolecular structure prediction and downstream tasks, enabling efficient real-world deployment and inference-time scaling for large-scale applications. While AF3 and its variants (e.g., Protenix,…

Quantitative Methods · Quantitative Biology 2025-10-17 Bo Qiang , Chengyue Gong , Xinshi Chen , Yuxuan Zhang , Wenzhi Xiao

Autoregressive sequence models achieve state-of-the-art performance in domains like machine translation. However, due to the autoregressive factorization nature, these models suffer from heavy latency during inference. Recently,…

Machine Learning · Computer Science 2020-01-10 Zhiqing Sun , Zhuohan Li , Haoqing Wang , Zi Lin , Di He , Zhi-Hong Deng

Action diffusion excels at high-fidelity action generation but incurs heavy computational costs owing to its iterative denoising nature. Despite current technologies showing promise in accelerating diffusion transformers by reusing the…

Computer Vision and Pattern Recognition · Computer Science 2026-05-14 Kangye Ji , Yuan Meng , Jianbo Zhou , Ye Li , Chen Tang , Zhi Wang

Diffusion models excel at capturing the natural design spaces of images, molecules, DNA, RNA, and protein sequences. However, rather than merely generating designs that are natural, we often aim to optimize downstream reward functions while…

Recent advancements in multi-modal large language models have propelled the development of joint probabilistic models capable of both image understanding and generation. However, we have identified that recent methods suffer from loss of…

Computer Vision and Pattern Recognition · Computer Science 2025-06-05 Jian Yang , Dacheng Yin , Yizhou Zhou , Fengyun Rao , Wei Zhai , Yang Cao , Zheng-Jun Zha

Designing protein binders targeting specific sites, which requires to generate realistic and functional interaction patterns, is a fundamental challenge in drug discovery. Current structure-based generative models are limited in generating…

Machine Learning · Computer Science 2025-10-17 Zishen Zhang , Xiangzhe Kong , Wenbing Huang , Yang Liu

Protein folding and design are major biophysical problems, the solution of which would lead to important applications especially in medicine. Here a novel protein model capable of simultaneously provide quantitative protein design and…

Biological Physics · Physics 2015-06-22 Ivan Coluzza

Discrete diffusion models offer a promising alternative to autoregressive generation through parallel decoding, but they suffer from a sampling wall: once categorical sampling occurs, rich distributional information collapses into one-hot…

Machine Learning · Computer Science 2026-05-14 Mingyu Jo , Jaesik Yoon , Justin Deschenaux , Caglar Gulcehre , Sungjin Ahn

Non-autoregressive approaches aim to improve the inference speed of translation models, particularly those that generate output in a one-pass forward manner. However, these approaches often suffer from a significant drop in translation…

Computation and Language · Computer Science 2024-10-15 Shen-sian Syu , Juncheng Xie , Hung-yi Lee

Computational protein design is experiencing a transformation driven by AI/ML. However, the range of potential protein sequences and structures is astronomically vast, even for moderately sized proteins. Hence, achieving convergence between…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-10-09 Aymen Alsaadi , Jonathan Ash , Mikhail Titov , Matteo Turilli , Andre Merzky , Shantenu Jha , Sagar Khare

This paper introduces a discrete diffusion model (DDM) framework for text-aligned speech tokenization and reconstruction. By replacing the auto-regressive speech decoder with a discrete diffusion counterpart, our model achieves…

Audio and Speech Processing · Electrical Eng. & Systems 2025-09-25 Pin-Jui Ku , He Huang , Jean-Marie Lemercier , Subham Sekhar Sahoo , Zhehuai Chen , Ante Jukić

Text-to-3D with diffusion models has achieved remarkable progress in recent years. However, existing methods either rely on score distillation-based optimization which suffer from slow inference, low diversity and Janus problems, or are…

Computer Vision and Pattern Recognition · Computer Science 2023-11-27 Jiahao Li , Hao Tan , Kai Zhang , Zexiang Xu , Fujun Luan , Yinghao Xu , Yicong Hong , Kalyan Sunkavalli , Greg Shakhnarovich , Sai Bi

Diffusion models have recently emerged as powerful generative priors for solving inverse problems. However, training diffusion models in the pixel space are both data-intensive and computationally demanding, which restricts their…

Computer Vision and Pattern Recognition · Computer Science 2024-04-17 Bowen Song , Soo Min Kwon , Zecheng Zhang , Xinyu Hu , Qing Qu , Liyue Shen

We introduce PolyDiff, the first diffusion-based approach capable of directly generating realistic and diverse 3D polygonal meshes. In contrast to methods that use alternate 3D shape representations (e.g. implicit representations), our…

Computer Vision and Pattern Recognition · Computer Science 2023-12-19 Antonio Alliegro , Yawar Siddiqui , Tatiana Tommasi , Matthias Nießner