English
Related papers

Related papers: Progressive Multi-Modality Learning for Inverse Pr…

200 papers

We present InvMSAFold, an inverse folding method for generating protein sequences that is optimized for diversity and speed. For a given structure, InvMSAFold generates the parameters of a probability distribution over the space of…

Quantitative Methods · Quantitative Biology 2025-05-30 Luca Alessandro Silva , Barthelemy Meynard-Piganeau , Carlo Lucibello , Christoph Feinauer

Effective protein representation learning is crucial for predicting protein functions. Traditional methods often pretrain protein language models on large, unlabeled amino acid sequences, followed by finetuning on labeled data. While…

Biomolecules · Quantitative Biology 2024-09-05 Jiangbin Zheng , Stan Z. Li

Proteins are essential macromolecules defined by their amino acid sequences, which determine their three-dimensional structures and, consequently, their functions in all living organisms. Therefore, generative protein modeling necessitates…

Machine Learning · Computer Science 2024-10-18 Xinyou Wang , Zaixiang Zheng , Fei Ye , Dongyu Xue , Shujian Huang , Quanquan Gu

We apply a new approach to the reverse protein folding problem. Our method uses a minimization function in the design process which is different from the energy function used for folding. For a lattice model, we show that this new approach…

Condensed Matter · Physics 2009-10-28 J. M. Deutsch , Tanya Kurosky

Protein language models often take into consideration the alignment between a protein sequence and its textual description. However, they do not take structural information into consideration. Traditional methods treat sequence and…

Machine Learning · Computer Science 2026-03-10 Aditya Ranganath , Hasin Us Sami , Kowshik Thopalli , Bhavya Kailkhura , Wesam Sakla

The impact of Transformer-based language models has been unprecedented in Natural Language Processing (NLP). The success of such models has also led to their adoption in other fields including bioinformatics. Taking this into account, this…

Machine Learning · Computer Science 2025-07-21 Nimisha Ghosh , Daniele Santoni , Debaleena Nawn , Eleonora Ottaviani , Giovanni Felici

This paper investigates the application of the transformer architecture in protein folding, as exemplified by DeepMind's AlphaFold project, and its implications for the understanding of so-called large language models. The prevailing…

Computers and Society · Computer Science 2024-12-10 Fabian Offert , Paul Kim , Qiaoyu Cai

Protein sequence design, determined by amino acid sequences, are essential to protein engineering problems in drug discovery. Prior approaches have resorted to evolutionary strategies or Monte-Carlo methods for protein design, but often…

Singlet fission has emerged as one of the most exciting phenomena known to improve the efficiencies of different types of solar cells and has found uses in diverse optoelectronic applications. The range of available singlet fission…

Inverse design, the process of matching a device or process parameters to exhibit a desired performance, is applied in many disciplines ranging from material design over chemical processes and to engineering. Machine learning has emerged as…

Machine Learning · Computer Science 2022-08-31 Michel Frising , Jorge Bravo-Abad , Ferry Prins

Recent studies have shown competitive performance in protein design that aims to find the amino acid sequence folding into the desired structure. However, most of them disregard the importance of predictive confidence, fail to cover the…

Biomolecules · Quantitative Biology 2023-05-31 Zhangyang Gao , Cheng Tan , Stan Z. Li

Machine Learning-guided solutions for protein learning tasks have made significant headway in recent years. However, success in scientific discovery tasks is limited by the accessibility of well-defined and labeled in-domain data. To tackle…

Machine Learning · Computer Science 2023-01-06 Ria Vinod , Pin-Yu Chen , Payel Das

Multimodal sensing systems are increasingly prevalent in various real-world applications. Most existing multimodal learning approaches heavily rely on training with a large amount of synchronized, complete multimodal data. However, such a…

Machine Learning · Computer Science 2025-03-06 Xiaomin Ouyang , Jason Wu , Tomoyoshi Kimura , Yihan Lin , Gunjan Verma , Tarek Abdelzaher , Mani Srivastava

The 21st century is presenting humankind with unprecedented environmental and medical challenges. The ability to design novel proteins tailored for specific purposes could transform our ability to respond timely to these issues. Recent…

Biomolecules · Quantitative Biology 2022-08-24 Noelia Ferruz , Birte Höcker

In this work, we present Multimodal Equivariant Inverse Design Network (MEIDNet), a framework that jointly learns structural information and materials properties through contrastive learning, while encoding structures via an equivariant…

Materials Science · Physics 2026-01-30 Anand Babu , Rogério Almeida Gouvêa , Pierre Vandergheynst , Gian-Marco Rignanese

Discovering new physical products and processes often demands enormous experimentation and expensive simulation. To design a new product with certain target characteristics, an extensive search is performed in the design space by trying out…

Machine Learning · Statistics 2018-11-16 Phuoc Nguyen , Truyen Tran , Sunil Gupta , Santu Rana , Svetha Venkatesh

With the growing demand for novel materials, machine learning-driven inverse design methods face significant challenges in reconciling the high-dimensional materials composition space with limited experimental data. Existing approaches…

Machine Learning · Computer Science 2025-07-02 Yeyong Yu , Xilei Bian , Jie Xiong , Xing Wu , Quan Qian

Multimodality Representation Learning, as a technique of learning to embed information from different modalities and their correlations, has achieved remarkable success on a variety of applications, such as Visual Question Answering (VQA),…

Artificial Intelligence · Computer Science 2024-03-04 Muhammad Arslan Manzoor , Sarah Albarri , Ziting Xian , Zaiqiao Meng , Preslav Nakov , Shangsong Liang

Multimodal learning typically relies on the assumption that all modalities are fully available during both the training and inference phases. However, in real-world scenarios, consistently acquiring complete multimodal data presents…

Computer Vision and Pattern Recognition · Computer Science 2024-07-18 Donggeun Kim , Taesup Kim

Protein is linked to almost every life process. Therefore, analyzing the biological structure and property of protein sequences is critical to the exploration of life, as well as disease detection and drug discovery. Traditional protein…

Machine Learning · Computer Science 2021-12-08 Yijia Xiao , Jiezhong Qiu , Ziang Li , Chang-Yu Hsieh , Jie Tang