English
Related papers

Related papers: Pro-PRIME: A general Temperature-Guided Language m…

200 papers

After AlphaFold won the Nobel Prize, protein prediction with deep learning once again became a hot topic. We comprehensively explore advanced deep learning methods applied to protein structure prediction and design. It begins by examining…

The global demand for sustainable protein sources has accelerated the need for intelligent tools that can rapidly process and synthesise domain-specific scientific knowledge. In this study, we present a proof-of-concept multi-agent…

Artificial Intelligence · Computer Science 2025-06-26 Alexander D. Kalian , Jaewook Lee , Stefan P. Johannesson , Lennart Otte , Christer Hogstrand , Miao Guo

Deep learning has deeply influenced protein science, enabling breakthroughs in predicting protein properties, higher-order structures, and molecular interactions. This paper introduces DeepProtein, a comprehensive and user-friendly deep…

Machine Learning · Computer Science 2025-06-17 Jiaqing Xie , Tianfan Fu

The prediction of amyloidogenicity in peptides and proteins remains a focal point of ongoing bioinformatics. The crucial step in this field is to apply advanced computational methodologies. Many recent approaches to predicting…

Machine Learning · Computer Science 2025-08-19 Zohra Yagoub , Hafida Bouziane

In this paper, we study how the intrinsic nature of pre-training data contributes to the fine-tuned downstream performance. To this end, we pre-train different transformer-based masked language models on several corpora with certain…

Computation and Language · Computer Science 2020-12-23 Cheng-Han Chiang , Hung-yi Lee

The sensitivity of the native states of protein-like heteropolymers to mutations modelled as perturbations in the interaction potential between amino acids is studied. The stability threshold against mutations is shown to be zero for random…

Soft Condensed Matter · Physics 2009-10-30 Michele Vendruscolo , Amos Maritan , Jayanth R. Banavar

The characterization of drug-protein interactions is crucial in the high-throughput screening for drug discovery. The deep learning-based approaches have attracted attention because they can predict drug-protein interactions without…

Machine Learning · Computer Science 2020-12-22 QHwan Kim , Joon-Hyuk Ko , Sunghoon Kim , Nojun Park , Wonho Jhe

Probabilistic representations of movement primitives open important new possibilities for machine learning in robotics. These representations are able to capture the variability of the demonstrations from a teacher as a probability…

Machine Learning · Computer Science 2020-02-20 Sebastian Gomez-Gonzalez , Gerhard Neumann , Bernhard Schölkopf , Jan Peters

Generative modeling has become a central paradigm in protein research, extending machine learning beyond structure prediction toward sequence design, backbone generation, inverse folding, and biomolecular interaction modeling. However, the…

Machine Learning · Computer Science 2026-03-30 Senura Hansaja Wanasekara , Minh-Duong Nguyen , Xiaochen Liu , Nguyen H. Tran , Ken-Tye Yong

This paper explores the intricate relationship between interpretability and robustness in deep learning models. Despite their remarkable performance across various tasks, deep learning models often exhibit critical vulnerabilities,…

Machine Learning · Computer Science 2024-12-30 Navid Nayyem , Abdullah Rakin , Longwei Wang

Pre-training decoder-only language models relies on vast amounts of high-quality data, yet the availability of such data is increasingly reaching its limits. While metadata is commonly used to create and curate these datasets, its potential…

Computation and Language · Computer Science 2025-12-09 Sebastian Sztwiertnia , Felix Friedrich , Kristian Kersting , Patrick Schramowski , Björn Deiseroth

Data-driven modeling based on Machine Learning (ML) is becoming a central component of protein engineering workflows. This perspective presents the elements necessary to develop effective, reliable, and reproducible ML models, and a set of…

Biomolecules · Quantitative Biology 2025-07-11 Fabio Herrera-Rocha , David Medina-Ortiz , Fabian Mauz , Juergen Pleiss , Mehdi D. Davari

Rapid adoptions of Deep Learning (DL) in a broad range of fields led to the development of specialised testing techniques for DL systems, including DL mutation testing. However, existing post-training DL mutation techniques often generate…

Software Engineering · Computer Science 2025-01-23 Jinhan Kim , Nargiz Humbatova , Gunel Jahangirova , Shin Yoo , Paolo Tonella

Large language models (LLMs) have garnered considerable attention for their proficiency in tackling intricate tasks, particularly leveraging their capacities for zero-shot and in-context learning. However, their utility has been…

Biomolecules · Quantitative Biology 2024-05-14 Yiqing Shen , Outongyi Lv , Houying Zhu , Yu Guang Wang

Motivation: The development of novel compounds targeting proteins of interest is one of the most important tasks in the pharmaceutical industry. Deep generative models have been applied to targeted molecular design and have shown promising…

Machine Learning · Computer Science 2022-09-05 Gökçe Uludoğan , Elif Ozkirimli , Kutlu O. Ulgen , Nilgün Karalı , Arzucan Özgür

Large-scale robotic policies trained on data from diverse tasks and robotic platforms hold great promise for enabling general-purpose robots; however, reliable generalization to new environment conditions remains a major challenge. Toward…

Robotics · Computer Science 2024-07-30 Bo Wu , Bruce D. Lee , Kostas Daniilidis , Bernadette Bucher , Nikolai Matni

Large language models show great potential in generating and optimizing code. Widely used sampling methods such as Nucleus Sampling increase the diversity of generation but often produce repeated samples for low temperatures and incoherent…

Machine Learning · Computer Science 2024-03-01 Dejan Grubisic , Chris Cummins , Volker Seeker , Hugh Leather

Preference-based Reinforcement Learning (PbRL) circumvents the need for reward engineering by harnessing human preferences as the reward signal. However, current PbRL methods excessively depend on high-quality feedback from domain experts,…

Machine Learning · Computer Science 2024-10-29 Jie Cheng , Gang Xiong , Xingyuan Dai , Qinghai Miao , Yisheng Lv , Fei-Yue Wang

Although the tailored metal active sites and porous architectures of MOFs hold great promise for engineering challenges ranging from gas separations to catalysis, a lack of understanding of how to improve their stability limits their use in…

Materials Science · Physics 2021-06-28 Aditya Nandy , Chenru Duan , Heather J. Kulik

We propose Neural Priming, a technique for adapting large pretrained models to distribution shifts and downstream tasks given few or no labeled examples. Presented with class names or unlabeled test samples, Neural Priming enables the model…