English
Related papers

Related papers: Multimodal Protein Language Models for Enzyme Kine…

200 papers

Foundation models (FMs) are pre-trained on large-scale datasets and then fine-tuned for a specific downstream task. The most common fine-tuning method is to update pretrained weights via low-rank adaptation (LoRA). Existing initialization…

Machine Learning · Computer Science 2025-10-21 Fabian Paischer , Lukas Hauzenberger , Thomas Schmied , Benedikt Alkin , Marc Peter Deisenroth , Sepp Hochreiter

The standard two-step model of homogeneous-catalyzed reactions had been theoretically analyzed at various levels of approximations from time to time. The primary aim was to check the validity of the quasi-steady-state approximation, and…

Chemical Physics · Physics 2019-11-14 Kamal Bhattacharyya , Sharmistha Dhatt

Large pre-trained language models are increasingly adapted to downstream tasks using parameter-efficient fine-tuning (PEFT), but existing PEFT methods are typically deterministic and unimodal, making them poorly suited for low-resource…

Machine Learning · Computer Science 2026-04-21 Habibeh Naderi , Behrouz Haji Soleimani , Stan Matwin

Multi-attribute classification generalizes classification, presenting new challenges for making accurate predictions and quantifying uncertainty. We build upon recent work and show that architectures for multi-attribute prediction can be…

Computer Vision and Pattern Recognition · Computer Science 2021-08-10 Jacob Kelly , Richard Zemel , Will Grathwohl

The molecular motor protein kinesin plays a key role in fundamental cellular processes such as intracellular transport, mitotic spindle formation, and cytokinesis, with important implications for neurodegenerative and cancer disease…

Biomolecules · Quantitative Biology 2014-11-18 B. D. Jacobson , L. J. Herskowitz , S. J. Koch , S. R. Atlas

With the formal construction of a thermodynamic spring, I describe the mechanics, energetics, entropy, and kinetics of a binary mechanical model system. A protein that transitions between two metastable structural states behaves as a…

Biological Physics · Physics 2025-01-22 Josh E. Baker

Motivated by the pressing challenges in the digital twin development for biomanufacturing systems, we introduce an adjoint sensitivity analysis (SA) approach to expedite the learning of mechanistic model parameters. In this paper, we…

Molecular Networks · Quantitative Biology 2024-07-02 Keilung Choy , Wei Xie

Cellulases hold great promise for the production of biofuels and biochemicals. However, they are modular enzymes acting on a complex heterogeneous substrate. Because of this complexity, the computational prediction of their catalytic…

Biological Physics · Physics 2022-07-25 Kay S. Schaller , Jeppe Kari , Kim Borch , Günther H. J. Peters , Peter Westh

Recent advancements in unsupervised protein language models (ProteinLMs), like ESM-1b and ESM-2, have shown promise in different protein prediction tasks. However, these models face challenges due to their high computational demands,…

Machine Learning · Computer Science 2023-10-31 Shuang Peng , Fei Yang , Ning Sun , Sheng Chen , Yanfeng Jiang , Aimin Pan

Protein structure prediction models are now capable of generating accurate 3D structural hypotheses from sequence alone. However, they routinely fail to capture the conformational diversity of dynamic biomolecular complexes, often requiring…

Machine Learning · Computer Science 2025-12-02 Rishwanth Raghu , Axel Levy , Gordon Wetzstein , Ellen D. Zhong

Based on our experience in kinetic modeling of coupled multiple metabolic pathways we propose a generic rate equation for the dynamical modeling of metabolic kinetics. Its symmetric form makes the kinetic parameters (or functions) easy to…

Molecular Networks · Quantitative Biology 2007-12-18 L. W. Lee , L. Yin , X. M. Zhu , P. Ao

With the exponential increase of the protein sequence databases over time, multiple-sequence alignment (MSA) methods, like PSI-BLAST, perform exhaustive and time-consuming database search to retrieve evolutionary information. The resulting…

Quantitative Methods · Quantitative Biology 2023-08-21 Issar Arab

Solving time-dependent parametric partial differential equations (PDEs) is challenging for data-driven methods, as these models must adapt to variations in parameters such as coefficients, forcing terms, and initial conditions.…

Machine Learning · Computer Science 2025-06-30 Louis Serrano , Armand Kassaï Koupaï , Thomas X Wang , Pierre Erbacher , Patrick Gallinari

Multimodal sentiment analysis (MSA) integrates heterogeneous text, audio, and visual signals to infer human emotions. While recent approaches leverage cross-modal complementarity, they often struggle to fully utilize weaker modalities. In…

Computation and Language · Computer Science 2026-04-21 Kang He , Yuzhe Ding , Xinrong Wang , Fei Li , Chong Teng , Donghong Ji

Chemical kinetics and reaction engineering consists of the phenomenological framework for the disentanglement of reaction mechanisms, optimization of reaction performance and the rational design of chemical processes. Here, we utilize…

Machine Learning · Computer Science 2021-12-10 Gabriel S. Gusmão , Adhika P. Retnanto , Shashwati C. da Cunha , Andrew J. Medford

The modeling of atomistic biomolecular simulations using kinetic models such as Markov state models (MSMs) has had many notable algorithmic advances in recent years. The variational principle has opened the door for a nearly fully automated…

Biological Physics · Physics 2019-11-26 Martin K. Scherer , Brooke E. Husic , Moritz Hoffmann , Fabian Paul , Hao Wu , Frank Noé

Multimodal embedding models, built upon causal Vision Language Models (VLMs), have shown promise in various tasks. However, current approaches face three key limitations: the use of causal attention in VLM backbones is suboptimal for…

Computer Vision and Pattern Recognition · Computer Science 2025-07-01 Haonan Chen , Hong Liu , Yuping Luo , Liang Wang , Nan Yang , Furu Wei , Zhicheng Dou

Computational prediction of enzyme mechanism and protein function requires accurate physics-based models and suitable sampling. We discuss recent advances in large-scale quantum mechanical (QM) modeling of biochemical systems that have…

Chemical Physics · Physics 2021-05-28 Vyshnavi Vennelakanti , Azadeh Nazemi , Rimsha Mehmood , Adam H. Steeves , Heather J. Kulik

Understanding the relationships between protein sequence, structure and function is a long-standing biological challenge with manifold implications from drug design to our understanding of evolution. Recently, protein language models have…

Quantitative Methods · Quantitative Biology 2024-01-29 Dexiong Chen , Philip Hartout , Paolo Pellizzoni , Carlos Oliver , Karsten Borgwardt

Protein language models have demonstrated significant potential in the field of protein engineering. However, current protein language models primarily operate at the residue scale, which limits their ability to provide information at the…

Biomolecules · Quantitative Biology 2024-06-14 Kangjie Zheng , Siyu Long , Tianyu Lu , Junwei Yang , Xinyu Dai , Ming Zhang , Zaiqing Nie , Wei-Ying Ma , Hao Zhou