English
Related papers

Related papers: Rational Multi-Modal Transformers for TCR-pMHC Pre…

200 papers

Advanced machine learning models have recently achieved high predictive accuracy for weather and climate prediction. However, these complex models often lack inherent transparency and interpretability, acting as "black boxes" that impede…

Atmospheric and Oceanic Physics · Physics 2024-03-29 Ruyi Yang , Jingyu Hu , Zihao Li , Jianli Mu , Tingzhao Yu , Jiangjiang Xia , Xuhong Li , Aritra Dasgupta , Haoyi Xiong

We present a conformal prediction method for time series using the Transformer architecture to capture long-memory and long-range dependencies. Specifically, we use the Transformer decoder as a conditional quantile estimator to predict the…

Machine Learning · Computer Science 2024-06-11 Junghwan Lee , Chen Xu , Yao Xie

Temporal Knowledge Graph (TKG) reasoning often involves completing missing factual elements along the timeline. Although existing methods can learn good embeddings for each factual element in quadruples by integrating temporal information,…

Artificial Intelligence · Computer Science 2024-05-02 Zhiyu Fang , Shuai-Long Lei , Xiaobin Zhu , Chun Yang , Shi-Xue Zhang , Xu-Cheng Yin , Jingyan Qin

The hybrid nature of multi-contact robotic systems, due to making and breaking contact with the environment, creates significant challenges for high-quality control. Existing model-based methods typically rely on either good prior knowledge…

Robotics · Computer Science 2024-03-05 Wei-Cheng Huang , Alp Aydinoglu , Wanxin Jin , Michael Posa

The major histocompatibility complex (MHC) molecules, which bind peptides for presentation on the cell surface, play an important role in cell-mediated immunity. In light of developing databases and technologies over the years, significant…

Biomolecules · Quantitative Biology 2023-01-26 Ayşenaz Ezgi Ergin , Deniz Turgay Altılar

Motivation: The activity of the adaptive immune system is governed by T-cells and their specific T-cell receptors (TCR), which selectively recognize foreign antigens. Recent advances in experimental techniques have enabled sequencing of…

Biomolecules · Quantitative Biology 2023-08-28 Anna Weber , Jannis Born , María Rodríguez Martínez

Machine-learning models have demonstrated great success in learning complex patterns that enable them to make predictions about unobserved data. In addition to using models for prediction, the ability to interpret what a model has learned…

Machine Learning · Statistics 2019-11-15 W. James Murdoch , Chandan Singh , Karl Kumbier , Reza Abbasi-Asl , Bin Yu

Human leukocyte antigen (HLA) is an important molecule family in the field of human immunity, which recognizes foreign threats and triggers immune responses by presenting peptides to T cells. In recent years, the synthesis of tumor vaccines…

Quantitative Methods · Quantitative Biology 2022-08-10 Meng Wang , Chuqi Lei , Jianxin Wang , Yaohang Li , Min Li

Multimodalities provide promising performance than unimodality in most tasks. However, learning the semantic of the representations from multimodalities efficiently is extremely challenging. To tackle this, we propose the Transformer based…

Computer Vision and Pattern Recognition · Computer Science 2019-11-14 Wubo Li , Wei Zou , Xiangang Li

Prompt injection poses a critical threat to the safe deployment of large language models, yet existing detection approaches are typically evaluated under limited settings that do not reflect real-world operating constraints. In this work,…

Computation and Language · Computer Science 2026-05-27 Akindoyin Akinrele , Shreyank N Gowda

Generative models coupled with reinforcement learning (RL), such as REINVENT and PepINVENT, have emerged as a powerful framework for de novo molecular design. During the ideation process these generative frameworks utilize various…

Artificial Intelligence · Computer Science 2026-05-08 Laura van Weesep , Sunay Chankeshwara , Leonardo De Maria , Florian David , Ola Engkvist , Gökçe Geylan

The emergence of large-scale pretrained language models has posed unprecedented challenges in deriving explanations of why the model has made some predictions. Stemmed from the compositional nature of languages, spurious correlations have…

Computation and Language · Computer Science 2023-05-04 Ruochen Zhao , Shafiq Joty , Yongjie Wang , Tan Wang

Accurate and robust drug response prediction is of utmost importance in precision medicine. Although many models have been developed to utilize the representations of drugs and cancer cell lines for predicting cancer drug responses (CDR),…

Quantitative Methods · Quantitative Biology 2023-11-22 Xiaoqiong Xia , Chaoyu Zhu , Yuqi Shan , Fan Zhong , Lei Liu

This work introduces a formulation of model predictive control (MPC) which adaptively reasons about the complexity of the model based on the task while maintaining feasibility and stability guarantees. Existing MPC implementations often…

Robotics · Computer Science 2024-11-07 Joseph Norby , Ardalan Tajbakhsh , Yanhao Yang , Aaron M. Johnson

Continual learning is essential for adapting models to new tasks while retaining previously acquired knowledge. While existing approaches predominantly focus on uni-modal data, multi-modal learning offers substantial benefits by utilizing…

Machine Learning · Computer Science 2025-11-11 Evelyn Chee , Wynne Hsu , Mong Li Lee

Mechanistic interpretability focuses on reverse engineering the internal mechanisms learned by neural networks. We extend our focus and propose to mechanistically forward engineer using our framework based on Concept Bottleneck Models. In…

Machine Learning · Computer Science 2025-12-01 Angela van Sprang , Erman Acar , Willem Zuidema

End-to-end deep neural networks have achieved remarkable success across various domains but are often criticized for their lack of interpretability. While post hoc explanation methods attempt to address this issue, they often fail to…

Machine Learning · Computer Science 2025-01-22 Weixin Chen , Simon Yu , Huajie Shao , Lui Sha , Han Zhao

The successful operation of mobile robots requires them to adapt rapidly to environmental changes. To develop an adaptive decision-making tool for mobile robots, we propose a novel algorithm that combines meta-reinforcement learning…

Robotics · Computer Science 2022-07-21 Jaeuk Shin , Astghik Hakobyan , Mingyu Park , Yeoneung Kim , Gihun Kim , Insoon Yang

To ensure faithful information transmission, cells utilize nonequilibrium drives to reduce errors. Kinetic proofreading is a classic mechanism known to sharpen ligand discrimination by T lymphocytes. It remains an open question whether the…

Biological Physics · Physics 2025-09-23 Qing Xu , Shenshen Wang

Time-to-event prediction, e.g. cancer survival analysis or hospital length of stay, is a highly prominent machine learning task in medical and healthcare applications. However, only a few interpretable machine learning methods comply with…

Computer Vision and Pattern Recognition · Computer Science 2024-11-25 Hubert Baniecki , Bartlomiej Sobieski , Patryk Szatkowski , Przemyslaw Bombinski , Przemyslaw Biecek