English
Related papers

Related papers: CLDR: Contrastive Learning Drug Response Models fr…

200 papers

Contrast consistency, the ability of a model to make consistently correct predictions in the presence of perturbations, is an essential aspect in NLP. While studied in tasks such as sentiment analysis and reading comprehension, it remains…

Computation and Language · Computer Science 2023-05-25 Zhihan Zhang , Wenhao Yu , Zheng Ning , Mingxuan Ju , Meng Jiang

Single-cell RNA sequencing (scRNA-seq) data is a potent tool for comprehending the "language of life" and can provide insights into various downstream biomedical tasks. Large-scale language models (LLMs) are starting to be used for cell…

Computational Engineering, Finance, and Science · Computer Science 2023-06-08 Suyuan Zhao , Jiahuan Zhang , Zaiqing Nie

Chemical language models, combined with reinforcement learning (RL), have shown significant promise to efficiently traverse large chemical spaces for drug discovery. However, the performance of various RL algorithms and their best practices…

Machine Learning · Computer Science 2025-11-06 Morgan Thomas , Albert Bou , Jose Carlos Gómez-Tamayo , Gary Tresadern , Mazen Ahmad , Gianni De Fabritiis

This paper highlights a shift in how to approach material generation. Instead of material-to-material, we propose a language-to-material generation architecture that utilizes millions of untapped data points. Using a web scraper to collect…

Computation and Language · Computer Science 2023-11-15 Neel Redkar

Motivated by the size of cell line drug sensitivity data, researchers have been developing machine learning (ML) models for predicting drug response to advance cancer treatment. As drug sensitivity studies continue generating data, a common…

While contrastive learning is proven to be an effective training strategy in computer vision, Natural Language Processing (NLP) is only recently adopting it as a self-supervised alternative to Masked Language Modeling (MLM) for improving…

Computation and Language · Computer Science 2021-09-16 Hooman Sedghamiz , Shivam Raval , Enrico Santus , Tuka Alhanai , Mohammad Ghassemi

Virtual screening, which identifies potential drugs from vast compound databases to bind with a particular protein pocket, is a critical step in AI-assisted drug discovery. Traditional docking methods are highly time-consuming, and can only…

Machine Learning · Computer Science 2023-10-11 Bowen Gao , Bo Qiang , Haichuan Tan , Minsi Ren , Yinjun Jia , Minsi Lu , Jingjing Liu , Weiying Ma , Yanyan Lan

Cross-lingual Cross-modal Retrieval (CCR) is an essential task in web search, which aims to break the barriers between modality and language simultaneously and achieves image-text retrieval in the multi-lingual scenario with a single model.…

Information Retrieval · Computer Science 2024-06-27 Zhijie Nie , Richong Zhang , Zhangchi Feng , Hailang Huang , Xudong Liu

Deep learning in computational biochemistry has traditionally focused on molecular graphs neural representations; however, recent advances in language models highlight how much scientific knowledge is encoded in text. To bridge these two…

Machine Learning · Computer Science 2023-07-26 Romain Lacombe , Andrew Gaut , Jeff He , David Lüdeke , Kateryna Pistunova

Objective: The majority of detailed patient information in real-world data (RWD) is only consistently available in free-text clinical documents. Manual curation is expensive and time-consuming. Developing natural language processing (NLP)…

Molecule representation learning (MRL) methods aim to embed molecules into a real vector space. However, existing SMILES-based (Simplified Molecular-Input Line-Entry System) or GNN-based (Graph Neural Networks) MRL methods either take…

Machine Learning · Computer Science 2021-09-23 Hongwei Wang , Weijiang Li , Xiaomeng Jin , Kyunghyun Cho , Heng Ji , Jiawei Han , Martin D. Burke

Contrastive learning methods enforce label distance relationships in feature space to improve representation capability for regression models. However, these methods highly depend on label information to correctly recover ordinal…

Machine Learning · Computer Science 2025-12-11 Ce Wang , Weihang Dai , Hanru Bai , Xiaomeng Li

Due to cancer's complex nature and variable response to therapy, precision oncology informed by omics sequence analysis has become the current standard of care. However, the amount of data produced for each patients makes it difficult to…

Machine Learning · Computer Science 2023-10-30 Patrick J. Lawrence , Xia Ning

Speech Emotion Recognition (SER) in real-world scenarios remains challenging due to severe class imbalance and the prevalence of spontaneous, natural speech. While recent approaches leverage self-supervised learning (SSL) representations…

Audio and Speech Processing · Electrical Eng. & Systems 2026-03-26 Lucas H. Ueda , João G. T. Lima , Paula D. P. Costa

Standard test sets for supervised learning evaluate in-distribution generalization. Unfortunately, when a dataset has systematic gaps (e.g., annotation artifacts), these evaluations are misleading: a model can learn simple decision rules…

Identifying unique characteristics in a network through comparison with another network is an essential network analysis task. For example, with networks of protein interactions obtained from normal and cancer tissues, we can discover…

Machine Learning · Computer Science 2022-02-16 Takanori Fujiwara , Jian Zhao , Francine Chen , Yaoliang Yu , Kwan-Liu Ma

Graph representation learning has attracted a surge of interest recently, whose target at learning discriminant embedding for each node in the graph. Most of these representation methods focus on supervised learning and heavily depend on…

Machine Learning · Computer Science 2021-07-07 Pengpeng Shao , Tong Liu , Dawei Zhang , Jianhua Tao , Feihu Che , Guohua Yang

Trapped by the label scarcity in molecular property prediction and drug design, graph contrastive learning (GCL) came forward. Leading contrastive learning works show two kinds of view generators, that is, random or learnable data…

Machine Learning · Computer Science 2025-01-16 Xueyuan Chen , Shangzhe Li , Ruomei Liu , Bowen Shi , Jiaheng Liu , Junran Wu , Ke Xu

Deep learning has been a prevalence in computational chemistry and widely implemented in molecule property predictions. Recently, self-supervised learning (SSL), especially contrastive learning (CL), gathers growing attention for the…

Machine Learning · Computer Science 2022-06-01 Yuyang Wang , Rishikesh Magar , Chen Liang , Amir Barati Farimani

Natural Language Processing (NLP) is widely used in fields like machine translation and sentiment analysis. However, traditional NLP models struggle with accuracy and efficiency. This paper introduces Deep Convolutional Neural Networks…

Computation and Language · Computer Science 2024-12-23 Chang Weng , Scott Rood , Mehdi Ali Ramezani , Amir Aslani , Reza Zarrab , Wang Zwuo , Sanjeev Salimans , Tim Satheesh