English
Related papers

Related papers: An Integrated Transfer Learning and Multitask Lear…

200 papers

The paradigm of representation learning through transfer learning has the potential to greatly enhance clinical natural language processing. In this work, we propose a multi-task pre-training and fine-tuning approach for learning…

Computation and Language · Computer Science 2021-03-15 Yuqi Si , Elmer V Bernstam , Kirk Roberts

An important aspect in the development of small molecules as drugs or agro-chemicals is their systemic availability after intravenous and oral administration. The prediction of the systemic availability from the chemical structure of a…

Quantitative Methods · Quantitative Biology 2024-01-03 Florian Führer , Andrea Gruber , Holger Diedam , Andreas H. Göller , Stephan Menz , Sebastian Schneckener

Drug discovery remains a slow and expensive process that involves many steps, from detecting the target structure to obtaining approval from the Food and Drug Administration (FDA), and is often riddled with safety concerns. Accurate…

Quantitative Methods · Quantitative Biology 2025-08-22 Ali Vefghi , Zahed Rahmati , Mohammad Akbari

A rapidly growing amount of content posted online, such as food recipes, opens doors to new exciting applications at the intersection of vision and language. In this work, we aim to estimate the calorie amount of a meal directly from an…

Computer Vision and Pattern Recognition · Computer Science 2020-11-03 Robin Ruede , Verena Heusser , Lukas Frank , Alina Roitberg , Monica Haurilet , Rainer Stiefelhagen

Multi-task learning is an effective learning strategy for deep-learning-based facial expression recognition tasks. However, most existing methods take into limited consideration the feature selection, when transferring information between…

Computer Vision and Pattern Recognition · Computer Science 2021-11-30 Rui Zhao , Tianshan Liu , Jun Xiao , Daniel P. K. Lun , Kin-Man Lam

Understanding and leveraging the 3D structures of proteins is central to a variety of biological and drug discovery tasks. While deep learning has been applied successfully for structure-based protein function prediction tasks, current…

Machine Learning · Computer Science 2024-04-03 Rong Han , Wenbing Huang , Lingxiao Luo , Xinyan Han , Jiaming Shen , Zhiqiang Zhang , Jun Zhou , Ting Chen

Parameter-efficient fine-tuning methods have emerged as a promising solution for adapting pre-trained models to various downstream tasks. While these methods perform well in single-task learning, extending them to multi-task learning…

Computer Vision and Pattern Recognition · Computer Science 2026-04-28 Neeraj Gangwar , Anshuka Rangi , Rishabh Deshmukh , Holakou Rahmanian , Yesh Dattatreya , Nickvash Kani

Recent advances in molecular machine learning, especially deep neural networks such as Graph Neural Networks (GNNs) for predicting structure activity relationships (SAR) have shown tremendous potential in computer-aided drug discovery.…

Machine Learning · Computer Science 2022-03-14 Vishal Dey , Raghu Machiraju , Xia Ning

Physiologically Based Pharmacokinetic (PBPK) modeling is a cornerstone of model-informed drug development (MIDD), providing a mechanistic framework to predict drug absorption, distribution, metabolism, and excretion (ADME). Despite its…

Machine Learning · Computer Science 2026-02-24 Shunqi Liu , Han Qiu , Tong Wang

The simultaneous application of multiple treatments is increasingly common in many fields, such as healthcare and marketing. In such scenarios, it is important to estimate the single treatment effects and the interaction treatment effects…

Methodology · Statistics 2025-11-14 Yuki Murakami , Takumi Hattori , Kohsuke Kubota

Deep learning methods such as multitask neural networks have recently been applied to ligand-based virtual screening and other drug discovery applications. Using a set of industrial ADMET datasets, we compare neural networks to standard…

Machine Learning · Statistics 2017-01-16 Steven Kearnes , Brian Goldman , Vijay Pande

Building accurate models for rare skin diseases remains challenging due to the lack of sufficient labeled data and the inherently long-tailed distribution of available samples. These issues are further complicated by inconsistencies in how…

Computer Vision and Pattern Recognition · Computer Science 2025-10-03 Zeynep Özdemir , Hacer Yalim Keles , Ömer Özgür Tanrıöver

The growing use of Machine Learning has produced significant advances in many fields. For image-based tasks, however, the use of deep learning remains challenging in small datasets. In this article, we review, evaluate and compare the…

Machine Learning · Computer Science 2021-06-09 Miguel Romero , Yannet Interian , Timothy Solberg , Gilmer Valdes

Prediction of molecular properties, including physico-chemical properties, is a challenging task in chemistry. Herein we present a new state-of-the-art multitask prediction method based on existing graph neural network models. We have used…

Machine Learning · Computer Science 2019-10-31 Fabio Capela , Vincent Nouchi , Ruud Van Deursen , Igor V. Tetko , Guillaume Godin

In industrial recommendation systems, multi-task learning (learning multiple tasks simultaneously on a single model) is a predominant approach to save training/serving resources and improve recommendation performance via knowledge transfer…

Information Retrieval · Computer Science 2024-11-20 Yun He , Xuxing Chen , Jiayi Xu , Renqin Cai , Yiling You , Jennifer Cao , Minhui Huang , Liu Yang , Yiqun Liu , Xiaoyi Liu , Rong Jin , Sem Park , Bo Long , Xue Feng

Prediction for ADMET (Absorption, Distribution, Metabolism, Excretion, and Toxicity) plays a crucial role in drug discovery and development, accelerating the screening and optimization of new drugs. Existing methods primarily rely on…

Machine Learning · Computer Science 2025-09-08 Han Zhang , Fengji Ma , Jiamin Su , Xinyue Yang , Lei Wang , Wen-Cai Ye , Li Liu

Large, pre-trained models are problematic to use in resource constrained applications. Fortunately, task-aware structured pruning methods offer a solution. These approaches reduce model size by dropping structural units like layers and…

Computation and Language · Computer Science 2023-11-14 Lucio Dery , David Grangier , Awni Hannun

In this study, we develop a method for multi-task manifold learning. The method aims to improve the performance of manifold learning for multiple tasks, particularly when each task has a small number of samples. Furthermore, the method also…

Machine Learning · Computer Science 2021-11-25 Hideaki Ishibashi , Kazushi Higa , Tetsuo Furukawa

Purpose: We propose a general framework for quantifying predictive uncertainties of dose-related quantities and leveraging this information in a dose mimicking problem in the context of automated radiation therapy treatment planning.…

Medical Physics · Physics 2021-09-08 Tianfang Zhang , Rasmus Bokrantz , Jimmy Olsson

Integrating knowledge across different domains is an essential feature of human learning. Learning paradigms such as transfer learning, meta-learning, and multi-task learning reflect the human learning process by exploiting the prior…

Machine Learning · Computer Science 2024-10-17 Richa Upadhyay , Ronald Phlypo , Rajkumar Saini , Marcus Liwicki