English
Related papers

Related papers: Task-Specific Sparse Feature Masks for Molecular T…

200 papers

Accurately predicting the state-of-health (SOH) and remaining useful life (RUL) of lithium-ion batteries is crucial for ensuring the safe and efficient operation of electric vehicles while minimizing associated risks. However, current deep…

Machine Learning · Computer Science 2026-03-25 Chenhan Wang , Zhengyi Bao , Huipin Lin , Jiahao Nie , Chunxiang Zhu

Currently, Large Language Models (LLMs) feature a diversified architectural landscape, including traditional Transformer, GateDeltaNet, and Mamba. However, the evolutionary laws of hierarchical representations, task knowledge formation…

Computation and Language · Computer Science 2026-04-23 Yuhang Wu , Qinyuan Liu , Qiuyang Zhao , Qingwei Chong

Modern Machine Learning (ML) applications often benefit from structured sparsity, a technique that efficiently reduces model complexity and simplifies handling of sparse data in hardware. Sparse systolic tensor arrays - specifically…

Hardware Architecture · Computer Science 2025-04-29 Christodoulos Peltekis , Chrysostomos Nicopoulos , Giorgos Dimitrakopoulos

In this paper, we propose a novel multi-task learning (MTL) framework, called Self-Paced Multi-Task Learning (SPMTL). Different from previous works treating all tasks and instances equally when training, SPMTL attempts to jointly learn the…

Machine Learning · Computer Science 2017-04-04 Changsheng Li , Junchi Yan , Fan Wei , Weishan Dong , Qingshan Liu , Hongyuan Zha

Sparse learning is ubiquitous in many machine learning tasks. It aims to regularize the goodness-of-fit objective by adding a penalty term to encode structural constraints on the model parameters. In this paper, we develop a flexible sparse…

Machine Learning · Statistics 2026-02-10 Yingjie Wang , Mokhtar Z. Alaya , Salim Bouzebda , Xinsheng Liu

Large Language Models (LLMs) exhibit remarkable capabilities but remain vulnerable to adversarial manipulations such as jailbreaking, where crafted prompts bypass safety mechanisms. Understanding the causal factors behind such…

Cryptography and Security · Computer Science 2025-12-05 Wei Zhao , Zhe Li , Jun Sun

Multi-task learning (MTL) in materials science relies on the assumption that physically related properties share learnable representations. We challenge this assumption using a 54,028-sample metal alloy dataset exhibiting extreme task-level…

Machine Learning · Computer Science 2026-02-03 Sungwoo Kang

Recent advances in large language models (LLMs) have led to their extensive global deployment, and ensuring their safety calls for comprehensive and multilingual toxicity evaluations. However, existing toxicity benchmarks are overwhelmingly…

Computation and Language · Computer Science 2024-08-13 Devansh Jain , Priyanshu Kumar , Samuel Gehman , Xuhui Zhou , Thomas Hartvigsen , Maarten Sap

Multi-task learning (MTL) is a learning paradigm that enables the simultaneous training of multiple communicating algorithms. Although MTL has been successfully applied to ether regression or classification tasks alone, incorporating mixed…

Machine Learning · Computer Science 2024-05-17 Han Cao , Sivanesan Rajan , Bianka Hahn , Ersoy Kocak , Daniel Durstewitz , Emanuel Schwarz , Verena Schneider-Lindner

Medical image classification involves thresholding of labels that represent malignancy risk levels. Usually, a task defines a single threshold, and when developing computer-aided diagnosis tools, a single network is trained per such…

Computer Vision and Pattern Recognition · Computer Science 2018-11-22 Vadim Ratner , Yoel Shoshan , Tal Kachman

We propose a novel, fully nonparametric approach for the multi-task learning, the Multi-task Highly Adaptive Lasso (MT-HAL). MT-HAL simultaneously learns features, samples and task associations important for the common model, while imposing…

Toxicity remains a leading cause of early-stage drug development failure. Despite advances in molecular design and property prediction, the task of molecular toxicity repair, generating structurally valid molecular alternatives with reduced…

Artificial Intelligence · Computer Science 2026-01-29 Fei Lin , Ziyang Gong , Cong Wang , Tengchao Zhang , Yonglin Tian , Yining Jiang , Ji Dai , Chao Guo , Xiaotong Yu , Xue Yang , Gen Luo , Fei-Yue Wang

While many machine learning methods have been used for medical prediction and risk factor analysis on healthcare data, most prior research has involved single-task learning (STL) methods. However, healthcare research often involves multiple…

Machine Learning · Computer Science 2021-03-08 Lu Wang , Haoyan Jiang , Mark Chignell

Accurate characterisation of visual attributes such as spiculation, lobulation, and calcification of lung nodules is critical in cancer management. The characterisation of these attributes is often subjective, which may lead to high inter-…

Image and Video Processing · Electrical Eng. & Systems 2022-06-13 Xiaohang Fu , Lei Bi , Ashnil Kumar , Michael Fulham , Jinman Kim

Reliable molecular property prediction is essential for various scientific endeavors and industrial applications, such as drug discovery. However, the data scarcity, combined with the highly non-linear causal relationships between…

Machine Learning · Computer Science 2025-01-14 Yue Wan , Jialu Wu , Tingjun Hou , Chang-Yu Hsieh , Xiaowei Jia

The Multi-Task Learning (MTL) technique has been widely studied by word-wide researchers. The majority of current MTL studies adopt the hard parameter sharing structure, where hard layers tend to learn general representations over all tasks…

Information Retrieval · Computer Science 2021-01-25 Dehong Gao , Wenjing Yang , Huiling Zhou , Yi Wei , Yi Hu , Hao Wang

Although multimodal large language models (MLLMs) excel in high-level vision-language reasoning, they lack inherent awareness of visual saliency, making it difficult to identify key visual elements. To bridge this gap, we propose…

Computer Vision and Pattern Recognition · Computer Science 2025-11-27 Long Li , Shuichen Ji , Ziyang Luo , Zhihui Li , Dingwen Zhang , Junwei Han , Nian Liu

When a number of similar tasks have to be learned simultaneously, multi-task learning (MTL) models can attain significantly higher accuracy than single-task learning (STL) models. However, the advantage of MTL depends on various factors,…

Machine Learning · Computer Science 2023-10-26 Afiya Ayman , Ayan Mukhopadhyay , Aron Laszka

Multi-Task Learning (MTL) aims to enhance the model generalization by sharing representations between related tasks for better performance. Typical MTL methods are jointly trained with the complete multitude of ground-truths for all tasks…

Computer Vision and Pattern Recognition · Computer Science 2021-10-15 Yufeng Wang , Yi-Hsuan Tsai , Wei-Chih Hung , Wenrui Ding , Shuo Liu , Ming-Hsuan Yang

Object detection, segmentation and classification are three common tasks in medical image analysis. Multi-task deep learning (MTL) tackles these three tasks jointly, which provides several advantages saving computing time and resources and…

Computer Vision and Pattern Recognition · Computer Science 2019-06-06 Fei Gao , Hyunsoo Yoon , Teresa Wu , Xianghua Chu