中文
相关论文

相关论文: M3H: Multimodal Multitask Machine Learning for Hea…

200 篇论文

Multi-task learning (MTL) has become an essential machine learning tool for addressing multiple learning tasks simultaneously and has been effectively applied across fields such as healthcare, marketing, and biomedical research. However, to…

机器学习 · 统计学 2025-06-02 Yang Sui , Qi Xu , Yang Bai , Annie Qu

We present a novel approach in the domain of federated learning (FL), particularly focusing on addressing the challenges posed by modality heterogeneity, variability in modality availability across clients, and the prevalent issue of…

机器学习 · 计算机科学 2023-12-19 Minh Tran , Roochi Shah , Zejun Gong

With the rapid advancement of remote sensing technology, high-resolution multi-modal imagery is now more widely accessible. Conventional Object detection models are trained on a single dataset, often restricted to a specific imaging…

计算机视觉与模式识别 · 计算机科学 2025-11-11 Yuxuan Li , Xiang Li , Yunheng Li , Yicheng Zhang , Yimian Dai , Qibin Hou , Ming-Ming Cheng , Jian Yang

Vision-language models (VLMs) have shown impressive abilities across a range of multi-modal tasks. However, existing metrics for evaluating the quality of text generated by VLMs typically focus on an overall evaluation for a specific task,…

计算与语言 · 计算机科学 2026-03-10 Masanari Ohi , Masahiro Kaneko , Naoaki Okazaki , Nakamasa Inoue

A major challenge in multimodal learning is the presence of noise within individual modalities. This noise inherently affects the resulting multimodal representations, especially when these representations are obtained through explicit…

计算机视觉与模式识别 · 计算机科学 2025-08-25 Mohammad Zia Ur Rehman , Devraj Raghuvanshi , Umang Jain , Shubhi Bansal , Nagendra Kumar

Multi-Task Learning (MTL) involves the concurrent training of multiple tasks, offering notable advantages for dense prediction tasks in computer vision. MTL not only reduces training and inference time as opposed to having multiple…

计算机视觉与模式识别 · 计算机科学 2024-12-05 Maxime Fontana , Michael Spratling , Miaojing Shi

This work proposes the M3E2, a multi-task learning neural network model to estimate the effect of multiple treatments. In contrast to existing methods, M3E2 can handle multiple treatment effects applied simultaneously to the same unit,…

机器学习 · 计算机科学 2023-01-09 Raquel Aoki , Yizhou Chen , Martin Ester

Semi-supervised learning has recently been attracting attention as an alternative to fully supervised models that require large pools of labeled data. Moreover, optimizing a model for multiple tasks can provide better generalizability than…

计算机视觉与模式识别 · 计算机科学 2020-05-07 Abdullah-Al-Zubaer Imran , Chao Huang , Hui Tang , Wei Fan , Yuan Xiao , Dingjun Hao , Zhen Qian , Demetri Terzopoulos

Recent advances in multimodal large language models have enabled unified processing of visual and textual inputs, offering promising applications in general-purpose medical AI. However, their ability to generalize compositionally across…

计算机视觉与模式识别 · 计算机科学 2025-11-17 Pooja Singh , Siddhant Ujjain , Tapan Kumar Gandhi , Sandeep Kumar

Tabular data is a fundamental component of real-world information systems, yet most research in table understanding remains confined to English, leaving multilingual comprehension significantly underexplored. Existing multilingual table…

Machine learning approaches have been effective in predicting adverse outcomes in different clinical settings. These models are often developed and evaluated on datasets with heterogeneous patient populations. However, good predictive…

机器学习 · 计算机科学 2018-06-11 Harini Suresh , Jen J. Gong , John Guttag

The development of effective machine learning methodologies for enhancing the efficiency and accuracy of clinical systems is crucial. Despite significant research efforts, managing a plethora of diversified clinical tasks and adapting to…

计算与语言 · 计算机科学 2024-06-19 Yujiang Wu , Hongjian Song , Jiawen Zhang , Xumeng Wen , Shun Zheng , Jiang Bian

Multimodal large language models (MLLMs) have advanced clinical tasks for common conditions, but their performance on rare diseases remains largely untested. In rare-disease scenarios, clinicians often lack prior clinical knowledge, forcing…

计算机视觉与模式识别 · 计算机科学 2026-05-14 Junzhi Ning , Jiashi Lin , Yingying Fang , Wei Li , Jiyao Liu , Cheng Tang , Chenglong Ma , Wenhao Tang , Tianbin Li , Ziyan Huang , Guang Yang , Junjun He

Massively multitask neural architectures provide a learning framework for drug discovery that synthesizes information from many distinct biological sources. To train these architectures at scale, we gather large amounts of data from public…

Surgical triplet recognition, which involves identifying instrument, verb, target, and their combinations, is a complex surgical scene understanding challenge plagued by long-tailed data distribution. The mainstream multi-task learning…

计算机视觉与模式识别 · 计算机科学 2025-09-17 Yiyi Zhang , Yuchen Yuan , Ying Zheng , Jialun Pei , Jinpeng Li , Zheng Li , Pheng-Ann Heng

Multimodal deep learning harnesses diverse imaging modalities, such as MRI sequences, to enhance diagnostic accuracy in medical imaging. A key challenge is determining the optimal timing for integrating these modalities-specifically,…

计算机视觉与模式识别 · 计算机科学 2026-02-16 Valerio Guarrasi , Klara Mogensen , Sara Tassinari , Sara Qvarlander , Paolo Soda

There has been many studies on improving the efficiency of shared learning in Multi-Task Learning(MTL). Previous work focused on the "micro" sharing perspective for a small number of tasks, while in Recommender Systems(RS) and other AI…

机器学习 · 计算机科学 2021-10-27 Junning Liu , Zijie Xia , Yu Lei , Xinjian Li , Xu Wang

Automated Machine Learning (AutoML) offers a promising approach to streamline the training of machine learning models. However, existing AutoML frameworks are often limited to unimodal scenarios and require extensive manual configuration.…

机器学习 · 计算机科学 2024-08-02 Daqin Luo , Chengjian Feng , Yuxuan Nong , Yiqing Shen

Real-world clinical data is inherently multimodal, providing complementary evidence that mirrors the practical necessity of jointly assessing multiple related outcomes. Although multi-task learning can improve efficiency by sharing…

机器学习 · 计算机科学 2026-05-06 He Lyu , Huolin Zeng , Junren Wang , Huazhen Yang , Linchao He , Yong Chen , Zhirui Li , Andreas Maier , Siming Bayer , Huan Song

Wearable sensor technologies and deep learning are transforming healthcare management. Yet, most health sensing studies focus narrowly on physical chronic diseases. This overlooks the critical need for joint assessment of comorbid physical…

机器学习 · 计算机科学 2025-11-21 Yidong Chai , Haoxin Liu , Jiaheng Xie , Chaopeng Wang , Xiao Fang