English
Related papers

Related papers: MultiModalPFN: Extending Prior-Data Fitted Network…

200 papers

The integration of diverse clinical modalities such as medical imaging and the tabular data extracted from patients' Electronic Health Records (EHRs) is a crucial aspect of modern healthcare. Integrative analysis of multiple sources can…

Computer Vision and Pattern Recognition · Computer Science 2025-04-22 Daniel Duenias , Brennan Nichyporuk , Tal Arbel , Tammy Riklin Raviv

Graph Foundation Models (GFMs) have achieved remarkable success in generalizing across diverse domains. However, they mainly focus on Text-Attributed Graphs (TAGs), leaving Multimodal-Attributed Graphs (MAGs) largely untapped. Developing…

Machine Learning · Computer Science 2026-02-05 Sicheng Liu , Xunkai Li , Daohan Su , Ru Zhang , Hongchao Qin , Ronghua Li , Guoren Wang

Foundation models are transforming machine learning across many modalities, with in-context learning replacing classical model training. Recent work on tabular data hints at a similar opportunity to build foundation models for…

Machine Learning · Computer Science 2025-05-12 Andreas Müller , Carlo Curino , Raghu Ramakrishnan

While interpretability is crucial for machine learning applications in safety-critical domains and for regulatory compliance, existing tabular foundation models like TabPFN lack transparency. Generalized Additive Models (GAMs) provide the…

Machine Learning · Computer Science 2026-02-06 Andreas Mueller , Julien Siems , Harsha Nori , David Salinas , Arber Zela , Rich Caruana , Frank Hutter

Universal lesion detection (ULD) on computed tomography (CT) images is an important but underdeveloped problem. Recently, deep learning-based approaches have been proposed for ULD, aiming to learn representative features from annotated CT…

Computer Vision and Pattern Recognition · Computer Science 2019-12-17 Zihao Li , Shu Zhang , Junge Zhang , Kaiqi Huang , Yizhou Wang , Yizhou Yu

Link prediction aims to identify potential missing triples in knowledge graphs. To get better results, some recent studies have introduced multimodal information to link prediction. However, these methods utilize multimodal information…

Artificial Intelligence · Computer Science 2023-03-21 Xinhang Li , Xiangyu Zhao , Jiaxing Xu , Yong Zhang , Chunxiao Xing

There is an increasing interest in the application of deep learning architectures to tabular data. One of the state-of-the-art solutions is TabTransformer which incorporates an attention mechanism to better track relationships between…

Machine Learning · Computer Science 2022-01-04 Radostin Cholakov , Todor Kolev

TabPFN v2 achieves better results than tree-based models on several tabular benchmarks, which is notable since tree-based models are usually the strongest choice for tabular data. However, it cannot handle more than 10K context tokens…

Machine Learning · Computer Science 2025-09-18 Renat Sergazinov , Shao-An Yin

Leveraging the in-context learning (ICL) capability of Large Language Models (LLMs) for tabular classification has gained significant attention for its training-free adaptability across diverse datasets. Recent advancements, like TabPFN,…

Machine Learning · Computer Science 2025-06-09 Yuchen Zeng , Tuan Dinh , Wonjun Kang , Andreas C Mueller

Multimodal Misinformation Recognition has become an urgent task with the emergence of huge multimodal fake content on social media platforms. Previous studies mainly focus on complex feature extraction and fusion to learn discriminative…

Multimedia · Computer Science 2025-10-15 Hengyang Zhou , Yiwei Wei , Jian Yang , Zhenyu Zhang

Technological advances in medical data collection, such as high-throughput genomic sequencing and digital high-resolution histopathology, have contributed to the rising requirement for multimodal biomedical modelling, specifically for…

Machine Learning · Computer Science 2024-10-29 Konstantin Hemker , Nikola Simidjievski , Mateja Jamnik

Multimodal learning has seen great success mining data features from multiple modalities with remarkable model performance improvement. Meanwhile, federated learning (FL) addresses the data sharing problem, enabling privacy-preserved…

Machine Learning · Computer Science 2023-03-29 Rongyu Zhang , Xiaowei Chi , Guiliang Liu , Wenyi Zhang , Yuan Du , Fangxin Wang

Personalized Federated Learning (PFL) which collaboratively trains a federated model while considering local clients under privacy constraints has attracted much attention. Despite its popularity, it has been observed that existing PFL…

Machine Learning · Computer Science 2022-12-05 Tianchun Wang , Wei Cheng , Dongsheng Luo , Wenchao Yu , Jingchao Ni , Liang Tong , Haifeng Chen , Xiang Zhang

Non-parametric distributional regression has achieved significant milestones in recent years. Among these, the Tabular Prior-Data Fitted Network (TabPFN) has demonstrated state-of-the-art performance on various benchmarks. However, a…

Soft Condensed Matter · Physics 2026-01-12 Jonas Landsgesell

Multimodal medical analysis combining image and tabular data has gained increasing attention. However, effective fusion remains challenging due to cross-modal discrepancies in feature dimensions and modality contributions, as well as the…

Computer Vision and Pattern Recognition · Computer Science 2025-09-17 Congjing Yu , Jing Ye , Yang Liu , Xiaodong Zhang , Zhiyong Zhang

Tabular data plays a critical role in real-world financial scenarios. Traditionally, tree models have dominated in handling tabular data. However, financial datasets in the industry often encounter some challenges, such as data…

Machine Learning · Computer Science 2025-03-17 Mingming Zhang , Jiahao Hu , Pengfei Shi , Ningtao Wang , Ruizhe Gao , Guandong Sun , Feng Zhao , Yulin kang , Xing Fu , Weiqiang Wang , Junbo Zhao

Healthcare data now span EHRs, medical imaging, genomics, and wearable sensors, but most diagnostic models still process these modalities in isolation. This limits their ability to capture early, cross-modal disease signatures. This paper…

Machine Learning · Computer Science 2025-12-18 Md Talha Mohsin , Ismail Abdulrashid

Learning from tabular data is of paramount importance, as it complements the conventional analysis of image and video data by providing a rich source of structured information that is often critical for comprehensive understanding and…

Computer Vision and Pattern Recognition · Computer Science 2025-01-14 Kankana Roy , Lars Krämer , Sebastian Domaschke , Malik Haris , Roland Aydin , Fabian Isensee , Martin Held

Accurate tumor segmentation in PET/CT images is crucial for computer-aided cancer diagnosis and treatment. The primary challenge lies in effectively integrating the complementary information from PET and CT images. In clinical settings, the…

Image and Video Processing · Electrical Eng. & Systems 2025-01-03 Yuxuan Qi , Li Lin , Jiajun Wang , Bin Zhang , Jingya Zhang

Federated learning (FL) underpins advancements in privacy-preserving distributed computing by collaboratively training neural networks without exposing clients' raw data. Current FL paradigms primarily focus on uni-modal data, while…

Machine Learning · Computer Science 2024-01-03 Yunfeng Fan , Wenchao Xu , Haozhao Wang , Jiaqi Zhu , Song Guo