English
Related papers

Related papers: TokaMind: A Multi-Modal Transformer Foundation Mod…

200 papers

Due to the over-fitting problem caused by imbalance samples, there is still room to improve the performance of data-driven automatic modulation classification (AMC) in noisy scenarios. By fully considering the signal characteristics, an AMC…

Signal Processing · Electrical Eng. & Systems 2022-03-08 Hao Shi , Qi Peng , Yiqi Zhuang

This work presents a multi-layered methodology for efficiently accelerating multimodal foundation models (MFMs). It combines hardware and software co-design of transformer blocks with an optimization pipeline that reduces computational and…

Achieving reliable real-time control of tokamak plasmas is essential for sustaining high-performance operation in next-generation fusion reactors. A major challenge is the accurate and timely prediction of edge-localized modes (ELMs),…

Real-world problems are often dependent on multiple data modalities, making multimodal fusion essential for leveraging diverse information sources. In high-stakes domains, such as in healthcare, understanding how each modality contributes…

Neural and Evolutionary Computing · Computer Science 2025-05-19 Mafalda Malafaia , Thalea Schlender , Tanja Alderliesten , Peter A. N. Bosman

Medical time series (MedTS) classification suffers from poor generalizability in real-world deployment due to inter- and intra-dataset heterogeneity, such as varying numbers of channels, signal lengths, task definitions, and patient…

Machine Learning · Computer Science 2025-05-20 Nan Huang , Haishuai Wang , Zihuai He , Marinka Zitnik , Xiang Zhang

Multimodal recommendation aims to enhance user preference modeling by leveraging rich item content such as images and text. Yet dominant systems fuse modalities in the spatial domain, obscuring the frequency structure of signals and…

Information Retrieval · Computer Science 2026-02-02 Wei Yang , Rui Zhong , Yiqun Chen , Shixuan Li , Heng Ping , Chi Lu , Peng Jiang

Effective foundation modeling in remote sensing requires spatially aligned heterogeneous modalities coupled with semantically grounded supervision, yet such resources remain limited at scale. We present GeoMeld, a large-scale multimodal…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Maram Hasan , Md Aminur Hossain , Savitra Roy , Souparna Bhowmik , Ayush V. Patel , Mainak Singha , Subhasis Chaudhuri , Muhammad Haris Khan , Biplab Banerjee

Recent advances in pre-trained vision transformers have shown promise in parameter-efficient audio-visual learning without audio pre-training. However, few studies have investigated effective methods for aligning multimodal features in…

Computer Vision and Pattern Recognition · Computer Science 2024-06-10 Tanvir Mahmud , Shentong Mo , Yapeng Tian , Diana Marculescu

Cancer prognosis is a critical task that involves predicting patient outcomes and survival rates. To enhance prediction accuracy, previous studies have integrated diverse data modalities, such as clinical notes, medical images, and genomic…

Machine Learning · Computer Science 2025-02-04 Jie Peng , Shuang Zhou , Longwei Yang , Yiran Song , Mohan Zhang , Kaixiong Zhou , Feng Xie , Mingquan Lin , Rui Zhang , Tianlong Chen

Learning motor control for muscle-driven musculoskeletal models is hindered by the computational cost of biomechanically accurate simulation and the scarcity of validated, open full-body models. Here we present MuscleMimic, an open-source…

Early identification of stroke symptoms is essential for enabling timely intervention and improving patient outcomes, particularly in prehospital settings. This study presents a fast, non-invasive multimodal deep learning framework for…

Computer Vision and Pattern Recognition · Computer Science 2026-03-19 Ngoc-Khai Hoang , Thi-Nhu-Mai Nguyen , Huy-Hieu Pham

Humans perceive the world by concurrently processing and fusing high-dimensional inputs from multiple modalities such as vision and audio. Machine perception models, in stark contrast, are typically modality-specific and optimised for…

Computer Vision and Pattern Recognition · Computer Science 2022-12-02 Arsha Nagrani , Shan Yang , Anurag Arnab , Aren Jansen , Cordelia Schmid , Chen Sun

In this work, a Model Predictive Controller (MPC) is proposed to control the plasma shape in the Tokamak \`a Configuration Variable (TCV). The proposed controller relies on models obtained by coupling linearized plasma response models,…

Recent multimodal large language models (MLLMs) have made remarkable progress in visual understanding and language-based reasoning, yet they lack a persistent world-centered representation for spatially consistent reasoning in 3D…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Bo Gu , Zhikang Zhang , Zizhuang Wei , Zhenyuan Chen , Lingyun Li , Zhuoyi Song

Multimodal molecular models often suffer from 3D conformer unreliability and modality collapse, limiting their robustness and generalization. We propose MuMo, a structured multimodal fusion framework that addresses these challenges in…

Machine Learning · Computer Science 2025-10-29 Zihao Jing , Yan Sun , Yan Yi Li , Sugitha Janarthanan , Alana Deng , Pingzhao Hu

Artificial intelligence is a key enabler for next-generation wireless communication and sensing. Yet, today's learning-based wireless techniques do not generalize well: most models are task-specific, environment-dependent, and limited to…

Signal Processing · Electrical Eng. & Systems 2026-02-05 Vahid Yazdnian , Yasaman Ghasempour

Current multi-modality driving frameworks normally fuse representation by utilizing attention between single-modality branches. However, the existing networks still suppress the driving performance as the Image and LiDAR branches are…

Computer Vision and Pattern Recognition · Computer Science 2024-05-14 Yiqun Duan , Xianda Guo , Zheng Zhu , Zhen Wang , Yu-Kai Wang , Chin-Teng Lin

The use of diverse modalities, such as omics, medical images, and clinical data can not only improve the performance of prognostic models but also deepen an understanding of disease mechanisms and facilitate the development of novel…

Image and Video Processing · Electrical Eng. & Systems 2025-08-14 Maria Boyko , Aleksandra Beliaeva , Dmitriy Kornilov , Alexander Bernstein , Maxim Sharaev

Artificial intelligence and machine learning have shown great promise in their ability to accelerate novel materials discovery. As researchers and domain scientists seek to unify and consolidate chemical knowledge, the case for models with…

We have developed an innovative workflow, STEP-0D, within the OMFIT integrated modelling framework. Through systematic validation against the International Tokamak Physics Activity (ITPA) global H-mode confinement database, we demonstrated…