English
Related papers

Related papers: CoRAST: Towards Foundation Model-Powered Correlate…

200 papers

Various IoT applications demand resource-constrained machine learning mechanisms for different applications such as pervasive healthcare, activity monitoring, speech recognition, real-time computer vision, etc. This necessitates us to…

Machine Learning · Computer Science 2020-11-09 Gautham Krishna Gudur , Bala Shyamala Balaji , Satheesh K. Perepu

In the last years, Federated learning (FL) has become a popular solution to train machine learning models in domains with high privacy concerns. However, FL scalability and performance face significant challenges in real-world deployments…

Machine Learning · Computer Science 2026-03-11 Davide Domini , Gianluca Aguzzi , Lukas Esterle , Mirko Viroli

Earth Observation Foundation Models (EOFMs) have exploded in prevalence as tools for processing the massive volumes of remotely sensed and other earth observation data, and for delivering impact on the many essential earth monitoring tasks.…

Computer Vision and Pattern Recognition · Computer Science 2025-10-07 Ryan P. Demilt , Nicholas LaHaye , Karis Tenneson

Foundation models (FMs) are catalyzing a transformative shift in materials science (MatSci) by enabling scalable, general-purpose, and multimodal AI systems for scientific discovery. Unlike traditional machine learning models, which are…

Machine Learning · Computer Science 2025-06-27 Minh-Hao Van , Prateek Verma , Chen Zhao , Xintao Wu

Existing few-shot segmentation (FSS) only considers learning support-query correlation and segmenting unseen categories under the precise pixel masks. However, the cost of a large number of pixel masks during training is expensive. This…

Computer Vision and Pattern Recognition · Computer Science 2024-05-31 Xinyang Huang , Chuang Zhu , Kebin Liu , Ruiying Ren , Shengjie Liu

Collective Adaptive Systems (CAS) consist of a large number of spatially distributed heterogeneous entities with decentralised control and varying degrees of complex autonomous behaviour that may be competing for shared resources even when…

Logic in Computer Science · Computer Science 2016-07-08 Maurice H. ter Beek , Michele Loreti

Foundational models (FMs), pretrained on extensive datasets using self-supervised techniques, are capable of learning generalized patterns from large amounts of data. This reduces the need for extensive labeled datasets for each new task,…

Machine Learning · Computer Science 2024-06-19 Quan M. Tran , Suong N. Hoang , Lam M. Nguyen , Dzung Phan , Hoang Thanh Lam

Nowadays, devices are equipped with advanced sensors with higher processing/computing capabilities. Further, widespread Internet availability enables communication among sensing devices. As a result, vast amounts of data are generated on…

Machine Learning · Computer Science 2020-02-26 Ahmed Imteaj , Urmish Thakker , Shiqiang Wang , Jian Li , M. Hadi Amini

Foundation models (FMs) currently dominate news headlines. They employ advanced deep learning architectures to extract structural information autonomously from vast datasets through self-supervision. The resulting rich representations of…

To improve the efficiency and sustainability of learning deep models, we propose CREST, the first scalable framework with rigorous theoretical guarantees to identify the most valuable examples for training non-convex models, particularly…

Machine Learning · Computer Science 2023-06-05 Yu Yang , Hao Kang , Baharan Mirzasoleiman

Remote sensing semantic segmentation (RSS) is an essential technology in earth observation missions. Due to concerns over geographic information security, data privacy, storage bottleneck and industry competition, high-quality annotated…

Computer Vision and Pattern Recognition · Computer Science 2024-12-25 Jieyi Tan , Yansheng Li , Sergey A. Bartalev , Shinkarenko Stanislav , Bo Dang , Yongjun Zhang , Liangqi Yuan , Wei Chen

This paper demonstrates the potential of vibration-based Foundation Models (FMs), pre-trained with unlabeled sensing data, to improve the robustness of run-time inference in (a class of) IoT applications. A case study is presented featuring…

Recent advances in deep forecasting models have achieved remarkable performance, yet most approaches still struggle to provide both accurate predictions and interpretable insights into temporal dynamics. This paper proposes CaReTS, a novel…

Machine Learning · Computer Science 2025-11-14 Fulong Yao , Wanqing Zhao , Chao Zheng , Xiaofei Han

Spatiotemporal learning plays a crucial role in mobile computing techniques to empower smart cites. While existing research has made great efforts to achieve accurate predictions on the overall dataset, they still neglect the significant…

Machine Learning · Computer Science 2024-03-20 Gengyu Lin , Zhengyang Zhou , Qihe Huang , Kuo Yang , Shifen Cheng , Yang Wang

Recent advancements in artificial intelligence (AI), particularly foundation models (FMs), have revolutionized medical image analysis, demonstrating strong zero- and few-shot performance across diverse medical imaging tasks, from…

Computer Vision and Pattern Recognition · Computer Science 2025-10-21 Praveenbalaji Rajendran , Mojtaba Safari , Wenfeng He , Mingzhe Hu , Shansong Wang , Jun Zhou , Xiaofeng Yang

Recent progress in self-supervision shows that pre-training large neural networks on vast amounts of unsupervised data can lead to impressive increases in generalisation for downstream tasks. Such models, recently coined as foundation…

The deep integration of foundation models (FM) with federated learning (FL) enhances personalization and scalability for diverse downstream tasks, making it crucial in sensitive domains like healthcare. Achieving group fairness has become…

Machine Learning · Computer Science 2025-06-24 Yuning Yang , Han Yu , Tianrun Gao , Xiaodong Xu , Guangyu Wang

Functional connectivity estimates are highly sensitive to analysis choices and can be dominated by noise when the number of sampled time points is small relative to network dimensionality. This issue is particularly acute in fMRI, where…

Disordered Systems and Neural Networks · Physics 2026-02-10 Izaro Fernandez-Iriondo , Antonio Jimenez-Marin , Jesus Cortes , Pablo Villegas

Urban systems, as dynamic complex systems, continuously generate spatio-temporal data streams that encode the fundamental laws of human mobility and city evolution. While AI for Science has witnessed the transformative power of foundation…

Machine Learning · Computer Science 2026-03-03 Wei Chen , Yuqian Wu , Junle Chen , Xiaofang Zhou , Yuxuan Liang

The rapid increase in remote sensing satellites has led to the emergence of distributed space-based observation systems. However, existing distributed remote sensing models often rely on centralized training, resulting in data leakage,…

Machine Learning · Computer Science 2025-04-08 Xiaohe Li , Haohua Wu , Jiahao Li , Zide Fan , Kaixin Zhang , Xinming Li , Yunping Ge , Xinyu Zhao