English
Related papers

Related papers: DataFed: Towards Reproducible Research via Federat…

200 papers

Federated Retrieval (FR) routes queries across multiple external knowledge sources, to mitigate hallucinations of LLMs, when necessary external knowledge is distributed. However, existing methods struggle to retrieve high-quality and…

Machine Learning · Computer Science 2025-10-15 Zhibang Yang , Xinke Jiang , Rihong Qiu , Ruiqing Li , Yihang Zhang , Yue Fang , Yongxin Xu , Hongxin Ding , Xu Chu , Junfeng Zhao , Yasha Wang

The fusion of complementary multimodal information is crucial in computational pathology for accurate diagnostics. However, existing multimodal learning approaches necessitate access to users' raw data, posing substantial privacy risks.…

Computer Vision and Pattern Recognition · Computer Science 2024-02-27 Yuanzhe Peng , Jieming Bian , Jie Xu

This document explores the advantages of integrating open source software and practices in managing a scientific lab, emphasizing reproducibility and the avoidance of pitfalls. It details practical applications from website management using…

Computers and Society · Computer Science 2024-05-14 Julien Cohen-Adad

For healthcare datasets, it is often not possible to combine data samples from multiple sites due to ethical, privacy or logistical concerns. Federated learning allows for the utilisation of powerful machine learning algorithms without…

Science gateways are user-centric, end-to-end cyberinfrastructure for managing scientific data and executions of computational software on distributed resources. In order to simplify the creation and management of science gateways, we have…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-07-09 Dimuthu Wannipurage , Isuru Ranawaka , Eroma Abeysinghe , Marcus Christie , Suresh Marru , Marlon Pierce

High-dimensional data visualization is crucial in the big data era and these techniques such as t-SNE and UMAP have been widely used in science and engineering. Big data, however, is often distributed across multiple data centers and…

Machine Learning · Computer Science 2024-12-19 Dong Qiao , Xinxian Ma , Jicong Fan

Edge computing enables data processing and storage closer to where the data are created. Given the largely distributed compute environment and the significantly dispersed data distribution, there are increasing demands of data sharing and…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-06-05 Zheng Li , Diego Seco , José Fuentes-Sepúlveda

In many sciences the increasing amounts of data are reaching the limit of established data handling and processing. With four large research centers of the German Helmholtz association the Large Scale Data Management and Analysis (LSDMA)…

Federated learning has attracted increasing attention to building models without accessing the raw user data, especially in healthcare. In real applications, different federations can seldom work together due to possible reasons such as…

Machine Learning · Computer Science 2023-07-11 Yiqiang Chen , Wang Lu , Xin Qin , Jindong Wang , Xing Xie

Spatio-Temporal (ST) data science, which includes sensing, managing, and mining large-scale data across space and time, is fundamental to understanding complex systems in domains such as urban computing, climate science, and intelligent…

Databases · Computer Science 2025-03-19 Yuxuan Liang , Haomin Wen , Yutong Xia , Ming Jin , Bin Yang , Flora Salim , Qingsong Wen , Shirui Pan , Gao Cong

Federated learning is a widely used distributed deep learning framework that protects the privacy of each client by exchanging model parameters rather than raw data. However, federated learning suffers from high communication costs, as a…

Machine Learning · Computer Science 2021-07-20 Guang Yang , Ke Mu , Chunhe Song , Zhijia Yang , Tierui Gong

Federated learning enables the deployment of machine learning to problems for which centralized data collection is impractical. Adding differential privacy guarantees bounds on privacy while data are contributed to a global model. Adding…

Machine Learning · Computer Science 2022-02-22 Andrew Silva , Katherine Metcalf , Nicholas Apostoloff , Barry-John Theobald

The ability to collect and analyze large amounts of data is a growing problem within the scientific community. The growing gap between data and users calls for innovative tools that address the challenges faced by big data volume, velocity…

We have entered the era of big data, and it is considered to be the "fuel" for the flourishing of artificial intelligence applications. The enactment of the EU General Data Protection Regulation (GDPR) raises concerns about individuals'…

Cryptography and Security · Computer Science 2022-01-25 Jiahui Geng , Neel Kanwal , Martin Gilje Jaatun , Chunming Rong

Distributed data mining (DDM) deals with the problem of finding patterns or models, called knowledge, in an environment with distributed data and computations. Today, a massive amounts of data which are often geographically distributed and…

Artificial Intelligence · Computer Science 2019-10-24 Nhien-An Le-Khac , Lamine M. Aouad , M-Tahar Kechadi

Data science models, although successful in a number of commercial domains, have had limited applicability in scientific problems involving complex physical phenomena. Theory-guided data science (TGDS) is an emerging paradigm that aims to…

Data collected by large-scale instruments, observatories, and sensor networks are key enablers of scientific discoveries in many disciplines. However, ensuring that these data can be accessed, integrated, and analyzed in a democratized and…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-12-14 Yubo Qin , Ivan Rodero , Manish Parashar

The development and operation of smart cities relyheavily on large-scale Internet-of-Things (IoT) networks and sensor infrastructures that continuously monitor various aspects of urban environments. These networks generate vast amounts of…

Networking and Internet Architecture · Computer Science 2025-02-10 Hrishikesh Dutta , Roberto Minerva , Maira Alvi , Noel Crespi

Federated learning is an improved version of distributed machine learning that further offloads operations which would usually be performed by a central server. The server becomes more like an assistant coordinating clients to work together…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-10-20 Sheng Shen , Tianqing Zhu , Di Wu , Wei Wang , Wanlei Zhou