中文
相关论文

相关论文: Data collaboration analysis for distributed datase…

200 篇论文

Combining the results of different search engines in order to improve upon their performance has been the subject of many research papers. This has become known as the "Data Fusion" task, and has great promise in dealing with the vast…

信息检索 · 计算机科学 2018-02-13 Weinan Huang , Junyi Chen , Lei Meng , David Lillis

Dataset Condensation (DC) aims to reduce deep neural networks training efforts by synthesizing a small dataset such that it will be as effective as the original large dataset. Conventionally, DC relies on a costly bi-level optimization…

计算机视觉与模式识别 · 计算机科学 2024-12-09 Sahar Rahimi Malakshan , Mohammad Saeed Ebrahimi Saadabadi , Ali Dabouei , Nasser M. Nasrabadi

In diverse fields ranging from finance to omics, it is increasingly common that data is distributed and with multiple individual sources (referred to as ``clients'' in some studies). Integrating raw data, although powerful, is often not…

统计方法学 · 统计学 2022-11-08 Yuanxing Chen , Qingzhao Zhang , Shuangge Ma , Kuangnan Fang

Distributed, online data mining systems have emerged as a result of applications requiring analysis of large amounts of correlated and high-dimensional data produced by multiple distributed data sources. We propose a distributed online data…

机器学习 · 计算机科学 2013-07-03 Cem Tekin , Mihaela van der Schaar

Federated learning is a technique that enables the use of distributed datasets for machine learning purposes without requiring data to be pooled, thereby better preserving privacy and ownership of the data. While supervised FL research has…

机器学习 · 计算机科学 2024-02-19 Swier Garst , Marcel Reinders

In the context of big data analysis, the divide-and-conquer methodology refers to a multiple-step process: first splitting a data set into several smaller ones; then analyzing each set separately; finally combining results from each…

机器学习 · 统计学 2021-02-23 Xueying Chen , Jerry Q. Cheng , Min-ge Xie

Collecting the large datasets needed to train deep neural networks can be very difficult, particularly for the many applications for which sharing and pooling data is complicated by practical, ethical, or legal concerns. However, it may be…

For many use cases, combining information from different datasets can be of interest to improve a machine learning model's performance, especially when the number of samples from at least one of the datasets is small. However, a potential…

机器学习 · 统计学 2023-05-17 Thu Nguyen , Rabindra Khadka , Nhan Phan , Anis Yazidi , Pål Halvorsen , Michael A. Riegler

Machine Learning (ML) techniques have begun to dominate data analytics applications and services. Recommendation systems are a key component of online service providers. The financial industry has adopted ML to harness large volumes of data…

分布式、并行与集群计算 · 计算机科学 2022-03-29 Richard Mortier , Hamed Haddadi , Sandra Servia , Liang Wang

Deep neural networks have shown the ability to extract universal feature representations from data such as images and text that have been useful for a variety of learning tasks. However, the fruits of representation learning have yet to be…

机器学习 · 计算机科学 2023-03-28 Liam Collins , Hamed Hassani , Aryan Mokhtari , Sanjay Shakkottai

This work tackles the challenges of data heterogeneity and communication limitations in decentralized federated learning. We focus on creating a collaboration graph that guides each client in selecting suitable collaborators for training…

机器学习 · 计算机科学 2024-06-11 Salma Kharrat , Marco Canini , Samuel Horvath

In the growing world of artificial intelligence, federated learning is a distributed learning framework enhanced to preserve the privacy of individuals' data. Federated learning lays the groundwork for collaborative research in areas where…

机器学习 · 计算机科学 2023-11-21 Elaheh Jafarigol , Theodore Trafalis , Talayeh Razzaghi , Mona Zamankhani

Federated Learning is an algorithm suited for training models on decentralized data, but the requirement of a central "server" node is a bottleneck. In this document, we first introduce the notion of Decentralized Federated Learning (DFL).…

机器学习 · 计算机科学 2021-08-10 Zhuofan Zhang , Mi Zhou , Kaicheng Niu , Chaouki Abdallah

In this paper, we propose a very concise deep learning approach for collaborative filtering that jointly models distributional representation for users and items. The proposed framework obtains better performance when compared against…

信息检索 · 计算机科学 2015-02-17 Zhang Junlin , Cai Heng , Huang Tongwen , Xue Huiping

Emerging cross-device artificial intelligence (AI) applications require a transition from conventional centralized learning systems towards large-scale distributed AI systems that can collaboratively perform complex learning tasks. In this…

Recent success of deep learning is largely attributed to the sheer amount of data used for training deep neural networks.Despite the unprecedented success, the massive data, unfortunately, significantly increases the burden on storage and…

机器学习 · 计算机科学 2023-10-10 Ruonan Yu , Songhua Liu , Xinchao Wang

Federated learning is an emerging distributed machine learning framework for privacy preservation. However, models trained in federated learning usually have worse performance than those trained in the standard centralized learning mode,…

机器学习 · 计算机科学 2021-06-15 Hangyu Zhu , Jinjin Xu , Shiqing Liu , Yaochu Jin

Dual encoding models that encode a pair of inputs are widely used for representation learning. Many approaches train dual encoding models by maximizing agreement between pairs of encodings on centralized training data. However, in many…

Distributed health data networks that use information from multiple sources have drawn substantial interest in recent years. However, missing data are prevalent in such networks and present significant analytical challenges. The current…

密码学与安全 · 计算机科学 2021-01-01 Yi Deng , Xiaoqian Jiang , Qi Long

Use of machine learning to perform database operations, such as indexing, cardinality estimation, and sorting, is shown to provide substantial performance benefits. However, when datasets change and data distribution shifts, empirical…

机器学习 · 计算机科学 2024-11-12 Sepanta Zeighami , Cyrus Shahahbi