English
Related papers

Related papers: Defeating duplicates: A re-design of the LearnedSo…

200 papers

Optimal designs are usually model-dependent and likely to be sub-optimal if the postulated model is not correctly specified. In practice, it is common that a researcher has a list of candidate models at hand and a design has to be found…

Statistics Theory · Mathematics 2023-03-29 Mingyao Ai , Holger Dette , Zhengfu Liu , Jun Yu

Existing distributed machine learning (DML) systems focus on improving the computational efficiency of distributed learning, whereas communication aspects have received less attention. Many DML systems treat the network as a blackbox. Thus,…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-07-02 Raajay Viswanathan , Aditya Akella

Learned Bloom Filters, i.e., models induced from data via machine learning techniques and solving the approximate set membership problem, have recently been introduced with the aim of enhancing the performance of standard Bloom Filters,…

Machine Learning · Computer Science 2022-11-29 Dario Malchiodi , Davide Raimondi , Giacomo Fumagalli , Raffaele Giancarlo , Marco Frasca

This research concerns Learned Data Structures, a recent area that has emerged at the crossroad of Machine Learning and Classic Data Structures. It is methodologically important and with a high practical impact. We focus on Learned Indexes,…

Data Structures and Algorithms · Computer Science 2023-09-06 Domenico Amato , Giosué Lo Bosco , Raffaele Giancarlo

In the search for highly efficient decoders for short LDPC codes approaching maximum likelihood performance, a relayed decoding strategy, specifically activating the ordered statistics decoding process upon failure of a neural min-sum…

Information Theory · Computer Science 2024-03-26 Guangwen Li , Xiao Yu

With the growth of machine learning techniques, privacy of data of users has become a major concern. Most of the machine learning algorithms rely heavily on large amount of data which may be collected from various sources. Collecting these…

Machine Learning · Computer Science 2023-11-17 Mahfuzur Rahman Chowdhury , Muhammad Ibrahim

When ranking big data observations such as colleges in the United States, diverse consumers reveal heterogeneous preferences. The objective of this paper is to sort out a linear ordering for these observations and to recommend strategies to…

Machine Learning · Statistics 2020-03-30 Xingwei Hu

While fairness-aware machine learning algorithms have been receiving increasing attention, the focus has been on centralized machine learning, leaving decentralized methods underexplored. Federated Learning is a decentralized form of…

Machine Learning · Computer Science 2023-07-04 Teresa Salazar , Miguel Fernandes , Helder Araujo , Pedro Henriques Abreu

As a prevalent distributed learning paradigm, Federated Learning (FL) trains a global model on a massive amount of devices with infrequent communication. This paper investigates a class of composite optimization and statistical recovery…

Machine Learning · Computer Science 2022-10-04 Yajie Bao , Michael Crawshaw , Shan Luo , Mingrui Liu

We introduce a new method for speeding up the inference of deep neural networks. It is somewhat inspired by the reduced-order modeling techniques for dynamical systems.The cornerstone of the proposed method is the maximum volume algorithm.…

Machine Learning · Computer Science 2020-11-26 Julia Gusak , Talgat Daulbaev , Evgeny Ponomarev , Andrzej Cichocki , Ivan Oseledets

Most work on supervised learning research has focused on marginal predictions. In decision problems, joint predictive distributions are essential for good performance. Previous work has developed methods for assessing low-order predictive…

Machine Learning · Statistics 2022-03-01 Ian Osband , Zheng Wen , Seyed Mohammad Asghari , Vikranth Dwaracherla , Xiuyuan Lu , Benjamin Van Roy

In the supervised learning domain, considering the recent prevalence of algorithms with high computational cost, the attention is steering towards simpler, lighter, and less computationally extensive training and inference approaches. In…

Machine Learning · Computer Science 2022-09-02 Antonello Rosato , Massimo Panella , Denis Kleyko

Federated learning is a framework for distributed optimization that places emphasis on communication efficiency. In particular, it follows a client-server broadcast model and is particularly appealing because of its ability to accommodate…

Machine Learning · Computer Science 2022-03-30 Han Wang , Siddartha Marella , James Anderson

Federated learning harnesses the power of distributed optimization to train a unified machine learning model across separate clients. However, heterogeneous data distributions and computational workloads can lead to inconsistent updates and…

Machine Learning · Computer Science 2024-10-15 Aayushya Agarwal , Gauri Joshi , Larry Pileggi

Federated learning has made an important contribution to data privacy-preserving. Many previous works are based on the assumption that the data are independently identically distributed (IID). As a result, the model performance on…

Machine Learning · Computer Science 2020-09-17 Anxun He , Jianzong Wang , Zhangcheng Huang , Jing Xiao

In distributed learning, the goal is to perform a learning task over data distributed across multiple nodes with minimal (expensive) communication. Prior work (Daume III et al., 2012) proposes a general model that bounds the communication…

Machine Learning · Computer Science 2012-04-17 Hal Daume , Jeff M. Phillips , Avishek Saha , Suresh Venkatasubramanian

Weighting strategy prevails in machine learning. For example, a common approach in robust machine learning is to exert lower weights on samples which are likely to be noisy or quite hard. This study reveals another undiscovered strategy,…

Machine Learning · Computer Science 2022-01-05 Rujing Yao , Ou Wu

Existing literature in Continual Learning (CL) has focused on overcoming catastrophic forgetting, the inability of the learner to recall how to perform tasks observed in the past. There are however other desirable properties of a CL system,…

Machine Learning · Computer Science 2021-02-15 Tom Veniat , Ludovic Denoyer , Marc'Aurelio Ranzato

Federated Learning (FL) is an exciting new paradigm that enables training a global model from data generated locally at the client nodes, without moving client data to a centralized server. Performance of FL in a multi-access edge computing…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-05-11 Saurav Prakash , Sagar Dhakal , Mustafa Akdeniz , A. Salman Avestimehr , Nageen Himayat

Semisort is a fundamental algorithmic primitive widely used in the design and analysis of efficient parallel algorithms. It takes input as an array of records and a function extracting a \emph{key} per record, and reorders them so that…

Data Structures and Algorithms · Computer Science 2023-04-21 Xiaojun Dong , Yunshu Wu , Zhongqi Wang , Laxman Dhulipala , Yan Gu , Yihan Sun