English
Related papers

Related papers: DFS: A Dataset File System for Data Discovering Us…

200 papers

Recent years have seen an increased interest in large-scale analytical dataflows on non-relational data. These dataflows are compiled into execution graphs scheduled on large compute clusters. In many novel application areas the predominant…

Databases · Computer Science 2013-11-26 Astrid Rheinländer , Arvid Heise , Fabian Hueske , Ulf Leser , Felix Naumann

Federated Distillation (FD) is a popular novel algorithmic paradigm for Federated Learning, which achieves training performance competitive to prior parameter averaging based methods, while additionally allowing the clients to train…

Machine Learning · Computer Science 2021-02-05 Felix Sattler , Tim Korjakow , Roman Rischke , Wojciech Samek

This is a thought piece on data-intensive science requirements for databases and science centers. It argues that peta-scale datasets will be housed by science centers that provide substantial storage and processing for scientists who access…

Databases · Computer Science 2007-05-23 Jim Gray , David T. Liu , Maria Nieto-Santisteban , Alexander S. Szalay , David DeWitt , Gerd Heber

In heterogeneous scenarios where the data distribution amongst the Federated Learning (FL) participants is Non-Independent and Identically distributed (Non-IID), FL suffers from the well known problem of data heterogeneity. This leads the…

Machine Learning · Computer Science 2024-07-09 Fatima Abacha , Sin G. Teo , Lucas C. Cordeiro , Mustafa A. Mustafa

Distillation-aware Neural Architecture Search (DaNAS) aims to search for an optimal student architecture that obtains the best performance and/or efficiency when distilling the knowledge from a given teacher model. Previous DaNAS methods…

Machine Learning · Computer Science 2023-05-29 Hayeon Lee , Sohyun An , Minseon Kim , Sung Ju Hwang

This paper addresses the problem of efficiently storing and accessing massive data blocks in a large-scale distributed environment, while providing efficient fine-grain access to data subsets. This issue is crucial in the context of…

Distributed, Parallel, and Cluster Computing · Computer Science 2008-10-14 Bogdan Nicolae , Gabriel Antoniu , Luc Bougé

Stateful applications and virtualized network functions (VNFs) can benefit from state externalization to increase their reliability, scalability, and inter-operability. To keep and share the externalized state, distributed data stores…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-09-25 Ruben Mayer , Harshit Gupta , Enrique Saurez , Umakishore Ramachandran

Storing data is easy, but finding and using data is not. It is desirable that the data is stored in a structured format, which can be preserved and retrieved in future. Creating Metadata for the data is one way of creating structured data…

Information Theory · Computer Science 2011-01-04 Ranjeet Devarakonda , Giri Palanisamy , Jim Green

In today's world data is being generated at a high rate due to which it has become inevitable to analyze and quickly get results from this data. Most of the relational databases primarily support SQL querying with a limited support for…

Databases · Computer Science 2021-04-08 Alex Watson , Suvam Kumar Das , Suprio Ray

A recent take towards Federated Analytics (FA), which allows analytical insights of distributed datasets, reuses the Federated Learning (FL) infrastructure to evaluate the summary of model performances across the training devices. However,…

Machine Learning · Computer Science 2021-06-01 Shashi Raj Pandey , Minh N. H. Nguyen , Tri Nguyen Dang , Nguyen H. Tran , Kyi Thar , Zhu Han , Choong Seon Hong

As the capacity of Solid-State Drives (SSDs) is constantly being optimised and boosted with gradually reduced cost, the SSD cluster is now widely deployed as part of the hybrid storage system in various scenarios such as cloud computing and…

Performance · Computer Science 2023-03-24 Jiashu Wu , Yang Wang , Jinpeng Wang , Hekang Wang , Taorui Lin

Dynamic neural networks (DyNNs) have become viable techniques to enable intelligence on resource-constrained edge devices while maintaining computational efficiency. In many cases, the implementation of DyNNs can be sub-optimal due to its…

Machine Learning · Computer Science 2022-12-08 Halima Bouzidi , Mohanad Odema , Hamza Ouarnoughi , Mohammad Abdullah Al Faruque , Smail Niar

Herein, we propose a novel dataset distillation method for constructing small informative datasets that preserve the information of the large original datasets. The development of deep learning models is enabled by the availability of…

Computer Vision and Pattern Recognition · Computer Science 2024-01-30 Guang Li , Ren Togo , Takahiro Ogawa , Miki Haseyama

Recently, a new generation of P2P systems capable of addressing data integrity and authenticity has emerged for the development of new applications for a "more" decentralized Internet, i.e., Distributed Ledger Technologies (DLT) and…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-09-13 Mirko Zichichi , Luca Serena , Stefano Ferretti , Gabriele D'Angelo

The term Data Space, understood as the secure exchange of data in distributed systems, ensuring openness, transparency, decentralization, sovereignty, and interoperability of information, has gained importance during the last years.…

Databases · Computer Science 2024-02-13 Javier Conde , Alejandro Pozo , Andrés Munoz-Arcentales , Johnny Choque , Álvaro Alonso

Over the last years, Linked Data has grown continuously. Today, we count more than 10,000 datasets being available online following Linked Data standards. These standards allow data to be machine readable and inter-operable. Nevertheless,…

Databases · Computer Science 2020-01-31 Gezim Sejdiu , Anisa Rula , Jens Lehmann , Hajira Jabeen

Transfer learning has proven to be a successful technique to train deep learning models in the domains where little training data is available. The dominant approach is to pretrain a model on a large generic dataset such as ImageNet and…

Computer Vision and Pattern Recognition · Computer Science 2020-04-02 Xi Yan , David Acuna , Sanja Fidler

The exponential increase of availability of digital data and the necessity to process it in business and scientific fields has literally forced upon us the need to analyze and mine useful knowledge from it. Traditionally data mining has…

Databases · Computer Science 2012-05-16 Rekha Sunny T , Sabu M. Thampi

Neural Architecture Search (NAS) is a popular tool for automatically generating Neural Network (NN) architectures. In early NAS works, these tools typically optimized NN architectures for a single metric, such as accuracy. However, in the…

Neural and Evolutionary Computing · Computer Science 2023-04-05 Emil Njor , Jan Madsen , Xenofon Fafoutis

The sustainability of any Data Warehouse System (DWS) is closely correlated with user satisfaction. Therefore, analysts, designers and developers focused more on achieving all its functionality, without considering others kinds of…

Databases · Computer Science 2013-11-06 I. Hilal , N. Afifi , R. Filali Hilali , M. Ouzzif