English
Related papers

Related papers: A Communication Efficient and Scalable Distributed…

200 papers

This work studies distributed compression for the uplink of a cloud radio access network where multiple multi-antenna base stations (BSs) are connected to a central unit, also referred to as cloud decoder, via capacity-constrained backhaul…

Information Theory · Computer Science 2012-06-19 Seok-Hwan Park , Osvaldo Simeone , Onur Sahin , Shlomo Shamai

Policy Brief on "Global Data in Astronomy: Challenges and Opportunities", distilled from the corresponding panel that was part of the discussions during S20 Policy Webinar on Astroinformatics for Sustainable Development held on 6-7 July…

Instrumentation and Methods for Astrophysics · Physics 2024-02-21 Renee Hložek , Chenzhou Cui , Mark Allen , Patricia Whitelock , Jess McIver , Giuseppe Longo , Christopher Fluke , Ajit Kembhavi , Pranav Sharma , Ashish Mahabal

Large-scale distributed computing systems often contain thousands of distributed nodes (machines). Monitoring the conditions of these nodes is important for system management purposes, which, however, can be extremely resource demanding as…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-05-23 Tiffany Tuor , Shiqiang Wang , Kin K. Leung , Bong Jun Ko

The size of astronomical observational data is increasing yearly. For example, while Atacama Large Millimeter/submillimeter Array is expected to generate 200 TB raw data every year, Large Synoptic Survey Telescope is estimated to produce 15…

Instrumentation and Methods for Astrophysics · Physics 2016-11-21 Satoshi Eguchi

The New Vacuum Solar Telescope (NVST) is a 1-m solar telescope that aims to observe the fine structures in both the photosphere and the chromosphere of the Sun. The observational data acquired simultaneously from one channel for the…

Instrumentation and Methods for Astrophysics · Physics 2016-12-23 Ying-bo Liu , Feng Wang , Hui Deng , Kai-fan Ji , Wei Dai , Shou-lin Wei , Bo Liang , Xiao-li Zhang

A distributed adaptive algorithm to estimate a time-varying signal, measured by a wireless sensor network, is designed and analyzed. One of the major features of the algorithm is that no central coordination among the nodes needs to be…

Distributed, Parallel, and Cluster Computing · Computer Science 2008-10-22 Carlo Fischione , Alberto Speranzon , Karl H. Johansson , Alberto Sangiovanni-Vincentelli

Data imbalance is a ubiquitous problem in machine learning. In large scale collected and annotated datasets, data imbalance is either mitigated manually by undersampling frequent classes and oversampling rare classes, or planned for with…

Computer Vision and Pattern Recognition · Computer Science 2021-07-20 Deep Patel , Erin Gao , Anirudh Koul , Siddha Ganju , Meher Anand Kasam

Nowadays, huge amounts of data are naturally collected in distributed sites due to different facts and moving these data through the network for extracting useful knowledge is almost unfeasible for either technical reasons or policies.…

Databases · Computer Science 2017-03-30 Lamine M. Aouad , Nhien-An Le-Khac , Tahar Kechadi

Nowadays medium-large size astronomical projects have to face the management of a large amount of information and data. Dedicated data centres manage the collection of raw and processed data and consequently make them accessible, typically…

Astrophysics · Physics 2007-05-23 Luciano Nicastro , Giorgio Calderone

Federated learning is proposed by Google to safeguard data privacy through training models locally on users' devices. However, with deep learning models growing in size to achieve better results, it becomes increasingly difficult to…

Machine Learning · Computer Science 2022-02-25 Jie Zhu , Shenggui Li , Yang You

Over the past decade, astronomers have been using an increasingly larger number of web-based applications and archives to conduct their research. However, despite the early success in creating links across projects and data centers, the…

Instrumentation and Methods for Astrophysics · Physics 2015-03-17 Alberto Accomazzi , Michael J. Kurtz , Stephen S. Murray

Federated data analytics is a framework for distributed data analysis where a server compiles noisy responses from a group of distributed low-bandwidth user devices to estimate aggregate statistics. Two major challenges in this framework…

Machine Learning · Computer Science 2022-06-10 Kamalika Chaudhuri , Chuan Guo , Mike Rabbat

Allocation of (redundant) file chunks throughout a distributed storage system affects important performance metrics such as the probability of file recovery, data download time, or the service rate of the system under a given data access…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-08-24 Pei Peng , Emina Soljanin

The integration of Low Earth Orbit (LEO) satellite constellations into 5G and Beyond is essential to achieve efficient global connectivity. As LEO satellites are a global infrastructure with predictable dynamics, a pre-planned fair and…

Networking and Internet Architecture · Computer Science 2022-11-14 Israel Leyva-Mayorga , Vineet Gala , Federico Chiariotti , Petar Popovski

In recent years, an increasing amount of data is collected in different and often, not cooperative, databases. The problem of privacy-preserving, distributed calculations over separated databases and, a relative to it, issue of private data…

Databases · Computer Science 2016-05-23 Philip Derbeko , Shlomi Dolev , Ehud Gudes , Jeffrey D. Ullman

Virtual Observatory (VO) is a data-intensively online astronomical research and education environment, which takes advantages of advanced information technologies to achieve seamless and global access to astronomical information. AstroCloud…

With the rapid advancements in observational technologies and the widespread implementation of large-scale sky surveys, diverse electromagnetic wave data (e.g., optical and infrared) and non-electromagnetic wave data (e.g., gravitational…

Instrumentation and Methods for Astrophysics · Physics 2026-03-03 Wujun Shao , Dongwei Fan , Chenzhou Cui , Yunfei Xu , Shirui Wei , Xin Lyu

Combining data from varied sources has considerable potential for knowledge discovery: collaborating data parties can mine data in an expanded feature space, allowing them to explore a larger range of scientific questions. However, data…

Machine Learning · Computer Science 2019-11-11 Erik-Jan van Kesteren , Chang Sun , Daniel L. Oberski , Michel Dumontier , Lianne Ippel

High-dimensional astronomical data cubes provide a wealth of spectral and structural information that can be used to study astrophysical and chemical processes. The complexity and sheer size of these datasets pose significant challenges in…

Instrumentation and Methods for Astrophysics · Physics 2025-12-18 Haley N. Scolati , Ryan A. Loomis , Anthony J. Remijan , Kin Long Kelvin Lee

While load balancing in distributed-memory computing has been well-studied, we present an innovative approach to this problem: a unified, reduced-order model that combines three key components to describe "work" in a distributed system:…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-04-26 Jonathan Lifflander , Philippe P. Pebay , Nicole L. Slattengren , Pierre L. Pebay , Robert A. Pfeiffer , Joseph D. Kotulski , Sean T. McGovern