English
Related papers

Related papers: Minimal Re-computation for Exploratory Data Analys…

200 papers

This paper introduces a novel iterative algorithm for optimizing pilot and data power control (PC) in cell-free massive multiple-input multiple-output (CF-mMIMO) systems, aiming to enhance system performance under real-time channel…

Signal Processing · Electrical Eng. & Systems 2026-01-05 Saeed Mohammadzadeh , Mostafa Rahmani , Kanapathippillai Cumanan , Alister Burr , Pei Xiao

Astronomical observation data require long-term preservation, and the rapid accumulation of observation data makes it necessary to consider the cost of long-term archive storage. In addition to low-speed disk-based online storage, optical…

Instrumentation and Methods for Astrophysics · Physics 2020-06-17 Chao Sun , Ce Yu , Chenzhou Cui , Boliang He , Jian Xiao , Zhen Li , Shanjiang Tang , Jizhou Sun

We introduce the use of two machine learning algorithms to create an empirical model of an experimental apparatus, which is able to reduce the number of measurements necessary for generic optimisation tasks exponentially as compared to…

Quantum Physics · Physics 2020-05-20 Pascal Kobel , Martin Link , Michael Köhl

To exploit the benefits of massive multiple-input multiple-output (M-MIMO) technology in scenarios where base stations (BSs) need to be cheap and equipped with simple hardware, the computational complexity of classical signal processing…

Signal Processing · Electrical Eng. & Systems 2020-03-11 Victor Croisfelt Rodrigues , Jose Carlos Marinello Filho , Taufik Abrao

We reformulate the gain correction problem of the radio interferometry as an optimization problem with regularization, which is solved efficiently with an iterative algorithm. Combining this new method with our previously proposed imaging…

Instrumentation and Methods for Astrophysics · Physics 2024-12-05 Shiro Ikeda , Takeshi Nakazato , Takashi Tsukagoshi , Tsutomu T. Takeuchi , Masayuki Yamaguchi

The study of the fundamental limits of information systems is a central theme in information theory. Both the traditional analytical approach and the recently proposed computational approach have significant limitations, where the former is…

Information Theory · Computer Science 2022-05-04 Wenjing Chen , Chao Tian

We present ReMasker, a new method of imputing missing values in tabular data by extending the masked autoencoding framework. Compared with prior work, ReMasker is both simple -- besides the missing values (i.e., naturally masked), we…

Machine Learning · Computer Science 2023-09-26 Tianyu Du , Luca Melis , Ting Wang

This paper introduces reAnalyst, a framework designed to facilitate the study of reverse engineering (RE) practices through the semi-automated annotation of RE activities across various RE tools. By integrating tool-agnostic data collection…

Software Engineering · Computer Science 2025-03-18 Tab Zhang , Claire Taylor , Bart Coppens , Waleed Mebane , Christian Collberg , Bjorn De Sutter

The aim of this paper is to describe a novel non-parametric noise reduction technique from the point of view of Bayesian inference that may automatically improve the signal-to-noise ratio of one- and two-dimensional data, such as e.g.…

Instrumentation and Methods for Astrophysics · Physics 2023-07-07 Pablo M Sanchez-Alarcon , Yago Ascasibar Sequeiros

The improved method of intermittent data analysis is proposed. It exploits, in addition to the standard density moments, the information on the bin-bin correlations, observed in the data and expressed in terms of the density correlators.…

High Energy Physics - Phenomenology · Physics 2007-05-23 B. Ziaja

Dimension reduction is often an important step in the analysis of high-dimensional data. PCA is a popular technique to find the best low-dimensional approximation of high-dimensional data. However, classical PCA is very sensitive to…

Computation · Statistics 2019-01-14 Holger Cevallos-Valdiviezo , Stefan Van Aelst

We describe the application of data mining algorithms to research problems in astronomy. We posit that data mining has always been fundamental to astronomical research, since data mining is the basis of evidence-based discovery, including…

Instrumentation and Methods for Astrophysics · Physics 2009-11-04 Kirk Borne

The use of ray projections to reconstruct images is a common technique in medical imaging. Dealing with incomplete data is particularly important when a patient is vulnerable to potentially damaging radiation or is unable to cope with the…

Neural and Evolutionary Computing · Computer Science 2024-06-04 Mohammad Majid al-Rifaie , Tim Blackwell

An adaptive iterative decision multi-feedback detection algorithm with constellation constraints is proposed for multiuser multi-antenna systems. An enhanced detection and interference cancellation is performed by introducing multiple…

Information Theory · Computer Science 2013-04-24 Peng Li , Jingjing Liu , Rodrigo C. de Lamare

Compressed sensing is triggering a major evolution in signal acquisition. It consists in sampling a sparse signal at low rate and later using computational power for its exact reconstruction, so that only the necessary information is…

Statistical Mechanics · Physics 2012-06-07 Florent Krzakala , Marc Mézard , François Sausset , Yifan Sun , Lenka Zdeborová

Large-scale science instruments, such as the distributed radio telescope LOFAR, show that we are in an era of data-intensive scientific discovery. Such instruments rely critically on significant computing resources, both hardware and…

Instrumentation and Methods for Astrophysics · Physics 2019-11-05 P. Chris Broekema , Verity L. Allan , Rob V. van Nieuwpoort , Henri E. Bal

The ability to compress observational data and accurately estimate physical parameters relies heavily on informative summary statistics. In this paper, we introduce the use of mutual information (MI) as a means of evaluating the quality of…

Cosmology and Nongalactic Astrophysics · Physics 2023-07-12 Ce Sui , Xiaosheng Zhao , Tao Jing , Yi Mao

In the current context of data explosion, online techniques that do not require storing all data in memory are indispensable to routinely perform tasks like principal component analysis (PCA). Recursive algorithms that update the PCA with…

Machine Learning · Statistics 2015-11-13 Hervé Cardot , David Degras

Data-collapse is a way of establishing scaling and extracting associated exponents in problems showing self-similar or self-affine characteristics as e.g. in equilibrium or non-equilibrium phase transitions, in critical phases, in dynamics…

Soft Condensed Matter · Physics 2009-11-07 Somendra M. Bhattacharjee , Flavio Seno

From the moment astronomical observations are made the resulting data products begin to grow stale. Even if perfect binary copies are preserved through repeated timely migration to more robust storage media, data standards evolve and new…

Instrumentation and Methods for Astrophysics · Physics 2014-10-15 Rob Seaman