English
Related papers

Related papers: Minimal Re-computation for Exploratory Data Analys…

200 papers

Low-dose tomography is highly preferred in medical procedures for its reduced radiation risk when compared to standard-dose Computed Tomography (CT). However, the lower the intensity of X-rays, the higher the acquisition noise and hence the…

Image and Video Processing · Electrical Eng. & Systems 2019-12-24 Preeti Gopal , Sharat Chandran , Imants Svalbe , Ajit Rajwade

Photometric surveys have provided incredible amounts of astronomical information in the form of images. However, astronomical images often contain artifacts that can critically hinder scientific analysis by misrepresenting intensities or…

Instrumentation and Methods for Astrophysics · Physics 2020-06-03 Suchetha Cooray , Tsutomu T. Takeuchi , Moe Yoda , Kazuo Sorai

We present a novel algorithm which can overcome the drawbacks of the conventional linear scaling method with minimal computational overhead. This is achieved by introducing additional constraints, thus eliminating the redundancy of the…

Materials Science · Physics 2015-06-25 Eiji Tsuchida

Data analysis methods have always been of critical importance for quantitative sciences. In astronomy, the increasing scale of current and future surveys is driving a trend towards a separation of the processes of low-level data reduction…

Instrumentation and Methods for Astrophysics · Physics 2011-09-07 James Bosch

In this paper, we propose a new algorithm for recovery of low-rank matrices from compressed linear measurements. The underlying idea of this algorithm is to closely approximate the rank function with a smooth function of singular values,…

Information Theory · Computer Science 2016-11-18 Mohammadreza Malek-Mohammadi , Massoud Babaie-Zadeh , Mikael Skoglund

The site conditions that make astronomical observatories in space and on the ground so desirable -- cold and dark -- demand a physical remoteness that leads to limited data transmission capabilities. Such transmission limitations directly…

Artificial Intelligence · Computer Science 2025-06-11 Tuan Truong , Rithwik Sudharsan , Yibo Yang , Peter Xiangyuan Ma , Ruihan Yang , Stephan Mandt , Joshua S. Bloom

Incremental computation aims to compute more efficiently on changed input by reusing previously computed results. We give a high-level overview of works on incremental computation, and highlight the essence underlying all of them, which we…

Programming Languages · Computer Science 2025-10-15 Yanhong A. Liu

We present new data processing techniques that allow to correct the main instrumental effects that degrade the images obtained by ISOCAM, the camera on board the Infrared Space Observatory (ISO). Our techniques take advantage of the fact…

Astrophysics · Physics 2009-10-31 M. -A. Miville-Deschenes , F. Boulanger , A. Abergel , J. -P. Bernard

This work presents generalized low-rank signal decompositions with the aid of switching techniques and adaptive algorithms, which do not require eigen-decompositions, for space-time adaptive processing. A generalized scheme is proposed to…

Information Theory · Computer Science 2013-04-09 R. C. de Lamare

The work is devoted to the analysis of the Resampling method proposed by A. Andronov and to the analysis of the Resampling method application possibility to the estimation and simulation of the calculation and logical systems reliability.…

Applications · Statistics 2013-04-25 Maxim Fioshin

The new generation research experiments will introduce huge data surge to a continuously increasing data production by current experiments. This data surge necessitates efficient compression techniques. These compression techniques must…

Numerical Analysis · Computer Science 2018-05-07 Pierre Aubert , Thomas Vuillaume , Gilles Maurin , Jean Jacquemier , Giovanni Lamanna , Nahid Emad

Astronomical data reduction is usually done with processing pipelines that consist of a series of individual processing steps that can be executed stand-alone. These processing steps are then strung together into workflows and fed with data…

Instrumentation and Methods for Astrophysics · Physics 2024-01-26 Wolfram Freudling , Stefano Zampieri , Lodovico Coccato , Stanislaw Podgorski , Martino Romaniello , Andrea Modigliani , John Pritchard

In radio astronomy, the science output of a telescope is often limited by computational resources. This is especially true for transient and technosignature surveys that need to search high-resolution data across a large parameter space.…

Instrumentation and Methods for Astrophysics · Physics 2024-04-11 Danny C. Price

We study Sigma-Delta quantization methods coupled with appropriate reconstruction algorithms for digitizing randomly sampled low-rank matrices. We show that the reconstruction error associated with our methods decays polynomially with the…

Information Theory · Computer Science 2018-04-18 Eric Lybrand , Rayan Saab

We present the design of a novel way of handling astronomical catalogs in Astro-WISE in order to achieve the scalability required for the data produced by large scale surveys. A high level of automation and abstraction is achieved in order…

Instrumentation and Methods for Astrophysics · Physics 2011-11-17 Hugo Buddelmeijer , Danny Boxhoorn , Edwin A. Valentijn

Astronomical observations, physical experiments as well as computer simulations often involve discrete data sets supposed to represent a fair sample of an underlying smooth and continuous field. Reconstructing the underlying fields from a…

Astrophysics · Physics 2007-05-23 W. E. Schaap , R. van de Weygaert

The influx of massive amounts of data from current and upcoming cosmological surveys necessitates compression schemes that can efficiently summarize the data with minimal loss of information. We introduce a method that leverages the…

Cosmology and Nongalactic Astrophysics · Physics 2023-12-18 Aizhan Akhmetzhanova , Siddharth Mishra-Sharma , Cora Dvorkin

In this paper we present a strategy for optimization functions with stochastic input. The main idea is to take advantage of decomposition in combination with a look-up table. Deciding what input values should be used for memoization is…

Other Computer Science · Computer Science 2012-11-26 Edin H. Mulalić , Miomir S. Stanković , Radomir S. Stanković

Image restoration methods are commonly used to improve the quality of astronomical images. In recent years, developments of deep neural networks and increments of the number of astronomical images have evoked a lot of data--driven image…

Instrumentation and Methods for Astrophysics · Physics 2020-11-25 Peng Jia , Ruiyu Ning , Ruiqi Sun , Xiaoshan Yang , Dongmei Cai

The ability to compress observational data and accurately estimate physical parameters relies heavily on informative summary statistics. In this paper, we introduce the use of mutual information (MI) as a means of evaluating the quality of…

Cosmology and Nongalactic Astrophysics · Physics 2023-07-12 Ce Sui , Xiaosheng Zhao , Tao Jing , Yi Mao