English
Related papers

Related papers: A new approach in data reduction: proper handling …

200 papers

Dimension reduction is often the first step in statistical modeling or prediction of multivariate spatial data. However, most existing dimension reduction techniques do not account for the spatial correlation between observations and do not…

Methodology · Statistics 2025-05-27 Si Cheng , Magali N. Blanco , Timothy V. Larson , Lianne Sheppard , Adam Szpiro , Ali Shojaie

Improvements in computational and experimental capabilities are rapidly increasing the amount of scientific data that is routinely generated. In applications that are constrained by memory and computational intensity, excessively large…

Machine Learning · Computer Science 2023-02-28 Malik Hassanaly , Bruce A. Perry , Michael E. Mueller , Shashank Yellapantula

As we enter the era of quantum technologies, quantum estimation theory provides an operationally motivating framework for determining high precision devices in modern technological applications. The aim of any estimation process is to…

Quantum Physics · Physics 2022-05-02 Abdallah Slaoui , Lalla Btissam Drissi , El Hassan Saidi , Rachid Ahl Laamara

Dimensionality reduction can be applied to hyperspectral images so that the most useful data can be extracted and processed more quickly. This is critical in any situation in which data volume exceeds the capacity of the computational…

Image and Video Processing · Electrical Eng. & Systems 2024-02-27 Daniela Lupu , Joseph L. Garrett , Tor Arne Johansen , Milica Orlandic , Ion Necoara

In data-driven inverse optimization an observer aims to learn the preferences of an agent who solves a parametric optimization problem depending on an exogenous signal. Thus, the observer seeks the agent's objective function that best…

Optimization and Control · Mathematics 2017-07-25 Peyman Mohajerin Esfahani , Soroosh Shafieezadeh-Abadeh , Grani Adiwena Hanasusanto , Daniel Kuhn

The accuracy of astrometric observations conducted via a space-borne optical interferometer orbiting the Earth is expected to approach a few microarcseconds. Data processing of such extremely high-precision measurements requires access to a…

General Relativity and Quantum Cosmology · Physics 2007-05-23 Sergei M. Kopeikin , N. V. Shuygina , M. V. Vasilyev , E. I. Yagudina , L. I. Yagudin

A simple, yet general, formalism for the optimized linear combination of astrophysical images is constructed and demonstrated. The formalism allows the user to combine multiple undersampled images to provide oversampled output at high…

Instrumentation and Methods for Astrophysics · Physics 2015-05-28 Barnaby Rowe , Christopher Hirata , Jason Rhodes

Program behavior may depend on parameters, which are either configured before compilation time, or provided at run-time, e.g., by sensors or other input devices. Parametric program analysis explores how different parameter settings may…

Programming Languages · Computer Science 2014-06-23 Thomas M. Gawlitza , Martin D. Schwarz , Helmut Seidl

We present a novel, domain-agnostic, model-independent, unsupervised, and universally applicable Machine Learning approach for dimensionality reduction based on the principles of algorithmic complexity. Specifically, but without loss of…

Data Structures and Algorithms · Computer Science 2025-05-06 Hector Zenil , Narsis A. Kiani , Alyssa Adams , Felipe S. Abrahão , Antonio Rueda-Toicen , Allan A. Zea , Luan Ozelim , Jesper Tegnér

This paper introduces a generalization of the empirical interpolation method (EIM) and the reduced basis method (RBM) in order to allow their combination with data mining and data assimilation. The purpose is to be able to derive sound…

Numerical Analysis · Mathematics 2017-05-09 Y. Maday , O. Mula

Least squares estimation, a regression technique based on minimisation of residuals, has been invaluable in bringing the best fit solutions to parameters in science and engineering. However, in dynamic environments such as in Geomatics…

Computational Engineering, Finance, and Science · Computer Science 2018-04-17 C. P. E. Agbachi

We present a method based on Mueller calculus to calibrate linear polarimetric observations. The key advantages of the proposed way of calibration are: (1) that it can be implemented in a data reduction pipeline, (2) that it is possible to…

Astrophysics · Physics 2009-11-13 Franco Joos , Esther Buenzli , Hans Martin Schmid , Christian Thalmann

A goodness-of-fit test for the fitting of a parametric model to data obtained from a detector with finite resolution and limited acceptance is proposed. The parameters of the model are found by minimization of a statistic that is used for…

Data Analysis, Statistics and Probability · Physics 2015-03-17 N. D. Gagunashvili

Many high-dimensional optimisation problems exhibit rich geometric structures in their set of minimisers, often forming smooth manifolds due to over-parametrisation or symmetries. When this structure is known, at least locally, it can be…

Optimization and Control · Mathematics 2025-10-27 Evan Markou , Thalaiyasingam Ajanthan , Stephen Gould

Energy minimization methods are a classical tool in a multitude of computer vision applications. While they are interpretable and well-studied, their regularity assumptions are difficult to design by hand. Deep learning techniques on the…

Optimization and Control · Mathematics 2019-08-20 Jonas Geiping , Michael Moeller

Optimal error estimation is key to achieve accurate photometry and astrometry. Stellar fluxes and positions in high angular resolution images are typically measured with PSF fitting routines, such as StarFinder. However, the formal…

Instrumentation and Methods for Astrophysics · Physics 2022-08-12 E. Gallego-Cano , R. Schödel , A. T. Gallego-Calvente , A. M. Ghez

Modern radio and multi-instrument astrophysical datasets are increasingly assembled from surveys with different sensitivities and selection effects. In such heterogeneous datasets, published measurement uncertainties are often incomplete,…

Instrumentation and Methods for Astrophysics · Physics 2026-04-14 Marko Imbrišak , Krešimir Tisanić

Many areas in science and engineering now have access to technologies that enable the rapid collection of overwhelming data volumes. While these datasets are vital for understanding phenomena from physical to biological and social systems,…

Signal Processing · Electrical Eng. & Systems 2026-01-14 Nicholas P. Bertrand , Eva Yezerets , Han Lun Yap , Adam S. Charles , Christopher J. Rozell

The newly installed Silmaril beam combiner at the CHARA array is designed to observe previously inaccessible faint targets, including Active Galactic Nuclei and T-Tauri Young Stellar Objects. Silmaril leverages cutting-edge optical design,…

This study proposes an automated data mining framework based on autoencoders and experimentally verifies its effectiveness in feature extraction and data dimensionality reduction. Through the encoding-decoding structure, the autoencoder can…

Machine Learning · Computer Science 2024-12-04 Yaxin Liang , Xinshi Li , Xin Huang , Ziqi Zhang , Yue Yao