English
Related papers

Related papers: Hyper-Fit: Fitting Linear Models to Multidimension…

200 papers

High dimensional hypothesis test deals with models in which the number of parameters is significantly larger than the sample size. Existing literature develops a variety of individual tests. Some of them are sensitive to the dense and small…

Statistics Theory · Mathematics 2018-08-09 Cheng Zhou , Xinsheng Zhang , Wenxin Zhou , Han Liu

The accurate automated classification of variable stars into their respective sub-types is difficult. Machine learning based solutions often fall foul of the imbalanced learning problem, which causes poor generalisation performance in…

Instrumentation and Methods for Astrophysics · Physics 2020-03-18 Zafiirah Hosenie , Robert Lyon , Benjamin Stappers , Arrykrishna Mootoovaloo , Vanessa McBride

Numerical relativity is an essential tool in studying the coalescence of binary black holes (BBHs). It is still computationally prohibitive to cover the BBH parameter space exhaustively, making phenomenological fitting formulas for BBH…

General Relativity and Quantum Cosmology · Physics 2017-03-28 Xisco Jiménez-Forteza , David Keitel , Sascha Husa , Mark Hannam , Sebastian Khan , Michael Pürrer

Cross-matching operation, which is to find corresponding data for the same celestial object or region from multiple catalogues,is indispensable to astronomical data analysis and research. Due to the large amount of astronomical catalogues…

Instrumentation and Methods for Astrophysics · Physics 2023-01-19 Yajie Zhang , Ce Yu , Chao Sun , Jian Xiao , Kun Li , Yifei Mu , Chenzhou Cui

The amount of collected data in many scientific fields is increasing, all of them requiring a common task: extract knowledge from massive, multi parametric data sets, as rapidly and efficiently possible. This is especially true in astronomy…

We consider the fitting of heavy tailed data and distribution with a special attention to distributions with a non--standard shape in the "body" of the distribution. To this end we consider a dense class of heavy tailed distributions…

Statistics Theory · Mathematics 2017-05-15 Mogens Bladt , Leonardo Rojas-Nandayapa

Hyperspectral remote sensing is a promising tool for a variety of applications including ecology, geology, analytical chemistry and medical research. This article presents the new \hsdar package for R statistical software, which performs a…

Other Statistics · Statistics 2019-05-28 Lukas W. Lehnert , Hanna Meyer , Wolfgang A. Obermeier , Brenner Silva , Bianca Regeling , Jörg Bendix

Consider a high-dimensional data set, in which for every data-point there is incomplete information. Each object in the data set represents a real entity, which is described by a point in high-dimensional space. We model the lack of…

Other Computer Science · Computer Science 2016-05-10 Hadassa Daltrophe , Shlomi Dolev , Zvi Lotker

We present a (selective) review of recent frequentist high-dimensional inference methods for constructing $p$-values and confidence intervals in linear and generalized linear models. We include a broad, comparative empirical study which…

Methodology · Statistics 2015-12-11 Ruben Dezeure , Peter Bühlmann , Lukas Meier , Nicolai Meinshausen

Unbinned maximum likelihood is a common procedure for parameter estimation. After parameters have been estimated, it is crucial to know whether the fit model adequately describes the experimental data. Univariate Goodness of Fit procedures…

Applications · Statistics 2011-02-14 Giulio Palombo

In recent years, both online and offline deep learning models have been developed for time series forecasting. However, offline deep forecasting models fail to adapt effectively to changes in time-series data, while online deep forecasting…

Machine Learning · Computer Science 2024-02-06 Mohamed Mejri , Chandramouli Amarnath , Abhijit Chatterjee

We study the problem of linear feature selection when features are highly correlated. Such settings pose two fundamental challenges. First, how should model similarity be defined? Simply counting features in common can be misleading: two…

Methodology · Statistics 2026-03-24 Xiaozhu Zhang , Jacob Bien , Armeen Taeb

A ubiquitous feature of data of our era is their extra-large sizes and dimensions. Analyzing such high-dimensional data poses significant challenges, since the feature dimension is often much larger than the sample size. This thesis…

Statistics Theory · Mathematics 2025-09-11 Kai Yang

Log-linear modeling is a popular method for the analysis of contingency table data. When the table is sparse, and the data falls on a proper face $F$ of the convex support, there are consequences on model inference and model selection.…

Computation · Statistics 2016-12-19 Matthew Friedlander

We present NPTFit, an open-source code package, written in python and cython, for performing non-Poissonian template fits (NPTFs). The NPTF is a recently-developed statistical procedure for characterizing the contribution of unresolved…

High Energy Astrophysical Phenomena · Physics 2017-06-07 Siddharth Mishra-Sharma , Nicholas L. Rodd , Benjamin R. Safdi

Heliophysics image data largely relies on a forty-year-old ecosystem built on the venerable Flexible Image Transport System (FITS) data standard. While many in situ measurements use newer standards, they are difficult to integrate with…

Complex phenomena in engineering and the sciences are often modeled with computationally intensive feed-forward simulations for which a tractable analytic likelihood does not exist. In these cases, it is sometimes necessary to estimate an…

Methodology · Statistics 2020-06-18 Niccolò Dalmasso , Ann B. Lee , Rafael Izbicki , Taylor Pospisil , Ilmun Kim , Chieh-An Lin

With the development of new remote sensing technology, large or even massive spatial datasets covering the globe become available. Statistical analysis of such data is challenging. This article proposes a semiparametric approach to model…

Methodology · Statistics 2019-10-24 Pulong Ma , Emily L. Kang

Most existing robust fitting methods are designed for classical models, such as lines, circles, and planes. In contrast, fewer methods have been developed to robustly handle non-classical models, such as spiral curves, procedural character…

Computer Vision and Pattern Recognition · Computer Science 2026-02-06 Zongliang Zhang , Shuxiang Li , Xingwang Huang , Zongyue Wang

We consider the challenges that arise when fitting complex ecological models to 'large' data sets. In particular, we focus on random effect models which are commonly used to describe individual heterogeneity, often present in ecological…

Methodology · Statistics 2022-05-17 Ruth King , Blanca Sarzo , Víctor Elvira