English
Related papers

Related papers: Information Splitting for Big Data Analytics

200 papers

Spectroscopy detected in the time domain entails many techniques, such as FTIR, pump-probe, FT-Raman, and 2DES, and applications, such as molecule characterization, excited state dynamics studies, or spectra classifications. Surprisingly,…

Optics · Physics 2024-05-21 Luca Bolzonello , Niek F van Hulst , Andreas Jakobsson

Learning predictive models from small high-dimensional data sets is a key problem in high-dimensional statistics. Expert knowledge elicitation can help, and a strong line of work focuses on directly eliciting informative prior distributions…

Machine Learning · Computer Science 2019-03-19 Homayun Afrabandpey , Tomi Peltola , Samuel Kaski

This paper deals with the problem of estimating the coupling constant $\theta$ of a mixing quantum Markov chain. For a repeated measurement on the chain's output we show that the outcomes' time average has an asymptotically normal…

Quantum Physics · Physics 2011-06-23 Madalin Guta

We consider the problem of providing valid inference for a selected parameter in a sparse regression setting. It is well known that classical regression tools can be unreliable in this context due to the bias generated in the selection…

Methodology · Statistics 2022-12-07 Daniel G. Rasines , G. Alastair Young

Analysis of a probabilistic system often requires to learn the joint probability distribution of its random variables. The computation of the exact distribution is usually an exhaustive precise analysis on all executions of the system. To…

Information Theory · Computer Science 2023-07-19 Fabrizio Biondi , Yusuke Kawamoto , Axel Legay , Louis-Marie Traonouez

This paper studies the asymptotic behavior of the Fisher information for a Levy process discretely sampled at an increasing frequency. We show that it is possible to distinguish not only the continuous part of the process from its jumps…

Probability · Mathematics 2007-05-23 Yacine Ait-Sahalia , Jean Jacod

Splitting methods are widely used for solving initial value problems (IVPs) due to their ability to simplify complicated evolutions into more manageable subproblems which can be solved efficiently and accurately. Traditionally, these…

Numerical Analysis · Mathematics 2024-11-15 L. M. Kreusser , H. E. Lockyer , E. H. Müller , P. Singh

Based on an idea in [4] we propose a new iterative multiplicative filtering algorithm for label assignment matrices which can be used for the supervised partitioning of data. Starting with a row-normalized matrix containing the averaged…

Numerical Analysis · Mathematics 2018-12-10 Ronny Bergmann , Jan Henrik Fitschen , Johannes Persch , Gabriele Steidl

We consider the estimation of parameters encoded in the measurement record of a continuously monitored quantum system in the jump unraveling, corresponding to a single-shot scenario, where information is continuously gathered. Here, it is…

Quantum Physics · Physics 2026-02-04 Marco Radaelli , Joseph A. Smiga , Gabriel T. Landi , Felix C. Binder

A Bayesian data assimilation scheme is formulated for advection-dominated or hyperbolic evolutionary problems, and observations. The method is referred to as the dynamic likelihood filter because it exploits the model physics to dynamically…

Dynamical Systems · Mathematics 2017-04-26 Juan M. Restrepo

The prior distribution for the unknown model parameters plays a crucial role in the process of statistical inference based on Bayesian methods. However, specifying suitable priors is often difficult even when detailed prior knowledge is…

Methodology · Statistics 2020-03-18 Marcelo Hartmann , Georgi Agiashvili , Paul Bürkner , Arto Klami

Deep neural networks are typically represented by a much larger number of parameters than shallow models, making them prohibitive for small footprint devices. Recent research shows that there is considerable redundancy in the parameter…

Machine Learning · Computer Science 2016-05-17 Ming Tu , Visar Berisha , Yu Cao , Jae-sun Seo

This paper provides a systematic approach to semiparametric identification that is based on statistical information as a measure of its "quality". Identification can be regular or irregular, depending on whether the Fisher information for…

Statistics Theory · Mathematics 2021-07-01 Juan Carlos Escanciano

We develop a general method to study the Fisher information distance in central limit theorem for nonlinear statistics. We first construct completely new representations for the score function. We then use these representations to derive…

Probability · Mathematics 2024-09-23 Nguyen Tien Dung

In this brief note we compute the Fisher information of a family of generalized normal distributions. Fisher information is usually defined for regular distributions, i.e. continuously differentiable (log) density functions whose support…

Information Theory · Computer Science 2020-11-18 Precious Ugo Abara , Sandra Hirche

A key obstacle in automated analytics and meta-learning is the inability to recognize when different datasets contain measurements of the same variable. Because provided attribute labels are often uninformative in practice, this task may be…

Machine Learning · Computer Science 2019-09-12 Jonas Mueller , Alex Smola

Multiple systems estimation using a Poisson loglinear model is a standard approach to quantifying hidden populations where data sources are based on lists of known cases. Information criteria are often used for selecting between the large…

Methodology · Statistics 2023-11-23 Bernard W. Silverman , Lax Chan , Kyle Vincent

Obtaining labels can be costly and time-consuming. Active learning allows a learning algorithm to intelligently query samples to be labeled for efficient learning. Fisher information ratio (FIR) has been used as an objective for selecting…

Machine Learning · Statistics 2016-10-18 Jamshid Sourati , Murat Akcakaya , Todd K. Leen , Deniz Erdogmus , Jennifer G. Dy

Estimating statistical models within sensor networks requires distributed algorithms, in which both data and computation are distributed across the nodes of the network. We propose a general approach for distributed learning based on…

Machine Learning · Computer Science 2012-07-03 Qiang Liu , Alexander Ihler

A deep neural network is a hierarchical nonlinear model transforming input signals to output signals. Its input-output relation is considered to be stochastic, being described for a given input by a parameterized conditional probability…

Machine Learning · Computer Science 2018-08-23 Shun-ichi Amari , Ryo Karakida , Masafumi Oizumi