English
Related papers

Related papers: ML-PWS: Estimating the Mutual Information Between …

200 papers

We describe a novel approach to statistical learning from particles tracked while moving in a random environment. The problem consists in inferring properties of the environment from recorded snapshots. We consider here the case of a fluid…

Information Theory · Computer Science 2008-06-09 Michael Chertkov , Lukas Kroc , Massimo Vergassola

Dryland vegetation ecosystems are known to be susceptible to critical transitions between alternative stable states when subjected to external forcing. Such transitions are often discussed through the framework of bifurcation theory, but…

Computational Physics · Physics 2025-05-16 Daniel Dylewsky , Sonia Kéfi , Madhur Anand , Chris T. Bauch

Many disciplines need quantitative models that synthesize experimental data across multiple instances of the same general system. For example, neuroscientists must combine data from the brains of many individual animals to understand the…

Machine Learning · Computer Science 2026-03-17 William E. Bishop , Luuk W. Hesselink , Bernhard Englitz , Misha B. Ahrens , James E. Fitzgerald

State-space models (SSMs) are a highly expressive model class for learning patterns in time series data and for system identification. Deterministic versions of SSMs (e.g. LSTMs) proved extremely successful in modeling complex time series…

Predicting performance-related behavior of the underlying network structure becomes more and more indispensable in terms of the aspired application outcome quality. However, the reliable forecast of QoS metrics like packet transfer delay in…

Performance · Computer Science 2013-08-20 Adam Bachorek , Bagavathiannan Palanisamy , Jens B. Schmitt

Probability proportional to size (PPS) sampling schemes with a target sample size aim to produce a sample comprising a specified number $n$ of items while ensuring that each item in the population appears in the sample with a probability…

Methodology · Statistics 2024-11-14 Brian Hentschel , Peter J. Haas , Yuanyuan Tian

Quantization is essential for Neural Network (NN) compression, reducing model size and computational demands by using lower bit-width data types, though aggressive reduction often hampers accuracy. Mixed Precision (MP) mitigates this…

Machine Learning · Computer Science 2025-05-20 Shmulik Markovich-Golan , Daniel Ohayon , Itay Niv , Yair Hanani

Networks and network computations have become a primary mathematical tool for analyzing the structure of many kinds of complex systems, ranging from the Internet and transportation networks to biochemical interactions and social networks. A…

Social and Information Networks · Computer Science 2023-07-11 M. E. J. Newman

We propose novel neural temporal models for predicting and synthesizing human motion, achieving state-of-the-art in modeling long-term motion trajectories while being competitive with prior work in short-term prediction and requiring…

Computer Vision and Pattern Recognition · Computer Science 2019-11-25 Anand Gopalakrishnan , Ankur Mali , Dan Kifer , C. Lee Giles , Alexander G. Ororbia

We introduce PINGS (Physics-Informed Neural Network for Fast Generative Sampling), a framework that amortizes diffusion sampling by training a physics-informed network to approximate reverse-time probability-flow dynamics, reducing sampling…

There is often a scarcity of training data for machine learning (ML) classification and regression models in industrial production, especially for time-consuming or sparsely run manufacturing processes. A majority of the limited…

Software Engineering · Computer Science 2022-08-09 Ayan Chatterjee , Bestoun S. Ahmed , Erik Hallin , Anton Engman

We propose a new family of message passing techniques for MAP estimation in graphical models which we call {\em Sequential Reweighted Message Passing} (SRMP). Special cases include well-known techniques such as {\em Min-Sum Diffusion} (MSD)…

Artificial Intelligence · Computer Science 2017-01-20 Vladimir Kolmogorov

In this work, we present a new random sampling method for data streams where the probability of an element's inclusion in the sample is proportional to a weight associated with that element. Our method is based on sampling with replacement,…

Data Structures and Algorithms · Computer Science 2026-03-18 Adriano Meligrana , Adriano Fazzone

This letter presents a probabilistic omnidirectional millimeter-wave path loss model based on real-world 28 GHz and 73 GHz measurements collected in New York City. The probabilistic path loss approach uses a free space line-of-sight…

Information Theory · Computer Science 2016-11-17 Mathew K. Samimi , Theodore S. Rappaport , George R. MacCartney

Epidemic propagation on networks represents an important departure from traditional massaction models. However, the high-dimensionality of the exact models poses a challenge to both mathematical analysis and parameter inference. By using…

Quantitative Methods · Quantitative Biology 2023-02-07 István Z. Kiss , Luc Berthouze , Wasiur R. KhudaBukhsh

Performance estimation aims at estimating the loss that a predictive model will incur on unseen data. These procedures are part of the pipeline in every machine learning project and are used for assessing the overall generalisation ability…

Machine Learning · Computer Science 2021-08-31 Vitor Cerqueira , Luis Torgo , Igor Mozetic

High-dimensional time series appear in many scientific setups, demanding a nuanced approach to model and analyze the underlying dependence structure. Theoretical advancements so far often rely on stringent assumptions regarding the sparsity…

Information Theory · Computer Science 2025-03-20 Daria Tieplova , Samriddha Lahiry , Jean Barbier

In this paper, prediction for linear systems with missing information is investigated. New methods are introduced to improve the Mean Squared Error (MSE) on the test set in comparison to state-of-the-art methods, through appropriate tuning…

Machine Learning · Statistics 2017-01-04 Mohammad Amin Fakharian , Ashkan Esmaeili , Farokh Marvasti

We define a notion of information that an individual sample provides to the training of a neural network, and we specialize it to measure both how much a sample informs the final weights and how much it informs the function computed by the…

Machine learning (ML) models are increasingly being used in metrology applications. However, for ML models to be credible in a metrology context they should be accompanied by principled uncertainty quantification. This paper addresses the…

Machine Learning · Computer Science 2024-05-09 Andrew Thompson