English
Related papers

Related papers: Incorporating prior information into distributed l…

200 papers

Active learning seeks to reduce the amount of data required to fit the parameters of a model, thus forming an important class of techniques in modern machine learning. However, past work on active learning has largely overlooked latent…

Machine Learning · Computer Science 2024-02-20 Aditi Jha , Zoe C. Ashwood , Jonathan W. Pillow

We introduce Diffusion Active Learning, a novel approach that combines generative diffusion modeling with data-driven sequential experimental design to adaptively acquire data for inverse problems. Although broadly applicable, we focus on…

Machine Learning · Computer Science 2025-04-07 Luis Barba , Johannes Kirschner , Tomas Aidukas , Manuel Guizar-Sicairos , Benjamín Béjar

Short-term forecasting is an important tool in understanding environmental processes. In this paper, we incorporate machine learning algorithms into a conditional distribution estimator for the purposes of forecasting tropical cyclone…

Machine Learning · Statistics 2020-08-19 David B. Huberman , Brian J. Reich , Howard D. Bondell

Decision trees usefully represent sparse, high dimensional and noisy data. Having learned a function from this data, we may want to thereafter integrate the function into a larger decision-making problem, e.g., for picking the best chemical…

Optimization and Control · Mathematics 2019-09-26 Miten Mistry , Dimitrios Letsios , Gerhard Krennrich , Robert M. Lee , Ruth Misener

Rooted trees with probabilities are convenient to represent a class of random processes with memory. They allow to describe and analyze variable length codes for data compression and distribution matching. In this work, the Leaf-Average…

Information Theory · Computer Science 2013-02-05 Georg Böcherer

Existing approaches for analyzing neural network activations, such as PCA and sparse autoencoders, rely on strong structural assumptions. Generative models offer an alternative: they can uncover structure without such assumptions and act as…

Machine Learning · Computer Science 2026-02-09 Grace Luo , Jiahai Feng , Trevor Darrell , Alec Radford , Jacob Steinhardt

The integration of mobile health (mHealth) devices into behavioral health research has fundamentally changed the way researchers and interventionalists are able to collect data as well as deploy and evaluate intervention strategies. In…

Methodology · Statistics 2021-12-17 Matthew D. Koslovsky , Emily T. Hebert , Michael S. Businelle , Marina Vannucci

Autoregressive large language models (LLMs) compress knowledge from their training data through next-token conditional distributions. This limits tractable querying of this knowledge to start-to-end autoregressive sampling. However, many…

Machine Learning · Computer Science 2024-03-15 Edward J. Hu , Moksh Jain , Eric Elmoznino , Younesse Kaddar , Guillaume Lajoie , Yoshua Bengio , Nikolay Malkin

In this paper, we propose a semiparametric, tree based joint latent class modeling approach (JLCT) to model the joint behavior of longitudinal and time-to-event data. Existing joint latent class modeling approaches are parametric and can…

Methodology · Statistics 2020-10-09 Ningshan Zhang , Jeffrey S. Simonoff

The Linear Threshold Model (LTM) is widely used to study the propagation of collective behaviors as complex contagions. However, its dependence on discrete states and timesteps restricts its ability to capture the multiple time-scales…

Systems and Control · Electrical Eng. & Systems 2026-04-01 Ian Xul Belaustegui , Himani Sinhmar , Ling-Wei Kong , Andrew Michael Hein , Naomi Ehrich Leonard

In this paper, a novel 3D deep learning network is proposed for brain MR image segmentation with randomized connection, which can decrease the dependency between layers and increase the network capacity. The convolutional LSTM and 3D…

Computer Vision and Pattern Recognition · Computer Science 2018-05-23 Siqi Bao , Pei Wang , Tony C. W. Mok , Albert C. S. Chung

We introduce a new nonlinear model for classification, in which we model the joint distribution of response variable, y, and covariates, x, non-parametrically using Dirichlet process mixtures. We keep the relationship between y and x linear…

Statistics Theory · Mathematics 2007-05-23 Babak Shahbaba , Radford M. Neal

The inference of astrophysical and cosmological properties from the Lyman-$\alpha$ forest conventionally relies on summary statistics of the transmission field that carry useful but limited information. We present a deep learning framework…

Cosmology and Nongalactic Astrophysics · Physics 2024-09-11 Parth Nayak , Michael Walther , Daniel Gruen , Sreyas Adiraju

Random Forest (Breiman, 2001) is a successful and widely used regression and classification algorithm. Part of its appeal and reason for its versatility is its (implicit) construction of a kernel-type weighting function on training data,…

Machine Learning · Statistics 2022-10-13 Domagoj Ćevid , Loris Michel , Jeffrey Näf , Nicolai Meinshausen , Peter Bühlmann

The purpose of this paper is to provide a discussion, with illustrating examples, on Bayesian forecasting for dynamic generalized linear models (DGLMs). Adopting approximate Bayesian analysis, based on conjugate forms and on Bayes linear…

Methodology · Statistics 2008-02-05 K. Triantafyllopoulos

We propose a novel method for approximate inference in Bayesian networks (BNs). The idea is to sample data from a BN, learn a latent tree model (LTM) from the data offline, and when online, make inference with the LTM instead of the…

Machine Learning · Computer Science 2014-01-16 Yi Wang , Nevin L. Zhang , Tao Chen

Count-compositional data arise in many different fields, including high-throughput sequencing experiments, ecological surveys, and palaeoclimate studies, where a common, important goal is to understand how covariates relate to the observed…

Methodology · Statistics 2026-04-10 André F. B. Menezes , Andrew C. Parnell , Keefe Murphy

An important task in health research is to characterize time-to-event outcomes such as disease onset or mortality in terms of a potentially high-dimensional set of risk factors. For example, prospective cohort studies of Alzheimer's disease…

Methodology · Statistics 2024-01-12 Harrison T. Reeder , Sebastien Haneuse , Kyu Ha Lee

Generalized linear models (GLMs) using a regression procedure to fit relationships between predictor and target variables are widely used in automobile insurance data. Here, in the process of ratemaking and in order to compute the premiums…

Applications · Statistics 2016-06-02 J. M. Pérez-Sánchez , E. Gómez-Déniz

We propose a Distributional Approach for addressing Controlled Text Generation from pre-trained Language Models (LMs). This approach permits to specify, in a single formal framework, both "pointwise" and "distributional" constraints over…

Computation and Language · Computer Science 2021-05-07 Muhammad Khalifa , Hady Elsahar , Marc Dymetman