English
Related papers

Related papers: Simulation-Based Fitting of Intractable Models via…

200 papers

Inference and learning of graphical models are both well-studied problems in statistics and machine learning that have found many applications in science and engineering. However, exact inference is intractable in general graphical models,…

Machine Learning · Statistics 2010-11-16 Jason K. Johnson , Praneeth Netrapalli , Michael Chertkov

Stochastic processes defined on integer valued state spaces are popular within the physical and biological sciences. These models are necessary for capturing the dynamics of small systems where the individual nature of the populations…

Machine Learning · Statistics 2024-04-15 Luke O'Loughlin , John Maclean , Andrew Black

We propose a novel sampling-based federated learning framework for statistical inference on M-estimators with non-smooth objective functions, which frequently arise in modern statistical applications such as quantile regression and AUC…

Methodology · Statistics 2025-05-06 Xiudi Li , Lu Tian , Tianxi Cai

This paper introduces an algorithm to select demonstration examples for in-context learning of a query set. Given a set of $n$ examples, how can we quickly select $k$ out of $n$ to best serve as the conditioning for downstream inference?…

Machine Learning · Computer Science 2025-11-05 Ziniu Zhang , Zhenshuo Zhang , Dongyue Li , Lu Wang , Jennifer Dy , Hongyang R. Zhang

Learning dynamical systems from sparse observations is critical in numerous fields, including biology, finance, and physics. Even if tackling such problems is standard in general information fusion, it remains challenging for contemporary…

Machine Learning · Computer Science 2024-06-04 Ella Tamir , Arno Solin

Stochastic approximation (SA) is a powerful and scalable computational method for iteratively estimating the solution of optimization problems in the presence of randomness, particularly well-suited for large-scale and streaming data…

Statistics Theory · Mathematics 2023-10-03 Meimei Liu , Zuofeng Shang , Yun Yang

Conformal prediction methods provide statistically rigorous marginal coverage guarantees for machine learning models, but such guarantees fail to account for algorithmic biases, thereby undermining fairness and trust. This paper introduces…

Machine Learning · Computer Science 2026-05-13 Senrong Xu , Yanke Zhou , Yuhao Tan , Zenan Li , Yuan Yao , Taolue Chen , Feng Xu , Xiaoxing Ma

In population genetics and other application fields, models with intractable likelihood are common. Approximate Bayesian Computation (ABC) or more generally Simulation-Based Inference (SBI) methods work by simulating instrumental data sets…

Methodology · Statistics 2025-01-29 Guillaume Le Mailloux , Paul Bastide , Jean-Michel Marin , Arnaud Estoup

Adaptable models could greatly benefit robotic agents operating in the real world, allowing them to deal with novel and varying conditions. While approaches such as Bayesian inference are well-studied frameworks for adapting models to…

Machine Learning · Computer Science 2023-10-20 Orr Krupnik , Elisei Shafer , Tom Jurgenson , Aviv Tamar

This work is concerned with conformal prediction in contemporary applications (including generative AI) where a black-box model has been trained on data that are not accessible to the user. Mirroring split-conformal inference, we design a…

Methodology · Statistics 2025-04-28 Jungeum Kim , Sean O'Hagan , Veronika Rockova

This paper proposes probabilistic conformal prediction (PCP), a predictive inference algorithm that estimates a target variable by a discontinuous predictive set. Given inputs, PCP construct the predictive set based on random samples from…

Machine Learning · Statistics 2022-06-22 Zhendong Wang , Ruijiang Gao , Mingzhang Yin , Mingyuan Zhou , David M. Blei

Selective inference methods are developed for group lasso estimators for use with a wide class of distributions and loss functions. The method includes the use of exponential family distributions, as well as quasi-likelihood modeling for…

Methodology · Statistics 2024-03-28 Yiling Huang , Sarah Pirenne , Snigdha Panigrahi , Gerda Claeskens

Surrogate models based on machine learning methods have become an important part of modern engineering to replace costly computer simulations. The data used for creating a surrogate model are essential for the model accuracy and often…

Machine Learning · Statistics 2023-10-03 Sven Lämmle , Can Bogoclu , Kevin Cremanns , Dirk Roos

The Heatbath Algorithm is commonly used for sampling in local lattice field theories, but performing exact updates or sampling from the local density is challenging when dealing with continuous variables. Heatbath methods rely on…

Computational Physics · Physics 2026-04-28 Ali Faraz , Ankur Singha , Dipankar Chakrabarti , Shinichi Nakajima , Vipul Arora

Exploring the dependence between covariates across distributions is crucial for many applications. Copulas serve as a powerful tool for modeling joint variable dependencies and have been effectively applied in various practical contexts due…

Machine Learning · Statistics 2026-04-09 Sumin Wang , Chenxian Huang , Yongdao Zhou , Min-Qian Liu

This paper tackles the challenge of parameter calibration in stochastic models, particularly in scenarios where the likelihood function is unavailable in an analytical form. We introduce a gradient-based simulated parameter estimation…

Machine Learning · Statistics 2025-03-25 Zehao Li , Yijie Peng

In this paper, we propose a novel fitting method that uses local image features to fit a 3D Morphable Model to 2D images. To overcome the obstacle of optimising a cost function that contains a non-differentiable feature extraction operator,…

Computer Vision and Pattern Recognition · Computer Science 2016-05-13 Patrik Huber , Zhen-Hua Feng , William Christmas , Josef Kittler , Matthias Rätsch

In this paper, a practicable simulation-free model order reduction method by nonlinear moment matching is developed. Based on the steady-state interpretation of linear moment matching, we comprehensively explain the extension of this…

Systems and Control · Electrical Eng. & Systems 2024-12-20 Maria Cruz Varona , Raphael Gebhart , Julian Suk , Boris Lohmann

Learning to sample from complex unnormalized distributions is a fundamental challenge in computational physics and machine learning. While score-based and variational methods have achieved success in continuous domains, extending them to…

Machine Learning · Statistics 2026-03-11 Lei Li , Zhen Wang , Lishuo Zhang

We derive computationally tractable methods to select a small subset of experiment settings from a large pool of given design points. The primary focus is on linear regression models, while the technique extends to generalized linear models…

Machine Learning · Statistics 2017-12-21 Yining Wang , Adams Wei Yu , Aarti Singh