English
Related papers

Related papers: Perturb-and-max-product: Sampling and learning in …

200 papers

Mixture models are a natural choice in many applications, but it can be difficult to place an a priori upper bound on the number of components. To circumvent this, investigators are turning increasingly to Dirichlet process mixture models…

Statistics Theory · Mathematics 2018-06-22 Łukasz Rajkowski

Finding the most probable assignment (MAP) in a general graphical model is known to be NP hard but good approximations have been attained with max-product belief propagation (BP) and its variants. In particular, it is known that using BP on…

Artificial Intelligence · Computer Science 2012-06-26 Yair Weiss , Chen Yanover , Talya Meltzer

This article makes discrete masked models for the generative modeling of discrete data controllable. The goal is to generate samples of a discrete random variable that adheres to a posterior distribution, satisfies specific constraints, or…

Machine Learning · Computer Science 2024-10-04 Wei Guo , Yuchen Zhu , Molei Tao , Yongxin Chen

Predicting with missing inputs challenges even parametric models, as parameter estimation alone is insufficient for prediction on incomplete data. While several works study prediction in linear models, we focus on logistic models, where…

Machine Learning · Statistics 2026-02-03 Christophe Muller , Erwan Scornet , Julie Josse

This paper studies the fundamental learning problem of the energy-based model (EBM). Learning the EBM can be achieved using the maximum likelihood estimation (MLE), which typically involves the Markov Chain Monte Carlo (MCMC) sampling, such…

Machine Learning · Computer Science 2023-12-06 Jiali Cui , Tian Han

The tracking method based on the extreme learning machine (ELM) is efficient and effective. ELM randomly generates input weights and biases in the hidden layer, and then calculates and computes the output weights by reducing the iterative…

Machine Learning · Computer Science 2018-07-27 Jing Zhang , Huibing Wang , Yonggong Ren

Recently, efficient fine-tuning of large-scale pre-trained models has attracted increasing research interests, where linear probing (LP) as a fundamental module is involved in exploiting the final representations for task-dependent…

Computer Vision and Pattern Recognition · Computer Science 2023-10-03 Mingze Gao , Qilong Wang , Zhenyi Lin , Pengfei Zhu , Qinghua Hu , Jingbo Zhou

We motivate Energy-Based Models (EBMs) as a promising model class for continual learning problems. Instead of tackling continual learning via the use of external memory, growing models, or regularization, EBMs change the underlying training…

Machine Learning · Computer Science 2025-03-05 Shuang Li , Yilun Du , Gido M. van de Ven , Igor Mordatch

In this paper, an eco--driving Pontryagin maximum principle (PMP) algorithm is designed for optimal deceleration and gear shifting in trucks based on switching among a finite set of driving modes. The PMP algorithm is implemented and…

Systems and Control · Electrical Eng. & Systems 2021-04-09 B. Wingelaar , G. R. Gonçalves da Silva , M. Lazar , Y. Chen , J. T. B. A. Kessels

Genomic studies face a vast hypothesis space, while interventions such as gene perturbations remain costly and time-consuming. To accelerate such experiments, gene perturbation models predict the transcriptional outcome of interventions.…

Quantitative Methods · Quantitative Biology 2025-10-21 George Panagopoulos , Johannes F. Lutzeyer , Sofiane Ennadir , Michalis Vazirgiannis , Jun Pang

Learning to sample from complex unnormalized distributions is a fundamental challenge in computational physics and machine learning. While score-based and variational methods have achieved success in continuous domains, extending them to…

Machine Learning · Statistics 2026-03-11 Lei Li , Zhen Wang , Lishuo Zhang

Model predictive control (MPC) has become the most widely used advanced control method in process industry. In many cases, forecasts of the disturbances are available, e.g., predicted renewable power generation based on weather forecast.…

Systems and Control · Electrical Eng. & Systems 2022-06-08 Ryan McCloy , Lai Wei , Jie Bao

This paper is concerned with model predictive control (MPC) of discrete-time linear systems subject to bounded additive disturbance and mixed constraints on the state and input, whereas the true disturbance set is unknown. Unlike most…

Optimization and Control · Mathematics 2024-05-22 Yulong Gao , Shuhao Yan , Jian Zhou , Mark Cannon , Alessandro Abate , Karl H. Johansson

Estimating a Gibbs density function given a sample is an important problem in computational statistics and statistical learning. Although the well established maximum likelihood method is commonly used, it requires the computation of the…

Machine Learning · Computer Science 2023-03-14 Eldad Haber , Moshe Eliasof , Luis Tenorio

The generic matrix multiply (GEMM) function is the core element of high-performance linear algebra libraries used in many computationally-demanding digital signal processing (DSP) systems. We propose an acceleration technique for GEMM based…

Mathematical Software · Computer Science 2015-05-30 Davide Anastasia , Yiannis Andreopoulos

The Hidden Markov Model (HMM) is a widely-used statistical model for handling sequential data. However, the presence of missing observations in real-world datasets often complicates the application of the model. The EM algorithm and Gibbs…

Machine Learning · Statistics 2026-01-06 Dongrong Li , Tianwei Yu , Xiaodan Fan

Inference in general Ising models is difficult, due to high treewidth making tree-based algorithms intractable. Moreover, when interactions are strong, Gibbs sampling may take exponential time to converge to the stationary distribution. We…

Machine Learning · Computer Science 2014-10-09 Justin Domke , Xianghang Liu

In the last few years, many explanation methods based on the perturbations of input data have been introduced to improve our understanding of decisions made by black-box models. The goal of this work is to introduce a novel perturbation…

Machine Learning · Computer Science 2022-09-20 Minh N. Vu , Huy Q. Mai , My T. Thai

We propose masked particle modeling (MPM) as a self-supervised method for learning generic, transferable, and reusable representations on unordered sets of inputs for use in high energy physics (HEP) scientific data. This work provides a…

High Energy Physics - Phenomenology · Physics 2024-07-12 Tobias Golling , Lukas Heinrich , Michael Kagan , Samuel Klein , Matthew Leigh , Margarita Osadchy , John Andrew Raine

Commonly used linear and nonlinear constitutive material models in deformation simulation contain many simplifications and only cover a tiny part of possible material behavior. In this work we propose a framework for learning customized…

Graphics · Computer Science 2020-10-27 Bin Wang , Yuanmin Deng , Paul Kry , Uri Ascher , Hui Huang , Baoquan Chen