English
Related papers

Related papers: The algorithmic hardness threshold for continuous …

200 papers

Energy-based models (EBMs) are powerful probabilistic models, but suffer from intractable sampling and density evaluation due to the partition function. As a result, inference in EBMs relies on approximate sampling algorithms, leading to a…

Machine Learning · Computer Science 2020-01-10 Dieterich Lawson , George Tucker , Bo Dai , Rajesh Ranganath

Energy-Based Models (EBMs) present a flexible and appealing way to represent uncertainty. Despite recent advances, training EBMs on high-dimensional data remains a challenging problem as the state-of-the-art approaches are costly, unstable,…

Machine Learning · Computer Science 2021-06-08 Will Grathwohl , Jacob Kelly , Milad Hashemi , Mohammad Norouzi , Kevin Swersky , David Duvenaud

Extreme learning machine (ELM) is a network model that arbitrarily initializes the first hidden layer and can be computed speedily. In order to improve the classification performance of ELM, a $\ell_2$ and $\ell_{0.5}$ regularization ELM…

Optimization and Control · Mathematics 2023-01-05 Liangjuan Zhou , Wei Miao

We consider the problem of jointly modeling and clustering populations of tensors by introducing a high-dimensional tensor mixture model with heterogeneous covariances. To effectively tackle the high dimensionality of tensor objects, we…

Methodology · Statistics 2024-11-21 Biao Cai , Jingfei Zhang , Will Wei Sun

Preparing the ground state of a given Hamiltonian and estimating its ground energy are important but computationally hard tasks. However, given some additional information, these problems can be solved efficiently on a quantum computer. We…

Quantum Physics · Physics 2020-12-16 Lin Lin , Yu Tong

Deconvolving COMPTEL gamma-ray data into images presents a major methodological challenge. We developed a new algorithm called Multiresolution Regularized Expectation Maximization (MREM), which explicitly accounts for spatial correlations…

In this note, we propose a framework for proving computational lower bounds in norm approximation by leveraging a reverse detection--estimation gap. The starting point is a testing problem together with an estimator whose error is…

Statistics Theory · Mathematics 2026-04-07 Runshi Tang , Yuefeng Han , Anru R. Zhang

Model-based reinforcement learning (MBRL) with real-time planning has shown great potential in locomotion and manipulation control tasks. However, the existing planning methods, such as the Cross-Entropy Method (CEM), do not scale well to…

Machine Learning · Computer Science 2023-09-12 Mostafa Kotb , Cornelius Weber , Stefan Wermter

Given an approximation algorithm $A$, we want to find the input with the worst approximation ratio, i.e., the input for which $A$'s output's objective value is the worst possible compared to the optimal solution's objective value. Such hard…

Data Structures and Algorithms · Computer Science 2025-04-29 Eklavya Sharma

In turbulence modeling, we are concerned with finding closure models that represent the effect of the subgrid scales on the resolved scales. Recent approaches gravitate towards machine learning techniques to construct such models. However,…

Numerical Analysis · Mathematics 2024-03-18 Toby van Gastelen , Wouter Edeling , Benjamin Sanderse

Efficient learning in the environment with sparse rewards is one of the most important challenges in Deep Reinforcement Learning (DRL). In continuous DRL environments such as robotic arms control, Hindsight Experience Replay (HER) has been…

Artificial Intelligence · Computer Science 2020-02-07 Qiwei He , Liansheng Zhuang , Houqiang Li

The development of new classification and regression algorithms based on empirical risk minimization (ERM) over deep neural network hypothesis classes, coined deep learning, revolutionized the area of artificial intelligence, machine…

Machine Learning · Computer Science 2020-11-12 Julius Berner , Philipp Grohs , Arnulf Jentzen

Standard maximum likelihood estimation cannot be applied to discrete energy-based models in the general case because the computation of exact model probabilities is intractable. Recent research has seen the proposal of several new…

Machine Learning · Computer Science 2012-02-20 Benjamin Marlin , Nando de Freitas

A basic simulation-based reinforcement learning algorithm is the Monte Carlo Exploring States (MCES) method, also known as optimistic policy iteration, in which the value function is approximated by simulated returns and a greedy policy is…

Optimization and Control · Mathematics 2020-07-22 Jun Liu

The Evidential Regression Network (ERN) represents a novel approach that integrates deep learning with Dempster-Shafer's theory to predict a target and quantify the associated uncertainty. Guided by the underlying theory, specific…

Machine Learning · Computer Science 2024-01-04 Kai Ye , Tiejin Chen , Hua Wei , Liang Zhan

In [Meurant, Pape\v{z}, Tich\'y; Numerical Algorithms 88, 2021], we presented an adaptive estimate for the energy norm of the error in the conjugate gradient (CG) method. In this paper, we extend the estimate to algorithms for solving…

Numerical Analysis · Mathematics 2023-05-04 Jan Papež , Petr Tichý

Entropy and free-energy estimation are key in thermodynamic characterization of simulated systems ranging from spin models through polymers, colloids, protein structure, and drug-design. Current techniques suffer from being model specific,…

Statistical Mechanics · Physics 2019-10-30 Ram Avinery , Micha Kornreich , Roy Beck

Reinforcement learning (RL) enables an agent interacting with an unknown MDP $M$ to optimise its behaviour by observing transitions sampled from $M$. A natural entity that emerges in the agent's reasoning is $\widehat{M}$, the maximum…

Machine Learning · Computer Science 2025-02-24 Shivaram Kalyanakrishnan , Sheel Shah , Santhosh Kumar Guguloth

Since its introduction a decade ago, \emph{relative entropy policy search} (REPS) has demonstrated successful policy learning on a number of simulated and real-world robotic domains, not to mention providing algorithmic components used by…

Machine Learning · Computer Science 2021-03-18 Aldo Pacchiano , Jonathan Lee , Peter Bartlett , Ofir Nachum

We consider network sparsification as an $L_0$-norm regularized binary optimization problem, where each unit of a neural network (e.g., weight, neuron, or channel, etc.) is attached with a stochastic binary gate, whose parameters are…

Machine Learning · Computer Science 2021-07-02 Yang Li , Shihao Ji
‹ Prev 1 8 9 10 Next ›