English
Related papers

Related papers: Fast and Efficient Stochastic Optimization for Ana…

200 papers

The EM algorithm is one of the most popular algorithm for inference in latent data models. The original formulation of the EM algorithm does not scale to large data set, because the whole data set is required at each iteration of the…

Machine Learning · Statistics 2019-10-29 Belhal Karimi , Hoi-To Wai , Eric Moulines , Marc Lavielle

We explore the use of the method of Maximum Entropy (ME) as a technique to generate approximations. In a first use of the ME method the "exact" canonical probability distribution of a fluid is approximated by that of a fluid of hard…

Statistical Mechanics · Physics 2009-11-10 Chih-Yuan Tseng , Ariel Caticha

Finite mixture modelling is a popular method in the field of clustering and is beneficial largely due to its soft cluster membership probabilities. A common method for fitting finite mixture models is to employ spectral clustering, which…

Machine Learning · Statistics 2024-03-22 Liam Welsh , Phillip Shreeves

For obtaining optimal first-order convergence guarantee for stochastic optimization, it is necessary to use a recurrent data sampling algorithm that samples every data point with sufficient frequency. Most commonly used data sampling…

Optimization and Control · Mathematics 2024-07-23 William G. Powell , Hanbaek Lyu

Bayesian models have many desirable properties, most notable is their ability to generalize from limited data and to properly estimate the uncertainty in their predictions. However, these benefits come at a steep computational cost as…

Machine Learning · Computer Science 2022-06-07 Coby Penso , Idan Achituve , Ethan Fetaya

An algorithm is proposed, analyzed, and tested experimentally for solving stochastic optimization problems in which the decision variables are constrained to satisfy equations defined by deterministic, smooth, and nonlinear functions. It is…

Optimization and Control · Mathematics 2021-07-09 Frank E. Curtis , Daniel P. Robinson , Baoyu Zhou

The Stochastic Series Expansion (SSE) technique is a quantum Monte Carlo method that is especially efficient for many quantum spin systems and boson models. It was the first generic method free from the discretization errors affecting…

Strongly Correlated Electrons · Physics 2019-09-25 Anders W. Sandvik

This review describes recent advances by the authors and others on the topic of incorporating experimental data into molecular simulations through maximum entropy methods. Methods which incorporate experimental data improve accuracy in…

Chemical Physics · Physics 2019-05-15 Dilnoza B. Amirkulova , Andrew D. White

Assessing sampling uncertainty in extremum estimation can be challenging when the asymptotic variance is not analytically tractable. Bootstrap inference offers a feasible solution but can be computationally costly especially when the model…

Econometrics · Economics 2020-09-15 Jean-Jacques Forneron , Serena Ng

This paper introduces a new stochastic optimization method based on the regularized Fisher information matrix (FIM), named SOFIM, which can efficiently utilize the FIM to approximate the Hessian matrix for finding Newton's gradient update…

Machine Learning · Computer Science 2024-05-02 Mrinmay Sen , A. K. Qin , Gayathri C , Raghu Kishore N , Yen-Wei Chen , Balasubramanian Raman

We present a framework for robust electric network frequency (ENF) extraction from real-world audio recordings, featuring multi-tone ENF harmonic enhancement and graph-based optimal harmonic selection. Specifically, We first extend the…

Sound · Computer Science 2021-08-03 Guang Hua , Han Liao , Haijian Zhang , Dengpan Ye , Jiayi Ma

(Pseudo)random sampling, a costly yet widely used method in (probabilistic) machine learning and Markov Chain Monte Carlo algorithms, remains unfeasible on a truly large scale due to unmet computational requirements. We introduce an…

Computational Physics · Physics 2025-01-03 Nicolas Alder , Shivam Nitin Kajale , Milin Tunsiricharoengul , Deblina Sarkar , Ralf Herbrich

Sequential robot manipulation tasks require finding collision-free trajectories that satisfy geometric constraints across multiple object interactions in potentially high-dimensional configuration spaces. Solving these problems in real-time…

Robotics · Computer Science 2025-10-14 Lucas Chen , Shrutheesh Raman Iyer , Zachary Kingston

Quantum mechanics for many-body systems may be reduced to the evaluation of integrals in 3N dimensions using Monte-Carlo, providing the Quantum Monte Carlo ab initio methods. Here we limit ourselves to expectation values for trial…

Computational Physics · Physics 2010-11-22 John Robert Trail , Ryo Maezono

Finite-sum Coupled Compositional Optimization (FCCO), characterized by its coupled compositional objective structure, emerges as an important optimization paradigm for addressing a wide range of machine learning problems. In this paper, we…

Machine Learning · Computer Science 2025-10-30 Xingyu Chen , Bokun Wang , Ming Yang , Qihang Lin , Tianbao Yang

In this paper, we consider the implementation of multi-level Monte Carlo method to a stochastic optimal control problem with log-normal coefficients and its surrogate model problem. From the perspective of two optimization problems, i.e.,…

Optimization and Control · Mathematics 2016-01-19 Qi Sun , Ju Ming

Real-time dispatch practices for operating the electric grid in an economic and reliable manner are evolving to accommodate higher levels of renewable energy generation. In particular, stochastic optimization is receiving increased…

Optimization and Control · Mathematics 2018-06-28 Ryan N. King , Matthew Reynolds , Devon Sigler , Wesley Jones

This paper concerns the identification of continuous-time systems in state-space form that are subject to Lebesgue sampling. Contrary to equidistant (Riemann) sampling, Lebesgue sampling consists of taking measurements of a continuous-time…

Systems and Control · Electrical Eng. & Systems 2023-04-10 Rodrigo A. González , Angel L. Cedeño , María Coronel , Juan C. Agüero , Cristian R. Rojas

Bayesian max-margin models have shown superiority in various practical applications, such as text categorization, collaborative prediction, social network link prediction and crowdsourcing, and they conjoin the flexibility of Bayesian…

Machine Learning · Statistics 2016-10-19 Wenbo Hu , Jun Zhu , Bo Zhang

To efficiently evaluate system reliability based on Monte Carlo simulation, importance sampling is used widely. The optimal importance sampling density was derived in 1950s for the deterministic simulation model, which maps an input to an…

Methodology · Statistics 2019-06-04 Quoc Dung Cao , Youngjun Choe