English
Related papers

Related papers: Hybrid deterministic/stochastic algorithm for larg…

200 papers

We propose a new dynamic stochastic blockmodel that focuses on the analysis of interaction lengths in networks. The model does not rely on a discretization of the time dimension and may be used to analyze networks that evolve continuously…

Methodology · Statistics 2019-01-29 Riccardo Rastelli , Michael Fop

The considered problem is how to optimally allocate a set of jobs to technicians of different skills such that the number of technicians of each skill does not exceed the number of persons with that skill designation. The key motivation is…

Artificial Intelligence · Computer Science 2018-03-06 Nima Safaei , Corey Kiassat

Fitting geometric models onto outlier contaminated data is provably intractable. Many computer vision systems rely on random sampling heuristics to solve robust fitting, which do not provide optimality guarantees and error bounds. It is…

Computer Vision and Pattern Recognition · Computer Science 2022-06-28 Anh-Dzung Doan , Michele Sasdelli , David Suter , Tat-Jun Chin

In this paper, we consider the problem of stochastic optimization, where the objective function is in terms of the expectation of a (possibly non-convex) cost function that is parametrized by a random variable. While the convergence speed…

Information Theory · Computer Science 2019-10-23 Naeimeh Omidvar , An Liu , Vincent Lau , Danny H. K. Tsang , Mohammad Reza Pakravan

Identification of the clusters from an unlabeled data set is one of the most important problems in Unsupervised Machine Learning. The state of the art clustering algorithms are based on either the statistical properties or the geometric…

Machine Learning · Computer Science 2018-01-04 Sambarta Dasgupta , Keivan Ebrahimi , Umesh Vaidya

Recently a majorization method for optimizing partition functions of log-linear models was proposed alongside a novel quadratic variational upper-bound. In the batch setting, it outperformed state-of-the-art first- and second-order…

Machine Learning · Computer Science 2013-09-24 Anna Choromanska , Tony Jebara

We study a mutually enriching connection between response time analysis in real-time systems and the mixing set problem. Thereby generalizing over known results we present a new approach to the computation of response times in…

Data Structures and Algorithms · Computer Science 2023-11-02 Max A. Deppert , Klaus Jansen

This contribution examines optimization problems that involve stochastic dominance constraints. These problems have uncountably many constraints. We develop methods to solve the optimization problem by reducing the constraints to a finite…

Optimization and Control · Mathematics 2025-02-27 Rajmadan Lakshmanan , Alois Pichler , Miloš Kopa

With the recent proliferation of large-scale learning problems,there have been a lot of interest on distributed machine learning algorithms, particularly those that are based on stochastic gradient descent (SGD) and its variants. However,…

Machine Learning · Computer Science 2015-12-07 Ruiliang Zhang , Shuai Zheng , James T. Kwok

Stochastic dynamics of several systems can be modeled via piecewise deterministic time evolution of the state, interspersed by random discrete events. Within this general class of systems, we consider time-triggered stochastic hybrid…

Systems and Control · Computer Science 2018-04-27 Mohammad Soltani , Abhyudai Singh

We present a hybrid continuum-atomistic scheme which combines molecular dynamics (MD) simulations with on-the-fly machine learning techniques for the accurate and efficient prediction of multiscale fluidic systems. By using a Gaussian…

Fluid Dynamics · Physics 2016-03-16 David Stephenson , James R Kermode , Duncan A Lockerby

By Emerging huge databases and the need to efficient learning algorithms on these datasets, new problems have appeared and some methods have been proposed to solve these problems by selecting efficient features. Feature selection is a…

Computer Vision and Pattern Recognition · Computer Science 2016-01-21 Mitra Montazeri , Mahdieh Soleymani Baghshah , Aliakbar Niknafs

We present an effective heuristic for the Steiner Problem in Graphs. Its main elements are a multistart algorithm coupled with aggressive combination of elite solutions, both leveraging recently-proposed fast local searches. We also propose…

Data Structures and Algorithms · Computer Science 2014-12-11 Thomas Pajor , Eduardo Uchoa , Renato F. Werneck

This study introduces a predictive maintenance strategy for high pressure industrial compressors using sensor data and features derived from unsupervised clustering integrated into classification models. The goal is to enhance model…

Machine Learning · Computer Science 2024-11-22 Alessandro Costa , Emilio Mastriani , Federico Incardona , Kevin Munari , Sebastiano Spinello

As the data size in Machine Learning fields grows exponentially, it is inevitable to accelerate the computation by utilizing the ever-growing large number of available cores provided by high-performance computing hardware. However, existing…

Machine Learning · Computer Science 2021-04-23 Kun Li , Liang Yuan , Yunquan Zhang , Gongwei Chen

In this work, multiplicative stochasticity is applied to the learning rate of stochastic optimization algorithms, giving rise to stochastic learning-rate schemes. In-expectation theoretical convergence results of Stochastic Gradient Descent…

Optimization and Control · Mathematics 2022-03-22 Theodoros Mamalis , Dusan Stipanovic , Petros Voulgaris

This paper presents a new stochastic finite element method for computing structural stochastic responses. The method provides a new expansion of stochastic response and decouples the stochastic response into a combination of a series of…

Numerical Analysis · Mathematics 2021-04-28 Zhibao Zheng

In this paper, we present a heuristic adaptive fast gradient method. We show that in practice our method has a better convergence rate than popular today optimization methods. Moreover, we justify our method and point out some problems that…

Optimization and Control · Mathematics 2020-08-26 Alexander Ogaltsov , Alexander Tyurin

Randomized saturation designs are a family of designs which assign a possibly different treatment proportion to each cluster of a population at random. As a result, they generalize the well-known (stratified) completely randomized designs…

Methodology · Statistics 2022-03-21 Chencheng Cai , Jean Pouget-Abadie , Edoardo M. Airoldi

For a linear equality constrained convex optimization problem involving two objective functions with a ``nonsmooth" + ``nonsmooth" composite structure, we study two algorithms derived from a mixed-order dynamical system which incorporates…

Optimization and Control · Mathematics 2026-03-25 Geng-Hua Li , Hai-Yi Zhao , Xiangkai Sun