English
Related papers

Related papers: Towards an improved Eigensystem Realization Algori…

200 papers

We develop an empirical Bayes (EB) algorithm for the matrix completion problems. The EB algorithm is motivated from the singular value shrinkage estimator for matrix means by Efron and Morris (1972). Since the EB algorithm is essentially…

Machine Learning · Statistics 2019-04-10 Takeru Matsuda , Fumiyasu Komaki

Entropy minimization (EM) is frequently used to increase the accuracy of classification models when they're faced with new data at test time. EM is a self-supervised learning method that optimizes classifiers to assign even higher…

Computer Vision and Pattern Recognition · Computer Science 2024-05-14 Ori Press , Ravid Shwartz-Ziv , Yann LeCun , Matthias Bethge

Numerous cutting-edge scientific technologies originate at the laboratory scale, but transitioning them to practical industry applications is a formidable challenge. Traditional pilot projects at intermediate scales are costly and…

Computational Engineering, Finance, and Science · Computer Science 2024-01-22 Seung Whan Chung , Youngsoo Choi , Pratanu Roy , Thomas Moore , Thomas Roy , Tiras Y. Lin , Du Y. Nguyen , Christopher Hahn , Eric B. Duoss , Sarah E. Baker

Scaling mobile manipulation imitation learning is bottlenecked by expensive mobile robot teleoperation. We present Egocentric Mobile MAnipulation (EMMA), an end-to-end framework training mobile manipulation policies from human mobile…

An adaptive projection-based reduced-order model (ROM) formulation is presented for model-order reduction of problems featuring chaotic and convection-dominant physics. An efficient method is formulated to adapt the basis at every time-step…

Computational Physics · Physics 2023-08-09 Cheng Huang , Karthik Duraisamy

Developing excavation autonomy is challenging given the environments where excavators operate, the complexity of physical interaction and the degrees of freedom of operation of the excavator itself. Simulation is a useful tool to build…

Empirical risk minimization is the main tool for prediction problems, but its extension to relational data remains unsolved. We solve this problem using recent ideas from graph sampling theory to (i) define an empirical risk for relational…

Machine Learning · Statistics 2019-02-25 Victor Veitch , Morgane Austern , Wenda Zhou , David M. Blei , Peter Orbanz

Emerging applications of control, estimation, and machine learning, ranging from target tracking to decentralized model fitting, pose resource constraints that limit which of the available sensors, actuators, or data can be simultaneously…

Optimization and Control · Mathematics 2020-12-15 Vasileios Tzoumas , Ali Jadbabaie , George J. Pappas

Rotation averaging (RA) is a fundamental problem in robotics and computer vision. In RA, the goal is to estimate a set of $N$ unknown orientations $R_{1}, ..., R_{N} \in SO(3)$, given noisy measurements $R_{ij} \sim R^{-1}_{i} R_{j}$ of a…

Computer Vision and Pattern Recognition · Computer Science 2023-11-29 Owen Howell , Haoen Huang , David Rosen

A seismic wavefield reconstruction framework based on compressed sensing using the data-driven reduced-order model (ROM) is proposed and its characteristics are investigated through numerical experiments. The data-driven ROM is generated…

To speed-up the solution to parametrized differential problems, reduced order models (ROMs) have been developed over the years, including projection-based ROMs such as the reduced-basis (RB) method, deep learning-based ROMs, as well as…

Numerical Analysis · Mathematics 2022-02-08 Ludovica Cicci , Stefania Fresca , Andrea Manzoni

Estimation of Distribution Algorithms (EDAs) require flexible probability models that can be efficiently learned and sampled. Restricted Boltzmann Machines (RBMs) are generative neural networks with these desired properties. We integrate an…

Neural and Evolutionary Computing · Computer Science 2014-12-01 Malte Probst , Franz Rothlauf , Jörn Grahl

In graph-based active learning, algorithms based on expected error minimization (EEM) have been popular and yield good empirical performance. The exact computation of EEM optimally balances exploration and exploitation. In practice,…

Machine Learning · Statistics 2016-09-06 Kwang-Sung Jun , Robert Nowak

The paper introduces a reduced order model (ROM) for numerical integration of a dynamical system which depends on multiple parameters. The ROM is a projection of the dynamical system on a low dimensional space that is both problem-dependent…

Numerical Analysis · Mathematics 2022-06-08 Alexander V. Mamonov , Maxim A. Olshanskii

In this manuscript, we combine non-intrusive reduced order models (ROMs) with space-dependent aggregation techniques to build a mixed-ROM. The prediction of the mixed formulation is given by a convex linear combination of the predictions of…

Numerical Analysis · Mathematics 2024-03-12 Anna Ivagnes , Niccolò Tonicello , Paola Cinnella , Gianluigi Rozza

We develop a family of accelerated stochastic algorithms that minimize sums of convex functions. Our algorithms improve upon the fastest running time for empirical risk minimization (ERM), and in particular linear least-squares regression,…

Machine Learning · Statistics 2015-06-25 Roy Frostig , Rong Ge , Sham M. Kakade , Aaron Sidford

In recent years, there is a growing need to train machine learning models on a huge volume of data. Designing efficient distributed optimization algorithms for empirical risk minimization (ERM) has therefore become an active and challenging…

Optimization and Control · Mathematics 2019-11-19 Ching-pei Lee , Kai-Wei Chang

Kinetic equations are crucial for modeling non-equilibrium phenomena, but their computational complexity is a challenge. This paper presents a data-driven approach using reduced order models (ROM) to efficiently model non-equilibrium flows…

Fluid Dynamics · Physics 2023-10-09 Julian Koellermeier , Philipp Krah , Julius Reiss , Zachary Schellin

The Extreme Learning Machine (ELM) is a growing statistical technique widely applied to regression problems. In essence, ELMs are single-layer neural networks where the hidden layer weights are randomly sampled from a specific distribution,…

Machine Learning · Statistics 2025-07-31 Daniela De Canditiis , Fabiano Veglianti

We present an extension of Vapnik's classical empirical risk minimizer (ERM) where the empirical risk is replaced by a median-of-means (MOM) estimator, the new estimators are called MOM minimizers. While ERM is sensitive to corruption of…

Statistics Theory · Mathematics 2018-08-10 Guillaume Lecué , Matthieu Lerasle , Timothée Mathieu