English
Related papers

Related papers: Model-Driven Subspaces for Large-Scale Optimizatio…

200 papers

Deep reinforcement learning has shown remarkable success in the past few years. Highly complex sequential decision making problems have been solved in tasks such as game playing and robotics. Unfortunately, the sample complexity of most…

Machine Learning · Computer Science 2020-12-03 Aske Plaat , Walter Kosters , Mike Preuss

In all but the most trivial optimization problems, the structure of the solutions exhibit complex interdependencies between the input parameters. Decades of research with stochastic search techniques has shown the benefit of explicitly…

Neural and Evolutionary Computing · Computer Science 2017-03-23 Shumeet Baluja

We introduce a new class of objectives for optimal transport computations of datasets in high-dimensional Euclidean spaces. The new objectives are parametrized by $\rho \geq 1$, and provide a metric space $\mathcal{R}_{\rho}(\cdot, \cdot)$…

Data Structures and Algorithms · Computer Science 2023-07-20 Moses Charikar , Beidi Chen , Christopher Re , Erik Waingarten

Pseudo-Boolean Optimization (PBO) provides a powerful framework for modeling combinatorial problems through pseudo-Boolean (PB) constraints. Local search solvers have shown excellent performance in PBO solving, and their efficiency is…

Artificial Intelligence · Computer Science 2025-09-05 Jinyuan Li , Yi Chu , Yiwen Sun , Mengchuan Zou , Shaowei Cai

The development of neuromorphic hardware and modeling of biological neural networks requires algorithms with local learning rules. Artificial neural networks using local learning rules to perform principal subspace analysis (PSA) and…

Neural and Evolutionary Computing · Computer Science 2021-02-11 Yanis Bahroun , Dmitri B. Chklovskii

Accurate localization is an essential technology for the flexible navigation of robots in large-scale environments. Both SLAM-based and map-based localization will increase the computing load due to the increase in map size, which will…

Robotics · Computer Science 2024-04-30 Yixiao Feng , Zhou Jiang , Yongliang Shi , Yunlong Feng , Xiangyu Chen , Hao Zhao , Guyue Zhou

Sampling-based methods are widely adopted solutions for robot motion planning. The methods are straightforward to implement, effective in practice for many robotic systems. It is often possible to prove that they have desirable properties,…

Robotics · Computer Science 2022-11-16 Troy McMahon , Aravind Sivaramakrishnan , Edgar Granados , Kostas E. Bekris

Bayesian optimization (BO) is a popular approach to optimize expensive-to-evaluate black-box functions. A significant challenge in BO is to scale to high-dimensional parameter spaces while retaining sample efficiency. A solution considered…

Machine Learning · Statistics 2020-10-26 Benjamin Letham , Roberto Calandra , Akshara Rai , Eytan Bakshy

In this note, we develop fast and deterministic dimensionality reduction techniques for a family of subspace approximation problems. Let $P\subset \mathbbm{R}^N$ be a given set of $M$ points. The techniques developed herein find an $O(n…

Computational Geometry · Computer Science 2013-12-06 Mark Iwen , Felix Krahmer

We present a new dimension reduction method called the global active subspace method. The method uses expected values of finite differences of the underlying function to identify the important directions, and builds a surrogate model using…

General Mathematics · Mathematics 2024-10-22 Ruilong Yue , Giray Ökten

This paper presents unifying results for subspace identification (SID) and dynamic mode decomposition (DMD) for autonomous dynamical systems. We observe that SID seeks to solve an optimization problem to estimate an extended observability…

Systems and Control · Electrical Eng. & Systems 2020-03-18 Sungho Shin , Qiugang Lu , Victor M. Zavala

We present a stochastic descent algorithm for unconstrained optimization that is particularly efficient when the objective function is slow to evaluate and gradients are not easily obtained, as in some PDE-constrained optimization and…

Optimization and Control · Mathematics 2024-07-08 David Kozak , Stephen Becker , Alireza Doostan , Luis Tenorio

We introduce a novel dynamic learning-rate scheduling scheme grounded in theory with the goal of simplifying the manual and time-consuming tuning of schedules in practice. Our approach is based on estimating the locally-optimal stepsize,…

Machine Learning · Computer Science 2023-11-27 Gilad Yehudai , Alon Cohen , Amit Daniely , Yoel Drori , Tomer Koren , Mariano Schain

In this paper, the problem of target localization in the presence of outlying sensors is tackled. This problem is important in practice because in many real-world applications the sensors might report irrelevant data unintentionally or…

Optimization and Control · Mathematics 2018-02-15 Alireza Zaeemzadeh , Mohsen Joneidi , Behzad Shahrasbi , Nazanin Rahnavard

Sampling-based algorithms solve the path planning problem by generating random samples in the search-space and incrementally growing a connectivity graph or a tree. Conventionally, the sampling strategy used in these algorithms is biased…

Robotics · Computer Science 2021-02-26 Sagar Suhas Joshi , Seth Hutchinson , Panagiotis Tsiotras

This paper considers optimization problems over networks where agents have individual objectives to meet, or individual parameter vectors to estimate, subject to subspace constraints that require the objectives across the network to lie in…

Multiagent Systems · Computer Science 2020-04-22 Roula Nassif , Stefan Vlaski , Ali H. Sayed

Computer simulations serve as powerful tools for scientists and engineers to gain insights into complex systems. Less costly than physical experiments, computer experiments sometimes involve large number of trials. Conventional design…

Methodology · Statistics 2025-06-06 Xu He , Junpeng Gong , Zhaohui Li

We present a novel approach for efficient and reliable goal-directed long-horizon navigation for a multi-robot team in a structured, unknown environment by predicting statistics of unknown space. Building on recent work in…

Robotics · Computer Science 2023-03-30 Abhish Khanal , Gregory J. Stein

We propose a space mapping-based optimization algorithm for microscopic interacting particle dynamics which are inappropriate for direct optimization. This is of relevance for example in applications with bounded domains such that the…

Optimization and Control · Mathematics 2021-02-23 Jennifer Weißen , Simone Göttlich , Claudia Totzeck

A simple and efficient adaptive Markov Chain Monte Carlo (MCMC) method, called the Metropolized Adaptive Subspace (MAdaSub) algorithm, is proposed for sampling from high-dimensional posterior model distributions in Bayesian variable…

Methodology · Statistics 2023-01-04 Christian Staerk , Maria Kateri , Ioannis Ntzoufras