English
Related papers

Related papers: Accelerated Relaxation Engines for Optimizing to M…

200 papers

Generating adversarial examples (AEs) can be formulated as an optimization problem. Among various optimization-based attacks, the gradient-based PGD and the momentum-based MI-FGSM have garnered considerable interest. However, all these…

Machine Learning · Computer Science 2025-12-17 Wei Tao , Sheng Long , Xin Liu , Wei Li , Qing Tao

In light of the increased focus on distributed methods, this paper proposes two accelerated subgradient methods and an adaptive penalty parameter scheme to speed-up the convergence of ADMM on the component-based dual decomposition of the…

Computational Engineering, Finance, and Science · Computer Science 2018-08-14 Sleiman Mhanna , Archie Chapman , Gregor Verbic

Many modern computer vision and machine learning applications rely on solving difficult optimization problems that involve non-differentiable objective functions and constraints. The alternating direction method of multipliers (ADMM) is a…

Computer Vision and Pattern Recognition · Computer Science 2017-04-11 Zheng Xu , Mario A. T. Figueiredo , Xiaoming Yuan , Christoph Studer , Tom Goldstein

Characterizing conformational transitions in physical systems remains a fundamental challenge, as traditional sampling methods struggle with the high-dimensional nature of molecular systems and high-energy barriers between stable states.…

Chemical Physics · Physics 2025-09-22 Magnus Petersen , Gemma Roig , Roberto Covino

In unmanned aerial vehicle (UAV) applications, the UAV's limited energy supply and storage have triggered the development of intelligent energy-conserving scheduling solutions. In this paper, we investigate energy minimization for UAV-aided…

Signal Processing · Electrical Eng. & Systems 2020-06-30 Yaxiong Yuan , Lei Lei , Thang Xuan Vu , Symeon Chatzinotas , Sumei Sun , Bjorn Ottersten

The calculation of minimum energy paths for transitions such as atomic and/or spin re-arrangements is an important task in many contexts and can often be used to determine the mechanism and rate of transitions. An important challenge is to…

Chemical Physics · Physics 2017-03-31 Olli-Pekka Koistinen , Emile Maras , Aki Vehtari , Hannes Jónsson

The implementation of adaptive genetic algorithms (AGA) for optimization problems has proven to be superior than many other methods due to its nature of producing more robust and high quality solutions. Considering the complexity involved…

Computational Physics · Physics 2024-11-28 Brandon Willnecker , Mervlyn Moodley

Edge computing enables data processing closer to the source, significantly reducing latency, an essential requirement for real-time vision-based analytics such as object detection in surveillance and smart city environments. However, these…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-02-04 Daghash K. Alqahtani , Maria A. Rodriguez , Muhammad Aamir Cheema , Hamid Rezatofighi , Adel N. Toosi

In recent years, neural architecture search (NAS) methods have been proposed for the automatic generation of task-oriented network architecture in image classification. However, the architectures obtained by existing NAS approaches are…

Computer Vision and Pattern Recognition · Computer Science 2021-03-24 Haichao Zhang , Kuangrong Hao , Lei Gao , Xuesong Tang , Bing Wei

Convex optimization over the spectrahedron, i.e., the set of all real $n\times n$ positive semidefinite matrices with unit trace, has important applications in machine learning, signal processing and statistics, mainly as a convex…

Optimization and Control · Mathematics 2022-11-01 Dan Garber , Atara Kaplan

This paper presents a Graphics Processing Units (GPUs) acceleration method of an iterative scheme for gas-kinetic model equations. Unlike the previous GPU parallelization of explicit kinetic schemes, this work features a fast converging…

Computational Physics · Physics 2020-01-08 Lianhua Zhu , Peng Wang , Songze Chen , Zhaoli Guo , Yonghao Zhang

Efficient localization and high-quality rendering in large-scale scenes remain a significant challenge due to the computational cost involved. While Scene Coordinate Regression (SCR) methods perform well in small-scale localization, they…

Computer Vision and Pattern Recognition · Computer Science 2025-10-17 Mingkai Liu , Dikai Fan , Haohua Que , Haojia Gao , Xiao Liu , Shuxue Peng , Meixia Lin , Shengyu Gu , Ruicong Ye , Wanli Qiu , Handong Yao , Ruopeng Zhang , Xianliang Huang

Processing Using Memory (PUM) accelerators have the potential to perform Deep Neural Network (DNN) inference by using arrays of memory cells as computation engines. Among various memory technologies, ReRAM crossbars show promising…

Hardware Architecture · Computer Science 2024-10-24 Mohammad Sabri , Marc Riera , Antonio González

Industrial domains such as automotive, robotics, and aerospace are rapidly evolving to satisfy the increasing demand for machine-learning-driven Autonomy, Connectivity, Electrification, and Shared mobility (ACES). This paradigm shift…

Hardware Architecture · Computer Science 2026-02-11 Thomas Benz

We propose an adaptive step size with an energy approach for a suitable class of preconditioned gradient descent methods. We focus on settings where the preconditioning is applied to address the constraints in optimization problems, such as…

Optimization and Control · Mathematics 2024-06-17 Hailiang Liu , Levon Nurbekyan , Xuping Tian , Yunan Yang

This paper presents a novel accelerated distributed algorithm for unconstrained consensus optimization over static undirected networks. The proposed algorithm combines the benefits of acceleration from momentum, the robustness of the…

Optimization and Control · Mathematics 2024-05-15 Eduardo Sebastián , Mauro Franceschelli , Andrea Gasparri , Eduardo Montijano , Carlos Sagüés

New directions in computing and algorithms has lead to some new applications that have tolerance to imprecision. Although, These applications are creating large volumes of data which exceeds the capability of today's computing systems.…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-01-16 Navid Mirnouri

Unrolled computation graphs arise in many scenarios, including training RNNs, tuning hyperparameters through unrolled optimization, and training learned optimizers. Current approaches to optimizing parameters in such computation graphs…

Machine Learning · Computer Science 2021-12-28 Paul Vicol , Luke Metz , Jascha Sohl-Dickstein

We present a powerful general framework for designing data-dependent optimization algorithms, building upon and unifying recent techniques in adaptive regularization, optimistic gradient predictions, and problem-dependent randomization. We…

Machine Learning · Statistics 2015-10-14 Mehryar Mohri , Scott Yang

This work explores an extension of machine learning-optimized piecewise polynomial approximation by incorporating energy optimization as an additional objective. Traditional closed-form solutions enable continuity and approximation targets…

Machine Learning · Computer Science 2025-08-08 Hannes Waclawek , Stefan Huber