English
Related papers

Related papers: Avoiding Premature Collapse: Adaptive Annealing fo…

200 papers

Scaling algorithms for entropic transport-type problems have become a very popular numerical method, encompassing Wasserstein barycenters, multi-marginal problems, gradient flows and unbalanced transport. However, a standard implementation…

Optimization and Control · Mathematics 2019-02-12 Bernhard Schmitzer

The Sinkhorn--Knopp (SK) algorithm is a cornerstone method for matrix scaling and entropically regularized optimal transport (EOT). Despite its empirical efficiency, existing theoretical guarantees to achieve a target marginal accuracy…

Data Structures and Algorithms · Computer Science 2026-04-07 Kun He

Aerial transportation using quadrotors with cable-suspended payloads holds great potential for applications in disaster response, logistics, and infrastructure maintenance. However, their hybrid and underactuated dynamics pose significant…

Systems and Control · Electrical Eng. & Systems 2025-10-30 Luis F. Recalde , Mrunal Sarvaiya , Giuseppe Loianno , Guanrui Li

Mode collapse, the failure to capture one or more modes when targetting a multimodal distribution, is a central challenge in modern variational inference. In this work, we provide a mathematical analysis of annealing based strategies for…

Machine Learning · Statistics 2026-02-16 Luigi Fogliani , Bruno Loureiro , Marylou Gabrié

In this paper, a novel adaptive smooth disturbance observer-based fast finite-time adaptive backstepping control scheme is presented for the attitude tracking of the 3-DOF helicopter system subject to compound disturbances. First, an…

Systems and Control · Electrical Eng. & Systems 2022-05-26 Xidong Wang , Zhan Li , Xinghu Yu , Zhen He

We use a mean-field-based transformer model to theoretically investigate how auxiliary variables, such as positional encoding, prevent mode collapse of self-attention mechanisms. The use of mean-field transformers to analyze the properties…

Machine Learning · Computer Science 2026-05-29 Masaaki Imaizumi , Masanori Koyama , Noboru Isobe , Kohei Hayashi

We develop a distribution-free, unsupervised anomaly detection method called ECAD, which wraps around any regression algorithm and sequentially detects anomalies. Rooted in conformal prediction, ECAD does not require data exchangeability…

Applications · Statistics 2021-06-04 Chen Xu , Yao Xie

Recurrent-attention hybrids aim to combine the efficiency of recurrence with the expressivity of attention, but existing approaches typically apply attention uniformly across all positions, even when the recurrent state alone is sufficient…

Artificial Intelligence · Computer Science 2026-05-14 Haoran Zheng , Chen Shani

This paper presents a novel approach to one-class classifier fusion through locally adaptive learning with dynamic $\ell$p-norm constraints. We introduce a framework that dynamically adjusts fusion weights based on local data…

Machine Learning · Computer Science 2024-11-21 Sepehr Nourmohammadi , Arda Sarp Yenicesu , Shervin Rahimzadeh Arashloo , Ozgur S. Oguz

A standard way of finding a feedback law that stabilizes a control system to an operating point is to recast the problem as an infinite horizon optimal control problem. If the optimal cost and the optmal feedback can be found on a large…

Optimization and Control · Mathematics 2019-04-02 Arthur J. Krener

We introduce the Probability Navigation Architecture (PNA) framework, which treats neural computation as navigation through a probability manifold governed by thermodynamic principles. We train State Space Models (SSMs) and Transformers…

Machine Learning · Computer Science 2026-03-05 Jay Noon

Limitations of the CAP theorem imply that if availability is desired in the presence of network partitions, one must sacrifice sequential consistency, a consistency model that is more natural for system design. We focus on the problem of…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-06-26 Duong Nguyen , Aleksey Charapko , Sandeep Kulkarni , Murat Demirbas

It is shown that the gap that limits the speed of a quantum annealing process can take three salient morphologies: (i) the supersteep gap where both the ground and the first excited eigenenergy level curves have topologically related pairs…

Quantum Physics · Physics 2024-10-07 Edmond Jonckheere

Unplanned engine failures in helicopters can lead to severe operational disruptions, safety hazards, and costly repairs. To mitigate these risks, this study compares two predictive maintenance strategies for helicopter engines: a supervised…

Machine Learning · Computer Science 2026-01-19 P. Sánchez , K. Reyes , B. Radu , E. Fernández

We propose a post-hoc adaptive conformal anomaly detection method for monitoring time series that leverages predictions from pre-trained foundation models without requiring additional fine-tuning. Our method yields an interpretable anomaly…

Machine Learning · Computer Science 2026-04-23 Natalia Martinez Gil , Fearghal O'Donncha , Wesley M. Gifford , Nianjun Zhou , Dhaval C. Patel , Roman Vaculin

Artificial neural network training with stochastic gradient descent can be destabilized by "bad batches" with high losses. This is often problematic for training with small batch sizes, high order loss functions or unstably high learning…

Machine Learning · Computer Science 2020-05-21 Jeffrey M. Ede , Richard Beanland

This paper develops entropy stable (ES) adaptive moving mesh schemes for the 2D and 3D special relativistic hydrodynamic (RHD) equations. They are built on the ES finite volume approximation of the RHD equations in curvilinear coordinates,…

Numerical Analysis · Mathematics 2021-01-08 Junming Duan , Huazhong Tang

The advancement of generalized deepfake disruption is constrained by the interruption imbalance, a fundamental bottleneck inherent to the generation of universal perturbations. We reveal that conventional static gradient normalization…

Machine Learning · Computer Science 2026-05-04 Hongrui Zheng , Liejun Wang , Zhiqing Guo

The paper proposes a novel Economic Model Predictive Control (EMPC) scheme for Autonomous Surface Vehicles (ASVs) to simultaneously address path following accuracy and energy constraints under environmental disturbances. By formulating…

Systems and Control · Electrical Eng. & Systems 2025-03-11 Zhongqi Deng , Yuan Wang , Jian Huang , Hui Zhang , Yaonan Wang

Classical adaptive control proves total-system stability for control of linear plants, but only for plants meeting very restrictive assumptions. Approximate Dynamic Programming (ADP) has the potential, in principle, to ensure stability…

adap-org · Physics 2015-06-24 Paul J. Werbos