English
Related papers

Related papers: Avoiding Premature Collapse: Adaptive Annealing fo…

200 papers

An elastic arch is an archetypal bistable system. Here, we combine elastica theory and photo-mechanical experiments to elucidate the mechanics of an active arch with a spatio-temporally varying preferred curvature $\overline \kappa(s)$. Our…

Soft Condensed Matter · Physics 2026-01-13 Michał Zmyślony , Ammar Khan , John S. Biggins

Incremental learning often encounter challenges such as overfitting to new data and catastrophic forgetting of old data. Existing methods can effectively extend the model for new tasks while freezing the parameters of the old model, but…

Computer Vision and Pattern Recognition · Computer Science 2025-12-29 Chuangxin Zhang , Guangfeng Lin , Enhui Zhao , Kaiyang Liao , Yajun Chen

Exemplar-Free Class Incremental Learning (EFCIL) aims to learn from a sequence of tasks without having access to previous task data. In this paper, we consider the challenging Cold Start scenario in which insufficient data is available in…

Computer Vision and Pattern Recognition · Computer Science 2024-05-31 Simone Magistri , Tomaso Trinci , Albin Soutif-Cormerais , Joost van de Weijer , Andrew D. Bagdanov

Deploying machine learning models requires high model quality and needs to comply with application constraints. That motivates hyperparameter optimization (HPO) to tune model configurations under deployment constraints. The constraints…

Machine Learning · Computer Science 2022-08-08 Yi-Wei Chen , Chi Wang , Amin Saied , Rui Zhuang

Anomaly detection plays a critical role in Autonomous Vehicles (AVs) by identifying unusual behaviors through perception systems that could compromise safety and lead to hazardous situations. Current approaches, which often rely on…

Artificial Intelligence · Computer Science 2025-07-08 Ashish Bastola , Mert D. Pesé , Long Cheng , Jonathon Smereka , Abolfazl Razi

Adaptive control of Euler-Lagrange systems is challenging when friction is governed by a finite-horizon internal state that is not directly observable from joint measurements. In this setting, the measured closed-loop state is no longer…

Machine Learning · Computer Science 2026-05-11 Giansalvo Cirrincione , Adriano Fagiolini

Forward Collision Warning systems are crucial for vehicle safety and autonomous driving, yet current methods often fail to balance precise multi-agent interaction modeling with real-time decision adaptability, evidenced by the high…

Machine Learning · Computer Science 2025-11-26 Haoran Hu , Junren Shi , Shuo Jiang , Kun Cheng , Xia Yang , Changhao Piao

The early prediction of tipping points, distinguished by sudden and catastrophic shifts from stable states, poses a challenging task that would enable us to assess the impending threat across natural and engineered systems. This threat…

Statistical Mechanics · Physics 2025-12-02 Tapas Bar , Anurag Banerjee , Blai Casals , Gustau Catalan , Javier Rodríguez-Viejo

Neural collapse (NC) -- the convergence of penultimate-layer features to a simplex equiangular tight frame -- is well understood at equilibrium, but the dynamics governing its onset remain poorly characterised. We identify a simple and…

Machine Learning · Computer Science 2026-04-02 Anamika Paul Rupa

Zero-Shot Anomaly Detection (ZSAD) aims to detect anomalies in unseen domains without target-domain adaptation. Recent CLIP-based methods have shown promising performance by leveraging prompt learning and visual-text alignment. However,…

Computer Vision and Pattern Recognition · Computer Science 2026-05-28 Xinyu Zhao , Qingyun Sun , Jiayi Luo , Jianxin Li

The Efficient Adaptive Transformer (EAT) framework unifies three adaptive efficiency techniques - progressive token pruning, sparse attention, and dynamic early exiting - into a single, reproducible architecture for input-adaptive…

Computation and Language · Computer Science 2025-10-16 Jan Miller

We develop a novel approach for confidently accelerating inference in the large and expensive multilayer Transformers that are now ubiquitous in natural language processing (NLP). Amortized or approximate computational methods increase…

Computation and Language · Computer Science 2021-09-10 Tal Schuster , Adam Fisch , Tommi Jaakkola , Regina Barzilay

Finite-grid (or aliasing) instabilities are pervasive in particle-in-cell (PIC) plasma simulation algorithms, and force the modeler to resolve the smallest (Debye) length scale in the problem regardless of dynamical relevance. These…

Plasma Physics · Physics 2019-10-25 D. C. Barnes , L. Chacon

We propose Acc-Sinkhorn, a simple accelerated variant of Sinkhorn for entropy-regularized optimal transport (EOT). The method is derived from a bilevel optimization view: Sinkhorn row scaling solves the inner variable $u$ exactly and…

Optimization and Control · Mathematics 2026-05-29 Zeyi Xu , Long Chen

Safety is a critical concern in learning-enabled autonomous systems especially when deploying these systems in real-world scenarios. An important challenge is accurately quantifying the uncertainty of unknown models to generate provably…

Robotics · Computer Science 2025-03-25 Hao Zhou , Yanze Zhang , Wenhao Luo

Online continual learning suffers from an underfitted solution due to insufficient training for prompt model update (e.g., single-epoch training). To address the challenge, we propose an efficient online continual learning method using the…

Computer Vision and Pattern Recognition · Computer Science 2024-04-03 Minhyuk Seo , Hyunseo Koh , Wonje Jeung , Minjae Lee , San Kim , Hankook Lee , Sungjun Cho , Sungik Choi , Hyunwoo Kim , Jonghyun Choi

Capturing the dynamics of active particles, i.e., small self-propelled agents that both deform and are deformed by a fluid in which they move is a formidable problem as it requires coupling fine scale hydrodynamics with large scale…

Soft Condensed Matter · Physics 2025-09-09 Sadra Saremi , Amirhossein Ahmadkhan Kordbacheh

Continual learning in artificial neural networks is fundamentally limited by the stability--plasticity dilemma: systems that retain prior knowledge tend to resist acquiring new knowledge, and vice versa. Existing approaches, most notably…

Statistical Mechanics · Physics 2026-04-07 Gunn Kim

Tipping to an undesired state in the climate when a control parameter slowly approaches a critical value is a growing concern with increasing greenhouse gas concentrations. Predictions rely on detecting early warning signals (EWSs) in…

Atmospheric and Oceanic Physics · Physics 2023-04-19 Peter D. Ditlevsen , Susanne Ditlevsen

Time-series anomaly detectors are commonly compared on workstation-class hardware under unconstrained execution. In-vehicle monitoring, however, requires predictable latency and stable behavior under limited CPU parallelism. Accuracy-only…

Machine Learning · Computer Science 2026-04-28 Kadir-Kaan Özer , René Ebeling , Markus Enzweiler