English
Related papers

Related papers: Avoiding Premature Collapse: Adaptive Annealing fo…

200 papers

Epilepsy is a common neurological disorder characterized by abrupt seizures. Although seizures may appear random, they are often preceded by early warning signs in neural signals, notably, critical slowing down, a phenomenon in which the…

Systems and Control · Electrical Eng. & Systems 2024-11-12 Yuzhen Qin , Marcel van Gerven

While deep learning has significantly advanced accident anticipation, the robustness of these safety-critical systems against real-world perturbations remains a major challenge. We reveal that state-of-the-art models like CRASH, despite…

Machine Learning · Computer Science 2026-04-03 Wenjing Wang , Wenxuan Wang , Songning Lai

Fine-tuning is the primary mechanism for adapting foundation models to downstream tasks; however, standard approaches largely optimize task objectives in isolation and do not account for secondary yet critical alignment objectives (e.g.,…

Machine Learning · Computer Science 2026-02-06 Gaurav Bhatt , Aditya Chinchure , Jiawei Zhou , Leonid Sigal

Early-exiting neural networks enable adaptive inference by allowing inputs to exit at intermediate classifiers, reducing computation for easy samples while maintaining high accuracy. In practice, exits can be trained sequentially by…

Machine Learning · Computer Science 2026-05-08 Alaa Zniber , Ouassim Karrakchou , Mounir Ghogho

Fine-tuning aligned language models on benign tasks unpredictably degrades safety guardrails, even when training data contains no harmful content and developers have no adversarial intent. We show that the prevailing explanation, that…

Prototype networks provide an intrinsic case based explanation mechanism, but their interpretability is often undermined by prototype collapse, where multiple prototypes degenerate to highly redundant evidence. We attribute this failure…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Junhao Jia , Jiaqi Wang , Yunyou Liu , Haodong Jing , Yueyi Wu , Xian Wu , Yefeng Zheng

This paper introduces a hybrid attention and autoencoder (AE) model for unsupervised online anomaly detection in time series. The autoencoder captures local structural patterns in short embeddings, while the attention model learns long-term…

Machine Learning · Computer Science 2024-01-09 Seyed Amirhossein Najafi , Mohammad Hassan Asemani , Peyman Setoodeh

Time-delay embedding is a fundamental technique in Topological Data Analysis (TDA) for reconstructing the phase space dynamics of time-series data. Persistent homology effectively identifies global topological features, such as loops…

Statistics Theory · Mathematics 2026-04-21 Donghyun Park , Junhyun An , Taehyoung Kim , Jisu Kim

Anomaly detection is fundamental yet, challenging problem with practical applications in industry. The current approaches neglect the higher-order dependencies within the networks of interconnected sensors in the high-dimensional time…

Machine Learning · Computer Science 2024-08-22 Sakhinana Sagar Srinivas , Rajat Kumar Sarkar , Venkataramana Runkana

Anomaly detection methods require high-quality features. In recent years, the anomaly detection community has attempted to obtain better features using advances in deep self-supervised feature learning. Surprisingly, a very promising…

Computer Vision and Pattern Recognition · Computer Science 2021-08-13 Tal Reiss , Niv Cohen , Liron Bergman , Yedid Hoshen

Adaptive time stepping methods for metastable dynamics of the Allen Cahn and Cahn Hilliard equations are investigated in the spatially continuous, semi-discrete setting. We analyse the performance of a number of first and second order…

Numerical Analysis · Mathematics 2020-06-01 Xinyu Cheng , Dong Li , Keith Promislow , Brian Wetton

Anomaly detection aims to separate anomalies from normal samples, and the pretrained network is promising for anomaly detection. However, adapting the pretrained features would be confronted with the risk of pattern collapse when finetuning…

Computer Vision and Pattern Recognition · Computer Science 2022-04-26 Xingtai Gui , Di Wu , Yang Chang , Shicai Fan

The Atlantic Meridional Overturning Circulation (AMOC) is a tipping element of the climate system. The current estimate of the global warming threshold for the onset of an AMOC collapse is +4.0C (uncertainty range 1.4-8C). However, such a…

Atmospheric and Oceanic Physics · Physics 2026-04-30 René M. van Westen , Reyk Börner , Henk A. Dijkstra

Emergence, a global property of complex adaptive systems (CASs) constituted by interactive agents, is prevalent in real-world dynamic systems, e.g., network-level traffic congestions. Detecting its formation and evaporation helps to monitor…

Multiagent Systems · Computer Science 2024-10-29 Siyuan Chen , Xin Du , Jiahai Wang

Early stopping based on hold-out data is a popular regularization technique designed to mitigate overfitting and increase the predictive accuracy of neural networks. Models trained with early stopping often provide relatively accurate…

Machine Learning · Statistics 2023-06-28 Ziyi Liang , Yanfei Zhou , Matteo Sesia

Material parameters such as thermal diffusivity govern how microstructural fields evolve during processing, but difficult to measure directly. The Stability-Aware Frozen Euler Physics-Informed Tracking for Continuum Mechanics (SAFE-PIT-CM),…

Machine Learning · Computer Science 2026-03-25 Emil Hovad

Since the future of computing is heterogeneous, scalability is a crucial problem for single image super-resolution. Recent works try to train one network, which can be deployed on platforms with different capacities. However, they rely on…

Computer Vision and Pattern Recognition · Computer Science 2022-07-22 Shizun Wang , Jiaming Liu , Kaixin Chen , Xiaoqi Li , Ming Lu , Yandong Guo

Real-world multimodal systems routinely face missing-input scenarios, and in reality, robots lose audio in a factory or a clinical record omits lab tests at inference time. Standard fusion layers either preserve robustness or calibration…

Machine Learning · Statistics 2025-05-22 Leon Chlon , Maggie Chlon , MarcAntonio M. Awada

This paper establishes new sufficient conditions for Mittag-Leffler stability of Caputo fractional-order nonlinear systems with state-dependent delays. The central analytical tool is a class of Lyapunov-Krasovskii functionals that…

Dynamical Systems · Mathematics 2026-02-10 Abdallah Alsammani , Gassan Farah

Machine learning models must continuously self-adjust themselves for novel data distribution in the open world. As the predominant principle, entropy minimization (EM) has been proven to be a simple yet effective cornerstone in existing…

Machine Learning · Statistics 2024-10-16 Qingyang Zhang , Yatao Bian , Xinke Kong , Peilin Zhao , Changqing Zhang