English
Related papers

Related papers: ZeroSiam: An Efficient Asymmetry for Test-Time Ent…

200 papers

Recognizing symmetries in data allows for significant boosts in neural network training, which is especially important where training data are limited. In many cases, however, the exact underlying symmetry is present only in an idealized…

High Energy Physics - Phenomenology · Physics 2025-04-07 Seth Nabat , Aishik Ghosh , Edmund Witkowski , Gregor Kasieczka , Daniel Whiteson

The absence of an algorithm that effectively monitors deep learning models used in side-channel attacks increases the difficulty of evaluation. If the attack is unsuccessful, the question is if we are dealing with a resistant implementation…

Cryptography and Security · Computer Science 2021-11-30 Servio Paguada , Lejla Batina , Ileana Buhan , Igor Armendariz

The promising zero-shot generalization of vision-language models such as CLIP has led to their adoption using prompt learning for numerous downstream tasks. Previous works have shown test-time prompt tuning using entropy minimization to…

Computer Vision and Pattern Recognition · Computer Science 2024-01-12 Jameel Hassan , Hanan Gani , Noor Hussein , Muhammad Uzair Khattak , Muzammal Naseer , Fahad Shahbaz Khan , Salman Khan

Adapting LLMs with new knowledge is increasingly important, but standard fine-tuning often erodes aligned epistemic abstention: the ability to acknowledge when the model does not know. This failure mode is especially concerning in…

Artificial Intelligence · Computer Science 2026-04-22 William F. Shen , Xinchi Qiu , Nicola Cancedda , Nicholas D. Lane

Behaviour biometrics are being explored as a viable alternative to overcome the limitations of traditional authentication methods such as passwords and static biometrics. Also, they are being considered as a viable authentication method for…

Cryptography and Security · Computer Science 2022-10-25 Oshan Jayawardana , Fariza Rashid , Suranga Seneviratne

This paper presents a neural network filter method based on contraction operators to address model collapse in recursive training of generative models. Unlike \cite{xu2024probabilistic}, which requires superlinear sample growth…

Machine Learning · Computer Science 2025-12-02 Zongjian Han , Yiran Liang , Ruiwen Wang , Yiwei Luo , Yilin Huang , Xiaotong Song , Dongqing Wei

Differentiable matching layers and residual connection paradigms, often implemented via entropy-regularized Optimal Transport (OT), serve as critical mechanisms in structural prediction and architectural scaling. However, recovering…

Machine Learning · Computer Science 2026-02-06 Yizhi Liu

Vision-Language Models (VLMs) rely heavily on pretrained vision encoders to support downstream tasks such as image captioning, visual question answering, and zero-shot classification. Despite their strong performance, these encoders remain…

Computer Vision and Pattern Recognition · Computer Science 2026-04-08 Md Zarif Hossain , Ahmed Imteaj

Sharpness aware minimization (SAM) optimizer has been extensively explored as it can generalize better for training deep neural networks via introducing extra perturbation steps to flatten the landscape of deep learning models. Integrating…

Machine Learning · Computer Science 2023-03-02 Hao Sun , Li Shen , Qihuang Zhong , Liang Ding , Shixiang Chen , Jingwei Sun , Jing Li , Guangzhong Sun , Dacheng Tao

Sharpness-Aware Minimization (SAM) has emerged as a promising approach for effectively reducing the generalization error. However, SAM incurs twice the computational cost compared to base optimizer (e.g., SGD). We propose Asymptotic…

Computer Vision and Pattern Recognition · Computer Science 2025-03-31 Jiaxin Deng , Junbiao Pang , Baochang Zhang

Neural networks (NNs) can achieved high performance in various fields such as computer vision, and natural language processing. However, deploying NNs in resource-constrained safety-critical systems has challenges due to uncertainty in the…

Machine Learning · Computer Science 2024-01-17 Soyed Tuhin Ahmed

Reinforcement learning with verifiable rewards (RLVR) has emerged as a prominent paradigm for enhancing the reasoning capabilities of large language models (LLMs). However, the entropy of LLMs usually collapses during RLVR training, leading…

Computation and Language · Computer Science 2026-04-21 Renren Jin , Pengzhi Gao , Yuqi Ren , Zhuowen Han , Tongxuan Zhang , Wuwei Huang , Wei Liu , Jian Luan , Deyi Xiong

Zero-shot imitation learning algorithms hold the promise of reproducing unseen behavior from as little as a single demonstration at test time. Existing practical approaches view the expert demonstration as a sequence of goals, enabling…

Machine Learning · Computer Science 2025-06-13 Thomas Rupf , Marco Bagatella , Nico Gürtler , Jonas Frey , Georg Martius

For solving pseudo-convex global optimization problems, we present a novel fully adaptive steepest descent method (or ASDM) without any hard-to-estimate parameters. For the step-size regulation in an $\varepsilon$-normalized direction, we…

Optimization and Control · Mathematics 2021-08-12 Z. R. Gabidullina

Large-scale pretrained vision-language models like CLIP have demonstrated remarkable zero-shot image classification capabilities across diverse domains. To enhance CLIP's performance while preserving the zero-shot paradigm, various…

Computer Vision and Pattern Recognition · Computer Science 2024-06-19 Xuefeng Hu , Ke Zhang , Min Sun , Albert Chen , Cheng-Hao Kuo , Ram Nevatia

With the rapid development of the new energy vehicle industry, the efficient disassembly and recycling of power batteries have become a critical challenge for the circular economy. In current unstructured disassembly scenarios, the dynamic…

Robotics · Computer Science 2025-09-16 Ziwen He , Zhigang Wang , Yanlong Peng , Pengxu Chang , Hong Yang , Ming Chen

Physical symmetries provide a strong inductive bias for constructing functions to analyze data. In particular, this bias may improve robustness, data efficiency, and interpretability of machine learning models. However, building machine…

High Energy Physics - Phenomenology · Physics 2025-11-05 Pradyun Hebbar , Thandikire Madula , Vinicius Mikuni , Benjamin Nachman , Nadav Outmezguine , Inbar Savoray

Recent studies have noted an intriguing phenomenon termed Neural Collapse, that is, when the neural networks establish the right correlation between feature spaces and the training targets, their last-layer features, together with the…

Computer Vision and Pattern Recognition · Computer Science 2025-09-22 Yining Wang , Junjie Sun , Chenyue Wang , Mi Zhang , Min Yang

We introduce Time-Conditioned Contraction Matching (TCCM), a novel method for semi-supervised anomaly detection in tabular data. TCCM is inspired by flow matching, a recent generative modeling framework that learns velocity fields between…

Machine Learning · Computer Science 2025-10-22 Zhong Li , Qi Huang , Yuxuan Zhu , Lincen Yang , Mohammad Mohammadi Amiri , Niki van Stein , Matthijs van Leeuwen

Reinforcement learning algorithms such as Q-learning have shown great promise in training models to learn the optimal action to take for a given system state; a goal in applications with an exploratory or adversarial nature such as…

Computation and Language · Computer Science 2020-04-08 Xusen Yin , Jonathan May