English
Related papers

Related papers: ZeroSiam: An Efficient Asymmetry for Test-Time Ent…

200 papers

Self-supervised learning (SSL) is an effective method for exploiting unlabelled data to learn a high-level embedding space that can be used for various downstream tasks. However, existing methods to monitor the quality of the encoder --…

Machine Learning · Computer Science 2024-09-11 Isaac Xu , Scott Lowe , Thomas Trappenberg

As the capabilities of Vision Language Models (VLMs) continue to improve, they are increasingly targeted by jailbreak attacks. Existing defense methods face two major limitations: (1) they struggle to ensure safety without compromising the…

Cryptography and Security · Computer Science 2025-09-29 Xiyu Zeng , Siyuan Liang , Liming Lu , Haotian Zhu , Enguang Liu , Jisheng Dang , Yongbin Zhou , Shuchao Pang

Prototypical self-supervised learning methods consistently suffer from partial prototype collapse, where multiple prototypes converge to nearly identical representations. This undermines their central purpose -- providing diverse and…

Diffusion models have emerged as powerful generative techniques for solving inverse problems. Despite their success in a variety of inverse problems in imaging, these models require many steps to converge, leading to slow inference time.…

Image and Video Processing · Electrical Eng. & Systems 2024-11-13 Yaşar Utku Alçalar , Mehmet Akçakaya

Many recent self-supervised frameworks for visual representation learning are based on certain forms of Siamese networks. Such networks are conceptually symmetric with two parallel encoders, but often practically asymmetric as numerous…

Computer Vision and Pattern Recognition · Computer Science 2022-04-04 Xiao Wang , Haoqi Fan , Yuandong Tian , Daisuke Kihara , Xinlei Chen

Test-time adaptation aims to adapt a well-trained model to potential distribution shifts at test time using only unlabeled test data, without access to the original training data. While previous efforts mainly focus on a single modality,…

Artificial Intelligence · Computer Science 2025-03-05 Yusheng Zhao , Junyu Luo , Xiao Luo , Jinsheng Huang , Jingyang Yuan , Zhiping Xiao , Ming Zhang

Large reasoning models have demonstrated remarkable performance on complex reasoning tasks, yet the excessive length of their chain-of-thought outputs remains a major practical bottleneck due to high computation cost and poor deployability.…

Computation and Language · Computer Science 2025-11-25 Hourun Zhu , Yang Gao , Wenlong Fei , Jiawei Li , Huashan Sun

The nonlinear optimization problem with linear constraints has many applications in engineering fields such as the visual-inertial navigation and localization of an unmanned aerial vehicle maintaining the horizontal flight. In order to…

Numerical Analysis · Mathematics 2020-11-03 Xin-long Luo , Jia-hui Lv , Geng Sun

We propose a novel LLM-based framework for reasoning in discrete, game-theoretic tasks, illustrated with \emph{Tic-Tac-Toe}. The method integrates in-context learning with entropy-guided chain-of-thought (CoT) reasoning and adaptive context…

Computation and Language · Computer Science 2026-04-14 Tommaso Felice Banfi , Sashenka Gamage

Reasoning VLMs can become more accurate while progressively losing visual grounding as they think. This creates task-conditional danger zones where low-entropy predictions are confident but ungrounded, a failure mode text-only monitoring…

Artificial Intelligence · Computer Science 2026-04-07 Suresh Raghu , Satwik Pandey

Meta-learning synthesizes and leverages the knowledge from a given set of tasks to rapidly learn new tasks using very little data. Meta-learning of linear regression tasks, where the regressors lie in a low-dimensional subspace, is an…

Machine Learning · Computer Science 2021-05-19 Kiran Koshy Thekumparampil , Prateek Jain , Praneeth Netrapalli , Sewoong Oh

Fully-test-time adaptation (F-TTA) can mitigate performance loss due to distribution shifts between train and test data (1) without access to the training data, and (2) without knowledge of the model training procedure. In online F-TTA, a…

Machine Learning · Computer Science 2023-09-11 Skyler Seto , Barry-John Theobald , Federico Danieli , Navdeep Jaitly , Dan Busbridge

Zero-Shot Anomaly Detection (ZSAD) aims to detect anomalies in unseen domains without target-domain adaptation. Recent CLIP-based methods have shown promising performance by leveraging prompt learning and visual-text alignment. However,…

Computer Vision and Pattern Recognition · Computer Science 2026-05-28 Xinyu Zhao , Qingyun Sun , Jiayi Luo , Jianxin Li

Large language models excel at reasoning but lack key aspects of introspection, including anticipating their own success and the computation required to achieve it. Humans use real-time introspection to decide how much effort to invest,…

Machine Learning · Computer Science 2025-12-24 Rohin Manvi , Joey Hong , Tim Seyde , Maxime Labonne , Mathias Lechner , Sergey Levine

Experimental robot optimization often requires evaluating each candidate policy for seconds to minutes. The chosen evaluation time influences optimization because of a speed-accuracy tradeoff: shorter evaluations enable faster iteration,…

Neural and Evolutionary Computing · Computer Science 2026-01-15 Russell M. Martin , Steven H. Collins

Large Reasoning Models (LRMs) often suffer from overthinking, generating unnecessarily long reasoning chains even for simple tasks. This leads to substantial computational overhead with limited performance gain, primarily due to redundant…

Artificial Intelligence · Computer Science 2026-01-13 Ruichu Cai , Haopeng Du , Qingwen Lin , Yutong Chen , Zijian Li , Boyan Xu

Deep metric learning (DML) aims to learn a discriminative high-dimensional embedding space for downstream tasks like classification, clustering, and retrieval. Prior literature predominantly focuses on pair-based and proxy-based methods to…

Computer Vision and Pattern Recognition · Computer Science 2024-07-04 Xiruo Jiang , Yazhou Yao , Xili Dai , Fumin Shen , Xian-Sheng Hua , Heng-Tao Shen

Audio-language models have recently demonstrated strong zero-shot capabilities by leveraging natural-language supervision to classify audio events without labeled training data. Yet, their performance is highly sensitive to the wording of…

The response time of physical computational elements is finite, and neurons are no exception. In hierarchical models of cortical networks each layer thus introduces a response lag. This inherent property of physical dynamical systems…

Neurons and Cognition · Quantitative Biology 2021-10-28 Paul Haider , Benjamin Ellenberger , Laura Kriener , Jakob Jordan , Walter Senn , Mihai A. Petrovici

Continual learning aims to acquire new tasks while preserving performance on previously learned ones, but most methods struggle with catastrophic forgetting. Existing approaches typically treat all layers uniformly, often trading stability…

Machine Learning · Computer Science 2025-12-29 Hengyi Wu , Zhenyi Wang , Heng Huang