English
Related papers

Related papers: The Rescue Effect: Spatio-Semantic Early Exit Bypa…

200 papers

Human action recognition plays a critical role in healthcare and medicine, supporting applications such as patient behavior monitoring, fall detection, surgical robot supervision, and procedural skill assessment. While traditional models…

Computer Vision and Pattern Recognition · Computer Science 2025-08-01 Utkarsh Shandilya , Marsha Mariya Kappan , Sanyam Jain , Vijeta Sharma

Early Exit (EE) techniques have emerged as a means to reduce inference latency in Deep Neural Networks (DNNs). The latency improvement and accuracy in these techniques crucially depend on the criteria used to make exit decisions. We propose…

Machine Learning · Computer Science 2025-02-04 Divya Jyoti Bajpai , Manjesh Kumar Hanawal

Few-shot learning (FSL) often requires effective adaptation of models using limited labeled data. However, most existing FSL methods rely on entangled representations, requiring the model to implicitly recover the unmixing process to obtain…

Computer Vision and Pattern Recognition · Computer Science 2025-08-06 Tianjiao Jiang , Zhen Zhang , Yuhang Liu , Javen Qinfeng Shi

Learning-based real image dehazing methods have achieved notable progress, yet they still face adaptation challenges in diverse real haze scenes. These challenges mainly stem from the lack of effective unsupervised mechanisms for unlabeled…

Computer Vision and Pattern Recognition · Computer Science 2026-03-12 Yan Zhang , Long Ma , Yuxin Feng , Zhe Huang , Fan Zhou , Zhuo Su

Vision Language Action (VLA) models are mainstream in embodied intelligence but face high inference costs. Edge-Cloud Collaborative (ECC) inference offers an effective fix by easing edge-device computing pressure to meet real-time needs.…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-03-13 Zihao Zheng , Sicheng Tian , Hangyu Cao , Chenyue Li , Jiayu Chen , Maoliang Li , Xinhao Sun , Hailong Zou , Guojie Luo , Xiang Chen

Pre-trained vision-language models such as contrastive language-image pre-training (CLIP) have demonstrated a remarkable generalizability, which has enabled a wide range of applications represented by zero-shot classification. However,…

Computer Vision and Pattern Recognition · Computer Science 2025-05-20 Kazuki Adachi , Shin'ya Yamaguchi , Tomoki Hamagami

Representation autoencoders that reuse frozen pretrained vision encoders as visual tokenizers have achieved strong reconstruction and generation quality. However, existing methods universally extract features from only the last encoder…

Computer Vision and Pattern Recognition · Computer Science 2026-05-13 Xuanyu Zhu , Yan Bai , Yang Shi , Yihang Lou , Yuanxing Zhang , Jing Jin , Yuan Zhou

Reinforcement Learning with Verifiable Rewards (RLVR) strengthens LLM reasoning, but training often oscillates between {entropy collapse} and {entropy explosion}. We trace both hazards to the mean baseline used in value-free RL (e.g., GRPO…

Machine Learning · Computer Science 2026-03-03 Junkang Wu , Kexin Huang , Jiancan Wu , An Zhang , Xiang Wang , Xiangnan He

Vision transformers (ViTs) have demonstrated remarkable performance across various visual tasks. However, ViT models suffer from substantial computational and memory requirements, making it challenging to deploy them on resource-constrained…

Computer Vision and Pattern Recognition · Computer Science 2024-01-23 Navin Ranjan , Andreas Savakis

This paper presents a novel method to enhance the reliability of image classification models during deployment in the face of transient hardware errors. By utilizing enriched text embeddings derived from GPT-3 with question prompts per…

Computer Vision and Pattern Recognition · Computer Science 2023-12-06 Syed Talal Wasim , Kabila Haile Soboka , Abdulrahman Mahmoud , Salman Khan , David Brooks , Gu-Yeon Wei

Foundation models like CLIP allow zero-shot transfer on various tasks without additional training data. Yet, the zero-shot performance is less competitive than a fully supervised one. Thus, to enhance the performance, fine-tuning and…

Computer Vision and Pattern Recognition · Computer Science 2026-01-08 Beier Zhu , Kaihua Tang , Qianru Sun , Hanwang Zhang

Electrical Impedance Tomography (EIT) is a non-invasive, low-cost bedside imaging modality with high temporal resolution, making it suitable for bedside monitoring. However, its inherently ill-posed inverse problem poses significant…

Computer Vision and Pattern Recognition · Computer Science 2025-07-21 Hao Fang , Sihao Teng , Hao Yu , Siyi Yuan , Huaiwu He , Zhe Liu , Yunjie Yang

In this work, we introduce EQ-Net: the first holistic framework that solves both the tasks of log-likelihood ratio (LLR) estimation and quantization using a data-driven method. We motivate our approach with theoretical insights on two…

Machine Learning · Computer Science 2021-05-04 Marius Arvinte , Ahmed H. Tewfik , Sriram Vishwanath

Few-shot class-incremental learning (FSCIL) aims to mitigate the catastrophic forgetting issue when a model is incrementally trained on limited data. However, many of these works lack effective exploration of prior knowledge, rendering them…

Computer Vision and Pattern Recognition · Computer Science 2025-01-09 Wan Xu , Tianyu Huang , Tianyu Qu , Guanglei Yang , Yiwen Guo , Wangmeng Zuo

While post-training compression techniques effectively reduce the memory footprint, latency, and power consumption of Large Language Models (LLMs), they often result in noticeable accuracy degradation and remain limited by hardware and…

Recent advances in contrastive language-image pretraining (CLIP) have demonstrated strong capabilities in zero-shot classification by aligning visual representations with target text embeddings in an image level. However, in dense…

Computer Vision and Pattern Recognition · Computer Science 2024-10-29 Feng Wang , Jieru Mei , Alan Yuille

CLIP is a discriminative model trained to align images and text in a shared embedding space. Due to its multimodal structure, it serves as the backbone of many generative pipelines, where a decoder is trained to map from the shared space…

Computer Vision and Pattern Recognition · Computer Science 2025-06-05 Antonio D'Orazio , Maria Rosaria Briglia , Donato Crisostomi , Dario Loi , Emanuele Rodolà , Iacopo Masi

The rapid advancements in vision-language models (VLMs), such as CLIP, have intensified the need to address distribution shifts between training and testing datasets. Although prior Test-Time Training (TTT) techniques for VLMs have…

Computer Vision and Pattern Recognition · Computer Science 2025-02-05 Yuto Kojima , Jiarui Xu , Xueyan Zou , Xiaolong Wang

Deploying large language model inference remains challenging due to their high computational overhead. Early exit optimizes model inference by adaptively reducing the number of inference layers. Current methods typically train internal…

Computation and Language · Computer Science 2026-03-05 Lianming Huang , Shangyu Wu , Yufei Cui , Ying Xiong , Haibo Hu , Xue Liu , Tei-Wei Kuo , Nan Guan , Chun Jason Xue

Contrastive language-image pre-training (CLIP) is a powerful vision-language model that has shown great benefits for various tasks. However, we have identified some issues with its explainability, which undermine its credibility and limit…

Computer Vision and Pattern Recognition · Computer Science 2024-09-17 Yi Li , Hualiang Wang , Yiqun Duan , Jiheng Zhang , Xiaomeng Li