English
Related papers

Related papers: A Simple Recipe for Competitive Low-compute Self s…

200 papers

Step-by-step reasoning approaches like chain of thought (CoT) have proved to be very effective in inducing reasoning capabilities in large language models. However, the success of the CoT approach is fundamentally tied to the model size,…

Machine Learning · Computer Science 2023-05-19 Kumar Shridhar , Alessandro Stolfo , Mrinmaya Sachan

Self-supervised speech representation learning enables the extraction of meaningful features from raw waveforms. These features can then be efficiently used across multiple downstream tasks. However, two significant issues arise when…

Audio and Speech Processing · Electrical Eng. & Systems 2024-03-14 Heitor R. Guimarães , Arthur Pimentel , Anderson R. Avila , Mehdi Rezagholizadeh , Boxing Chen , Tiago H. Falk

Vision transformer (ViT) recently has drawn great attention in computer vision due to its remarkable model capability. However, most prevailing ViT models suffer from huge number of parameters, restricting their applicability on devices…

Computer Vision and Pattern Recognition · Computer Science 2022-07-22 Kan Wu , Jinnian Zhang , Houwen Peng , Mengchen Liu , Bin Xiao , Jianlong Fu , Lu Yuan

Deep Learning has emerged as a promising approach for skin lesion analysis. However, existing methods mostly rely on fully supervised learning, requiring extensive labeled data, which is challenging and costly to obtain. To alleviate this…

Image and Video Processing · Electrical Eng. & Systems 2025-08-18 Siyamalan Manivannan

Recently, contrastive learning has achieved great results in self-supervised learning, where the main idea is to push two augmentations of an image (positive pairs) closer compared to other random images (negative pairs). We argue that not…

Computer Vision and Pattern Recognition · Computer Science 2021-09-13 Ajinkya Tejankar , Soroush Abbasi Koohpayegani , Vipin Pillai , Paolo Favaro , Hamed Pirsiavash

Neural machine translation (NMT) offers a novel alternative formulation of translation that is potentially simpler than statistical approaches. However to reach competitive performance, NMT models need to be exceedingly large. In this paper…

Computation and Language · Computer Science 2016-09-23 Yoon Kim , Alexander M. Rush

Traditional computer vision models are trained to predict a fixed set of predefined categories. Recently, natural language has been shown to be a broader and richer source of supervision that provides finer descriptions to visual concepts…

Computer Vision and Pattern Recognition · Computer Science 2021-04-20 Ruizhe Cheng , Bichen Wu , Peizhao Zhang , Peter Vajda , Joseph E. Gonzalez

Computationally expensive training strategies make self-supervised learning (SSL) impractical for resource constrained industrial settings. Techniques like knowledge distillation (KD), dynamic computation (DC), and pruning are often used to…

The landscape of self-supervised learning (SSL) is currently dominated by generative approaches (e.g., MAE) that reconstruct raw low-level data, and predictive approaches (e.g., I-JEPA) that predict high-level abstract embeddings. While…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Scott C. Lowe , Anthony Fuller , Sageev Oore , Evan Shelhamer , Graham W. Taylor

Large self-supervised models are effective feature extractors, but their application is challenging under on-device budget constraints and biased dataset collection, especially in keyword spotting. To address this, we proposed a knowledge…

Computation and Language · Computer Science 2023-07-07 Gene-Ping Yang , Yue Gu , Qingming Tang , Dongsu Du , Yuzong Liu

Hyperspectral image (HSI) classification presents unique challenges due to its high spectral dimensionality and limited labeled data. Traditional deep learning models often suffer from overfitting and high computational costs.…

Computer Vision and Pattern Recognition · Computer Science 2026-01-13 Prachet Dev Singh , Shyamsundar Paramasivam , Sneha Barman , Mainak Singha , Ankit Jha , Girish Mishra , Biplab Banerjee

Transformers recently are adapted from the community of natural language processing as a promising substitute of convolution-based neural networks for visual learning tasks. However, its supremacy degenerates given an insufficient amount of…

Computer Vision and Pattern Recognition · Computer Science 2021-06-24 Sucheng Ren , Zhengqi Gao , Tianyu Hua , Zihui Xue , Yonglong Tian , Shengfeng He , Hang Zhao

The semi-supervised learning (SSL) strategy in lightweight models requires reducing annotated samples and facilitating cost-effective inference. However, the constraint on model parameters, imposed by the scarcity of training labels, limits…

Computation and Language · Computer Science 2024-12-03 Qianren Mao , Weifeng Jiang , Junnan Liu , Chenghua Lin , Qian Li , Xianqing Wen , Jianxin Li , Jinhu Lu

Interpreting the predictions of a black-box deep network can facilitate the reliability of its deployment. In this work, we propose a re-label distillation approach to learn a direct map from the input to the prediction in a…

Computer Vision and Pattern Recognition · Computer Science 2024-09-23 Yingying Hua , Shiming Ge , Daichi Zhang

In recent years, Embodied Artificial Intelligence (Embodied AI) has advanced rapidly, yet the increasing size of models conflicts with the limited computational capabilities of Embodied AI platforms. To address this challenge, we aim to…

Computer Vision and Pattern Recognition · Computer Science 2024-09-30 Junyou Zhu , Yanyuan Qiao , Siqi Zhang , Xingjian He , Qi Wu , Jing Liu

We study semi-supervised learning (SSL) for vision transformers (ViT), an under-explored topic despite the wide adoption of the ViT architectures to different tasks. To tackle this problem, we propose a new SSL pipeline, consisting of first…

Computer Vision and Pattern Recognition · Computer Science 2022-08-12 Zhaowei Cai , Avinash Ravichandran , Paolo Favaro , Manchen Wang , Davide Modolo , Rahul Bhotika , Zhuowen Tu , Stefano Soatto

Knowledge distillation is a technique used to train a small student network using the output generated by a large teacher network, and has many empirical advantages~\citep{Hinton2015DistillingTK}. While the standard one-shot approach to…

Machine Learning · Computer Science 2025-03-25 Shivam Gupta , Sushrut Karmalkar

Few-shot class incremental learning (FSCIL) portrays the problem of learning new concepts gradually, where only a few examples per concept are available to the learner. Due to the limited number of examples for training, the techniques…

Computer Vision and Pattern Recognition · Computer Science 2021-04-01 Ali Cheraghian , Shafin Rahman , Pengfei Fang , Soumava Kumar Roy , Lars Petersson , Mehrtash Harandi

In instance-level detection tasks (e.g., object detection), reducing input resolution is an easy option to improve runtime efficiency. However, this option traditionally hurts the detection performance much. This paper focuses on boosting…

Computer Vision and Pattern Recognition · Computer Science 2021-09-16 Lu Qi , Jason Kuen , Jiuxiang Gu , Zhe Lin , Yi Wang , Yukang Chen , Yanwei Li , Jiaya Jia

This paper proposes the DistillCSE framework, which performs contrastive learning under the self-training paradigm with knowledge distillation. The potential advantage of DistillCSE is its self-enhancing feature: using a base model to…

Computation and Language · Computer Science 2023-12-25 Jiahao Xu , Wei Shao , Lihui Chen , Lemao Liu