中文
相关论文

相关论文: ELF: An Early-Exiting Framework for Long-Tailed Cl…

200 篇论文

Large pre-trained language models (LMs) have demonstrated remarkable ability as few-shot learners. However, their success hinges largely on scaling model parameters to a degree that makes it challenging to train and serve. In this paper, we…

计算与语言 · 计算机科学 2021-05-03 Sinong Wang , Han Fang , Madian Khabsa , Hanzi Mao , Hao Ma

This paper proposes an easy-to-use method for one-class classification: Repeated Element-wise Folding (REF). The algorithm consists of repeatedly standardizing and applying an element-wise folding operation on the one-class training data.…

机器学习 · 计算机科学 2025-06-19 Jenni Raitoharju

Modern search engine ranking pipelines are commonly based on large machine-learned ensembles of regression trees. We propose LEAR, a novel - learned - technique aimed to reduce the average number of trees traversed by documents to…

Large language models have achieved remarkable capabilities, but their practical deployment is hindered by significant computational costs. While adaptive computation methods like early-exiting promise to reduce these costs, they introduce…

计算与语言 · 计算机科学 2025-12-16 Sangmin Bae

In class incremental learning (CIL) a model must learn new classes in a sequential manner without forgetting old ones. However, conventional CIL methods consider a balanced distribution for each new task, which ignores the prevalence of…

计算机视觉与模式识别 · 计算机科学 2022-10-04 Xialei Liu , Yu-Song Hu , Xu-Sheng Cao , Andrew D. Bagdanov , Ke Li , Ming-Ming Cheng

The popularity of algorithms based on Extreme Learning Machine (ELM), which can be used to train Single Layer Feedforward Neural Networks (SLFN), has increased in the past years. They have been successfully applied to a wide range of…

In this work, we introduce a novel strategy for long-tail recognition that addresses the tail classes' few-shot problem via training-free knowledge transfer. Our objective is to transfer knowledge acquired from information-rich common…

计算机视觉与模式识别 · 计算机科学 2022-04-13 Sarah Parisot , Pedro M. Esperanca , Steven McDonagh , Tamas J. Madarasz , Yongxin Yang , Zhenguo Li

Label distributions in camera-trap images are highly imbalanced and long-tailed, resulting in neural networks tending to be biased towards head-classes that appear frequently. Although long-tail learning has been extremely explored to…

计算机视觉与模式识别 · 计算机科学 2022-02-17 Byeongjun Park , Jeongsoo Kim , Seungju Cho , Heeseon Kim , Changick Kim

Effectively handling the co-occurrence of non-IID data and long-tailed distributions remains a critical challenge in federated learning. While fine-tuning vision-language models (VLMs) like CLIP has shown to be promising in addressing…

机器学习 · 计算机科学 2025-03-11 Shihao Hou , Xinyi Shang , Shreyank N Gowda , Yang Lu , Chao Wu , Yan Yan , Hanzi Wang

The datasets used for Deep Neural Network training (e.g., ImageNet, MSCOCO, etc.) are often manually balanced across categories (classes) to facilitate learning of all the categories. This curation process is often expensive and requires…

计算机视觉与模式识别 · 计算机科学 2024-11-12 Harsh Rangwani

Knowledge distillation (KD) has become a powerful tool for training compact student models using larger, pretrained teacher models, often requiring less data and computational resources. Teacher models typically possess more layers and thus…

机器学习 · 计算机科学 2025-05-05 Edvin Fasth , Sagar Singh

The long-tailed distribution datasets poses great challenges for deep learning based classification models on how to handle the class imbalance problem. Existing solutions usually involve class-balacing strategies or transfer learing from…

计算机视觉与模式识别 · 计算机科学 2022-04-21 Gongzhe Li , Zhiwen Tan , Linpeng Pan

In the real world, long-tailed data distributions are prevalent, making it challenging for models to effectively learn and classify tail classes. However, we discover that in the field of drug chemistry, certain tail classes exhibit higher…

机器学习 · 计算机科学 2025-04-08 Yujia Su , Xinjie Li , Lionel Z. Wang

Generalized Category Discovery (GCD) utilizes labeled samples of known classes to discover novel classes in unlabeled samples. Existing methods show effective performance on artificial datasets with balanced distributions. However,…

人工智能 · 计算机科学 2025-07-31 Cuong Manh Hoang

Sample selection is a prevalent method in learning with noisy labels, where small-loss data are typically considered as correctly labeled data. However, this method may not effectively identify clean hard examples with large losses, which…

机器学习 · 计算机科学 2023-08-29 Suqin Yuan , Lei Feng , Tongliang Liu

While the novel class discovery has recently made great progress, existing methods typically focus on improving algorithms on class-balanced benchmarks. However, in real-world recognition tasks, the class distributions of their…

计算机视觉与模式识别 · 计算机科学 2023-08-28 Chuyu Zhang , Ruijie Xu , Xuming He

Large-scale object detection and instance segmentation face a severe data imbalance. The finer-grained object classes become, the less frequent they appear in our datasets. However, at test-time, we expect a detector that performs well for…

计算机视觉与模式识别 · 计算机科学 2023-01-25 Jang Hyun Cho , Philipp Krähenbühl

The tracking method based on the extreme learning machine (ELM) is efficient and effective. ELM randomly generates input weights and biases in the hidden layer, and then calculates and computes the output weights by reducing the iterative…

机器学习 · 计算机科学 2018-07-27 Jing Zhang , Huibing Wang , Yonggong Ren

Entity typing (ET) is the problem of assigning labels to given entity mentions in a sentence. Existing works for ET require knowledge about the domain and target label set for a given test instance. ET in the absence of such knowledge is a…

计算与语言 · 计算机科学 2021-06-01 Abhishek Abhishek , Amar Prakash Azad , Balaji Ganesan , Ashish Anand , Amit Awekar

Recently, a number of iterative learning methods have been introduced to improve generalization. These typically rely on training for longer periods of time in exchange for improved generalization. LLF (later-layer-forgetting) is a…