English
Related papers

Related papers: The Devil is in Fine-tuning and Long-tailed Proble…

200 papers

Analyzing short texts infers discriminative and coherent latent topics that is a critical and fundamental task since many real-world applications require semantic understanding of short texts. Traditional long text topic modeling algorithms…

Information Retrieval · Computer Science 2019-04-17 Qiang Jipeng , Qian Zhenyu , Li Yun , Yuan Yunhao , Wu Xindong

In medical contexts, the imbalanced data distribution in long-tailed datasets, due to scarce labels for rare diseases, greatly impairs the diagnostic accuracy of deep learning models. Recent multimodal text-image supervised foundation…

Computer Vision and Pattern Recognition · Computer Science 2024-08-28 Sirui Li , Li Lin , Yijin Huang , Pujin Cheng , Xiaoying Tang

The imbalanced distribution of long-tailed data presents a considerable challenge for deep learning models, as it causes them to prioritize the accurate classification of head classes but largely disregard tail classes. The biased decision…

Computer Vision and Pattern Recognition · Computer Science 2025-06-06 Mengke Li , Zhikai Hu , Yang Lu , Weichao Lan , Yiu-ming Cheung , Hui Huang

The imbalance (or long-tail) is the nature of many real-world data distributions, which often induces the undesirable bias of deep classification models toward frequent classes, resulting in poor performance for tail classes. In this paper,…

Machine Learning · Computer Science 2025-10-13 Fudong Lin , Xu Yuan

Long-tailed classification poses a challenge due to its heavy imbalance in class probabilities and tail-sensitivity risks with asymmetric misprediction costs. Recent attempts have used re-balancing loss and ensemble methods, but they are…

Machine Learning · Computer Science 2023-03-22 Bolian Li , Ruqi Zhang

The problem of deep long-tailed learning, a prevalent challenge in the realm of generic visual recognition, persists in a multitude of real-world applications. To tackle the heavily-skewed dataset issue in long-tailed classification, prior…

Computer Vision and Pattern Recognition · Computer Science 2023-09-26 Wenxiang Xu , Yongcheng Jing , Linyun Zhou , Wenqi Huang , Lechao Cheng , Zunlei Feng , Mingli Song

The large language models (LLMs) are able to generate high-quality texts in multiple languages. Such texts are often not recognizable by humans as generated, and therefore present a potential of LLMs for misuse (e.g., plagiarism, spams,…

Computation and Language · Computer Science 2025-09-25 Dominik Macko

In real-world scenarios, collected and annotated data often exhibit the characteristics of multiple classes and long-tailed distribution. Additionally, label noise is inevitable in large-scale annotations and hinders the applications of…

Computer Vision and Pattern Recognition · Computer Science 2023-07-04 Chao Liang , Zongxin Yang , Linchao Zhu , Yi Yang

Recent progress in large-scale pre-training has led to the development of advanced vision-language models (VLMs) with remarkable proficiency in comprehending and generating multimodal content. Despite the impressive ability to perform…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Hang Hua , Jing Shi , Kushal Kafle , Simon Jenni , Daoan Zhang , John Collomosse , Scott Cohen , Jiebo Luo

For long-tailed classification, most works often pretrain a big model on a large-scale dataset, and then fine-tune the whole model for adapting to long-tailed data. Though promising, fine-tuning the whole pretrained model tends to suffer…

Computer Vision and Pattern Recognition · Computer Science 2023-03-29 Bowen Dong , Pan Zhou , Shuicheng Yan , Wangmeng Zuo

Augmenting missing key aspects in Textual Vulnerability Descriptions (TVDs) is crucial for effective vulnerability analysis. For instance, in TVDs, key aspects include Attack Vector, Vulnerability Type, among others. These key aspects help…

Software Engineering · Computer Science 2024-12-17 Linyi Han , Shidong Pan , Zhenchang Xing , Jiamou Sun , Sofonias Yitagesu , Xiaowang Zhang , Zhiyong Feng

Real-world data often have a long-tailed distribution, where the number of samples per class is not equal over training classes. The imbalanced data form a biased feature space, which deteriorates the performance of the recognition model.…

Computer Vision and Pattern Recognition · Computer Science 2022-11-23 Minki Jeong , Changick Kim

There is currently a significant gap between the performance of fine-tuned models and prompting approaches using Large Language Models (LLMs) on the challenging task of text-to-SQL, as evaluated on datasets such as Spider. To improve the…

Computation and Language · Computer Science 2023-11-06 Mohammadreza Pourreza , Davood Rafiei

Recently, video scene text detection has received increasing attention due to its comprehensive applications. However, the lack of annotated scene text video datasets has become one of the most important problems, which hinders the…

Computer Vision and Pattern Recognition · Computer Science 2021-03-30 Jiajun Zhu , Xiufeng Jiang , Zhiwei Jia , Shugong Xu , Shan Cao

Large language models (LLMs) frequently produce \emph{detail hallucinations} when processing long regulatory documents, including subtle errors in threshold values, units, scopes, obligation levels, and conditions that preserve surface…

Social and Information Networks · Computer Science 2026-04-28 Yang Liu , Bin Chong , Yuhan Lin , Chongyang Zhang , Hao Zheng , Ziyi Zhang , Jiayu Liang , Ran Ran , Qian Li , Kefu Xu

Context: Software vulnerabilities pose a significant threat to modern software systems, as evidenced by the growing number of reported vulnerabilities and cyberattacks. These escalating trends underscore the urgent need for effective…

Software Engineering · Computer Science 2025-07-01 Siyu Chen , Jiongyi Yang , Xiang Chen , Menglin Zheng , Minnan Wei , Xiaolin Ju

Large language models (LLMs) have shown remarkable performance across various tasks, yet their ability to handle long-context reading remains challenging. This study explores the effectiveness of leveraging high-quality academic peer review…

Computation and Language · Computer Science 2024-11-11 Shengzhi Li , Kittipat Kampa , Rongyu Lin , Bohang Li , Shichao Pei

Scene text detection is an important step of scene text reading system. The main challenges lie on significantly varied sizes and aspect ratios, arbitrary orientations and shapes. Driven by recent progress in deep learning, impressive…

Computer Vision and Pattern Recognition · Computer Science 2019-10-02 Yongchao Xu , Yukang Wang , Wei Zhou , Yongpan Wang , Zhibo Yang , Xiang Bai

Scene-text image synthesis techniques that aim to naturally compose text instances on background scene images are very appealing for training deep neural networks due to their ability to provide accurate and comprehensive annotation…

Computer Vision and Pattern Recognition · Computer Science 2023-10-18 Zhengmi Tang , Tomo Miyazaki , Shinichiro Omachi

The training datasets used in long-tailed recognition are extremely unbalanced, resulting in significant variation in per-class accuracy across categories. Prior works mostly used average accuracy to evaluate their algorithms, which easily…

Computer Vision and Pattern Recognition · Computer Science 2024-01-31 Hao Yu , Yingxiao Du , Jianxin Wu