English
Related papers

Related papers: ELM: Embedding and Logit Margins for Long-Tail Lea…

200 papers

In this paper, we propose a progressive margin loss (PML) approach for unconstrained facial age classification. Conventional methods make strong assumption on that each class owns adequate instances to outline its data distribution, likely…

Computer Vision and Pattern Recognition · Computer Science 2021-03-04 Zongyong Deng , Hao Liu , Yaoxing Wang , Chenyang Wang , Zekuan Yu , Xuehong Sun

In many real-world applications, the frequency distribution of class labels for training data can exhibit a long-tailed distribution, which challenges traditional approaches of training deep neural networks that require heavy amounts of…

Computer Vision and Pattern Recognition · Computer Science 2024-09-06 Richard Franklin , Jiawei Yao , Deyang Zhong , Qi Qian , Juhua Hu

We study a distributed machine learning problem carried out by an edge server and multiple agents in a wireless network. The objective is to minimize a global function that is a sum of the agents' local loss functions. And the optimization…

Information Theory · Computer Science 2021-12-03 Howard H. Yang , Zihan Chen , Tony Q. S. Quek , H. Vincent Poor

Traditional way of storing facts in triplets ({\it head\_entity, relation, tail\_entity}), abbreviated as ({\it h, r, t}), makes the knowledge intuitively displayed and easily acquired by mankind, but hardly computed or even reasoned by AI…

Artificial Intelligence · Computer Science 2015-04-08 Miao Fan , Qiang Zhou , Thomas Fang Zheng , Ralph Grishman

In class incremental learning (CIL) a model must learn new classes in a sequential manner without forgetting old ones. However, conventional CIL methods consider a balanced distribution for each new task, which ignores the prevalence of…

Computer Vision and Pattern Recognition · Computer Science 2022-10-04 Xialei Liu , Yu-Song Hu , Xu-Sheng Cao , Andrew D. Bagdanov , Ke Li , Ming-Ming Cheng

Convolutional neural networks have achieved great improvement on face recognition in recent years because of its extraordinary ability in learning discriminative features of people with different identities. To train such a well-designed…

Computer Vision and Pattern Recognition · Computer Science 2016-11-29 Xiao Zhang , Zhiyuan Fang , Yandong Wen , Zhifeng Li , Yu Qiao

Despite the undeniable progress in visual recognition tasks fueled by deep neural networks, there exists recent evidence showing that these models are poorly calibrated, resulting in over-confident predictions. The standard practices of…

Computer Vision and Pattern Recognition · Computer Science 2024-02-01 Balamurali Murugesan , Bingyuan Liu , Adrian Galdran , Ismail Ben Ayed , Jose Dolz

We present a neural network-based method for solving linear and nonlinear partial differential equations, by combining the ideas of extreme learning machines (ELM), domain decomposition and local neural networks. The field solution on each…

Numerical Analysis · Mathematics 2021-09-22 Suchuan Dong , Zongwei Li

Text embeddings have become an essential part of a variety of language applications. However, methods for interpreting, exploring and reversing embedding spaces are limited, reducing transparency and precluding potentially valuable…

Computation and Language · Computer Science 2026-01-27 Brian Ondov , Chia-Hsuan Chang , Yujia Zhou , Mauro Giuffrè , Hua Xu

Learning-based techniques, especially advanced Large Language Models (LLMs) for code, have gained considerable popularity in various software engineering (SE) tasks. However, most existing works focus on designing better learning-based…

Software Engineering · Computer Science 2023-09-08 Xin Zhou , Kisub Kim , Bowen Xu , Jiakun Liu , DongGyun Han , David Lo

In the real world, long-tailed data distributions are prevalent, making it challenging for models to effectively learn and classify tail classes. However, we discover that in the field of drug chemistry, certain tail classes exhibit higher…

Machine Learning · Computer Science 2025-04-08 Yujia Su , Xinjie Li , Lionel Z. Wang

Long-tailed data distributions pose challenges for a variety of domains like e-commerce, finance, biomedical science, and cyber security, where the performance of machine learning models is often dominated by head categories while tail…

Machine Learning · Computer Science 2024-10-31 Haohui Wang , Weijie Guan , Jianpeng Chen , Zi Wang , Dawei Zhou

We propose a novel loss function for imbalanced classification. LDAM loss, which minimizes a margin-based generalization bound, is widely utilized for class-imbalanced image classification. Although, by using LDAM loss, it is possible to…

Computer Vision and Pattern Recognition · Computer Science 2023-06-16 Sota Kato , Kazuhiro Hotta

The conventional detectors tend to make imbalanced classification and suffer performance drop, when the distribution of the training data is severely skewed. In this paper, we propose to use the mean classification score to indicate the…

Computer Vision and Pattern Recognition · Computer Science 2021-08-19 Chengjian Feng , Yujie Zhong , Weilin Huang

In this work, we tackle the challenging problem of long-tailed image recognition. Previous long-tailed recognition approaches mainly focus on data augmentation or re-balancing strategies for the tail classes to give them more attention…

Computer Vision and Pattern Recognition · Computer Science 2023-09-15 Weide Liu , Zhonghua Wu , Yiming Wang , Henghui Ding , Fayao Liu , Jie Lin , Guosheng Lin

In the realm of edge computing, the increasing demand for high Quality of Service (QoS), particularly in dynamic multimedia streaming applications (e.g., Augmented Reality/Virtual Reality and online gaming), has prompted the need for…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-12-29 Cheng Zhang , Yinuo Deng , Hailiang Zhao , Tianlv Chen , Shuiguang Deng

Deploying deep models in real-world scenarios entails a number of challenges, including computational efficiency and real-world (e.g., long-tailed) data distributions. We address the combined challenge of learning long-tailed distributions…

Computer Vision and Pattern Recognition · Computer Science 2024-04-02 Jihun Kim , Dahyun Kim , Hyungrok Jung , Taeil Oh , Jonghyun Choi

In spite of the dominant performances of deep neural networks, recent works have shown that they are poorly calibrated, resulting in over-confident predictions. Miscalibration can be exacerbated by overfitting due to the minimization of the…

Computer Vision and Pattern Recognition · Computer Science 2023-07-06 Bingyuan Liu , Ismail Ben Ayed , Adrian Galdran , Jose Dolz

Representation learning is currently a very hot topic in modern machine learning, mostly due to the great success of the deep learning methods. In particular low-dimensional representation which discriminates classes can not only enhance…

Machine Learning · Computer Science 2015-04-13 Wojciech Marian Czarnecki , Rafał Józefowicz , Jacek Tabor

Extreme learning machine (ELM), proposed by Huang et al., has been shown a promising learning algorithm for single-hidden layer feedforward neural networks (SLFNs). Nevertheless, because of the random choice of input weights and biases, the…

Neural and Evolutionary Computing · Computer Science 2014-09-16 Yuguang Wang , Feilong Cao , Yubo Yuan