English
Related papers

Related papers: Embedding Semantic Hierarchy in Discrete Optimal T…

200 papers

Deep Neural Networks (DNNs) have achieved remarkable success in a variety of tasks, especially when it comes to prediction accuracy. However, in complex real-world scenarios, particularly in safety-critical applications, high accuracy alone…

Artificial Intelligence · Computer Science 2024-05-31 Han Liu , Peng Cui , Bingning Wang , Jun Zhu , Xiaolin Hu

So far, discontinuous named entity recognition (NER) has received increasing research attention and many related methods have surged such as hypergraph-based methods, span-based methods, and sequence-to-sequence (Seq2Seq) methods, etc.…

Computation and Language · Computer Science 2022-11-03 Jiang Liu , Donghong Ji , Jingye Li , Dongdong Xie , Chong Teng , Liang Zhao , Fei Li

Structured output prediction problems are ubiquitous in machine learning. The prominent approach leverages neural networks as powerful feature extractors, otherwise assuming the independence of the outputs. These outputs, however, jointly…

This paper presents an experimental analysis about trade-offs in top-k classification accuracies on losses for deep leaning and proposal of a novel top-k loss. Commonly-used cross entropy (CE) is not guaranteed to optimize top-k prediction…

Machine Learning · Computer Science 2020-07-31 Azusa Sawada , Eiji Kaneko , Kazutoshi Sagi

Decision Trees (DTs) are widely used in safety-critical domains such as medical diagnosis, valued for their interpretability and effectiveness on tabular data. However, training accurate oblique DTs is challenging due to complex…

Machine Learning · Computer Science 2026-05-11 Subrat Prasad Panda , Blaise Genest , Arvind Easwaran

Deep neural networks have established as a powerful tool for large scale supervised classification tasks. The state-of-the-art performances of deep neural networks are conditioned to the availability of large number of accurately labeled…

Computer Vision and Pattern Recognition · Computer Science 2021-06-22 Bharath Bhushan Damodaran , Rémi Flamary , Viven Seguy , Nicolas Courty

Hyperspectral imaging (HSI) shows great promise for surgical applications, offering detailed insights into biological tissue differences beyond what the naked eye can perceive. Refined labelling efforts are underway to train vision systems…

Computer Vision and Pattern Recognition · Computer Science 2025-10-07 Junwen Wang , Oscar Maccormac , William Rochford , Aaron Kujawa , Jonathan Shapey , Tom Vercauteren

In neural machine translation, cross entropy (CE) is the standard loss function in two training methods of auto-regressive models, i.e., teacher forcing and scheduled sampling. In this paper, we propose mixed cross entropy loss (mixed CE)…

Computation and Language · Computer Science 2021-07-01 Haoran Li , Wei Lu

Semi-supervised learning has made remarkable strides by effectively utilizing a limited amount of labeled data while capitalizing on the abundant information present in unlabeled data. However, current algorithms often prioritize aligning…

Computer Vision and Pattern Recognition · Computer Science 2024-05-31 Zhiquan Tan , Kaipeng Zheng , Weiran Huang

Cross Entropy (CE) has an important role in machine learning and, in particular, in neural networks. It is commonly used in neural networks as the cost between the known distribution of the label and the Softmax/Sigmoid output. In this…

Machine Learning · Computer Science 2020-07-17 Ron Shoham , Haim Permuter

In traditional supervised learning, the cross-entropy loss treats all incorrect predictions equally, ignoring the relevance or proximity of wrong labels to the correct answer. By leveraging a tree hierarchy for fine-grained labels, we…

Sound · Computer Science 2025-01-23 Haokun Tian , Stefan Lattner , Brian McFee , Charalampos Saitis

Semantic segmentation and instance level segmentation made substantial progress in recent years due to the emergence of deep neural networks (DNNs). A number of deep architectures with Convolution Neural Networks (CNNs) were proposed that…

Computer Vision and Pattern Recognition · Computer Science 2019-09-18 Pulak Purkait , Christopher Zach , Ian Reid

In this paper, we consider the problem of distributed inference in tree based networks. In the framework considered in this paper, distributed nodes make a 1-bit local decision regarding a phenomenon before sending it to the fusion center…

Information Theory · Computer Science 2016-11-17 Bhavya Kailkhura , Aditya Vempaty , Pramod K. Varshney

Class-incremental learning of deep networks sequentially increases the number of classes to be classified. During training, the network has only access to data of one task at a time, where each task contains several classes. In this…

Computer Vision and Pattern Recognition · Computer Science 2020-04-02 Lu Yu , Bartłomiej Twardowski , Xialei Liu , Luis Herranz , Kai Wang , Yongmei Cheng , Shangling Jui , Joost van de Weijer

Unsupervised domain adaptation (UDA) aims to estimate a transferable model for unlabeled target domains by exploiting labeled source data. Optimal Transport (OT) based methods have recently been proven to be a promising solution for UDA…

Computer Vision and Pattern Recognition · Computer Science 2024-04-22 Yingxue Xu , Guihua Wen , Yang Hu , Pei Yang

State-of-the-art deep neural networks demonstrate outstanding performance in semantic segmentation. However, their performance is tied to the domain represented by the training data. Open world scenarios cause inaccurate predictions which…

Computer Vision and Pattern Recognition · Computer Science 2026-01-13 Kira Maag , Matthias Rottmann

In this study, we introduce a novel framework called Toast for learning general-purpose representations of road networks, along with its advanced counterpart DyToast, designed to enhance the integration of temporal dynamics to boost the…

Machine Learning · Computer Science 2024-03-19 Yile Chen , Xiucheng Li , Gao Cong , Zhifeng Bao , Cheng Long

Optimal path planning requires finding a series of feasible states from the starting point to the goal to optimize objectives. Popular path planning algorithms, such as Effort Informed Trees (EIT*), employ effort heuristics to guide the…

Fault intensity diagnosis (FID) plays a pivotal role in intelligent manufacturing while neglecting dependencies among target classes hinders its practical deployment. This paper introduces a novel and general framework with deep…

Audio and Speech Processing · Electrical Eng. & Systems 2026-04-21 Yu Sha , Shuiping Gou , Bo Liu , Haofan Lu , Ningtao Liu , Jiahui Fu , Horst Stoecker , Domagoj Vnucec , Nadine Wetzstein , Andreas Widl , Kai Zhou

Confusing classes that are ubiquitous in real world often degrade performance for many vision related applications like object detection, classification, and segmentation. The confusion errors are not only caused by similar visual patterns…

Computer Vision and Pattern Recognition · Computer Science 2018-08-02 Qichuan Geng , Xinyu Huang , Zhong Zhou , Ruigang Yang