English
Related papers

Related papers: Beyond One-hot Encoding: lower dimensional target …

200 papers

We propose associative domain adaptation, a novel technique for end-to-end domain adaptation with neural networks, the task of inferring class labels for an unlabeled target domain based on the statistical properties of a labeled source…

Computer Vision and Pattern Recognition · Computer Science 2017-08-04 Philip Haeusser , Thomas Frerix , Alexander Mordvintsev , Daniel Cremers

Examining the effect of different encoding techniques on entity and context embeddings, the goal of this work is to challenge commonly used Ordinal encoding for tabular learning. Applying different preprocessing methods and network…

Machine Learning · Computer Science 2024-03-29 Fredy Reusser

Text classification is one of the most important and fundamental tasks in natural language processing. Performance of this task mainly dependents on text representation learning. Currently, most existing learning frameworks mainly focus on…

Computation and Language · Computer Science 2020-02-26 Xien Liu , Song Wang , Xiao Zhang , Xinxin You , Ji Wu , Dejing Dou

In the transductive setting, where the full graph is observed but node labels are only partially available, progress in semi-supervised node classification has largely focused on architectural innovation. In this paper, we revisit an…

Machine Learning · Computer Science 2026-05-21 Brown Zaz , Mar Gonzàlez I Català , Ferran Hernandez Caralt , Moshe Eliasof , Pietro Liò

This paper proposes an algorithm that implements binary encoding of the categorical features of neural network model input data, while also implementing changes in the forward and backpropagation procedures in order to achieve the property…

Machine Learning · Computer Science 2023-11-13 Lazar Zlatić

We present a compositional embedding framework that infers not just a single class per input image, but a set of classes, in the setting of one-shot learning. Specifically, we propose and evaluate several novel models consisting of (1) an…

Machine Learning · Computer Science 2020-11-16 Zeqian Li , Michael C. Mozer , Jacob Whitehill

Despite the success on few-shot learning problems, most meta-learned models only focus on achieving good performance on clean examples and thus easily break down when given adversarially perturbed samples. While some recent works have shown…

Machine Learning · Computer Science 2023-10-27 Minseon Kim , Hyeonjeong Ha , Dong Bok Lee , Sung Ju Hwang

Few-shot learning addresses the issue of classifying images using limited labeled data. Exploiting unlabeled data through the use of transductive inference methods such as label propagation has been shown to improve the performance of…

Computer Vision and Pattern Recognition · Computer Science 2023-11-01 Michalis Lazarou , Yannis Avrithis , Guangyu Ren , Tania Stathaki

Heterogeneous Information Network (HIN) embedding refers to the low-dimensional projections of the HIN nodes that preserve the HIN structure and semantics. HIN embedding has emerged as a promising research field for network analysis as it…

Machine Learning · Computer Science 2021-08-10 Rayyan Ahmad Khan , Martin Kleinsteuber

Despite the breakthroughs achieved by deep learning models in conventional supervised learning scenarios, their dependence on sufficient labeled training data in each class prevents effective applications of these deep models in situations…

Machine Learning · Computer Science 2018-04-20 Meng Ye , Yuhong Guo

Multi-label learning handles instances associated with multiple class labels. The original label space is a logical matrix with entries from the Boolean domain $\in \left \{ 0,1 \right \}$. Logical labels are not able to show the relative…

Machine Learning · Computer Science 2021-03-01 Ali Braytee , Wei Liu

Weakly-supervised anomaly detection aims at learning an anomaly detector from a limited amount of labeled data and abundant unlabeled data. Recent works build deep neural networks for anomaly detection by discriminatively mapping the normal…

Machine Learning · Computer Science 2021-08-29 Yingjie Zhou , Xucheng Song , Yanru Zhang , Fanxing Liu , Ce Zhu , Lingqiao Liu

In point cloud geometry compression, context models usually use the one-hot encoding of node occupancy as the label, and the cross-entropy between the one-hot encoding and the probability distribution predicted by the context model as the…

Image and Video Processing · Electrical Eng. & Systems 2024-07-12 Chang Sun , Hui Yuan , Shuai Li , Xin Lu , Raouf Hamzaoui

Autonomous agents interacting with the real world need to learn new concepts efficiently and reliably. This requires learning in a low-data regime, which is a highly challenging problem. We address this task by introducing a fast…

Computer Vision and Pattern Recognition · Computer Science 2022-03-22 Ardhendu Shekhar Tripathi , Martin Danelljan , Luc Van Gool , Radu Timofte

There is growing evidence that converting targets to soft targets in supervised learning can provide considerable gains in performance. Much of this work has considered classification, converting hard zero-one values to soft labels---such…

Machine Learning · Statistics 2018-06-13 Ehsan Imani , Martha White

This work explores the intrinsic limitations of the popular one-hot encoding method in classification of intents when detection of out-of-scope (OOS) inputs is required. Although recent work has shown that there can be significant…

Machine Learning · Computer Science 2022-05-19 Claudio Pinhanez , Paulo Cavalin

From CNNs to attention mechanisms, encoding inductive biases into neural networks has been a fruitful source of improvement in machine learning. Adding auxiliary losses to the main objective function is a general way of encoding biases that…

Machine Learning · Computer Science 2021-09-07 Ferran Alet , Maria Bauza , Kenji Kawaguchi , Nurullah Giray Kuru , Tomas Lozano-Perez , Leslie Pack Kaelbling

Knowledge Tracing (KT) aims to predict a student's future performance based on their sequence of interactions with learning content. Many KT models rely on knowledge concepts (KCs), which represent the skills required for each item.…

Computers and Society · Computer Science 2025-08-26 Yahya Badran , Christine Preisach

We map categorical variables in a function approximation problem into Euclidean spaces, which are the entity embeddings of the categorical variables. The mapping is learned by a neural network during the standard supervised training…

Machine Learning · Computer Science 2016-04-25 Cheng Guo , Felix Berkhahn

Semantic segmentation, which aims to acquire a detailed understanding of images, is an essential issue in computer vision. However, in practical scenarios, new categories that are different from the categories in training usually appear.…

Computer Vision and Pattern Recognition · Computer Science 2020-07-02 Haiyang Liu , Yichen Wang , Jiayi Zhao , Guowu Yang , Fengmao Lv