English
Related papers

Related papers: When Invariant Representation Learning Meets Label…

200 papers

The successes of modern deep machine learning methods are founded on their ability to transform inputs across multiple layers to build good high-level representations. It is therefore critical to understand this process of representation…

Machine Learning · Statistics 2023-05-26 Adam X. Yang , Maxime Robeyns , Edward Milsom , Ben Anson , Nandi Schoots , Laurence Aitchison

In the face of dataset shift, model calibration plays a pivotal role in ensuring the reliability of machine learning systems. Calibration error (CE) is an indicator of the alignment between the predicted probabilities and the classifier…

Machine Learning · Computer Science 2023-12-15 Teodora Popordanoska , Gorjan Radevski , Tinne Tuytelaars , Matthew B. Blaschko

Web image datasets curated online inherently contain ambiguous in-distribution (ID) instances and out-of-distribution (OOD) instances, which we collectively call non-conforming (NC) instances. In many recent approaches for mitigating the…

Computer Vision and Pattern Recognition · Computer Science 2023-07-20 Xia Huang , Kai Fong Ernest Chong

We study the open-set label shift problem, where the test data may include a novel class absent from training. This setting is challenging because both the class proportions and the distribution of the novel class are not identifiable…

Methodology · Statistics 2025-09-19 Siyan Liu , Yukun Liu , Qinglong Tian , Pengfei Li , Jing Qin

The basic underlying assumption of machine learning (ML) models is that the training and test data are sampled from the same distribution. However, in daily practice, this assumption is often broken, i.e. the distribution of the test data…

Computation and Language · Computer Science 2026-01-16 Adriana Valentina Costache , Silviu Florin Gheorghe , Eduard Gabriel Poesina , Paul Irofti , Radu Tudor Ionescu

Embedding based Knowledge Graph (KG) Completion has gained much attention over the past few years. Most of the current algorithms consider a KG as a multidirectional labeled graph and lack the ability to capture the semantics underlying the…

Artificial Intelligence · Computer Science 2024-07-12 Mehwish Alam , Frank van Harmelen , Maribel Acosta

This paper presents a novel method for embedding transfer, a task of transferring knowledge of a learned embedding model to another. Our method exploits pairwise similarities between samples in the source embedding space as the knowledge,…

Computer Vision and Pattern Recognition · Computer Science 2021-03-30 Sungyeon Kim , Dongwon Kim , Minsu Cho , Suha Kwak

With increasing applications of semantic segmentation, numerous datasets have been proposed in the past few years. Yet labeling remains expensive, thus, it is desirable to jointly train models across aggregations of datasets to enhance data…

Computer Vision and Pattern Recognition · Computer Science 2022-03-01 Dongwan Kim , Yi-Hsuan Tsai , Yumin Suh , Masoud Faraki , Sparsh Garg , Manmohan Chandraker , Bohyung Han

We introduce the problem of domain adaptation under Open Set Label Shift (OSLS) where the label distribution can change arbitrarily and a new class may arrive during deployment, but the class-conditional distributions p(x|y) are…

Machine Learning · Computer Science 2022-10-18 Saurabh Garg , Sivaraman Balakrishnan , Zachary C. Lipton

GNSS localization is an important part of today's autonomous systems, although it suffers from non-Gaussian errors caused by non-line-of-sight effects. Recent methods are able to mitigate these effects by including the corresponding…

Robotics · Computer Science 2020-03-20 Tim Pfeifer , Peter Protzel

Machine learning models that are developed with invariance to certain types of data transformations have demonstrated superior generalization performance in practice. However, the underlying mechanism that explains why invariance leads to…

Machine Learning · Computer Science 2023-02-24 Sicheng Zhu , Bang An , Furong Huang

In this work, we study the transfer learning problem under high-dimensional generalized linear models (GLMs), which aim to improve the fit on target data by borrowing information from useful source data. Given which sources to transfer, we…

Machine Learning · Statistics 2022-04-19 Ye Tian , Yang Feng

Despite the rising prevalence of neural language models, recent empirical evidence suggests their deficiency in compositional generalization. One of the current de-facto solutions to this problem is compositional data augmentation, which…

Computation and Language · Computer Science 2025-03-03 Zhaoyi Li , Gangwei Jiang , Chenwang Wu , Ying Wei , Defu Lian , Enhong Chen

In many practical applications of machine learning, a discrepancy often arises between a source distribution from which labeled training examples are drawn and a target distribution for which only unlabeled data is observed. Traditionally,…

Machine Learning · Statistics 2025-03-05 Paweł Teisseyre , Jan Mielniczuk

Entity alignment is to find identical entities in different knowledge graphs (KGs) that refer to the same real-world object. Embedding-based entity alignment techniques have been drawing a lot of attention recently because they can help…

Computation and Language · Computer Science 2022-11-08 Xiaobin Tian , Zequn Sun , Guangyao Li , Wei Hu

An important problem with machine learning is that when label number n>2, it is very difficult to construct and optimize a group of learning functions, and we wish that optimized learning functions are still useful when prior distribution…

Artificial Intelligence · Computer Science 2022-12-26 Chenguang Lu

The balanced loss is a widely adopted objective for multi-class classification under class imbalance. By assigning equal importance to all classes, regardless of their frequency, it promotes fairness and ensures that minority classes are…

Machine Learning · Computer Science 2026-01-01 Corinna Cortes , Mehryar Mohri , Yutao Zhong

Visual recognition tasks are often limited to dealing with a small subset of classes simply because the labels for the remaining classes are unavailable. We are interested in identifying novel concepts in a dataset through representation…

Computer Vision and Pattern Recognition · Computer Science 2023-03-17 Geeho Kim , Junoh Kang , Bohyung Han

A fundamental task for knowledge graphs (KGs) is knowledge graph completion (KGC). It aims to predict unseen edges by learning representations for all the entities and relations in a KG. A common concern when learning representations on…

Machine Learning · Computer Science 2023-02-13 Harry Shomer , Wei Jin , Wentao Wang , Jiliang Tang

Label distribution learning (LDL) is a novel paradigm that describe the samples by label distribution of a sample. However, acquiring LDL dataset is costly and time-consuming, which leads to the birth of incomplete label distribution…

Machine Learning · Computer Science 2025-11-18 Jiecheng Jiang , Jiawei Tang , Jiahao Jiang , Hui Liu , Junhui Hou , Yuheng Jia