English
Related papers

Related papers: Learning to Re-weight Examples with Optimal Transp…

200 papers

Learned reweighting (LRW) approaches to supervised learning use an optimization criterion to assign weights for training instances, in order to maximize performance on a representative validation dataset. We pose and formalize the problem…

Machine Learning · Computer Science 2024-04-01 Nishant Jain , Arun S. Suggala , Pradeep Shenoy

Deep multi-task networks are of particular interest for autonomous driving systems. They can potentially strike an excellent trade-off between predictive performance, hardware constraints and efficient use of information from multiple types…

Computer Vision and Pattern Recognition · Computer Science 2020-06-30 Isabelle Leang , Ganesh Sistu , Fabian Burger , Andrei Bursuc , Senthil Yogamani

The relevance of optimal transport methods to machine learning has long been hindered by two salient limitations. First, the $O(n^3)$ computational cost of standard sample-based solvers (when used on batches of $n$ samples) is prohibitive.…

Machine Learning · Computer Science 2023-06-01 Meyer Scetbon , Michal Klein , Giovanni Palla , Marco Cuturi

Object detection is a task that performs position identification and label classification of objects in images or videos. The information obtained through this process plays an essential role in various tasks in the field of computer…

Computer Vision and Pattern Recognition · Computer Science 2023-09-06 Heewon Lee , Sangtae Ahn

We propose a novel adaptive transfer learning framework, learning to transfer learn (L2TL), to improve performance on a target dataset by careful extraction of the related information from a source dataset. Our framework considers…

Machine Learning · Computer Science 2020-07-17 Linchao Zhu , Sercan O. Arik , Yi Yang , Tomas Pfister

Transfer learning has been demonstrated to be successful and essential in diverse applications, which transfers knowledge from related but different source domains to the target domain. Online transfer learning(OTL) is a more challenging…

Machine Learning · Computer Science 2020-02-12 Yuntao Du , Zhiwen Tan , Qian Chen , Yi Zhang , Chongjun Wang

In this paper, we focus on triplet-based deep binary embedding networks for image retrieval task. The triplet loss has been shown to be most effective for the ranking problem. However, most of the previous works treat the triplets equally…

Computer Vision and Pattern Recognition · Computer Science 2018-04-18 Jikai Chen , Hanjiang Lai , Libing Geng , Yan Pan

Event processing is the cornerstone of the dynamic and responsive Internet of Things (IoT). Recent approaches in this area are based on representational state transfer (REST) principles, which allow event processing tasks to be placed at…

Machine Learning · Computer Science 2021-12-08 A. Mazayev , F. Al-Tam , N. Correia

While tasks could come with varying the number of instances and classes in realistic settings, the existing meta-learning approaches for few-shot classification assume that the number of instances per task and class is fixed. Due to such…

Machine Learning · Computer Science 2022-02-15 Hae Beom Lee , Hayeon Lee , Donghyun Na , Saehoon Kim , Minseop Park , Eunho Yang , Sung Ju Hwang

It is often desired that ordinal regression models yield unimodal predictions. However, in many recent works this characteristic is either absent, or implemented using soft targets, which do not guarantee unimodal outputs at inference. In…

Machine Learning · Statistics 2021-11-19 Uri Shaham , Igal Zaidman , Jonathan Svirsky

For many real-world classification problems, e.g., sentiment classification, most existing machine learning methods are biased towards the majority class when the Imbalance Ratio (IR) is high. To address this problem, we propose a set…

Information Retrieval · Computer Science 2021-04-14 Yang Gao , Yi-Fan Li , Yu Lin , Charu Aggarwal , Latifur Khan

In this paper we introduce a new classification algorithm called Optimization of Distributions Differences (ODD). The algorithm aims to find a transformation from the feature space to a new space where the instances in the same class are as…

Machine Learning · Computer Science 2017-03-06 Mohammad Reza Bonyadi , Quang M. Tieng , David C. Reutens

In most applications of utilizing neural networks for mathematical optimization, a dedicated model is trained for each specific optimization objective. However, in many scenarios, several distinct yet correlated objectives or tasks often…

Machine Learning · Computer Science 2024-04-15 Wei Cui , Wei Yu

Unsupervised domain transfer is the task of transferring or translating samples from a source distribution to a different target distribution. Current solutions unsupervised domain transfer often operate on data on which the modes of the…

Machine Learning · Computer Science 2019-05-31 Mikołaj Bińkowski , R Devon Hjelm , Aaron Courville

In the real open world, data tends to follow long-tailed class distributions, motivating the well-studied long-tailed recognition (LTR) problem. Naive training produces models that are biased toward common classes in terms of higher…

Computer Vision and Pattern Recognition · Computer Science 2022-03-29 Shaden Alshammari , Yu-Xiong Wang , Deva Ramanan , Shu Kong

Although binary classification is a well-studied problem in computer vision, training reliable classifiers under severe class imbalance remains a challenging problem. Recent work has proposed techniques that mitigate the effects of training…

Machine Learning · Computer Science 2024-06-06 Kelsey Lieberman , Shuai Yuan , Swarna Kamlam Ravindran , Carlo Tomasi

Despite the success of deep learning-based algorithms, it is widely known that neural networks may fail to be robust. A popular paradigm to enforce robustness is adversarial training (AT), however, this introduces many computational and…

Machine Learning · Computer Science 2024-01-18 Nicolas Garcia Trillos , Matt Jacobs , Jakwang Kim , Matthew Werenski

Pretraining large language models (LLMs) on vast and heterogeneous datasets is crucial for achieving state-of-the-art performance across diverse downstream tasks. However, current training paradigms treat all samples equally, overlooking…

Machine Learning · Computer Science 2025-02-11 Daouda Sow , Herbert Woisetschläger , Saikiran Bulusu , Shiqiang Wang , Hans-Arno Jacobsen , Yingbin Liang

Optimal Transport (OT) naturally arises in many machine learning applications, yet the heavy computational burden limits its wide-spread uses. To address the scalability issue, we propose an implicit generative learning-based framework…

Machine Learning · Computer Science 2019-06-26 Yujia Xie , Minshuo Chen , Haoming Jiang , Tuo Zhao , Hongyuan Zha

Optimal transport is a powerful framework for the efficient allocation of resources between sources and targets. However, traditional models often struggle to scale effectively in the presence of large and heterogeneous populations. In this…

Artificial Intelligence · Computer Science 2024-11-13 Navpreet Kaur , Juntao Chen , Yingdong Lu