English
Related papers

Related papers: Translation-Equivariant Self-Supervised Learning f…

200 papers

In machine learning, Optimal Transport (OT) theory is extensively utilized to compare probability distributions across various applications, such as graph data represented by node distributions and image data represented by pixel…

Machine Learning · Computer Science 2025-01-30 Jianming Huang , Xun Su , Zhongxi Fang , Hiroyuki Kasai

Imbalanced data pose challenges for deep learning based classification models. One of the most widely-used approaches for tackling imbalanced data is re-weighting, where training samples are associated with different weights in the loss…

Machine Learning · Computer Science 2022-08-08 Dandan Guo , Zhuo Li , Meixi Zheng , He Zhao , Mingyuan Zhou , Hongyuan Zha

We introduce an unsupervised domain adaption (UDA) strategy that combines multiple image translations, ensemble learning and self-supervised learning in one coherent approach. We focus on one of the standard tasks of UDA in which a semantic…

Computer Vision and Pattern Recognition · Computer Science 2021-07-14 Fabrizio J. Piva , Gijs Dubbelman

We study the problem of estimating, in the sense of optimal transport metrics, a measure which is assumed supported on a manifold embedded in a Hilbert space. By establishing a precise connection between optimal transport metrics, optimal…

Machine Learning · Computer Science 2012-09-06 Guillermo D. Canas , Lorenzo Rosasco

Semi-supervised learning provides an effective paradigm for leveraging unlabeled data to improve a model's performance. Among the many strategies proposed, graph-based methods have shown excellent properties, in particular since they allow…

Machine Learning · Statistics 2021-03-29 Mourad El Hamri , Younès Bennani

The problem of mobile position estimation in multipath scenarios is addressed. A low-complexity, fully-adaptive algorithm is proposed, based on the pseudo maximum likelihood approach. The processing is done exclusively on-board at the…

Signal Processing · Electrical Eng. & Systems 2019-02-12 Alessio Fascista , Angelo Coluccia , Giuseppe Ricci

We present a new approach for Neural Optimal Transport (NOT) training procedure, capable of accurately and efficiently estimating optimal transportation plan via specific regularization on dual Kantorovich potentials. The main bottleneck of…

Machine Learning · Computer Science 2024-10-21 Nazar Buzun , Maksim Bobrin , Dmitry V. Dylov

Multi-tasking optimization can usually achieve better performance than traditional single-tasking optimization through knowledge transfer between tasks. However, current multi-tasking optimization algorithms have some deficiencies. For high…

Neural and Evolutionary Computing · Computer Science 2021-08-03 Zhengping Liang , Weiqi Liang , Xiuju Xu , Ling Liu , Zexuan Zhu

Machine learning systems often experience a distribution shift between training and testing. In this paper, we introduce a simple variational objective whose optima are exactly the set of all representations on which risk minimizers are…

Machine Learning · Computer Science 2022-03-16 Yangjun Ruan , Yann Dubois , Chris J. Maddison

We propose an implicit neural formulation of optimal transport that eliminates adversarial min--max optimization and multi-network architectures commonly used in existing approaches. Our key idea is to parameterize a single potential in the…

Optimization and Control · Mathematics 2026-05-12 Yesom Park , Eric Gelphman , Stanley Osher , Samy Wu Fung

Reliable estimation of terrain traversability is critical for the successful deployment of autonomous systems in wild, outdoor environments. Given the lack of large-scale annotated datasets for off-road navigation, strictly-supervised…

Robotics · Computer Science 2024-03-19 Sanghun Jung , JoonHo Lee , Xiangyun Meng , Byron Boots , Alexander Lambert

At the core of self-supervised learning for vision is the idea of learning invariant or equivariant representations with respect to a set of data transformations. This approach, however, introduces strong inductive biases, which can render…

Machine Learning · Computer Science 2024-05-29 Sharut Gupta , Chenyu Wang , Yifei Wang , Tommi Jaakkola , Stefanie Jegelka

Unsupervised machine translation (MT) has recently achieved impressive results with monolingual corpora only. However, it is still challenging to associate source-target sentences in the latent space. As people speak different languages…

Computation and Language · Computer Science 2020-05-08 Po-Yao Huang , Junjie Hu , Xiaojun Chang , Alexander Hauptmann

Vision Transformers (ViTs) have demonstrated remarkable capabilities in learning representations, but their performance is compromised when applied to unseen domains. Previous methods either engage in prompt learning during the training…

Computer Vision and Pattern Recognition · Computer Science 2024-09-11 Yunbei Zhang , Akshay Mehra , Jihun Hamm

Optimal Transport, a theory for optimal allocation of resources, is widely used in various fields such as astrophysics, machine learning, and imaging science. However, many applications impose elementwise constraints on the transport plan…

Optimization and Control · Mathematics 2022-06-28 Zixuan Cang , Qing Nie , Yanxiang Zhao

This paper presents novel Bayesian optimisation algorithms for minimum error rate training of statistical machine translation systems. We explore two classes of algorithms for efficiently exploring the translation space, with the first…

Computation and Language · Computer Science 2014-12-24 Yishu Miao , Ziyu Wang , Phil Blunsom

Recently self supervised learning has seen explosive growth and use in variety of machine learning tasks because of its ability to avoid the cost of annotating large-scale datasets. This paper gives an overview for best self supervised…

Machine Learning · Computer Science 2022-10-21 Naman Goyal

Collaborative learning has recently achieved very significant results. It still suffers, however, from several issues, including the type of information that needs to be exchanged, the criteria for stopping and how to choose the right…

Machine Learning · Computer Science 2021-03-29 Fatima Ezzahraa Ben Bouazza , Younès Bennani

In this work, we develop an optimal transport (OT) based framework to select informative prototypical examples that best represent a given target dataset. Summarizing a given target dataset via representative examples is an important…

Machine Learning · Computer Science 2021-04-06 Karthik S. Gurumoorthy , Pratik Jawanpuria , Bamdev Mishra

We describe a method to jointly pre-train speech and text in an encoder-decoder modeling framework for speech translation and recognition. The proposed method incorporates four self-supervised and supervised subtasks for cross modality…

Computation and Language · Computer Science 2022-04-13 Yun Tang , Hongyu Gong , Ning Dong , Changhan Wang , Wei-Ning Hsu , Jiatao Gu , Alexei Baevski , Xian Li , Abdelrahman Mohamed , Michael Auli , Juan Pino