中文
相关论文

相关论文: Translation-Equivariant Self-Supervised Learning f…

200 篇论文

In machine learning, Optimal Transport (OT) theory is extensively utilized to compare probability distributions across various applications, such as graph data represented by node distributions and image data represented by pixel…

机器学习 · 计算机科学 2025-01-30 Jianming Huang , Xun Su , Zhongxi Fang , Hiroyuki Kasai

Imbalanced data pose challenges for deep learning based classification models. One of the most widely-used approaches for tackling imbalanced data is re-weighting, where training samples are associated with different weights in the loss…

机器学习 · 计算机科学 2022-08-08 Dandan Guo , Zhuo Li , Meixi Zheng , He Zhao , Mingyuan Zhou , Hongyuan Zha

We introduce an unsupervised domain adaption (UDA) strategy that combines multiple image translations, ensemble learning and self-supervised learning in one coherent approach. We focus on one of the standard tasks of UDA in which a semantic…

计算机视觉与模式识别 · 计算机科学 2021-07-14 Fabrizio J. Piva , Gijs Dubbelman

We study the problem of estimating, in the sense of optimal transport metrics, a measure which is assumed supported on a manifold embedded in a Hilbert space. By establishing a precise connection between optimal transport metrics, optimal…

机器学习 · 计算机科学 2012-09-06 Guillermo D. Canas , Lorenzo Rosasco

Semi-supervised learning provides an effective paradigm for leveraging unlabeled data to improve a model's performance. Among the many strategies proposed, graph-based methods have shown excellent properties, in particular since they allow…

机器学习 · 统计学 2021-03-29 Mourad El Hamri , Younès Bennani

The problem of mobile position estimation in multipath scenarios is addressed. A low-complexity, fully-adaptive algorithm is proposed, based on the pseudo maximum likelihood approach. The processing is done exclusively on-board at the…

信号处理 · 电气工程与系统科学 2019-02-12 Alessio Fascista , Angelo Coluccia , Giuseppe Ricci

We present a new approach for Neural Optimal Transport (NOT) training procedure, capable of accurately and efficiently estimating optimal transportation plan via specific regularization on dual Kantorovich potentials. The main bottleneck of…

机器学习 · 计算机科学 2024-10-21 Nazar Buzun , Maksim Bobrin , Dmitry V. Dylov

Multi-tasking optimization can usually achieve better performance than traditional single-tasking optimization through knowledge transfer between tasks. However, current multi-tasking optimization algorithms have some deficiencies. For high…

神经与进化计算 · 计算机科学 2021-08-03 Zhengping Liang , Weiqi Liang , Xiuju Xu , Ling Liu , Zexuan Zhu

Machine learning systems often experience a distribution shift between training and testing. In this paper, we introduce a simple variational objective whose optima are exactly the set of all representations on which risk minimizers are…

机器学习 · 计算机科学 2022-03-16 Yangjun Ruan , Yann Dubois , Chris J. Maddison

We propose an implicit neural formulation of optimal transport that eliminates adversarial min--max optimization and multi-network architectures commonly used in existing approaches. Our key idea is to parameterize a single potential in the…

最优化与控制 · 数学 2026-05-12 Yesom Park , Eric Gelphman , Stanley Osher , Samy Wu Fung

Reliable estimation of terrain traversability is critical for the successful deployment of autonomous systems in wild, outdoor environments. Given the lack of large-scale annotated datasets for off-road navigation, strictly-supervised…

机器人学 · 计算机科学 2024-03-19 Sanghun Jung , JoonHo Lee , Xiangyun Meng , Byron Boots , Alexander Lambert

At the core of self-supervised learning for vision is the idea of learning invariant or equivariant representations with respect to a set of data transformations. This approach, however, introduces strong inductive biases, which can render…

机器学习 · 计算机科学 2024-05-29 Sharut Gupta , Chenyu Wang , Yifei Wang , Tommi Jaakkola , Stefanie Jegelka

Unsupervised machine translation (MT) has recently achieved impressive results with monolingual corpora only. However, it is still challenging to associate source-target sentences in the latent space. As people speak different languages…

计算与语言 · 计算机科学 2020-05-08 Po-Yao Huang , Junjie Hu , Xiaojun Chang , Alexander Hauptmann

Vision Transformers (ViTs) have demonstrated remarkable capabilities in learning representations, but their performance is compromised when applied to unseen domains. Previous methods either engage in prompt learning during the training…

计算机视觉与模式识别 · 计算机科学 2024-09-11 Yunbei Zhang , Akshay Mehra , Jihun Hamm

Optimal Transport, a theory for optimal allocation of resources, is widely used in various fields such as astrophysics, machine learning, and imaging science. However, many applications impose elementwise constraints on the transport plan…

最优化与控制 · 数学 2022-06-28 Zixuan Cang , Qing Nie , Yanxiang Zhao

This paper presents novel Bayesian optimisation algorithms for minimum error rate training of statistical machine translation systems. We explore two classes of algorithms for efficiently exploring the translation space, with the first…

计算与语言 · 计算机科学 2014-12-24 Yishu Miao , Ziyu Wang , Phil Blunsom

Recently self supervised learning has seen explosive growth and use in variety of machine learning tasks because of its ability to avoid the cost of annotating large-scale datasets. This paper gives an overview for best self supervised…

机器学习 · 计算机科学 2022-10-21 Naman Goyal

Collaborative learning has recently achieved very significant results. It still suffers, however, from several issues, including the type of information that needs to be exchanged, the criteria for stopping and how to choose the right…

机器学习 · 计算机科学 2021-03-29 Fatima Ezzahraa Ben Bouazza , Younès Bennani

In this work, we develop an optimal transport (OT) based framework to select informative prototypical examples that best represent a given target dataset. Summarizing a given target dataset via representative examples is an important…

机器学习 · 计算机科学 2021-04-06 Karthik S. Gurumoorthy , Pratik Jawanpuria , Bamdev Mishra

We describe a method to jointly pre-train speech and text in an encoder-decoder modeling framework for speech translation and recognition. The proposed method incorporates four self-supervised and supervised subtasks for cross modality…