English
Related papers

Related papers: Common Variable Learning and Invariant Representat…

200 papers

Domain gaps of sensor modalities pose a challenge for the design of autonomous robots. Taking a step towards closing this gap, we propose two unsupervised training frameworks for finding a common representation of LiDAR and camera data. The…

Computer Vision and Pattern Recognition · Computer Science 2020-01-06 Andreas Bühler , Niclas Vödisch , Mathias Bürki , Lukas Schaupp

A key obstacle in automated analytics and meta-learning is the inability to recognize when different datasets contain measurements of the same variable. Because provided attribute labels are often uninformative in practice, this task may be…

Machine Learning · Computer Science 2019-09-12 Jonas Mueller , Alex Smola

We present the Siamese Continuous Bag of Words (Siamese CBOW) model, a neural network for efficient estimation of high-quality sentence embeddings. Averaging the embeddings of words in a sentence has proven to be a surprisingly successful…

Computation and Language · Computer Science 2016-06-16 Tom Kenter , Alexey Borisov , Maarten de Rijke

Imitation learning enables robots to learn and replicate human behavior from training data. Recent advances in machine learning enable end-to-end learning approaches that directly process high-dimensional observation data, such as images.…

Robotics · Computer Science 2024-01-22 Koki Yamane , Sho Sakaino , Toshiaki Tsuji

In recent years, there has been a resurgence in methods that use distributed (neural) representations to represent and reason about semantic knowledge for robotics applications. However, while robots often observe previously unknown…

Robotics · Computer Science 2021-05-11 Angel Daruna , Mehul Gupta , Mohan Sridharan , Sonia Chernova

What representation do deep neural networks learn? How similar are images to each other for neural networks? Despite the overwhelming success of deep learning methods key questions about their internal workings still remain largely…

Computer Vision and Pattern Recognition · Computer Science 2024-10-31 Tassilo Wald , Constantin Ulrich , Gregor Köhler , David Zimmerer , Stefan Denner , Michael Baumgartner , Fabian Isensee , Priyank Jaini , Klaus H. Maier-Hein

Deep learning models for human activity recognition (HAR) based on sensor data have been heavily studied recently. However, the generalization ability of deep models on complex real-world HAR data is limited by the availability of…

Computer Vision and Pattern Recognition · Computer Science 2021-06-30 Chenglin Li , Carrie Lu Tong , Di Niu , Bei Jiang , Xiao Zuo , Lei Cheng , Jian Xiong , Jianming Yang

The training methods in AI do involve semantically distinct pairs of samples. However, their role typically is to enhance the between class separability. The actual notion of similarity is normally learned from semantically identical pairs.…

Computer Vision and Pattern Recognition · Computer Science 2025-05-30 Jiantao Wu , Sara Atito , Zhenhua Feng , Shentong Mo , Josef Kitler , Muhammad Awais

Recently self-supervised representation learning has drawn considerable attention from the scene text recognition community. Different from previous studies using contrastive learning, we tackle the issue from an alternative perspective,…

Computer Vision and Pattern Recognition · Computer Science 2022-03-23 Canjie Luo , Lianwen Jin , Jingdong Chen

Sense embedding learning methods learn multiple vectors for a given ambiguous word, corresponding to its different word senses. For this purpose, different methods have been proposed in prior work on sense embedding learning that use…

Computation and Language · Computer Science 2023-05-31 Haochen Luo , Yi Zhou , Danushka Bollegala

While there has been substantial progress in learning suitable distance metrics, these techniques in general lack transparency and decision reasoning, i.e., explaining why the input set of images is similar or dissimilar. In this work, we…

Computer Vision and Pattern Recognition · Computer Science 2022-05-05 Meng Zheng , Srikrishna Karanam , Terrence Chen , Richard J. Radke , Ziyan Wu

Neural language models learn word representations, or embeddings, that capture rich linguistic and conceptual information. Here we investigate the embeddings learned by neural machine translation models, a recently-developed class of neural…

Computation and Language · Computer Science 2015-04-06 Felix Hill , Kyunghyun Cho , Sebastien Jean , Coline Devin , Yoshua Bengio

This paper is a contribution in the context of variational data assimilation combined with statistical learning. The framework of data assimilation traditionally uses data collected at sensor locations in order to bring corrections to a…

Numerical Analysis · Mathematics 2023-05-09 Amina Benaceur , Barbara Verfürth

We present Relational Sentence Embedding (RSE), a new paradigm to further discover the potential of sentence embeddings. Prior work mainly models the similarity between sentences based on their embedding distance. Because of the complex…

Computation and Language · Computer Science 2023-06-09 Bin Wang , Haizhou Li

We present a novel technique for learning semantic representations, which extends the distributional hypothesis to multilingual data and joint-space embeddings. Our models leverage parallel data and learn to strongly align the embeddings of…

Computation and Language · Computer Science 2014-04-21 Karl Moritz Hermann , Phil Blunsom

Invariance (defined in a general sense) has been one of the most effective priors for representation learning. Direct factorization of parametric models is feasible only for a small range of invariances, while regularization approaches,…

Machine Learning · Computer Science 2020-07-28 Yingyi Ma , Vignesh Ganapathiraman , Yaoliang Yu , Xinhua Zhang

Differentiating multivariate dynamic signals is a difficult learning problem as the feature space may be large yet often only a few training examples are available. Traditional approaches to this problem either proceed from handcrafted…

Computer Vision and Pattern Recognition · Computer Science 2019-12-09 U. Mahmood , M. M. Rahman , A. Fedorov , Z. Fu , V. D. Calhoun , S. M. Plis

Recent studies have investigated siamese network architectures for learning invariant speech representations using same-different side information at the word level. Here we investigate systematically an often ignored component of siamese…

Computation and Language · Computer Science 2018-08-24 Rachid Riad , Corentin Dancette , Julien Karadayi , Neil Zeghidour , Thomas Schatz , Emmanuel Dupoux

Contrastive Self-supervised Learning (CSL) is a practical solution that learns meaningful visual representations from massive data in an unsupervised approach. The ordinary CSL embeds the features extracted from neural networks onto…

Computer Vision and Pattern Recognition · Computer Science 2022-08-19 Shentong Mo , Zhun Sun , Chao Li

This paper proposes a general interpretable predictive system with shared information. The system is able to perform predictions in a multi-task setting where distinct tasks are not bound to have the same input/output structure. Embeddings…

Machine Learning · Computer Science 2024-07-02 Maciej Żelaszczyk , Jacek Mańdziuk