English
Related papers

Related papers: A multi-view contrastive learning framework for sp…

200 papers

In recent years, self-supervised learning has played a pivotal role in advancing machine learning by allowing models to acquire meaningful representations from unlabeled data. An intriguing research avenue involves developing…

Machine Learning · Computer Science 2023-10-30 Denis Janiak , Jakub Binkowski , Piotr Bielak , Tomasz Kajdanowicz

In forecasting multiple time series, accounting for the individual features of each sequence can be challenging. To address this, modern deep learning methods for time series analysis combine a shared (global) model with local layers,…

Machine Learning · Computer Science 2025-02-14 Luca Butera , Giovanni De Felice , Andrea Cini , Cesare Alippi

This paper introduces the visually informed embedding of word (VIEW), a continuous vector representation for a word extracted from a deep neural model trained using the Microsoft COCO data set to forecast the spatial arrangements between…

Computation and Language · Computer Science 2016-03-29 Oswaldo Ludwig , Xiao Liu , Parisa Kordjamshidi , Marie-Francine Moens

Pre-training has become a standard paradigm in many computer vision tasks. However, most of the methods are generally designed on the RGB image domain. Due to the discrepancy between the two-dimensional image plane and the three-dimensional…

Computer Vision and Pattern Recognition · Computer Science 2022-01-19 Zhenyu Li , Zehui Chen , Ang Li , Liangji Fang , Qinhong Jiang , Xianming Liu , Junjun Jiang , Bolei Zhou , Hang Zhao

Mapping and localization, preferably from a small number of observations, are fundamental tasks in robotics. We address these tasks by combining spatial structure (differentiable mapping) and end-to-end learning in a novel neural network…

Computer Vision and Pattern Recognition · Computer Science 2020-05-20 Peter Karkus , Anelia Angelova , Vincent Vanhoucke , Rico Jonschkowski

Many contrastive learning based models have achieved advanced performance in image-text matching tasks. The key of these models lies in analyzing the correlation between image-text pairs, which involves cross-modal interaction of embeddings…

Computer Vision and Pattern Recognition · Computer Science 2024-10-23 Xiang Ma , Xuemei Li , Lexin Fang , Caiming Zhang

Image-text representation learning forms a cornerstone in vision-language models, where pairs of images and textual descriptions are contrastively aligned in a shared embedding space. Since visual and textual concepts are naturally…

Computer Vision and Pattern Recognition · Computer Science 2025-03-04 Avik Pal , Max van Spengler , Guido Maria D'Amely di Melendugno , Alessandro Flaborea , Fabio Galasso , Pascal Mettes

Predicting commuting flows based on infrastructure and land-use information is critical for urban planning and public policy development. However, it is a challenging task given the complex patterns of commuting flows. Conventional models,…

Physics and Society · Physics 2020-08-25 Zhicheng Liu , Fabio Miranda , Weiting Xiong , Junyan Yang , Qiao Wang , Claudio T. Silva

Spatial autocorrelation and spatial heterogeneity widely exist in spatial data, which make the traditional machine learning model perform badly. Spatial domain generalization is a spatial extension of domain generalization, which can…

Machine Learning · Computer Science 2022-12-29 Dazhou Yu , Guangji Bai , Yun Li , Liang Zhao

Latent representations learned by neural networks often exhibit semantic structure, where concept similarity is reflected by geometric proximity in embedding space. However, comparing such spaces across models remains difficult: changes in…

With the emergence of deep learning, metric learning has gained significant popularity in numerous machine learning tasks dealing with complex and large-scale datasets, such as information retrieval, object recognition and recommendation…

Computer Vision and Pattern Recognition · Computer Science 2022-11-29 Imam Mustafa Kamal , Hyerim Bae , Ling Liu

Multimodal sentence embedding models typically leverage image-caption pairs in addition to textual data during training. However, such pairs often contain noise, including redundant or irrelevant information on either the image or caption…

Computation and Language · Computer Science 2025-08-04 Kaiyan Zhao , Zhongtao Miao , Yoshimasa Tsuruoka

Embedding models, which learn latent representations of users and items based on user-item interaction patterns, are a key component of recommendation systems. In many applications, contextual constraints need to be applied to refine…

Information Retrieval · Computer Science 2019-07-04 Syrine Krichene , Mike Gartrell , Clement Calauzenes

Large-scale multi-relational embedding refers to the task of learning the latent representations for entities and relations in large knowledge graphs. An effective and scalable solution for this problem is crucial for the true success of…

Machine Learning · Computer Science 2017-07-07 Hanxiao Liu , Yuexin Wu , Yiming Yang

We present a contrasting learning approach with data augmentation techniques to learn document representations in an unsupervised manner. Inspired by recent contrastive self-supervised learning algorithms used for image and NLP pretraining,…

Computation and Language · Computer Science 2021-03-29 Dongsheng Luo , Wei Cheng , Jingchao Ni , Wenchao Yu , Xuchao Zhang , Bo Zong , Yanchi Liu , Zhengzhang Chen , Dongjin Song , Haifeng Chen , Xiang Zhang

Current few-shot learning models capture visual object relations in the so-called meta-learning setting under a fixed-resolution input. However, such models have a limited generalization ability under the scale and location mismatch between…

Computer Vision and Pattern Recognition · Computer Science 2022-10-11 Hongguang Zhang , Philip H. S. Torr , Piotr Koniusz

Majority of the current dimensionality reduction or retrieval techniques rely on embedding the learned feature representations onto a computable metric space. Once the learned features are mapped, a distance metric aids the bridging of gaps…

Computer Vision and Pattern Recognition · Computer Science 2018-10-17 Muhammad Kamran Janjua , Shah Nawaz , Alessandro Calefati , Ignazio Gallo

With the development of feature extraction technique, one sample always can be represented by multiple features which locate in high-dimensional space. Multiple features can re ect various perspectives of one same sample, so there must be…

Computer Vision and Pattern Recognition · Computer Science 2018-07-30 Huibing Wang , Lin Feng , Adong Kong , Bo Jin

Estimating correspondences between pairs of non-rigid deformable 3D shapes remains a significant challenge in computer vision and graphics. While deep functional map methods have become the go-to solution for addressing this problem, they…

Computer Vision and Pattern Recognition · Computer Science 2026-03-20 Feifan Luo , Hongyang Chen

Data from many real-world applications can be naturally represented by multi-view networks where the different views encode different types of relationships (e.g., friendship, shared interests in music, etc.) between real-world individuals…

Social and Information Networks · Computer Science 2019-09-04 Yiwei Sun , Suhang Wang , Tsung-Yu Hsieh , Xianfeng Tang , Vasant Honavar