English
Related papers

Related papers: Canonicalizing Multimodal Contrastive Representati…

200 papers

In image morphing, a sequence of plausible frames are synthesized and composited together to form a smooth transformation between given instances. Intermediates must remain faithful to the input, stand on their own as members of the set,…

Graphics · Computer Science 2020-05-05 Noa Fish , Richard Zhang , Lilach Perry , Daniel Cohen-Or , Eli Shechtman , Connelly Barnes

Foundation models learn highly transferable representations through large-scale pretraining on diverse data. An increasing body of research indicates that these representations exhibit a remarkable degree of similarity across architectures…

Artificial Intelligence · Computer Science 2025-10-08 Jianglin Lu , Hailing Wang , Yi Xu , Yizhou Wang , Kuo Yang , Yun Fu

We propose a novel framework for ID-preserving generation using a multi-modal encoding strategy rather than injecting identity features via adapters into pre-trained models. Our method treats identity and text as a unified conditioning…

Computer Vision and Pattern Recognition · Computer Science 2025-05-23 Zichuan Liu , Liming Jiang , Qing Yan , Yumin Jia , Hao Kang , Xin Lu

Image feature matching is a fundamental part of many geometric computer vision applications, and using multiple images can improve performance. In this work, we formulate multi-image matching as a graph embedding problem then use a Graph…

Computer Vision and Pattern Recognition · Computer Science 2019-01-09 Stephen Phillips , Kostas Daniilidis

Few-shot learning (FSL) often requires effective adaptation of models using limited labeled data. However, most existing FSL methods rely on entangled representations, requiring the model to implicitly recover the unmixing process to obtain…

Computer Vision and Pattern Recognition · Computer Science 2025-08-06 Tianjiao Jiang , Zhen Zhang , Yuhang Liu , Javen Qinfeng Shi

Contrastive learning is a cornerstone underlying recent progress in multi-view and multimodal learning, e.g., in representation learning with image/caption pairs. While its effectiveness is not yet fully understood, a line of recent work…

Machine Learning · Computer Science 2023-03-17 Imant Daunhawer , Alice Bizeul , Emanuele Palumbo , Alexander Marx , Julia E. Vogt

Representing words by vectors, or embeddings, enables computational reasoning and is foundational to automating natural language tasks. For example, if word embeddings of similar words contain similar values, word similarity can be readily…

Computation and Language · Computer Science 2022-02-02 Carl Allen

Learning joint representations across multiple modalities remains a central challenge in multimodal machine learning. Prevailing approaches predominantly operate in pairwise settings, aligning two modalities at a time. While some recent…

Computer Vision and Pattern Recognition · Computer Science 2026-04-06 Stefanos Koutoupis , Michaela Areti Zervou , Konstantinos Kontras , Maarten De Vos , Panagiotis Tsakalides , Grigorios Tsagkatakis

Contrastive Language-Image Pre-Training (CLIP) is a popular method for learning multimodal latent spaces with well-organized semantics. Despite its wide range of applications, CLIP's latent space is known to fail at handling complex…

Machine Learning · Computer Science 2026-03-17 Raphi Kang , Yue Song , Georgia Gkioxari , Pietro Perona

Many innovative applications require establishing correspondences among 3D geometric objects. However, the countless possible deformations of smooth surfaces make shape matching a challenging task. Finding an embedding to represent the…

Computer Vision and Pattern Recognition · Computer Science 2022-06-09 Riccardo Marin , Souhaib Attaiki , Simone Melzi , Emanuele Rodolà , Maks Ovsjanikov

In rapidly evolving field of vision-language models (VLMs), contrastive language-image pre-training (CLIP) has made significant strides, becoming foundation for various downstream tasks. However, relying on one-to-one (image, text)…

Computer Vision and Pattern Recognition · Computer Science 2024-12-03 Haicheng Wang , Chen Ju , Weixiong Lin , Shuai Xiao , Mengting Chen , Yixuan Huang , Chang Liu , Mingshuai Yao , Jinsong Lan , Ying Chen , Qingwen Liu , Yanfeng Wang

Deformable shape representations, parameterized by deformations relative to a given template, have proven effective for improved image analysis tasks. However, their broader applicability is hindered by two major challenges. First, existing…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Tonmoy Hossain , Miaomiao Zhang

Recent contrastive multimodal vision-language models like CLIP have demonstrated robust open-world semantic understanding, becoming the standard image backbones for vision-language applications. However, recent findings suggest high…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Mayug Maniparambil , Raiymbek Akshulakov , Yasser Abdelaziz Dahou Djilali , Sanath Narayan , Ankit Singh , Noel E. O'Connor

Contrastive representation learning has been recently proved to be very efficient for self-supervised training. These methods have been successfully used to train encoders which perform comparably to supervised training on downstream…

Machine Learning · Computer Science 2020-12-03 Ibrahim Merad , Yiyang Yu , Emmanuel Bacry , Stéphane Gaïffas

Multimodal learning for generative models often refers to the learning of abstract concepts from the commonality of information in multiple modalities, such as vision and language. While it has proven effective for learning generalisable…

Machine Learning · Computer Science 2021-04-22 Yuge Shi , Brooks Paige , Philip H. S. Torr , N. Siddharth

Multimodal Attributed Graphs (MAGs) are ubiquitous in real-world applications, encompassing extensive knowledge through multimodal attributes attached to nodes (e.g., texts and images) and topological structure representing node…

Machine Learning · Computer Science 2025-02-28 Hao Yan , Chaozhuo Li , Jun Yin , Zhigang Yu , Weihao Han , Mingzheng Li , Zhengxin Zeng , Hao Sun , Senzhang Wang

Recent success in training deep neural networks have prompted active investigation into the features learned on their intermediate layers. Such research is difficult because it requires making sense of non-linear computations performed by…

Machine Learning · Computer Science 2016-03-01 Yixuan Li , Jason Yosinski , Jeff Clune , Hod Lipson , John Hopcroft

The heterogeneity-gap between different modalities brings a significant challenge to multimedia information retrieval. Some studies formalize the cross-modal retrieval tasks as a ranking problem and learn a shared multi-modal embedding…

Machine Learning · Computer Science 2017-07-11 Minnan Luo , Xiaojun Chang , Zhihui Li , Liqiang Nie , Alexander G. Hauptmann , Qinghua Zheng

Currently, the most dominant approach to establishing language-image alignment is to pre-train text and image encoders jointly through contrastive learning, such as CLIP and its variants. In this work, we question whether such a costly…

Computer Vision and Pattern Recognition · Computer Science 2025-06-05 Jingfeng Yang , Ziyang Wu , Yue Zhao , Yi Ma

Contrastive learning allows us to flexibly define powerful losses by contrasting positive pairs from sets of negative samples. Recently, the principle has also been used to learn cross-modal embeddings for video and text, yet without…

Computer Vision and Pattern Recognition · Computer Science 2021-10-01 Mohammadreza Zolfaghari , Yi Zhu , Peter Gehler , Thomas Brox