English
Related papers

Related papers: Language Quantized AutoEncoders: Towards Unsupervi…

200 papers

Generative Adversarial Networks (GANs) play an increasingly important role in machine learning. However, there is one fundamental issue hindering their practical applications: the absence of capability for encoding real-world samples. The…

Machine Learning · Computer Science 2022-03-02 Jiapeng Zhu , Deli Zhao , Bo Zhang , Bolei Zhou

Large Vision-Language Models (LVLMs) have demonstrated remarkable multimodal capabilities, but they inherit the tendency to hallucinate from their underlying language models. While visual contrastive decoding has been proposed to mitigate…

Computer Vision and Pattern Recognition · Computer Science 2026-03-04 Eun Woo Im , Muhammad Kashif Ali , Vivek Gupta

Human infant learning happens during exploration of the environment, by interaction with objects, and by listening to and repeating utterances casually, which is analogous to unsupervised learning. Only occasionally, a learning infant would…

Computation and Language · Computer Science 2023-02-23 Ozan Özdemir , Matthias Kerzel , Cornelius Weber , Jae Hee Lee , Muhammad Burhan Hafez , Patrick Bruns , Stefan Wermter

Large language models excel at a wide range of complex tasks. However, enabling general inference in the real world, e.g., for robotics problems, raises the challenge of grounding. We propose embodied language models to directly incorporate…

Dense passage retrieval aims to retrieve the relevant passages of a query from a large corpus based on dense representations (i.e., vectors) of the query and the passages. Recent studies have explored improving pre-trained language models…

Computation and Language · Computer Science 2022-12-05 Xing Wu , Guangyuan Ma , Meng Lin , Zijia Lin , Zhongyuan Wang , Songlin Hu

Pre-trained language models have recently contributed to significant advances in NLP tasks. Recently, multi-modal versions of BERT have been developed, using heavy pre-training relying on vast corpora of aligned textual and image data,…

Computation and Language · Computer Science 2020-12-17 Thomas Scialom , Patrick Bordes , Paul-Alexis Dray , Jacopo Staiano , Patrick Gallinari

With the metaverse slowly becoming a reality and given the rapid pace of developments toward the creation of digital humans, the need for a principled style editing pipeline for human faces is bound to increase manifold. We cater to this…

Computer Vision and Pattern Recognition · Computer Science 2023-12-27 Snehal Singh Tomar , A. N. Rajagopalan

This paper introduces a novel explainable image quality evaluation approach called X-IQE, which leverages visual large language models (LLMs) to evaluate text-to-image generation methods by generating textual explanations. X-IQE utilizes a…

Computer Vision and Pattern Recognition · Computer Science 2023-05-29 Yixiong Chen , Li Liu , Chris Ding

Large multimodal language models have demonstrated impressive capabilities in understanding and manipulating images. However, many of these models struggle with comprehending intensive textual contents embedded within the images, primarily…

Computer Vision and Pattern Recognition · Computer Science 2024-07-30 Ruiyi Zhang , Yufan Zhou , Jian Chen , Jiuxiang Gu , Changyou Chen , Tong Sun

Autoencoder networks are unsupervised approaches aiming at combining generative and representational properties by learning simultaneously an encoder-generator map. Although studied extensively, the issues of whether they have the same…

Machine Learning · Computer Science 2020-04-10 Stanislav Pidhorskyi , Donald Adjeroh , Gianfranco Doretto

Recently, various studies have been directed towards exploring dense passage retrieval techniques employing pre-trained language models, among which the masked auto-encoder (MAE) pre-training architecture has emerged as the most promising.…

Information Retrieval · Computer Science 2023-05-23 Zehan Li , Yanzhao Zhang , Dingkun Long , Pengjun Xie

Reconstructing natural language from non-invasive electroencephalography (EEG) holds great promise as a language decoding technology for brain-computer interfaces (BCIs). However, EEG-based language decoding is still in its nascent stages,…

Computation and Language · Computer Science 2024-09-27 Jiaqi Wang , Zhenxi Song , Zhengyu Ma , Xipeng Qiu , Min Zhang , Zhiguo Zhang

Recent advances in large vision-language models (VLMs) have shown remarkable progress in solving the text-promptable object counting problem. Representative methods typically specify text prompts with object category information in images.…

Computer Vision and Pattern Recognition · Computer Science 2025-07-10 Miaojing Shi , Xiaowen Zhang , Zijie Yue , Yong Luo , Cairong Zhao , Li Li

Modern text classification methods heavily rely on contextual embeddings from large language models (LLMs). Compared to human-engineered features, these embeddings provide automatic and effective representations for classification model…

Computation and Language · Computer Science 2025-07-29 Xuansheng Wu , Wenhao Yu , Xiaoming Zhai , Ninghao Liu

Variational autoencoders (VAEs) are widely used deep generative models capable of learning unsupervised latent representations of data. Such representations are often difficult to interpret or control. We consider the problem of…

Machine Learning · Computer Science 2018-12-18 Jack Klys , Jake Snell , Richard Zemel

Growing techniques have been emerging to improve the performance of passage retrieval. As an effective representation bottleneck pretraining technique, the contextual masked auto-encoder utilizes contextual embedding to assist in the…

Computation and Language · Computer Science 2023-04-07 Xing Wu , Guangyuan Ma , Peng Wang , Meng Lin , Zijia Lin , Fuzheng Zhang , Songlin Hu

Learning disentangled representations of real-world data is a challenging open problem. Most previous methods have focused on either supervised approaches which use attribute labels or unsupervised approaches that manipulate the…

Computation and Language · Computer Science 2021-01-26 Vikash Balasubramanian , Ivan Kobyzev , Hareesh Bahuleyan , Ilya Shapiro , Olga Vechtomova

Scientific visual question answering poses significant challenges for vision-language models due to the complexity of scientific figures and their multimodal context. Traditional approaches treat the figure and accompanying text (e.g.,…

Computer Vision and Pattern Recognition · Computer Science 2025-09-25 Belal Shoer , Yova Kementchedjhieva

Learning embeddings that are invariant to the pose of the object is crucial in visual image retrieval and re-identification. The existing approaches for person, vehicle, or animal re-identification tasks suffer from high intra-class…

Computer Vision and Pattern Recognition · Computer Science 2020-08-27 Olga Moskvyak , Frederic Maire , Feras Dayoub , Mahsa Baktashmotlagh

Vision-language tasks, such as VQA, SNLI-VE, and VCR are challenging because they require the model's reasoning ability to understand the semantics of the visual world and natural language. Supervised methods working for vision-language…

Computer Vision and Pattern Recognition · Computer Science 2025-04-01 Zhecan Wang , Rui Sun , Haoxuan You , Noel Codella , Kai-Wei Chang , Shih-Fu Chang