English
Related papers

Related papers: Hierarchical Textual Knowledge for Enhanced Image …

200 papers

Discovering the semantics of multimodal utterances is essential for understanding human language and enhancing human-machine interactions. Existing methods manifest limitations in leveraging nonverbal information for discerning complex…

Multimedia · Computer Science 2024-05-22 Hanlei Zhang , Hua Xu , Fei Long , Xin Wang , Kai Gao

A popular approach to semantic image understanding is to manually tag images with keywords and then learn a mapping from vi- sual features to keywords. Manually tagging images is a subjective pro- cess and the same or very similar visual…

Computer Vision and Pattern Recognition · Computer Science 2016-09-08 Ke Sun , Xianxu Hou , Qian Zhang , Guoping Qiu

Recommendation systems are widely used in e-commerce websites and online platforms to address information overload. However, existing systems primarily rely on historical data and user feedback, making it difficult to capture user intent…

Information Retrieval · Computer Science 2024-02-22 Qian Zhao , Hao Qian , Ziqi Liu , Gong-Duo Zhang , Lihong Gu

We consider a novel clustering task in which clusters can have compositional relationships, e.g., one cluster contains images of rectangles, one contains images of circles, and a third (compositional) cluster contains images with both…

Machine Learning · Computer Science 2023-08-04 Zeqian Li , Xinlu He , Jacob Whitehill

Traditional image clustering methods take a two-step approach, feature learning and clustering, sequentially. However, recent research results demonstrated that combining the separated phases in a unified framework and training them jointly…

Computer Vision and Pattern Recognition · Computer Science 2017-03-24 Fengfu Li , Hong Qiao , Bo Zhang , Xuanyang Xi

Contrastive Language-Image Pre-training (CLIP) has recently shown great promise in pixel-level zero-shot learning tasks. However, existing approaches utilizing CLIP's text and patch embeddings to generate semantic masks often misidentify…

Computer Vision and Pattern Recognition · Computer Science 2024-09-04 Jingyao Li , Pengguang Chen , Shengju Qian , Shu Liu , Jiaya Jia

Cross-lingual Text Classification (CLC) consists of automatically classifying, according to a common set C of classes, documents each written in one of a set of languages L, and doing so more accurately than when naively classifying each…

Machine Learning · Computer Science 2021-09-22 Andrea Esuli , Alejandro Moreo , Fabrizio Sebastiani

We tackle open-world semantic segmentation, which aims at learning to segment arbitrary visual concepts in images, by using only image-text pairs without dense annotations. Existing open-world segmentation methods have shown impressive…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Junbum Cha , Jonghwan Mun , Byungseok Roh

Several recent publications have proposed methods for mapping images into continuous semantic embedding spaces. In some cases the embedding space is trained jointly with the image transformation. In other cases the semantic embedding space…

Machine Learning · Computer Science 2017-02-28 Mohammad Norouzi , Tomas Mikolov , Samy Bengio , Yoram Singer , Jonathon Shlens , Andrea Frome , Greg S. Corrado , Jeffrey Dean

In data containing heterogeneous subpopulations, classification performance benefits from incorporating the knowledge of cluster structure in the classifier. Previous methods for such combined clustering and classification either 1) are…

Machine Learning · Computer Science 2023-01-04 Shivin Srivastava , Siddharth Bhatia , Lingxiao Huang , Lim Jun Heng , Kenji Kawaguchi , Vaibhav Rajan

State-of-the-art approaches for image captioning require supervised training data consisting of captions with paired image data. These methods are typically unable to use unsupervised data such as textual data with no corresponding images,…

Computer Vision and Pattern Recognition · Computer Science 2017-06-27 Wenhu Chen , Aurelien Lucchi , Thomas Hofmann

In this paper, we present a semi-supervised learning algorithm for classification of text documents. A method of labeling unlabeled text documents is presented. The presented method is based on the principle of divide and conquer strategy.…

Machine Learning · Computer Science 2017-06-27 Harsha S. Gowda , Mahamad Suhil , D. S. Guru , Lavanya Narayana Raju

This paper presents a Kernel Entity Salience Model (KESM) that improves text understanding and retrieval by better estimating entity salience (importance) in documents. KESM represents entities by knowledge enriched distributed…

Information Retrieval · Computer Science 2018-05-04 Chenyan Xiong , Zhengzhong Liu , Jamie Callan , Tie-Yan Liu

The target of image-text clustering (ITC) is to find correct clusters by integrating complementary and consistent information of multi-modalities for these heterogeneous samples. However, the majority of current studies analyse ITC on the…

Artificial Intelligence · Computer Science 2022-12-01 Dongjin Guo , Xiaoming Su , Jiatai Wang , Limin Liu , Zhiyong Pei , Zhiwei Xu

Existing state-of-the-art 3D point clouds understanding methods only perform well in a fully supervised manner. To the best of our knowledge, there exists no unified framework which simultaneously solves the downstream high-level…

Computer Vision and Pattern Recognition · Computer Science 2023-12-06 Kangcheng Liu

Dataset distillation aims to synthesize a compact dataset from the original large-scale one, enabling highly efficient learning while preserving competitive model performance. However, traditional techniques primarily capture low-level…

Computer Vision and Pattern Recognition · Computer Science 2026-05-14 Qianxin Xia , Jiawei Du , Guoming Lu , Zhiyong Shu , Jielei Wang

Low-light conditions have an adverse impact on machine cognition, limiting the performance of computer vision systems in real life. Since low-light data is limited and difficult to annotate, we focus on image processing to enhance low-light…

Computer Vision and Pattern Recognition · Computer Science 2024-12-11 Igor Morawski , Kai He , Shusil Dangi , Winston H. Hsu

One of the main issues related to unsupervised machine learning is the cost of processing and extracting useful information from large datasets. In this work, we propose a classifier ensemble based on the transferable learning capabilities…

Computer Vision and Pattern Recognition · Computer Science 2021-07-09 Luis Lucas , David Tomas , Jose Garcia-Rodriguez

In this work we present a clustering technique called \textit{multi-level conformal clustering (MLCC)}. The technique is hierarchical in nature because it can be performed at multiple significance levels which yields greater insight into…

Machine Learning · Statistics 2020-06-25 Ilia Nouretdinov , James Gammerman , Matteo Fontana , Daljit Rehal

Multiview clustering (MVC) segregates data samples into meaningful clusters by synthesizing information across multiple views. Moreover, deep learning-based methods have demonstrated their strong feature learning capabilities in MVC…

Machine Learning · Computer Science 2024-03-22 Hao Yang , Hua Mao , Wai Lok Woo , Jie Chen , Xi Peng