English
Related papers

Related papers: MultiGrain: a unified image embedding for classes …

200 papers

Multimodal Large Language Models (MLLMs) excel in vision--language tasks by pre-training solely on coarse-grained concept annotations (e.g., image captions). We hypothesize that integrating fine-grained concept annotations (e.g., object…

Computer Vision and Pattern Recognition · Computer Science 2024-12-10 Xiao Xu , Tianhao Niu , Yuxi Xie , Libo Qin , Wanxiang Che , Min-Yen Kan

Scattering networks are a class of designed Convolutional Neural Networks (CNNs) with fixed weights. We argue they can serve as generic representations for modelling images. In particular, by working in scattering space, we achieve…

In visual recognition tasks, few-shot learning requires the ability to learn object categories with few support examples. Its re-popularity in light of the deep learning development is mainly in image classification. This work focuses on…

Computer Vision and Pattern Recognition · Computer Science 2022-07-29 Miao Zhang , Miaojing Shi , Li Li

Fine-grained image search is still a challenging problem due to the difficulty in capturing subtle differences regardless of pose variations of objects from fine-grained categories. In practice, a dynamic inventory with new fine-grained…

Computer Vision and Pattern Recognition · Computer Science 2018-07-09 Kevin Lin , Fan Yang , Qiaosong Wang , Robinson Piramuthu

Effective image classification hinges on discerning relevant features from both foreground and background elements, with the foreground typically holding the critical information. While humans adeptly classify images with limited exposure,…

Computer Vision and Pattern Recognition · Computer Science 2024-05-08 Weihao Jiang , Haoyang Cui , Kun He

Convolutional Neural Networks has been implemented in many complex machine learning takes such as image classification, object identification, autonomous vehicle and robotic vision tasks. However, ConvNet architecture efficiency and…

Computer Vision and Pattern Recognition · Computer Science 2018-01-08 Pushparaja Murugan

A discriminatively trained neural net classifier can fit the training data perfectly if all information about its input other than class membership has been discarded prior to the output layer. Surprisingly, past research has discovered…

Machine Learning · Computer Science 2021-07-23 Piotr Teterwak , Chiyuan Zhang , Dilip Krishnan , Michael C. Mozer

Network embedding is the process of learning low-dimensional representations for nodes in a network, while preserving node features. Existing studies only leverage network structure information and focus on preserving structural features.…

Machine Learning · Computer Science 2019-03-29 Conghui Zheng , Li Pan , Peng Wu

Network embedding is a highly effective method to learn low-dimensional node vector representations with original network structures being well preserved. However, existing network embedding algorithms are mostly developed for a single…

Social and Information Networks · Computer Science 2021-05-06 Xiao Shen , Quanyu Dai , Sitong Mao , Fu-lai Chung , Kup-Sze Choi

Deep SORT\cite{wojke2017simple} is a tracking-by-detetion approach to multiple object tracking with a detector and a RE-ID model. Both separately training and inference with the two model is time-comsuming. In this paper, we unify the…

Computer Vision and Pattern Recognition · Computer Science 2019-07-09 Yuhao Xu , Jiakui Wang

Heterogeneous graph convolutional networks have gained great popularity in tackling various network analytical tasks on heterogeneous network data, ranging from link prediction to node classification. However, most existing works ignore the…

Social and Information Networks · Computer Science 2022-08-15 Pengyang Yu , Chaofan Fu , Yanwei Yu , Chao Huang , Zhongying Zhao , Junyu Dong

The clustering of unlabeled raw images is a daunting task, which has recently been approached with some success by deep learning methods. Here we propose an unsupervised clustering framework, which learns a deep neural network in an…

Computer Vision and Pattern Recognition · Computer Science 2020-12-16 Guy Shiran , Daphna Weinshall

Classification between thousands of classes in high-resolution images is one of the heavily studied problems in deep learning over the last decade. However, the challenge of fine-grained multi-class classification of objects in aerial…

Computer Vision and Pattern Recognition · Computer Science 2018-08-29 Eran Dahan , Tzvi Diskin

Vehicle re-identification is an important computer vision task where the objective is to identify a specific vehicle among a set of vehicles seen at various viewpoints. Recent methods based on deep learning utilize a global average pooling…

Computer Vision and Pattern Recognition · Computer Science 2021-02-02 Abu Md Niamul Taufique , Andreas Savakis

In this paper, we introduce a convolutional network which we call MultiPodNet consisting of a combination of two or more convolutional networks which process the input image in parallel to achieve the same goal. Output feature maps of…

Computer Vision and Pattern Recognition · Computer Science 2022-10-04 Hongyi Pan , Salih Atici , Ahmet Enis Cetin

Convolutional Neural Networks (CNN) have demon- strated its successful applications in computer vision, speech recognition, and natural language processing. For object recog- nition, CNNs might be limited by its strict label requirement and…

Computer Vision and Pattern Recognition · Computer Science 2016-10-12 Miao Sun , Tony X. Han , Ming-Chang Liu , Ahmad Khodayari-Rostamabad

Our research focuses on few-shot fine-grained image classification, which faces two major challenges: appearance similarity of fine-grained objects and limited number of samples. To preserve the appearance details of images, traditional…

Computer Vision and Pattern Recognition · Computer Science 2024-07-03 Shulei Qiu , Wanqi Yang , Ming Yang

Existing foundation models, such as CLIP, aim to learn a unified embedding space for multimodal data, enabling a wide range of downstream web-based applications like search, recommendation, and content classification. However, these models…

Machine Learning · Computer Science 2025-04-28 Yufei He , Yuan Sui , Xiaoxin He , Yue Liu , Yifei Sun , Bryan Hooi

Object segmentation and structure localization are important steps in automated image analysis pipelines for microscopy images. We present a convolution neural network (CNN) based deep learning architecture for segmentation of objects in…

Computer Vision and Pattern Recognition · Computer Science 2019-01-24 Shan E Ahmed Raza , Linda Cheung , Muhammad Shaban , Simon Graham , David Epstein , Stella Pelengaris , Michael Khan , Nasir M. Rajpoot

Fine-grained video classification requires understanding complex spatio-temporal and semantic cues that often exceed the capacity of a single modality. In this paper, we propose a multimodal framework that fuses video, image, and text…

Computer Vision and Pattern Recognition · Computer Science 2025-07-08 Namho Kim , Junhwa Kim