English
Related papers

Related papers: Object Counting with GPT-4o and GPT-5: A Comparati…

200 papers

This work introduces a model that can recognize objects in images even if no training data is available for the objects. The only necessary knowledge about the unseen categories comes from unsupervised large text corpora. In our zero-shot…

Computer Vision and Pattern Recognition · Computer Science 2013-03-21 Richard Socher , Milind Ganjoo , Hamsa Sridhar , Osbert Bastani , Christopher D. Manning , Andrew Y. Ng

Zero-shot object counting (ZSOC) aims to enumerate objects of arbitrary categories specified by text descriptions without requiring visual exemplars. However, existing methods often treat counting as a coarse retrieval task, suffering from…

Computer Vision and Pattern Recognition · Computer Science 2026-03-18 Da Zhang , Bingyu Li , Feiyu Wang , Zhiyuan Zhao , Junyu Gao

In this study, we tackle the challenge of classifying the object category in point clouds, which previous works like PointCLIP struggle to address due to the inherent limitations of the CLIP architecture. Our approach leverages GPT-4 Vision…

Computer Vision and Pattern Recognition · Computer Science 2024-01-17 Qi Sun , Xiao Cui , Wengang Zhou , Houqiang Li

Instruction-tuned Large Language Models (LLMs) have exhibited impressive language understanding and the capacity to generate responses that follow specific prompts. However, due to the computational demands associated with training these…

Computation and Language · Computer Science 2024-03-26 Yida Mu , Ben P. Wu , William Thorne , Ambrose Robinson , Nikolaos Aletras , Carolina Scarton , Kalina Bontcheva , Xingyi Song

In this article, we explore the potential of zero-shot Large Multimodal Models (LMMs) in the domain of drone perception. We focus on person detection and action recognition tasks and evaluate two prominent LMMs, namely YOLO-World and…

Computer Vision and Pattern Recognition · Computer Science 2024-04-03 Christian Limberg , Artur Gonçalves , Bastien Rigault , Helmut Prendinger

Expanding pre-trained zero-shot counting models to handle unseen categories requires more than simply adding new prompts, as this approach does not achieve the necessary alignment between text and visual features for accurate counting. We…

Computer Vision and Pattern Recognition · Computer Science 2025-05-27 Huilin Zhu , Senyao Li , Jingling Yuan , Zhengwei Yang , Yu Guo , Wenxuan Liu , Xian Zhong , Shengfeng He

An ability to learn about new objects from a small amount of visual data and produce convincing linguistic justification about the presence/absence of certain concepts (that collectively compose the object) in novel scenarios is an…

Computer Vision and Pattern Recognition · Computer Science 2024-10-18 Shailaja Keyur Sampat , Maitreya Patel , Yezhou Yang , Chitta Baral

Object counting is a fundamental task in computer vision, with broad applicability in many real-world scenarios. Fully-supervised counting methods require costly point-level annotations per object. Few weakly-supervised methods leverage…

Computer Vision and Pattern Recognition · Computer Science 2026-02-16 Xiaowen Zhang , Zijie Yue , Yong Luo , Cairong Zhao , Qijun Chen , Miaojing Shi

By encoding time series as a string of numerical digits, we can frame time series forecasting as next-token prediction in text. Developing this approach, we find that large language models (LLMs) such as GPT-3 and LLaMA-2 can surprisingly…

Machine Learning · Computer Science 2024-08-13 Nate Gruver , Marc Finzi , Shikai Qiu , Andrew Gordon Wilson

Vision-language models (VLMs) have shown impressive zero- and few-shot performance on real-world visual question answering (VQA) benchmarks, alluding to their capabilities as visual reasoning engines. However, the benchmarks being used…

Computation and Language · Computer Science 2024-09-04 Aishik Nagar , Shantanu Jaiswal , Cheston Tan

Recently large language models (LLMs) like ChatGPT have shown impressive performance on many natural language processing tasks with zero-shot. In this paper, we investigate the effectiveness of zero-shot LLMs in the financial domain. We…

Computation and Language · Computer Science 2023-05-29 Agam Shah , Sudheer Chava

This paper aims to efficiently enable Large Language Models (LLMs) to use multimodal tools. Advanced proprietary LLMs, such as ChatGPT and GPT-4, have shown great potential for tool usage through sophisticated prompt engineering.…

Computer Vision and Pattern Recognition · Computer Science 2023-05-31 Rui Yang , Lin Song , Yanwei Li , Sijie Zhao , Yixiao Ge , Xiu Li , Ying Shan

Leveraging class semantic descriptions and examples of known objects, zero-shot learning makes it possible to train a recognition model for an object class whose examples are not available. In this paper, we propose a novel zero-shot…

Computer Vision and Pattern Recognition · Computer Science 2017-08-22 Soravit Changpinyo , Wei-Lun Chao , Fei Sha

Given semantic descriptions of object classes, zero-shot learning aims to accurately recognize objects of the unseen classes, from which no examples are available at the training stage, by associating them to the seen classes, from which…

Computer Vision and Pattern Recognition · Computer Science 2016-05-31 Soravit Changpinyo , Wei-Lun Chao , Boqing Gong , Fei Sha

Classifying scanned documents is a challenging problem that involves image, layout, and text analysis for document understanding. Nevertheless, for certain benchmark datasets, notably RVL-CDIP, the state of the art is closing in to…

Computer Vision and Pattern Recognition · Computer Science 2024-12-19 Anna Scius-Bertrand , Michael Jungo , Lars Vögtlin , Jean-Marc Spat , Andreas Fischer

Face Recognition Systems (FRS) are increasingly vulnerable to face-morphing attacks, prompting the development of Morphing Attack Detection (MAD) algorithms. However, a key challenge in MAD lies in its limited generalizability to unseen…

Computer Vision and Pattern Recognition · Computer Science 2025-03-17 Haoyu Zhang , Raghavendra Ramachandra , Kiran Raja , Christoph Busch

This paper introduces a novel framework for zero-shot learning (ZSL), i.e., to recognize new categories that are unseen during training, by using a multi-model and multi-alignment integration method. Specifically, we propose three…

Computer Vision and Pattern Recognition · Computer Science 2024-05-06 Siqi Yin , Lifan Jiang

Large Language Models (LLMs) have exhibited remarkable performance on various Natural Language Processing (NLP) tasks. However, there is a current hot debate regarding their reasoning capacity. In this paper, we examine the performance of…

Computation and Language · Computer Science 2023-09-21 Jessica López Espejel , El Hassane Ettifouri , Mahaman Sanoussi Yahaya Alassan , El Mehdi Chouham , Walid Dahhane

Systematic reviews are crucial for evidence-based medicine as they comprehensively analyse published research findings on specific questions. Conducting such reviews is often resource- and time-intensive, especially in the screening phase,…

Information Retrieval · Computer Science 2024-02-02 Shuai Wang , Harrisen Scells , Shengyao Zhuang , Martin Potthast , Bevan Koopman , Guido Zuccon

Large Language Models (LLMs) operating in 0-shot or few-shot settings achieve competitive results in Text Classification tasks. In-Context Learning (ICL) typically achieves better accuracy than the 0-shot setting, but it pays in terms of…

Computation and Language · Computer Science 2024-04-04 Parth Patwa , Simone Filice , Zhiyu Chen , Giuseppe Castellucci , Oleg Rokhlenko , Shervin Malmasi