English
Related papers

Related papers: GPT4Vis: What Can GPT-4 Do for Zero-shot Visual Re…

200 papers

Classroom observation protocols standardize the assessment of teaching effectiveness and facilitate comprehension of classroom interactions. Whereas these protocols offer teachers specific feedback on their teaching practices, the manual…

Human-Computer Interaction · Computer Science 2024-07-04 Ruikun Hou , Tim Fütterer , Babette Bühler , Efe Bozkir , Peter Gerjets , Ulrich Trautwein , Enkelejda Kasneci

Vision-Language Models (VLMs) have rapidly advanced alongside Large Language Models (LLMs). This study evaluates the capabilities of prominent generative VLMs, such as GPT-4.1 and Gemini 2.5 Pro, accessed via APIs, for histopathology image…

Computer Vision and Pattern Recognition · Computer Science 2025-06-17 Samarth Singhal , Sandeep Singhal

Large scale Vision-Language (VL) models have shown tremendous success in aligning representations between visual and text modalities. This enables remarkable progress in zero-shot recognition, image generation & editing, and many other…

Computer Vision and Pattern Recognition · Computer Science 2023-07-25 Wei Lin , Leonid Karlinsky , Nina Shvetsova , Horst Possegger , Mateusz Kozinski , Rameswar Panda , Rogerio Feris , Hilde Kuehne , Horst Bischof

Data visualization is a powerful tool for exploring and communicating insights in various domains. To automate visualization choice for datasets, a task known as visualization recommendation has been proposed. Various machine-learning-based…

Human-Computer Interaction · Computer Science 2023-10-17 Lei Wang , Songheng Zhang , Yun Wang , Ee-Peng Lim , Yong Wang

Recently, zero-shot TTS and VC methods have gained attention due to their practicality of being able to generate voices even unseen during training. Among these methods, zero-shot modifications of the VITS model have shown superior…

Audio and Speech Processing · Electrical Eng. & Systems 2023-05-29 Seongyeon Park , Bohyung Kim , Tae-hyun Oh

The upsurge in pre-trained large models started by ChatGPT has swept across the entire deep learning community. Such powerful models demonstrate advanced generative ability and multimodal understanding capability, which quickly set new…

Computer Vision and Pattern Recognition · Computer Science 2025-02-28 Ning Ding , Yehui Tang , Zhongqian Fu , Chao Xu , Kai Han , Yunhe Wang

OpenAI released version GPT-4 on March 14, 2023, following the success of ChatGPT, which was announced in November 2022. In addition to the existing GPT-3 features, GPT-4 can interpret images. To achieve this, the processing power and model…

Computer Vision and Pattern Recognition · Computer Science 2025-02-04 Omer Aydin , Enis Karaarslan

Cognitive psychology delves on understanding perception, attention, memory, language, problem-solving, decision-making, and reasoning. Large language models (LLMs) are emerging as potent tools increasingly capable of performing human-level…

Computation and Language · Computer Science 2023-04-13 Sifatkaur Dhingra , Manmeet Singh , Vaisakh SB , Neetiraj Malviya , Sukhpal Singh Gill

Animal ethology is an crucial aspect of animal research, and animal behavior labeling is the foundation for studying animal behavior. This process typically involves labeling video clips with behavioral semantic tags, a task that is…

Computer Vision and Pattern Recognition · Computer Science 2024-06-17 Yiqi Wu , Xiaodan Hu , Ziming Fu , Siling Zhou , Jiangong Li

Generative Zero-shot learning (ZSL) learns a generator to synthesize visual samples for unseen classes, which is an effective way to advance ZSL. However, existing generative methods rely on the conditions of Gaussian noise and the…

Computer Vision and Pattern Recognition · Computer Science 2024-04-24 Wenjin Hou , Shiming Chen , Shuhuang Chen , Ziming Hong , Yan Wang , Xuetao Feng , Salman Khan , Fahad Shahbaz Khan , Xinge You

The recent success of general-domain large language models (LLMs) has significantly changed the natural language processing paradigm towards a unified foundation model across domains and applications. In this paper, we focus on assessing…

Generalized zero-shot learning (GZSL) is a technique to train a deep learning model to identify unseen classes using the image attribute. In this paper, we put forth a new GZSL approach exploiting Vision Transformer (ViT) to maximize the…

Computer Vision and Pattern Recognition · Computer Science 2023-02-03 Jiseob Kim , Kyuhong Shim , Junhan Kim , Byonghyo Shim

This study evaluates the performance of ChatGPT variants, GPT-3.5 and GPT-4, both with and without prompt engineering, against solely student work and a mixed category containing both student and GPT-4 contributions in university-level…

Computation and Language · Computer Science 2024-10-08 Will Yeadon , Alex Peach , Craig P. Testrow

Zero-shot object recognition or zero-shot learning aims to transfer the object recognition ability among the semantically related categories, such as fine-grained animal or bird species. However, the images of different fine-grained objects…

Computer Vision and Pattern Recognition · Computer Science 2021-05-25 Zongyan Han , Zhenyong Fu , Jian Yang

Conventional approaches to dietary assessment are primarily grounded in self-reporting methods or structured interviews conducted under the supervision of dietitians. These methods, however, are often subjective, potentially inaccurate, and…

Computer Vision and Pattern Recognition · Computer Science 2023-12-15 Frank P. -W. Lo , Jianing Qiu , Zeyu Wang , Junhong Chen , Bo Xiao , Wu Yuan , Stamatia Giannarou , Gary Frost , Benny Lo

General Purpose Vision (GPV) systems are models that are designed to solve a wide array of visual tasks without requiring architectural changes. Today, GPVs primarily learn both skills and concepts from large fully supervised datasets.…

Computer Vision and Pattern Recognition · Computer Science 2022-07-22 Amita Kamath , Christopher Clark , Tanmay Gupta , Eric Kolve , Derek Hoiem , Aniruddha Kembhavi

Generalized zero-shot learning (GZSL) aims to recognize both seen and unseen classes by transferring knowledge from semantic descriptions to visual representations. Recent generative methods formulate GZSL as a missing data problem, which…

Computer Vision and Pattern Recognition · Computer Science 2020-09-02 Yu-Chao Gu , Le Zhang , Yun Liu , Shao-Ping Lu , Ming-Ming Cheng

Embodied agents equipped with GPT as their brains have exhibited extraordinary decision-making and generalization abilities across various tasks. However, existing zero-shot agents for vision-and-language navigation (VLN) only prompt GPT-4…

Artificial Intelligence · Computer Science 2024-06-21 Jiaqi Chen , Bingqian Lin , Ran Xu , Zhenhua Chai , Xiaodan Liang , Kwan-Yee K. Wong

Vision-language models trained on large, randomly collected data had significant impact in many areas since they appeared. But as they show great performance in various fields, such as image-text-retrieval, their inner workings are still…

Computer Vision and Pattern Recognition · Computer Science 2022-09-15 Felix Vogel , Nina Shvetsova , Leonid Karlinsky , Hilde Kuehne

We propose global context vision transformer (GC ViT), a novel architecture that enhances parameter and compute utilization for computer vision. Our method leverages global context self-attention modules, joint with standard local…

Computer Vision and Pattern Recognition · Computer Science 2023-06-07 Ali Hatamizadeh , Hongxu Yin , Greg Heinrich , Jan Kautz , Pavlo Molchanov