English
Related papers

Related papers: NICE: CVPR 2023 Challenge on Zero-shot Image Capti…

200 papers

This paper presents a comprehensive review of the NTIRE 2026 Low Light Image Enhancement Challenge, highlighting the proposed solutions and final results. The objective of this challenge is to identify effective networks capable of…

Image captioning is a longstanding problem in the field of computer vision and natural language processing. To date, researchers have produced impressive state-of-the-art performance in the age of deep learning. Most of these…

Computer Vision and Pattern Recognition · Computer Science 2022-07-20 Zihang Meng , David Yang , Xuefei Cao , Ashish Shah , Ser-Nam Lim

Automatically creating the description of an image using any natural languages sentence like English is a very challenging task. It requires expertise of both image processing as well as natural language processing. This paper discuss about…

Computer Vision and Pattern Recognition · Computer Science 2018-10-03 Parth Shah , Vishvajit Bakarola , Supriya Pati

Large vision-language models revolutionized image classification and semantic segmentation paradigms. However, they typically assume a pre-defined set of categories, or vocabulary, at test time for composing textual prompts. This assumption…

Computer Vision and Pattern Recognition · Computer Science 2024-04-18 Alessandro Conti , Enrico Fini , Massimiliano Mancini , Paolo Rota , Yiming Wang , Elisa Ricci

We propose a deep learning framework for modeling complex high-dimensional densities called Non-linear Independent Component Estimation (NICE). It is based on the idea that a good representation is one in which the data has a distribution…

Machine Learning · Computer Science 2015-04-13 Laurent Dinh , David Krueger , Yoshua Bengio

Image captioning has long been regarded as a fundamental task in visual understanding. Recently, however, few large vision-language model (LVLM) research discusses model's image captioning performance because of the outdated short-caption…

Computer Vision and Pattern Recognition · Computer Science 2024-07-09 Hongyuan Dong , Jiawen Li , Bohong Wu , Jiacong Wang , Yuan Zhang , Haoyuan Guo

Image descriptions can help visually impaired people to quickly understand the image content. While we made significant progress in automatically describing images and optical character recognition, current approaches are unable to include…

Computer Vision and Pattern Recognition · Computer Science 2020-08-05 Oleksii Sidorov , Ronghang Hu , Marcus Rohrbach , Amanpreet Singh

Vision-language models (VLMs) like CLIP have been cherished for their ability to perform zero-shot visual recognition on open-vocabulary concepts. This is achieved by selecting the object category whose textual representation bears the…

Computer Vision and Pattern Recognition · Computer Science 2024-12-06 Shaunak Halbe , Junjiao Tian , K J Joseph , James Seale Smith , Katherine Stevo , Vineeth N Balasubramanian , Zsolt Kira

Gaze reflects how humans process visual scenes and is therefore increasingly used in computer vision systems. Previous works demonstrated the potential of gaze for object-centric tasks, such as object localization and recognition, but it…

Computer Vision and Pattern Recognition · Computer Science 2016-08-19 Yusuke Sugano , Andreas Bulling

The First Perception Test challenge was held as a half-day workshop alongside the IEEE/CVF International Conference on Computer Vision (ICCV) 2023, with the goal of benchmarking state-of-the-art video models on the recently proposed…

Computer Vision and Pattern Recognition · Computer Science 2023-12-21 Joseph Heyward , João Carreira , Dima Damen , Andrew Zisserman , Viorica Pătrăucean

The increasing demand for computational photography and imaging on mobile platforms has led to the widespread development and integration of advanced image sensors with novel algorithms in camera systems. However, the scarcity of…

We propose an end-to-end model which generates captions for images embedded in news articles. News images present two key challenges: they rely on real-world knowledge, especially about named entities; and they typically have linguistically…

Computer Vision and Pattern Recognition · Computer Science 2020-06-16 Alasdair Tran , Alexander Mathews , Lexing Xie

It has been a longstanding goal within image captioning to move beyond a dependence on object detection. We investigate using superpixels coupled with Vision Language Models (VLMs) to bridge the gap between detector-based captioning…

Computer Vision and Pattern Recognition · Computer Science 2025-03-12 Henry Senior , Luca Rossi , Gregory Slabaugh , Shanxin Yuan

This paper presents final results of ICDAR 2019 Scene Text Visual Question Answering competition (ST-VQA). ST-VQA introduces an important aspect that is not addressed by any Visual Question Answering system up to date, namely the…

Computer Vision and Pattern Recognition · Computer Science 2019-07-02 Ali Furkan Biten , Rubèn Tito , Andres Mafla , Lluis Gomez , Marçal Rusiñol , Minesh Mathew , C. V. Jawahar , Ernest Valveny , Dimosthenis Karatzas

Recently, reference-free metrics such as CLIPScore (Hessel et al., 2021), UMIC (Lee et al., 2021), and PAC-S (Sarto et al., 2023) have been proposed for automatic reference-free evaluation of image captions. Our focus lies in evaluating the…

Computation and Language · Computer Science 2024-02-07 Saba Ahmadi , Aishwarya Agrawal

In this paper, we summarize the 1st NTIRE challenge on stereo image super-resolution (restoration of rich details in a pair of low-resolution stereo images) with a focus on new solutions and results. This challenge has 1 track aiming at the…

Computer Vision and Pattern Recognition · Computer Science 2022-04-21 Longguang Wang , Yulan Guo , Yingqian Wang , Juncheng Li , Shuhang Gu , Radu Timofte

Image captioning has conventionally relied on reference-based automatic evaluations, where machine captions are compared against captions written by humans. This is in contrast to the reference-free manner in which humans assess caption…

Computer Vision and Pattern Recognition · Computer Science 2022-03-25 Jack Hessel , Ari Holtzman , Maxwell Forbes , Ronan Le Bras , Yejin Choi

In the era of evolving artificial intelligence, machines are increasingly emulating human-like capabilities, including visual perception and linguistic expression. Image captioning stands at the intersection of these domains, enabling…

Computer Vision and Pattern Recognition · Computer Science 2024-08-29 Hrishikesh Singh , Aarti Sharma , Millie Pant

This technical report presents the implementation details of 2nd winning for CVPR'24 UG2 WeatherProof Dataset Challenge. This challenge aims at semantic segmentation of images degraded by various degrees of weather from all around the…

Computer Vision and Pattern Recognition · Computer Science 2024-07-03 Guojin Cao , Jiaxu Li , Jia He , Ying Min , Yunhao Zhang

As large language models (LLMs) are increasingly applied in social contexts such as emotional companionship and customer service, measuring their social intelligence has become critical to the quality and safety of human-AI interaction.…

Artificial Intelligence · Computer Science 2026-05-29 Yunjin Qi , Zhaojun Jiang , Xuan Wu , Hanxi Pan , Yixuan Wang , Yanfang Liu , Xiang Ji , Churu Yu , Chunyuan Zheng , Yingze Chen , Jie He , Liuqing Chen , Zaifeng Gao