English
Related papers

Related papers: Improved Image Captioning via Policy Gradient opti…

200 papers

In this paper, we propose an approach to improve image captioning solution for images with novel objects that do not have caption labels in the training dataset. We refer to our approach as Partially-Supervised Novel Object Captioning…

Computer Vision and Pattern Recognition · Computer Science 2021-11-22 Shashank Bujimalla , Mahesh Subedar , Omesh Tickoo

Image classifiers should be used with caution in the real world. Performance evaluated on a validation set may not reflect performance in the real world. In particular, classifiers may perform well for conditions that are frequently…

Computer Vision and Pattern Recognition · Computer Science 2024-09-30 Adrien LeCoz , Houssem Ouertatani , Stéphane Herbin , Faouzi Adjed

A great deal of progress has been made in image captioning, driven by research into how to encode the image using pre-trained models. This includes visual encodings (e.g. image grid features or detected objects) and more recently textual…

Computer Vision and Pattern Recognition · Computer Science 2023-05-26 Chia-Wen Kuo , Zsolt Kira

Image captioning models require the high-level generalization ability to describe the contents of various images in words. Most existing approaches treat the image-caption pairs equally in their training without considering the differences…

Computer Vision and Pattern Recognition · Computer Science 2022-12-15 Hongkuan Zhang , Saku Sugawara , Akiko Aizawa , Lei Zhou , Ryohei Sasano , Koichi Takeda

Incompatibility of image descriptor and ranking is always neglected in image retrieval. In this paper, manifold learning and Gestalt psychology theory are involved to solve the incompatibility problem. A new holistic descriptor called…

Computer Vision and Pattern Recognition · Computer Science 2016-09-27 Shenglan Liu , Jun Wu , Lin Feng , Yang Liu , Hong Qiao , Wenbo Luo Muxin Sun , Wei Wang

In this paper, we will present p roposed enhance process of image compression by using RLE algorithm. This proposed yield to decrease the size of compressing image, but the original method used primarily for compressing a binary images…

Multimedia · Computer Science 2018-04-03 Ali H. Husseen Al-nuaimi , Shyamaa Shakir Al-juboori , R. J. Mohammed

In the era of large time-domain spectro-photometric surveys, surface variations such as starspots, chemical inhomogeneities, pulsations, rotational distortions, and binary interactions can now be directly detected and modelled. Accurately…

Solar and Stellar Astrophysics · Physics 2025-11-17 M. Jabłońska , T. Różański , L. Casagrande , H. Shah , P. A. Kołaczek-Szymański , M. Rychlicki , Yuan-Sen Ting

Despite significant advancements in caption generation, existing evaluation metrics often fail to capture the full quality or fine-grained details of captions. This is mainly due to their reliance on non-specific human-written references or…

Computer Vision and Pattern Recognition · Computer Science 2025-07-31 Sara Sarto , Nicholas Moratelli , Marcella Cornia , Lorenzo Baraldi , Rita Cucchiara

Automatically translating images to texts involves image scene understanding and language modeling. In this paper, we propose a novel model, termed RefineCap, that refines the output vocabulary of the language decoder using decoder-guided…

Computation and Language · Computer Science 2021-09-09 Yekun Chai , Shuo Jin , Junliang Xing

Image captioning has been recently gaining a lot of attention thanks to the impressive achievements shown by deep captioning architectures, which combine Convolutional Neural Networks to extract image representations, and Recurrent Neural…

Computer Vision and Pattern Recognition · Computer Science 2018-05-22 Marcella Cornia , Lorenzo Baraldi , Giuseppe Serra , Rita Cucchiara

Evaluating the quality of automatically generated image descriptions is challenging, requiring metrics that capture various aspects such as grammaticality, coverage, correctness, and truthfulness. While human evaluation offers valuable…

Computer Vision and Pattern Recognition · Computer Science 2024-08-06 Jia-Hong Huang , Hongyi Zhu , Yixian Shen , Stevan Rudinac , Alessio M. Pacces , Evangelos Kanoulas

Prompt-based models have demonstrated impressive prompt-following capability at image editing tasks. However, the models still struggle with following detailed editing prompts or performing local edits. Specifically, global image quality…

Graphics · Computer Science 2025-10-20 Kenan Tang , Yanhong Li , Yao Qin

We propose an algorithm for automatic, targetless, extrinsic calibration of a LiDAR and camera system using semantic information. We achieve this goal by maximizing mutual information (MI) of semantic information between sensors, leveraging…

Computer Vision and Pattern Recognition · Computer Science 2021-04-27 Peng Jiang , Philip Osteen , Srikanth Saripalli

Image colorization is a well-known problem in computer vision. However, due to the ill-posed nature of the task, image colorization is inherently challenging. Though several attempts have been made by researchers to make the colorization…

Computer Vision and Pattern Recognition · Computer Science 2022-08-08 Subhankar Ghosh , Prasun Roy , Saumik Bhattacharya , Umapada Pal , Michael Blumenstein

Neural captioners are typically trained to mimic human-generated references without optimizing for any specific communication goal, leading to problems such as the generation of vague captions. In this paper, we show that fine-tuning an…

Computer Vision and Pattern Recognition · Computer Science 2023-04-05 Roberto Dessì , Michele Bevilacqua , Eleonora Gualdoni , Nathanael Carraz Rakotonirina , Francesca Franzon , Marco Baroni

Composed Image Retrieval (CIR) aims to retrieve images based on a query image with text. Current Zero-Shot CIR (ZS-CIR) methods try to solve CIR tasks without using expensive triplet-labeled training datasets. However, the gap between…

Computer Vision and Pattern Recognition · Computer Science 2024-07-10 Yingying Jiang , Hanchao Jia , Xiaobing Wang , Peng Hao

A number of attempts have been made to improve accuracy and/or scalability of the PC (Peter and Clark) algorithm, some well known (Buhlmann, et al., 2010; Kalisch and Buhlmann, 2007; 2008; Zhang, 2012, to give some examples). We add here…

Artificial Intelligence · Computer Science 2016-10-06 Joseph Ramsey

Image captioning systems have made substantial progress, largely due to the availability of curated datasets like Microsoft COCO or Vizwiz that have accurate descriptions of their corresponding images. Unfortunately, scarce availability of…

Computer Vision and Pattern Recognition · Computer Science 2020-12-23 Pierre Dognin , Igor Melnyk , Youssef Mroueh , Inkit Padhi , Mattia Rigotti , Jarret Ross , Yair Schiff

This paper describes our winning entry in the ImageCLEF 2015 image sentence generation task. We improve Google's CNN-LSTM model by introducing concept-based sentence reranking, a data-driven approach which exploits the large amounts of…

Computer Vision and Pattern Recognition · Computer Science 2016-05-04 Xirong Li , Qin Jin

The growing volume of digital images necessitates advanced systems for efficient categorization and retrieval, presenting a significant challenge in database management and information retrieval. This paper introduces PICS (Pipeline for…

Computer Vision and Pattern Recognition · Computer Science 2024-02-16 Grant Rosario , David Noever
‹ Prev 1 8 9 10 Next ›