English
Related papers

Related papers: Neural Fashion Image Captioning : Accounting for D…

200 papers

Specialized datasets that capture the fashion industry's rich language and styling elements can boost progress in AI-driven fashion design. We present FLORA, (Fashion Language Outfit Representation for Apparel Generation), the first…

Computer Vision and Pattern Recognition · Computer Science 2025-12-12 Gayatri Deshmukh , Somsubhra De , Chirag Sehgal , Jishu Sen Gupta , Sparsh Mittal

The advent of artificial intelligence has contributed in a groundbreaking transformation of the fashion industry, redefining creativity and innovation in unprecedented ways. This work investigates methodologies for generating tailored…

Computer Vision and Pattern Recognition · Computer Science 2024-09-11 Georgia Argyrou , Angeliki Dimitriou , Maria Lymperaiou , Giorgos Filandrianos , Giorgos Stamou

Image captioning models tend to describe images in an object-centric way, emphasising visible objects. But image descriptions can also abstract away from objects and describe the type of scene depicted. In this paper, we explore the…

Computation and Language · Computer Science 2022-11-11 Michele Cafagna , Kees van Deemter , Albert Gatt

We hypothesize that end-to-end neural image captioning systems work seemingly well because they exploit and learn `distributional similarity' in a multimodal feature space by mapping a test image to similar training images in this space and…

Computer Vision and Pattern Recognition · Computer Science 2018-09-13 Pranava Madhyastha , Josiah Wang , Lucia Specia

Aided by recent advances in Deep Learning, Image Caption Generation has seen tremendous progress over the last few years. Most methods use transfer learning to extract visual information, in the form of image features, with the help of…

Computer Vision and Pattern Recognition · Computer Science 2021-02-24 Sulabh Katiyar , Samir Kumar Borgohain

As font is one of the core design concepts, automatic font identification and similar font suggestion from an image or photo has been on the wish list of many designers. We study the Visual Font Recognition (VFR) problem, and advance the…

Computer Vision and Pattern Recognition · Computer Science 2015-07-14 Zhangyang Wang , Jianchao Yang , Hailin Jin , Eli Shechtman , Aseem Agarwala , Jonathan Brandt , Thomas S. Huang

Image captioning is one of the straightforward tasks that can take advantage of large-scale web-crawled data which provides rich knowledge about the visual world for a captioning model. However, since web-crawled data contains image-text…

Computer Vision and Pattern Recognition · Computer Science 2023-09-28 Wooyoung Kang , Jonghwan Mun , Sungjun Lee , Byungseok Roh

This paper strives to find amidst a set of sentences the one best describing the content of a given image or video. Different from existing works, which rely on a joint subspace for their image and video caption retrieval, we propose to do…

Computer Vision and Pattern Recognition · Computer Science 2018-07-17 Jianfeng Dong , Xirong Li , Cees G. M. Snoek

The fashion industry is looking forward to use artificial intelligence technologies to enhance their processes, services, and applications. Although the amount of fashion data currently in use is increasing, there is a large gap in data…

Computers and Society · Computer Science 2020-09-10 Mohammed Al-Rawi , Joeran Beel

Fashion is an increasingly important topic in computer vision, in particular the so-called street-to-shop task of matching street images with shop images containing similar fashion items. Solving this problem promises new means of making…

Computer Vision and Pattern Recognition · Computer Science 2018-07-03 Julia Lasserre , Katharina Rasch , Roland Vollgraf

How do two sets of images differ? Discerning set-level differences is crucial for understanding model behaviors and analyzing datasets, yet manually sifting through thousands of images is impractical. To aid in this discovery process, we…

Computer Vision and Pattern Recognition · Computer Science 2024-04-30 Lisa Dunlap , Yuhui Zhang , Xiaohan Wang , Ruiqi Zhong , Trevor Darrell , Jacob Steinhardt , Joseph E. Gonzalez , Serena Yeung-Levy

Developers of text generation models rely on automated evaluation metrics as a stand-in for slow and expensive manual evaluations. However, image captioning metrics have struggled to give accurate learned estimates of the semantic and…

Computation and Language · Computer Science 2022-03-21 Mert İnan , Piyush Sharma , Baber Khalid , Radu Soricut , Matthew Stone , Malihe Alikhani

Convolutional Neural Networks have been highly successful in performing a host of computer vision tasks such as object recognition, object detection, image segmentation and texture synthesis. In 2015, Gatys et. al [7] show how the style of…

Computer Vision and Pattern Recognition · Computer Science 2017-08-01 Prutha Date , Ashwinkumar Ganesan , Tim Oates

In this paper, we present our solution to the New frontiers for Zero-shot Image Captioning Challenge. Different from the traditional image captioning datasets, this challenge includes a larger new variety of visual concepts from many…

Computer Vision and Pattern Recognition · Computer Science 2024-07-08 Xiangyu Wu , Yi Gao , Hailiang Zhang , Yang Yang , Weili Guo , Jianfeng Lu

In this paper, we present a model which takes as input a corpus of images with relevant spoken captions and finds a correspondence between the two modalities. We employ a pair of convolutional neural networks to model visual objects and…

Computer Vision and Pattern Recognition · Computer Science 2015-11-13 David Harwath , James Glass

Recent years have witnessed increasing attention in cartoon media, powered by the strong demands of industrial applications. As the first step to understand this media, cartoon face recognition is a crucial but less-explored task with few…

Computer Vision and Pattern Recognition · Computer Science 2020-06-30 Yi Zheng , Yifan Zhao , Mengyuan Ren , He Yan , Xiangju Lu , Junhui Liu , Jia Li

Image generation in the fashion domain has predominantly focused on preserving body characteristics or following input prompts, but little attention has been paid to improving the inherent fashionability of the output images. This paper…

Computer Vision and Pattern Recognition · Computer Science 2024-12-25 Qice Qin , Yuki Hirakawa , Ryotaro Shimizu , Takuya Furusawa , Edgar Simo-Serra

Image captioning strives to generate pertinent captions for specified images, situating itself at the crossroads of Computer Vision (CV) and Natural Language Processing (NLP). This endeavor is of paramount importance with far-reaching…

Computer Vision and Pattern Recognition · Computer Science 2024-04-03 Tianrui Liu , Qi Cai , Changxin Xu , Bo Hong , Jize Xiong , Yuxin Qiao , Tsungwei Yang

Discriminativeness is a desirable feature of image captions: captions should describe the characteristic details of input images. However, recent high-performing captioning models, which are trained with reinforcement learning (RL), tend to…

Computer Vision and Pattern Recognition · Computer Science 2023-01-03 Ukyo Honda , Taro Watanabe , Yuji Matsumoto

Dataset bias in vision-language tasks is becoming one of the main problems which hinders the progress of our community. Existing solutions lack a principled analysis about why modern image captioners easily collapse into dataset bias. In…

Computer Vision and Pattern Recognition · Computer Science 2023-12-05 Xu Yang , Hanwang Zhang , Jianfei Cai