中文
相关论文

相关论文: DeepDiary: Automatic Caption Generation for Lifelo…

200 篇论文

This project aims to create an automated image captioning system that generates natural language descriptions for input images by integrating techniques from computer vision and natural language processing. We employ various different…

计算机视觉与模式识别 · 计算机科学 2024-12-17 Joshua Adrian Cahyono , Jeremy Nathan Jusuf

We present an image caption system that addresses new challenges of automatically describing images in the wild. The challenges include high quality caption quality with respect to human judgments, out-of-domain data handling, and low…

计算机视觉与模式识别 · 计算机科学 2016-04-01 Kenneth Tran , Xiaodong He , Lei Zhang , Jian Sun , Cornelia Carapcea , Chris Thrasher , Chris Buehler , Chris Sienkiewicz

Automatic image caption generation aims to produce an accurate description of an image in natural language automatically. However, Bangla, the fifth most widely spoken language in the world, is lagging considerably in the research and…

计算与语言 · 计算机科学 2018-09-10 Motiur Rahman , Nabeel Mohammed , Nafees Mansoor , Sifat Momen

Image captioning is a longstanding problem in the field of computer vision and natural language processing. To date, researchers have produced impressive state-of-the-art performance in the age of deep learning. Most of these…

计算机视觉与模式识别 · 计算机科学 2022-07-20 Zihang Meng , David Yang , Xuefei Cao , Ashish Shah , Ser-Nam Lim

The best summary of a long video differs among different people due to its highly subjective nature. Even for the same person, the best summary may change with time or mood. In this paper, we introduce the task of generating customized…

计算机视觉与模式识别 · 计算机科学 2018-03-05 Jinsoo Choi , Tae-Hyun Oh , In So Kweon

Automatically generating a natural language description of an image is a task close to the heart of image understanding. In this paper, we present a multi-model neural network method closely related to the human visual system that…

计算机视觉与模式识别 · 计算机科学 2017-06-09 Zhongliang Yang , Yu-Jin Zhang , Sadaqat ur Rehman , Yongfeng Huang

Current image captioning works usually focus on generating descriptions in an autoregressive manner. However, there are limited works that focus on generating descriptions non-autoregressively, which brings more decoding diversity. Inspired…

计算机视觉与模式识别 · 计算机科学 2023-05-23 Yufeng He , Zefan Cai , Xu Gan , Baobao Chang

Medical imaging has significantly revolutionized medical diagnostics and treatment planning, progressing from early X-ray usage to sophisticated methods like MRIs, CT scans, and ultrasounds. This paper investigates the use of deep learning…

计算机视觉与模式识别 · 计算机科学 2024-11-22 Abdennour Boulesnane , Boutheina Mokhtari , Oumnia Rana Segueni , Slimane Segueni

In the era of evolving artificial intelligence, machines are increasingly emulating human-like capabilities, including visual perception and linguistic expression. Image captioning stands at the intersection of these domains, enabling…

计算机视觉与模式识别 · 计算机科学 2024-08-29 Hrishikesh Singh , Aarti Sharma , Millie Pant

Automatic generation of caption to describe the content of an image has been gaining a lot of research interests recently, where most of the existing works treat the image caption as pure sequential data. Natural language, however possess a…

计算机视觉与模式识别 · 计算机科学 2017-11-16 Ying Hua Tan , Chee Seng Chan

The aim of image captioning is to generate captions by machine to describe image contents. Despite many efforts, generating discriminative captions for images remains non-trivial. Most traditional approaches imitate the language structure…

计算机视觉与模式识别 · 计算机科学 2018-07-24 Xihui Liu , Hongsheng Li , Jing Shao , Dapeng Chen , Xiaogang Wang

Screen recordings of mobile applications are easy to capture and include a wealth of information, making them a popular mechanism for users to inform developers of the problems encountered in the bug reports. However, watching the bug…

软件工程 · 计算机科学 2023-02-03 Sidong Feng , Mulong Xie , Yinxing Xue , Chunyang Chen

This paper proposes a network architecture to perform variable length semantic video generation using captions. We adopt a new perspective towards video generation where we allow the captions to be combined with the long-term and short-term…

计算机视觉与模式识别 · 计算机科学 2017-11-17 Tanya Marwah , Gaurav Mittal , Vineeth N. Balasubramanian

In this paper we explore the bi-directional mapping between images and their sentence-based descriptions. We propose learning this mapping using a recurrent neural network. Unlike previous approaches that map both sentences and images to a…

计算机视觉与模式识别 · 计算机科学 2014-11-21 Xinlei Chen , C. Lawrence Zitnick

Generating automatic dense captions for videos that accurately describe their contents remains a challenging area of research. Most current models require processing the entire video at once. Instead, we propose an efficient, online…

计算机视觉与模式识别 · 计算机科学 2024-11-25 AJ Piergiovanni , Dahun Kim , Michael S. Ryoo , Isaac Noble , Anelia Angelova

Automatically generating the descriptions of an image, i.e., image captioning, is an important and fundamental topic in artificial intelligence, which bridges the gap between computer vision and natural language processing. Based on the…

计算机视觉与模式识别 · 计算机科学 2019-01-14 Shiyang Yan , Yuan Xie , Fangyu Wu , Jeremy S. Smith , Wenjin Lu , Bailing Zhang

Video captioning is a challenging task that requires a deep understanding of visual scenes. State-of-the-art methods generate captions using either scene-level or object-level information but without explicitly modeling object interactions.…

计算机视觉与模式识别 · 计算机科学 2020-04-01 Boxiao Pan , Haoye Cai , De-An Huang , Kuan-Hui Lee , Adrien Gaidon , Ehsan Adeli , Juan Carlos Niebles

We investigate the incorporation of visual relationships into the task of supervised image caption generation by proposing a model that leverages detected objects and auto-generated visual relationships to describe images in natural…

计算机视觉与模式识别 · 计算机科学 2021-09-24 Maximilian Mozes , Martin Schmitt , Vladimir Golkov , Hinrich Schütze , Daniel Cremers

We introduce a novel meme generation system, which given any image can produce a humorous and relevant caption. Furthermore, the system can be conditioned on not only an image but also a user-defined label relating to the meme template,…

计算与语言 · 计算机科学 2018-06-13 Abel L Peirson , E Meltem Tolunay

State-of-the-art image captioners can generate accurate sentences to describe images in a sequence to sequence manner without considering the controllability and interpretability. This, however, is far from making image captioning widely…

计算机视觉与模式识别 · 计算机科学 2022-05-26 Luka Maxwell