English
Related papers

Related papers: Automatic Annotation of Structured Facts in Images

200 papers

Pre-trained neural abstractive summarization systems have dominated extractive strategies on news summarization performance, at least in terms of ROUGE. However, system-generated abstractive summaries often face the pitfall of factual…

Computation and Language · Computer Science 2020-10-07 Yue Dong , Shuohang Wang , Zhe Gan , Yu Cheng , Jackie Chi Kit Cheung , Jingjing Liu

Data is the engine of modern computer vision, which necessitates collecting large-scale datasets. This is expensive, and guaranteeing the quality of the labels is a major challenge. In this paper, we investigate efficient annotation…

Computer Vision and Pattern Recognition · Computer Science 2021-04-27 Yuan-Hong Liao , Amlan Kar , Sanja Fidler

We present a universal framework to model contextualized sentence representations with visual awareness that is motivated to overcome the shortcomings of the multimodal parallel data with manual annotations. For each sentence, we first…

Computation and Language · Computer Science 2019-11-12 Zhuosheng Zhang , Rui Wang , Kehai Chen , Masao Utiyama , Eiichiro Sumita , Hai Zhao

Automatically generating descriptive captions for images is a well-researched area in computer vision. However, existing evaluation approaches focus on measuring the similarity between two sentences disregarding fine-grained semantics of…

Computer Vision and Pattern Recognition · Computer Science 2019-08-07 Philipp Harzig , Dan Zecha , Rainer Lienhart , Carolin Kaiser , René Schallner

We consider the problem of segmenting image regions given a natural language phrase, and study it on a novel dataset of 77,262 images and 345,486 phrase-region pairs. Our dataset is collected on top of the Visual Genome dataset and uses the…

Computer Vision and Pattern Recognition · Computer Science 2020-08-05 Chenyun Wu , Zhe Lin , Scott Cohen , Trung Bui , Subhransu Maji

We present a new method for training pedestrian detectors on an unannotated set of images. We produce a mixed reality dataset that is composed of real-world background images and synthetically generated static human-agents. Our approach is…

Computer Vision and Pattern Recognition · Computer Science 2017-11-15 Ernest C. Cheung , Tsan Kwong Wong , Aniket Bera , Dinesh Manocha

Image captioning aims at automatically generating descriptions of an image in natural language. This is a challenging problem in the field of artificial intelligence that has recently received significant attention in the computer vision…

Computer Vision and Pattern Recognition · Computer Science 2019-04-02 Hassan Maleki Galandouz , Mohsen Ebrahimi Moghaddam , Mehrnoush Shamsfard

In this work, we focus on the task of generating natural language descriptions from a structured table of facts containing fields (such as nationality, occupation, etc) and values (such as Indian, actor, director, etc). One simple choice is…

Computation and Language · Computer Science 2019-07-16 Preksha Nema , Shreyas Shetty , Parag Jain , Anirban Laha , Karthik Sankaranarayanan , Mitesh M. Khapra

Detecting road features is a key enabler for autonomous driving and localization. For instance, a reliable detection of poles which are widespread in road environments can improve localization. Modern deep learning-based perception systems…

Computer Vision and Pattern Recognition · Computer Science 2024-12-17 Maxime Noizet , Philippe Xu , Philippe Bonnifait

To interpret the meanings of colors in visualizations of categorical information, people must determine how distinct colors correspond to different concepts. This process is easier when assignments between colors and concepts in…

Human-Computer Interaction · Computer Science 2019-10-08 Ragini Rathore , Zachary Leggon , Laurent Lessard , Karen B. Schloss

We propose a structured approach to the problem of retrieval of images by content and present a description logic that has been devised for the semantic indexing and retrieval of images containing complex objects. As other approaches do, we…

Artificial Intelligence · Computer Science 2011-09-08 E. Di Sciascio , F. M. Donini , M. Mongiello

Image annotation provides several keywords automatically for a given image based on various tags to describe its contents which is useful in Image retrieval. Various researchers are working on text based and content based image annotations…

Information Retrieval · Computer Science 2013-06-21 Payal Gulati , A. K. Sharma

Recent progress on automatic generation of image captions has shown that it is possible to describe the most salient information conveyed by images with accurate and meaningful sentences. In this paper, we propose an image caption system…

Computer Vision and Pattern Recognition · Computer Science 2015-06-23 Junqi Jin , Kun Fu , Runpeng Cui , Fei Sha , Changshui Zhang

Small satellite constellations provide daily global coverage of the earth's landmass, but image enrichment relies on automating key tasks like change detection or feature searches. For example, to extract text annotations from raw pixels…

Computer Vision and Pattern Recognition · Computer Science 2020-01-17 David Noever , Wes Regian , Matt Ciolino , Josh Kalin , Dom Hambrick , Kaye Blankenship

Automatically generating a natural language description of an image is a task close to the heart of image understanding. In this paper, we present a multi-model neural network method closely related to the human visual system that…

Computer Vision and Pattern Recognition · Computer Science 2017-06-09 Zhongliang Yang , Yu-Jin Zhang , Sadaqat ur Rehman , Yongfeng Huang

We present a novel data set made up of omnidirectional video of multiple objects whose centroid positions are annotated automatically. Omnidirectional vision is an active field of research focused on the use of spherical imagery in video…

Computer Vision and Pattern Recognition · Computer Science 2017-09-13 Victor Stamatescu , Peter Barsznica , Manjung Kim , Kin K. Liu , Mark McKenzie , Will Meakin , Gwilyn Saunders , Sebastien C. Wong , Russell S. A. Brinkworth

Recently, there has been growing interest in developing learning-based methods to detect and utilize salient semi-global or global structures, such as junctions, lines, planes, cuboids, smooth surfaces, and all types of symmetries, for 3D…

Computer Vision and Pattern Recognition · Computer Science 2020-07-20 Jia Zheng , Junfei Zhang , Jing Li , Rui Tang , Shenghua Gao , Zihan Zhou

Image captioning is a computer vision task that involves generating natural language descriptions for images. This method has numerous applications in various domains, including image retrieval systems, medicine, and various industries.…

Computer Vision and Pattern Recognition · Computer Science 2023-08-08 Sai Suprabhanu Nallapaneni , Subrahmanyam Konakanchi

Equitable urban transportation applications require high-fidelity digital representations of the built environment: not just streets and sidewalks, but bike lanes, marked and unmarked crossings, curb ramps and cuts, obstructions, traffic…

Computer Vision and Pattern Recognition · Computer Science 2024-08-05 Bin Han , Yiwei Yang , Anat Caspi , Bill Howe

The availability of labeled image datasets has been shown critical for high-level image understanding, which continuously drives the progress of feature designing and models developing. However, constructing labeled image datasets is…

Computer Vision and Pattern Recognition · Computer Science 2019-03-04 Yazhou Yao , Jian Zhang , Fumin Shen , Li Liu , Fan Zhu , Dongxiang Zhang , Heng-Tao Shen