English
Related papers

Related papers: Assistive Image Annotation Systems with Deep Learn…

200 papers

We introduce a new multi-modal task for computer systems, posed as a combined vision-language comprehension challenge: identifying the most suitable text describing a scene, given several similar options. Accomplishing the task entails…

Computation and Language · Computer Science 2016-12-26 Nan Ding , Sebastian Goodman , Fei Sha , Radu Soricut

Deep learning has recently become one of the most popular sub-fields of machine learning owing to its distributed data representation with multiple levels of abstraction. A diverse range of deep learning algorithms are being employed to…

Computer Vision and Pattern Recognition · Computer Science 2018-04-12 Rajat Kumar Sinha , Ruchi Pandey , Rohan Pattnaik

Pre-trained vision-language models learn massive data to model unified representations of images and natural languages, which can be widely applied to downstream machine learning tasks. In addition to zero-shot inference, in order to better…

Computer Vision and Pattern Recognition · Computer Science 2024-06-28 Qian-Wei Wang , Yuqiu Xie , Letian Zhang , Zimo Liu , Shu-Tao Xia

Many real-world applications require automated data annotation, such as identifying tissue origins based on gene expressions and classifying images into semantic categories. Annotation classes are often numerous and subject to changes over…

Computation and Language · Computer Science 2018-07-03 Maxim Grechkin , Hoifung Poon , Bill Howe

Supervised Deep Learning has been highly successful in recent years, achieving state-of-the-art results in most tasks. However, with the ongoing uptake of such methods in industrial applications, the requirement for large amounts of…

Computer Vision and Pattern Recognition · Computer Science 2019-07-18 Fabio De Sousa Ribeiro , Francesco Caliva , Mark Swainson , Kjartan Gudmundsson , Georgios Leontidis , Stefanos Kollias

Image collections, if critical aspects of image content are exposed, can spur research and practical applications in many domains. Supervised machine learning may be the only feasible way to annotate very large collections, but leading…

Computer Vision and Pattern Recognition · Computer Science 2019-03-01 Sara Mousavi , Ramin Nabati , Megan Kleeschulte , Audris Mockus

Accurately annotated ultrasonic images are vital components of a high-quality medical report. Hospitals often have strict guidelines on the types of annotations that should appear on imaging results. However, manually inspecting these…

Image and Video Processing · Electrical Eng. & Systems 2023-07-11 Yuanheng Zhang , Nan Jiang , Zhaoheng Xie , Junying Cao , Yueyang Teng

We consider the problem of understanding real world tasks depicted in visual images. While most existing image captioning methods excel in producing natural language descriptions of visual scenes involving human tasks, there is often the…

Information Retrieval · Computer Science 2018-11-30 Sebastin Santy , Wazeer Zulfikar , Rishabh Mehrotra , Emine Yilmaz

Recent advances in deep learning, in particular enabled by hardware advances and big data, have provided impressive results across a wide range of computational problems such as computer vision, natural language, or reinforcement learning.…

Computer Vision and Pattern Recognition · Computer Science 2021-12-23 Ileana Rugina , Rumen Dangovski , Mark Veillette , Pooya Khorrami , Brian Cheung , Olga Simek , Marin Soljačić

Despite the progress of interactive image segmentation methods, high-quality pixel-level annotation is still time-consuming and laborious - a bottleneck for several deep learning applications. We take a step back to propose interactive and…

Computer Vision and Pattern Recognition · Computer Science 2022-07-12 Jord{ã}o Bragantini , Alexandre X Falc{ã}o , Laurent Najman

This paper focuses on the analysis of the application effectiveness of the integration of deep learning and computer vision technologies. Deep learning achieves a historic breakthrough by constructing hierarchical neural networks, enabling…

Computer Vision and Pattern Recognition · Computer Science 2023-12-21 Bo Liu , Liqiang Yu , Chang Che , Qunwei Lin , Hao Hu , Xinyu Zhao

Artificial Intelligence (AI) is revolutionizing assistive technologies. It offers innovative solutions to enhance the quality of life for individuals with visual impairments. This review examines the development, applications, and impact of…

Human-Computer Interaction · Computer Science 2025-03-21 Prudhvi Naayini , Praveen Kumar Myakala , Chiranjeevi Bura , Anil Kumar Jonnalagadda , Srikanth Kamatala

Robots will eventually be part of every household. It is thus critical to enable algorithms to learn from and be guided by non-expert users. In this paper, we bring a human in the loop, and enable a human teacher to give feedback to a…

Computation and Language · Computer Science 2017-06-06 Huan Ling , Sanja Fidler

Since acquiring pixel-wise annotations for training convolutional neural networks for semantic image segmentation is time-consuming, weakly supervised approaches that only require class tags have been proposed. In this work, we propose…

Computer Vision and Pattern Recognition · Computer Science 2019-05-17 Johann Sawatzky , Debayan Banerjee , Juergen Gall

Recently, sign language researchers have turned to sign language interpreted TV broadcasts, comprising (i) a video of continuous signing and (ii) subtitles corresponding to the audio content, as a readily available and large-scale source of…

Computer Vision and Pattern Recognition · Computer Science 2022-08-05 Liliane Momeni , Hannah Bull , K R Prajwal , Samuel Albanie , Gül Varol , Andrew Zisserman

Automatic annotation of images with descriptive words is a challenging problem with vast applications in the areas of image search and retrieval. This problem can be viewed as a label-assignment problem by a classifier dealing with a very…

Computer Vision and Pattern Recognition · Computer Science 2017-05-09 Amara Tariq , Hassan Foroosh

Deep learning has rapidly transformed the state of the art algorithms used to address a variety of problems in computer vision and robotics. These breakthroughs have relied upon massive amounts of human annotated training data. This time…

Computer Vision and Pattern Recognition · Computer Science 2017-02-28 Matthew Johnson-Roberson , Charles Barto , Rounak Mehta , Sharath Nittur Sridhar , Karl Rosaen , Ram Vasudevan

Image segmentation is a fundamental problem in biomedical image analysis. Recent advances in deep learning have achieved promising results on many biomedical image segmentation benchmarks. However, due to large variations in biomedical…

Computer Vision and Pattern Recognition · Computer Science 2017-06-16 Lin Yang , Yizhe Zhang , Jianxu Chen , Siyuan Zhang , Danny Z. Chen

Automatically generating natural language descriptions from an image is a challenging problem in artificial intelligence that requires a good understanding of the visual and textual signals and the correlations between them. The…

Computation and Language · Computer Science 2020-08-07 Arushi Goel , Basura Fernando , Thanh-Son Nguyen , Hakan Bilen

Image semantic segmentation is more and more being of interest for computer vision and machine learning researchers. Many applications on the rise need accurate and efficient segmentation mechanisms: autonomous driving, indoor navigation,…

Computer Vision and Pattern Recognition · Computer Science 2017-04-25 Alberto Garcia-Garcia , Sergio Orts-Escolano , Sergiu Oprea , Victor Villena-Martinez , Jose Garcia-Rodriguez