English
Related papers

Related papers: SynthRef: Generation of Synthetic Referring Expres…

200 papers

Training data is the key ingredient for deep learning approaches, but difficult to obtain for the specialized domains often encountered in robotics. We describe a synthesis pipeline capable of producing training data for cluttered scene…

Computer Vision and Pattern Recognition · Computer Science 2020-05-13 Max Schwarz , Sven Behnke

We propose an end-to-end approach to the natural language object retrieval task, which localizes an object within an image according to a natural language description, i.e., referring expression. Previous works divide this problem into two…

Computer Vision and Pattern Recognition · Computer Science 2017-03-23 Fan Wu , Zhongwen Xu , Yi Yang

In recent years, instance segmentation has garnered significant attention across various applications. However, training a fully-supervised instance segmentation model requires costly both instance-level and pixel-level annotations. In…

Computer Vision and Pattern Recognition · Computer Science 2024-10-10 Yuchen Shen , Dong Zhang , Zhao Zhang , Liyong Fu , Qiaolin Ye

We present an overview and evaluation of a new, systematic approach for generation of highly realistic, annotated synthetic data for training of deep neural networks in computer vision tasks. The main contribution is a procedural world…

Computer Vision and Pattern Recognition · Computer Science 2017-10-19 Apostolia Tsirikoglou , Joel Kronander , Magnus Wrenninge , Jonas Unger

Enabling intuitive, language-driven interaction with surgical scenes is a critical step toward intelligent operating rooms and autonomous surgical robotic assistance. However, the task of referring segmentation, localizing surgical…

Computer Vision and Pattern Recognition · Computer Science 2026-03-19 Meng Wei , Kun Yuan , Shi Li , Yue Zhou , Long Bai , Nassir Navab , Hongliang Ren , Hong Joo Lee , Tom Vercauteren , Nicolas Padoy

In this paper, we study video synthesis with emphasis on simplifying the generation conditions. Most existing video synthesis models or datasets are designed to address complex motions of a single object, lacking the ability of…

Computer Vision and Pattern Recognition · Computer Science 2023-05-24 Yang Wu , Zhibin Liu , Hefeng Wu , Liang Lin

Recently, automated medical image segmentation methods based on deep learning have achieved great success. However, they heavily rely on large annotated datasets, which are costly and time-consuming to acquire. Few-shot learning aims to…

Artificial Intelligence · Computer Science 2024-08-20 Jiayu Huo , Ruiqiang Xiao , Haotian Zheng , Yang Liu , Sebastien Ourselin , Rachel Sparks

The task of video object segmentation with referring expressions (language-guided VOS) is to, given a linguistic phrase and a video, generate binary masks for the object to which the phrase refers. Our work argues that existing benchmarks…

Computer Vision and Pattern Recognition · Computer Science 2020-10-02 Miriam Bellver , Carles Ventura , Carina Silberer , Ioannis Kazakos , Jordi Torres , Xavier Giro-i-Nieto

Preparing training data for deep vision models is a labor-intensive task. To address this, generative models have emerged as an effective solution for generating synthetic data. While current generative models produce image-level category…

Computer Vision and Pattern Recognition · Computer Science 2023-11-14 Quang Nguyen , Truong Vu , Anh Tran , Khoi Nguyen

Video retrieval is a challenging research topic bridging the vision and language areas and has attracted broad attention in recent years. Previous works have been devoted to representing videos by directly encoding from frame-level…

Computer Vision and Pattern Recognition · Computer Science 2020-06-17 Zerun Feng , Zhimin Zeng , Caili Guo , Zheng Li

Modern vision models excel at general purpose downstream tasks. It is unclear, however, how they may be used for personalized vision tasks, which are both fine-grained and data-scarce. Recent works have successfully applied synthetic data…

Computer Vision and Pattern Recognition · Computer Science 2024-12-23 Shobhita Sundaram , Julia Chae , Yonglong Tian , Sara Beery , Phillip Isola

Training computer vision models usually requires collecting and labeling vast amounts of imagery under a diverse set of scene configurations and properties. This process is incredibly time-consuming, and it is challenging to ensure that the…

Computer Vision and Pattern Recognition · Computer Science 2022-07-26 Yunhao Ge , Harkirat Behl , Jiashu Xu , Suriya Gunasekar , Neel Joshi , Yale Song , Xin Wang , Laurent Itti , Vibhav Vineet

Current deep networks are very data-hungry and benefit from training on largescale datasets, which are often time-consuming to collect and annotate. By contrast, synthetic data can be generated infinitely using generative models such as…

Computer Vision and Pattern Recognition · Computer Science 2023-10-11 Weijia Wu , Yuzhong Zhao , Hao Chen , Yuchao Gu , Rui Zhao , Yefei He , Hong Zhou , Mike Zheng Shou , Chunhua Shen

Advances in unsupervised learning of object-representations have culminated in the development of a broad range of methods for unsupervised object segmentation and interpretable object-centric scene generation. These methods, however, are…

Computer Vision and Pattern Recognition · Computer Science 2022-01-26 Martin Engelcke , Oiwi Parker Jones , Ingmar Posner

As an important step towards visual reasoning, visual grounding (e.g., phrase localization, referring expression comprehension/segmentation) has been widely explored Previous approaches to referring expression comprehension (REC) or…

Computer Vision and Pattern Recognition · Computer Science 2021-07-15 Muchen Li , Leonid Sigal

Existing referring understanding tasks tend to involve the detection of a single text-referred object. In this paper, we propose a new and general referring understanding task, termed referring multi-object tracking (RMOT). Its core idea is…

Computer Vision and Pattern Recognition · Computer Science 2023-03-14 Dongming Wu , Wencheng Han , Tiancai Wang , Xingping Dong , Xiangyu Zhang , Jianbing Shen

Localizing desired objects from remote sensing images is of great use in practical applications. Referring image segmentation, which aims at segmenting out the objects to which a given expression refers, has been extensively studied in…

Computer Vision and Pattern Recognition · Computer Science 2024-03-05 Zhenghang Yuan , Lichao Mou , Yuansheng Hua , Xiao Xiang Zhu

Vision-based object detectors are a crucial basis for robotics applications as they provide valuable information about object localisation in the environment. These need to ensure high reliability in different lighting conditions,…

Computer Vision and Pattern Recognition · Computer Science 2024-10-29 Ritvik Singh , Jingzhou Liu , Karl Van Wyk , Yu-Wei Chao , Jean-Francois Lafleche , Florian Shkurti , Nathan Ratliff , Ankur Handa

This paper presents an improved scheme for the generation and adaption of synthetic images for the training of deep Convolutional Neural Networks(CNNs) to perform the object detection task in smart vending machines. While generating…

Computer Vision and Pattern Recognition · Computer Science 2019-04-30 Kai Wang , Fuyuan Shi , Wenqi Wang , Yibing Nan , Shiguo Lian

We propose an end-to-end learning framework for segmenting generic objects in both images and videos. Given a novel image or video, our approach produces a pixel-level mask for all "object-like" regions---even for object categories never…

Computer Vision and Pattern Recognition · Computer Science 2018-12-19 Bo Xiong , Suyog Dutt Jain , Kristen Grauman