English
Related papers

Related papers: Learning Sketches for Decomposing Planning Problem…

200 papers

We introduce SketchGNN, a convolutional graph neural network for semantic segmentation and labeling of freehand vector sketches. We treat an input stroke-based sketch as a graph, with nodes representing the sampled points along input…

Computer Vision and Pattern Recognition · Computer Science 2021-03-26 Lumin Yang , Jiajie Zhuang , Hongbo Fu , Xiangzhi Wei , Kun Zhou , Youyi Zheng

High-dimensional sparse data present computational and statistical challenges for supervised learning. We propose compact linear sketches for reducing the dimensionality of the input, followed by a single layer neural network. We show that…

Machine Learning · Computer Science 2016-04-21 Amit Daniely , Nevena Lazic , Yoram Singer , Kunal Talwar

Machine learning practitioners often end up tunneling on low-level technical details like model architectures and performance metrics. Could early model development instead focus on high-level questions of which factors a model ought to pay…

Human-Computer Interaction · Computer Science 2023-03-07 Michelle S. Lam , Zixian Ma , Anne Li , Izequiel Freitas , Dakuo Wang , James A. Landay , Michael S. Bernstein

Recently, Zero-shot Sketch-based Image Retrieval (ZS-SBIR) has attracted the attention of the computer vision community due to it's real-world applications, and the more realistic and challenging setting than found in SBIR. ZS-SBIR inherits…

Computer Vision and Pattern Recognition · Computer Science 2021-02-09 Osman Tursun , Simon Denman , Sridha Sridharan , Ethan Goan , Clinton Fookes

Significant progress has recently been made in creative applications of large pre-trained models for downstream tasks in 3D vision, such as text-to-shape generation. This motivates our investigation of how these pre-trained models can be…

Computer Vision and Pattern Recognition · Computer Science 2023-07-11 Aditya Sanghi , Pradeep Kumar Jayaraman , Arianna Rampini , Joseph Lambourne , Hooman Shayani , Evan Atherton , Saeid Asgari Taghanaki

Sketches, with their expressive potential, allow humans to convey the essence of an object through even a rough contour. For the first time, we harness this expressive potential to improve segmentation performance in challenging tasks like…

Computer Vision and Pattern Recognition · Computer Science 2025-02-03 Ying Zang , Runlong Cao , Jianqi Zhang , Yidong Han , Ziyue Cao , Wenjun Hu , Didi Zhu , Lanyun Zhu , Zejian Li , Deyi Ji , Tianrun Chen

We introduce SketchDeco, a training-free approach to sketch colourisation that bridges the gap between professional design needs and intuitive, region-based control. Our method empowers artists to use simple masks and colour palettes for…

Computer Vision and Pattern Recognition · Computer Science 2026-04-07 Chaitat Utintu , Yi-Zhe Song

We present an algorithm for searching image collections using free-hand sketches that describe the appearance and relative positions of multiple objects. Sketch based image retrieval (SBIR) methods predominantly match queries containing a…

Computer Vision and Pattern Recognition · Computer Science 2021-06-16 Alexander Black , Tu Bui , Long Mai , Hailin Jin , John Collomosse

During the last half decade, convolutional neural networks (CNNs) have triumphed over semantic segmentation, which is one of the core tasks in many applications such as autonomous driving and augmented reality. However, to train CNNs…

Computer Vision and Pattern Recognition · Computer Science 2019-01-11 Yang Zhang , Philip David , Hassan Foroosh , Boqing Gong

In this paper we investigate image generation guided by hand sketch. When the input sketch is badly drawn, the output of common image-to-image translation follows the input edges due to the hard condition imposed by the translation process.…

Computer Vision and Pattern Recognition · Computer Science 2018-07-27 Yongyi Lu , Shangzhe Wu , Yu-Wing Tai , Chi-Keung Tang

In the compressive learning theory, instead of solving a statistical learning problem from the input data, a so-called sketch is computed from the data prior to learning. The sketch has to capture enough information to solve the problem…

Machine Learning · Statistics 2019-10-23 Michael P. Sheehan , Antoine Gonon , Mike E. Davies

Sketch-an-Anchor is a novel method to train state-of-the-art Zero-shot Sketch-based Image Retrieval (ZSSBIR) models in under an epoch. Most studies break down the problem of ZSSBIR into two parts: domain alignment between images and…

Computer Vision and Pattern Recognition · Computer Science 2023-03-30 Leo Sampaio Ferraz Ribeiro , Moacir Antonelli Ponti

Iteratively refining and critiquing sketches are crucial steps to developing effective designs. We introduce Scones, a mixed-initiative, machine-learning-driven system that enables users to iteratively author sketches from text…

Human-Computer Interaction · Computer Science 2020-05-19 Forrest Huang , Eldon Schoop , David Ha , John Canny

Sketches make an intuitive and powerful visual expression as they are fast executed freehand drawings. We present a method for synthesizing realistic photos from scene sketches. Without the need for sketch and photo pairs, our framework…

Computer Vision and Pattern Recognition · Computer Science 2022-09-08 Jiayun Wang , Sangryul Jeon , Stella X. Yu , Xi Zhang , Himanshu Arora , Yu Lou

In this work, we investigate the problem of sketch-based object localization on natural images, where given a crude hand-drawn sketch of an object, the goal is to localize all the instances of the same object on the target image. This…

Computer Vision and Pattern Recognition · Computer Science 2023-03-16 Aditay Tripathi , Anand Mishra , Anirban Chakraborty

Sketch segmentation involves grouping pixels within a sketch that belong to the same object or instance. It serves as a valuable tool for sketch editing tasks, such as moving, scaling, or removing specific components. While image…

Computer Vision and Pattern Recognition · Computer Science 2025-05-07 Mia Tang , Yael Vinker , Chuan Yan , Lvmin Zhang , Maneesh Agrawala

Understanding the informative structures of scenes is essential for low-level vision tasks. Unfortunately, it is difficult to obtain a concrete visual definition of the informative structures because influences of visual features are…

Computer Vision and Pattern Recognition · Computer Science 2025-06-04 Jisu Shin , Seunghyun Shin , Hae-Gon Jeon

3D Content Generation is at the heart of many computer graphics applications, including video gaming, film-making, virtual and augmented reality, etc. This paper proposes a novel deep-learning based approach for automatically generating…

Computer Vision and Pattern Recognition · Computer Science 2026-02-09 Yongzhi Xu , Yonhon Ng , Yifu Wang , Inkyu Sa , Yunfei Duan , Zhenhong Sun , Yang Li , Pan Ji , Hongdong Li

Sketches are highly expressive, inherently capturing subjective and fine-grained visual cues. The exploration of such innate properties of human sketches has, however, been limited to that of image retrieval. In this paper, for the first…

Computer Vision and Pattern Recognition · Computer Science 2023-10-31 Pinaki Nath Chowdhury , Ayan Kumar Bhunia , Aneeshan Sain , Subhadeep Koley , Tao Xiang , Yi-Zhe Song

Sketching is widely used in randomized linear algebra for low-rank matrix approximation, column subset selection, and many other problems, and it has gained significant traction in machine learning applications. However, sketching large…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-03-24 Hussam Al Daas , Grey Ballard , Laura Grigori , Md Taufique Hussain , Suraj Kumar , Mohammad Marufur Rahman , Kathryn Rouse