English
Related papers

Related papers: LogoMotion: Visually-Grounded Code Synthesis for C…

200 papers

Generative AI is reshaping product design practices through "vibe coding," where product team members express intent in natural language and AI translates it into functional prototypes and code. Despite rapid adoption, little research has…

Human-Computer Interaction · Computer Science 2026-05-04 Jie Li , Youyang Hou , Laura Lin , Ruihao Zhu , Hancheng Cao , Abdallah El Ali

Image animation is a key task in computer vision which aims to generate dynamic visual content from static image. Recent image animation methods employ neural based rendering technique to generate realistic animations. Despite these…

Computer Vision and Pattern Recognition · Computer Science 2023-12-06 Zuozhuo Dai , Zhenghao Zhang , Yao Yao , Bingxue Qiu , Siyu Zhu , Long Qin , Weizhi Wang

Creative coding is an experimentation-heavy activity that requires translating high-level visual ideas into code. However, most languages and libraries for creative coding may not be adequately intuitive for beginners. In this paper, we…

Programming Languages · Computer Science 2024-04-17 Mark Edward M. Gonzales , Hans Oswald A. Ibrahim , Elyssia Barrie H. Ong , Ryan Austin Fernandez

AI code generation tools have expanded software creation beyond professional developers, giving rise to vibe coding, a practice in which users generate software via natural-language prompts, evaluate outputs primarily by execution. Prior…

Software Engineering · Computer Science 2026-05-26 Ahmed Fawzy , Amjed Tahir , Kelly Blincoe

AI-powered coding assistants, like GitHub Copilot, are increasingly used to boost developers' productivity. However, their output quality hinges on the contextual richness of the prompts. Meanwhile, gaze behaviour carries rich cognitive…

Human-Computer Interaction · Computer Science 2025-11-12 Yasmine Elfares , Gül Çalikli , Mohamed Khamis

Video generation has achieved rapid progress benefiting from high-quality renderings provided by powerful image generators. We regard the video synthesis task as generating a sequence of images sharing the same contents but varying in…

Computer Vision and Pattern Recognition · Computer Science 2023-03-07 Jingyuan Zhu , Huimin Ma , Jiansheng Chen , Jian Yuan

Generative AI agents are reshaping human-computer interaction, shifting users from direct task execution to supervising machine-driven actions, especially the rise of "vibe coding" in programming. Yet little is known about how screen reader…

Human-Computer Interaction · Computer Science 2025-12-12 Nan Chen , Luna K. Qiu , Arran Zeyu Wang , Zilong Wang , Yuqing Yang

Text-driven motion generation offers a powerful and intuitive way to create human movements directly from natural language. By removing the need for predefined motion inputs, it provides a flexible and accessible approach to controlling…

Computer Vision and Pattern Recognition · Computer Science 2025-05-15 Ali Rida Sahili , Najett Neji , Hedi Tabia

This demo is about automatic authoring of various motion effects that are provided with audiovisual content to improve user experiences. Traditionally, motion effects have been used for simulators, e.g., flight simulators for pilots and…

Human-Computer Interaction · Computer Science 2024-11-11 Jiwan Lee , Seungmoon Choi

In this paper we present a new deep learning-driven approach to image-based synthesis of animations involving humanoid characters. Unlike previous deep approaches to image-based animation our method makes no assumptions on the type of…

Graphics · Computer Science 2019-08-14 John Kanji , David I. W. Levin

Current motion-controlled image-to-video generation models rigidly follow user-provided trajectories that are often sparse, imprecise, and causally incomplete. Such reliance often yields unnatural or implausible outcomes, especially by…

Computer Vision and Pattern Recognition · Computer Science 2026-05-22 Lee Hsin-Ying , Hanwen Jiang , Yiqun Mei , Jing Shi , Ming-Hsuan Yang , Zhixin Shu

This paper introduces a framework, called EMOTION, for generating expressive motion sequences in humanoid robots, enhancing their ability to engage in humanlike non-verbal communication. Non-verbal cues such as facial expressions, gestures,…

Robotics · Computer Science 2024-10-31 Peide Huang , Yuhan Hu , Nataliya Nechyporenko , Daehwa Kim , Walter Talbott , Jian Zhang

This study presents a theory-inspired visual narrative generative system that integrates conceptual principles-comic authoring idioms-with generative and language models to enhance the comic creation process. Our system combines human…

Artificial Intelligence · Computer Science 2024-09-27 Yi-Chun Chen , Arnav Jhala

Text-to-motion generation is driven by learning motion representations for semantic alignment with language. Existing methods rely on either continuous or discrete motion representations. However, continuous representations entangle…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Dawei Guan , Di Yang , Chengjie Jin , Jiangtao Wang

Low-code programming allows citizen developers to create programs with minimal coding effort, typically via visual (e.g. drag-and-drop) interfaces. In parallel, recent AI-powered tools such as Copilot and ChatGPT generate programs from…

Software Engineering · Computer Science 2023-06-01 Nikitha Rao , Jason Tsay , Kiran Kate , Vincent J. Hellendoorn , Martin Hirzel

Text-to-motion generation, which translates textual descriptions into human motions, faces the challenge that users often struggle to precisely convey their intended motions through text alone. To address this issue, this paper introduces…

Computer Vision and Pattern Recognition · Computer Science 2026-05-21 Tao Wang , Lei Jin , Zhihua Wu , Qiaozhi He , Jiaming Chu , Yu Cheng , Junliang Xing , Jian Zhao , Shuicheng Yan , Li Wang

During software front-end development, the work to convert Graphical User Interface(GUI) image to the corresponding front-end code is an inevitable tedious work. There have been some attempts to make this work to be automatic. However, the…

Machine Learning · Computer Science 2020-07-08 Xiaoling Huang , Feng Liao

Filmmaking and animation production often require sophisticated techniques for coordinating camera transitions and object movements, typically involving labor-intensive real-world capturing. Despite advancements in generative AI for video…

Computer Vision and Pattern Recognition · Computer Science 2024-06-24 Yaowei Li , Xintao Wang , Zhaoyang Zhang , Zhouxia Wang , Ziyang Yuan , Liangbin Xie , Yuexian Zou , Ying Shan

Graphic layout generation is a growing research area focusing on generating aesthetically pleasing layouts ranging from poster designs to documents. While recent research has explored ways to incorporate user constraints to guide the layout…

Generating reasonable and high-quality human interactive motions in a given dynamic environment is crucial for understanding, modeling, transferring, and applying human behaviors to both virtual and physical robots. In this paper, we…

Computer Vision and Pattern Recognition · Computer Science 2025-03-04 Peishan Cong , Ziyi Wang , Yuexin Ma , Xiangyu Yue