English
Related papers

Related papers: From Pixels to Paths: A Multi-Agent Framework for …

200 papers

Scientific sketches (e.g., models) offer a powerful lens into students' conceptual understanding, yet AI-powered automated assessment of such free-form, visually diverse artifacts remains a critical challenge. Existing solutions often treat…

Human-Computer Interaction · Computer Science 2025-10-21 Ehsan Latif , Zirak Khan , Xiaoming Zhai

Vision-Language Models (VLMs) frequently misread values, hallucinate details, and confuse overlapping elements in charts. Current approaches rely solely on pixel interpretation, creating a Pixel-Only Bottleneck: agents treat interactive…

Computation and Language · Computer Science 2026-04-24 Yiyang Lu , Woong Shin , Ahmad Maroof Karimi , Feiyi Wang , Jie Ren , Evgenia Smirni

Recent advances in diffusion-based text-to-image generation have demonstrated promising results through visual condition control. However, existing ControlNet-like methods struggle with compositional visual conditioning - simultaneously…

Computer Vision and Pattern Recognition · Computer Science 2026-05-25 Yanjie Pan , Qingdong He , Zhengkai Jiang , Pengcheng Xu , Chaoyi Wang , Jinlong Peng , Haoxuan Wang , Yun Cao , Zhenye Gan , Mingmin Chi , Bo Peng , Yabiao Wang

Story visualization is the transformation of narrative elements into image sequences. While existing research has primarily focused on visual contextual coherence, the deeper narrative essence of stories often remains overlooked. This…

Computer Vision and Pattern Recognition · Computer Science 2025-03-05 Seungkwon Kim , GyuTae Park , Sangyeon Kim , Seung-Hun Nam

Scientific data visualization is pivotal for transforming raw data into comprehensible visual representations, enabling pattern recognition, forecasting, and the presentation of data-driven insights. However, novice users often face…

Computation and Language · Computer Science 2025-02-04 Kanika Goswami , Puneet Mathur , Ryan Rossi , Franck Dernoncourt

While modern visual generation models excel at creating aesthetically pleasing natural images, they struggle with producing or editing structured visuals like charts, diagrams, and mathematical figures, which demand composition planning,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-05 Le Zhuo , Songhao Han , Yuandong Pu , Boxiang Qiu , Sayak Paul , Yue Liao , Yihao Liu , Jie Shao , Xi Chen , Si Liu , Hongsheng Li

Despite rapid advances in autonomous AI scientists powered by language models, generating publication-ready illustrations remains a labor-intensive bottleneck in the research workflow. To lift this burden, we introduce PaperBanana, an…

Computation and Language · Computer Science 2026-03-25 Dawei Zhu , Rui Meng , Yale Song , Xiyu Wei , Sujian Li , Tomas Pfister , Jinsung Yoon

Real-world design documents (e.g., posters) are inherently multi-layered, combining decoration, text, and images. Editing them from natural-language instructions requires fine-grained, layer-aware reasoning to identify relevant layers and…

Computer Vision and Pattern Recognition · Computer Science 2026-01-30 Zihao Lin , Wanrong Zhu , Jiuxiang Gu , Jihyung Kil , Christopher Tensmeyer , Lin Zhang , Shilong Liu , Ruiyi Zhang , Lifu Huang , Vlad I. Morariu , Tong Sun

Recent advances in vision-language models (VLMs) have expanded their multimodal code generation capabilities, yet their ability to generate executable visualization code from plots, especially for complex 3D, animated, plot-to-plot…

Human-Computer Interaction · Computer Science 2026-01-21 Yi Zhao , Zhen Yang , Shuaiqi Duan , Wenmeng Yu , Zhe Su , Jibing Gong , Jie Tang

Graphic design images consist of multiple editable layers, such as text, background, and decorative elements, while most generative models produce rasterized outputs without explicit layer structures, limiting downstream editing. Existing…

Computer Vision and Pattern Recognition · Computer Science 2026-04-22 Weidong Chen , Dexiang Hong , Zhendong Mao , Yutao Cheng , Xinyan Liu , Lei Zhang , Yongdong Zhang

Modern image editing models produce realistic results but struggle with abstract, multi step instructions (e.g., ``make this advertisement more vegetarian-friendly''). Prior agent based methods decompose such tasks but rely on handcrafted…

Computer Vision and Pattern Recognition · Computer Science 2026-05-15 Anirudh Sundara Rajan , Krishna Kumar Singh , Yong Jae Lee

Visual designers naturally draw inspiration from multiple visual references, combining diverse elements and aesthetic principles to create artwork. However, current image generative frameworks predominantly rely on single-source inputs --…

Computer Vision and Pattern Recognition · Computer Science 2025-08-27 Ruoxi Chen , Dongping Chen , Siyuan Wu , Sinan Wang , Shiyun Lang , Petr Sushko , Gaoyang Jiang , Yao Wan , Ranjay Krishna

Large Multi-modality Models (LMMs) have made significant progress in visual understanding and generation, but they still face challenges in General Visual Editing, particularly in following complex instructions, preserving appearance…

Computer Vision and Pattern Recognition · Computer Science 2025-05-28 Xiangyu Zhao , Peiyuan Zhang , Kexian Tang , Xiaorong Zhu , Hao Li , Wenhao Chai , Zicheng Zhang , Renqiu Xia , Guangtao Zhai , Junchi Yan , Hua Yang , Xue Yang , Haodong Duan

Real-world visualization tasks involve complex, multi-modal requirements that extend beyond simple text-to-chart generation, requiring reference images, code examples, and iterative refinement. Current systems exhibit fundamental…

Computation and Language · Computer Science 2026-01-27 Jinwei Lu , Yuanfeng Song , Chen Zhang , Raymond Chi-Wing Wong

Generating academic slides from scientific papers is a challenging multimodal reasoning task that requires both long context understanding and deliberate visual planning. Existing approaches largely reduce it to text only summarization,…

Artificial Intelligence · Computer Science 2025-12-10 Xin Liang , Xiang Zhang , Yiwei Xu , Siqi Sun , Chenyu You

Scientific data visualization plays a crucial role in research by enabling the direct display of complex information and assisting researchers in identifying implicit patterns. Despite its importance, the use of Large Language Models (LLMs)…

Computation and Language · Computer Science 2024-03-20 Zhiyu Yang , Zihan Zhou , Shuo Wang , Xin Cong , Xu Han , Yukun Yan , Zhenghao Liu , Zhixing Tan , Pengyuan Liu , Dong Yu , Zhiyuan Liu , Xiaodong Shi , Maosong Sun

Visual documentation is an effective tool for reducing the cognitive barrier developers face when understanding unfamiliar code, enabling more intuitive comprehension. Compared to textual documentation, it provides a higher-level…

Software Engineering · Computer Science 2025-09-16 Luís F. Gomes , Xin Zhou , David Lo , Rui Abreu

In scientific research, analysis requires accurately interpreting complex multimodal knowledge, integrating evidence from different sources, and drawing inferences grounded in domain-specific knowledge. However, current artificial…

Computation and Language · Computer Science 2026-02-13 Xuehang Guo , Zhiyong Lu , Tom Hope , Qingyun Wang

Understanding how scientific ideas evolve requires more than summarizing individual papers-it demands structured, cross-document reasoning over thematically related research. In this work, we formalize multi-document scientific inference, a…

Computation and Language · Computer Science 2025-09-05 Qi Chen , Jingxuan Wei , Zhuoya Yao , Haiguang Wang , Gaowei Wu , Bihui Yu , Siyuan Li , Cheng Tan

The technical complexity of research papers often limits their reach, necessitating more accessible formats like scientific videos to disseminate key insights through engaging narration. However, existing automated methods primarily focus…

Artificial Intelligence · Computer Science 2026-04-22 Xiao Liang , Bangxin Li , Zixuan Chen , Hanyue Zheng , Zhi Ma , Di Wang , Cong Tian , Quan Wang