English
Related papers

Related papers: SlideGen: Collaborative Multimodal Agents for Scie…

200 papers

Interactive documents help readers engage with complex ideas through dynamic visualization, interactive animations, and exploratory interfaces. However, creating such documents remains costly, as it requires both domain expertise and web…

Human-Computer Interaction · Computer Science 2026-03-31 Yinghao Tang , Yupeng Xie , Yingchaojie Feng , Tingfeng Lan , Jiale Lao , Yue Cheng , Wei Chen

Generating presentation slides is a time-consuming task that urgently requires automation. Due to their limited flexibility and lack of automated refinement mechanisms, existing autonomous LLM-based agents face constraints in real-world…

Computation and Language · Computer Science 2025-02-24 Yunqing Xu , Xinbei Ma , Jiyang Qiu , Hai Zhao

In this paper, we introduce SciGen, a new challenge dataset for the task of reasoning-aware data-to-text generation consisting of tables from scientific articles and their corresponding descriptions. Describing scientific tables goes beyond…

Computation and Language · Computer Science 2021-04-20 Nafise Sadat Moosavi , Andreas Rücklé , Dan Roth , Iryna Gurevych

Synthetic data offers a scalable solution for vision-language pre-training, yet current state-of-the-art methods typically rely on scaling up a single generative backbone, which introduces generator-specific spectral biases and limits…

Computer Vision and Pattern Recognition · Computer Science 2026-02-03 Leonardo Brusini , Cristian Sbrolli , Eugenio Lomurno , Toshihiko Yamasaki , Matteo Matteucci

Presentation slides describing the content of scientific and technical papers are an efficient and effective way to present that work. However, manually generating presentation slides is labor intensive. We propose a method to automatically…

Computation and Language · Computer Science 2021-06-08 Athar Sefid , Jian Wu , Prasenjit Mitra , Lee Giles

Automatically generating presentations from documents is a challenging task that requires accommodating content quality, visual appeal, and structural coherence. Existing methods primarily focus on improving and evaluating the content…

Artificial Intelligence · Computer Science 2025-02-24 Hao Zheng , Xinyan Guan , Hao Kong , Jia Zheng , Weixiang Zhou , Hongyu Lin , Yaojie Lu , Ben He , Xianpei Han , Le Sun

Lecture slide presentations, a sequence of pages that contain text and figures accompanied by speech, are constructed and presented carefully in order to optimally transfer knowledge to students. Previous studies in multimedia and…

Artificial Intelligence · Computer Science 2022-08-18 Dong Won Lee , Chaitanya Ahuja , Paul Pu Liang , Sanika Natu , Louis-Philippe Morency

Preparing high-quality instructional materials remains a labor-intensive process that often requires extensive coordination among teaching faculty, instructional designers, and teaching assistants. In this work, we present Instructional…

Artificial Intelligence · Computer Science 2026-02-03 Huaiyuan Yao , Wanpeng Xu , Justin Turnau , Nadia Kellam , Hua Wei

Creating high-quality figures and visualizations for scientific papers is a time-consuming task that requires both deep domain knowledge and professional design skills. Despite over 2.5 million scientific papers published annually, the…

Artificial Intelligence · Computer Science 2026-01-09 Siyuan Huang , Yutong Gao , Juyang Bai , Yifan Zhou , Zi Yin , Xinxin Liu , Rama Chellappa , Chun Pong Lau , Sayan Nag , Cheng Peng , Shraman Pramanick

Generating texts in scientific papers requires not only capturing the content contained within the given input but also frequently acquiring the external information called \textit{context}. We push forward the scientific text generation by…

Computation and Language · Computer Science 2021-10-22 Hong Chen , Hiroya Takamura , Hideki Nakayama

Generating engaging, accurate short-form videos from scientific papers is challenging due to content complexity and the gap between expert authors and readers. Existing end-to-end methods often suffer from factual inaccuracies and visual…

Computation and Language · Computer Science 2025-04-29 Jong Inn Park , Maanas Taneja , Qianwen Wang , Dongyeop Kang

Real-world design documents (e.g., posters) are inherently multi-layered, combining decoration, text, and images. Editing them from natural-language instructions requires fine-grained, layer-aware reasoning to identify relevant layers and…

Computer Vision and Pattern Recognition · Computer Science 2026-01-30 Zihao Lin , Wanrong Zhu , Jiuxiang Gu , Jihyung Kil , Christopher Tensmeyer , Lin Zhang , Shilong Liu , Ruiyi Zhang , Lifu Huang , Vlad I. Morariu , Tong Sun

Understanding scientific papers requires more than answering isolated questions or summarizing content. It involves an integrated reasoning process that grounds textual and visual information, interprets experimental evidence, synthesizes…

Information Retrieval · Computer Science 2026-04-29 Yanjun Zhao , Tianxin Wei , Jiaru Zou , Xuying Ning , Yuanchen Bei , Lingjie Chen , Simmi Rana , Wendy H. Yang , Hanghang Tong , Jingrui He

Enabling machines to understand structured visuals like slides and user interfaces is essential for making them accessible to people with disabilities. However, achieving such understanding computationally has required manual data…

Computer Vision and Pattern Recognition · Computer Science 2024-10-02 Yi-Hao Peng , Faria Huq , Yue Jiang , Jason Wu , Amanda Xin Yue Li , Jeffrey Bigham , Amy Pavel

Editing presentation slides is a frequent yet tedious task, ranging from creative layout design to repetitive text maintenance. While recent GUI-based agents powered by Multimodal LLMs (MLLMs) excel at tasks requiring visual perception,…

Computation and Language · Computer Science 2026-05-12 Kyudan Jung , Hojun Cho , Jooyeol Yun , Soyoung Yang , Jaehyeok Jang , Jaegul Choo

Comprehending long visual documents, where information is distributed across extensive pages of text and visual elements, is a critical but challenging task for modern Vision-Language Models (VLMs). Existing approaches falter on a…

Computer Vision and Pattern Recognition · Computer Science 2025-11-17 Dawei Zhu , Rui Meng , Jiefeng Chen , Sujian Li , Tomas Pfister , Jinsung Yoon

The exponential growth of scientific literature in PDF format necessitates advanced tools for efficient and accurate document understanding, summarization, and content optimization. Traditional methods fall short in handling complex layouts…

Computer Vision and Pattern Recognition · Computer Science 2025-08-12 Kun Qian , Wenjie Li , Tianyu Sun , Wenhong Wang , Wenhan Luo

Recent advancements in multimodal large language models (MLLMs) and video agent systems have significantly improved general video understanding. However, when applied to scientific video understanding and educating, a domain that demands…

Computer Vision and Pattern Recognition · Computer Science 2025-11-25 Zhiyu Xu , Weilong Yan , Yufei Shi , Xin Meng , Tao He , Huiping Zhuang , Ming Li , Hehe Fan

Producing presentation slides automatically entails coordinating narrative structure with page-level graphic design under strict spatial constraints. For such structured multimodal tasks, a well-organized design process is essential to…

Human-Computer Interaction · Computer Science 2026-05-27 Zhiyao Cui , Chenxu Wang , Shuyue Hu , Yiqun Zhang , Wenqi Shao , Qiaosheng Zhang , Zhen Wang

Modern vision--language models (VLMs) are increasingly used to interpret and generate educational content, yet their semantic outputs remain challenging to verify, reproduce, and audit over time. Inconsistencies across model families,…

Computer Vision and Pattern Recognition · Computer Science 2026-01-01 Md Motaleb Hossen Manik , Md Zabirul Islam , Ge Wang