English
Related papers

Related papers: Stealing Creator's Workflow: A Creator-Inspired Ag…

200 papers

Motivation: Building and iterating machine learning models is often a resource-intensive process. In biomedical research, scientific codebases can lack scalability and are not easily transferable to work beyond what they were intended.…

Machine Learning · Computer Science 2025-04-03 Khoa A. Tran , John V. Pearson , Nicola Waddell

Web agents, which couple language models with browsing and tool-use capabilities, show promise as open web assistants. Yet progress is increasingly limited by the lack of scalable, process-level supervision. Existing benchmarks are largely…

Artificial Intelligence · Computer Science 2026-05-29 Tenghao Huang , Kung-Hsiang Huang , Prafulla Kumar Choubey , Yilun Zhou , Muhao Chen , Jonathan May , Chien-Sheng Wu

Providing high-quality feedback on student assignments is crucial for student success, but it is heavily limited by time and budgetary constraints. In this work, we introduce Synthetic Educational Feedback Loops (SEFL), a synthetic data…

Computation and Language · Computer Science 2026-02-25 Mike Zhang , Amalie Pernille Dilling , Léon Gondelman , Niels Erik Ruan Lyngdorf , Euan D. Lindsay , Johannes Bjerva

Large Language Models (LLMs) motivate generative agent simulation (e.g., AI Town) to create a ``dynamic world'', holding immense value across entertainment and research. However, for non-experts, especially those without programming skills,…

Human-Computer Interaction · Computer Science 2026-01-30 Jianwen Sun , Yukang Feng , Kaining Ying , Chuanhao Li , Zizhen Li , Fanrui Zhang , Jiaxin Ai , Yifan Chang , Yu Dai , Yifei Huang , Kaipeng Zhang

Audience feedback is crucial for refining video content, yet it typically comes after publication, limiting creators' ability to make timely adjustments. To bridge this gap, we introduce SimTube, a generative AI system designed to simulate…

Human-Computer Interaction · Computer Science 2024-11-19 Yu-Kai Hung , Yun-Chien Huang , Ting-Yu Su , Yen-Ting Lin , Lung-Pan Cheng , Bryan Wang , Shao-Hua Sun

Despite advancements in multimodal large language models (MLLMs), current approaches struggle in medium-to-long video understanding due to frame and context length limitations. As a result, these models often depend on frame sampling, which…

Computer Vision and Pattern Recognition · Computer Science 2025-04-25 Shehreen Azad , Vibhav Vineet , Yogesh Singh Rawat

If the video has long been mentioned as a widespread visualization form, the animation sequence in the video is mentioned as storytelling for people. Producing an animation requires intensive human labor from skilled professional artists to…

Computer Vision and Pattern Recognition · Computer Science 2023-11-14 Thi-Ngoc-Hanh Le , Sheng-Yi Yao , Chun-Te Wu , Tong-Yee Lee

Understanding ultra-long videos such as egocentric recordings, live streams, or surveillance footage spanning days to weeks, remains a challenge. For current multimodal LLMs: even with million-token context windows, frame budgets cover only…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Jiazheng Li , Chi-Hao Wu , Yunze Liu , Kaize Ding , Jundong Li , Chuxu Zhang

The transition from monolithic large language models (LLMs) to modular, skill-equipped agents represents a fundamental architectural shift in artificial intelligence deployment. While general-purpose models demonstrate remarkable breadth in…

Artificial Intelligence · Computer Science 2026-03-18 Shuzhen Bi , Mengsong Wu , Hao Hao , Keqian Li , Wentao Liu , Siyu Song , Hongbo Zhao , Aimin Zhou

Sketching serves as a versatile tool for externalizing ideas, enabling rapid exploration and visual communication that spans various disciplines. While artificial systems have driven substantial advances in content creation and…

Computer Vision and Pattern Recognition · Computer Science 2024-11-27 Yael Vinker , Tamar Rott Shaham , Kristine Zheng , Alex Zhao , Judith E Fan , Antonio Torralba

Video storytelling is engaging multimedia content that utilizes video and its accompanying narration to attract the audience, where a key challenge is creating narrations for recorded visual scenes. Previous studies on dense video…

Multimedia · Computer Science 2024-12-31 Dingyi Yang , Chunru Zhan , Ziheng Wang , Biao Wang , Tiezheng Ge , Bo Zheng , Qin Jin

The applications of conversational agents for scientific disciplines (as expert domains) are understudied due to the lack of dialogue data to train such agents. While most data collection frameworks, such as Amazon Mechanical Turk, foster…

Computation and Language · Computer Science 2022-10-14 Federico Ruggeri , Mohsen Mesgar , Iryna Gurevych

Large language models (LLMs) show the promise in supporting scientific research implementation, yet their ability to generate correct and executable code remains limited. Existing works largely adopt one-shot settings, ignoring the…

Automated long-form story generation typically employs long-context large language models (LLMs) for one-shot creation, which can produce cohesive but not necessarily engaging content. We introduce Storytelling With Action Guidance (SWAG),…

Computation and Language · Computer Science 2024-10-10 Zeeshan Patel , Karim El-Refai , Jonathan Pei , Tianle Li

Large language models (LLMs) are increasingly used across the scientific workflow, including to draft peer-review reports. However, many AI-generated reviews are superficial and insufficiently actionable, leaving authors without concrete,…

Computation and Language · Computer Science 2026-04-29 Sihong Wu , Yiling Ma , Yilun Zhao , Tiansheng Hu , Owen Jiang , Manasi Patwardhan , Arman Cohan

Evaluating short-form video content requires moving beyond surface-level quality metrics toward human-aligned, multimodal reasoning. While existing frameworks like VideoScore-2 assess visual and semantic fidelity, they do not capture how…

Computer Vision and Pattern Recognition · Computer Science 2025-12-29 Arnav Gupta , Gurekas Singh Sahney , Hardik Rathi , Abhishek Chandwani , Ishaan Gupta , Pratik Narang , Dhruv Kumar

Traditional approaches to test case generation often involve manual effort and incur significant computational overhead. Additionally, these approaches are not scalable, and hence, unsuitable for complex software systems. Recently, Large…

Software Engineering · Computer Science 2026-05-05 Kushal Jasti , Tejamani Prashanth Sahu , Rishitha Pentyala , Muvvala Mohit , Vivek Yelleti

High-quality speech dialogue datasets are crucial for Speech-LLM development, yet existing acquisition methods face significant limitations. Human recordings incur high costs and privacy concerns, while synthetic approaches often lack…

Computation and Language · Computer Science 2025-04-01 Minghan Wang , Ye Bai , Yuxia Wang , Thuy-Trang Vu , Ehsan Shareghi , Gholamreza Haffari

Existing multi-agent Large Language Model (LLM) frameworks for code generation typically use execution feedback and improve iteratively using Input/Output (I/O) test cases. However, this does not work for scientific workflows, where I/O…

Software Engineering · Computer Science 2026-04-28 Siddeshwar Raghavan , Tanwi Mallick

We propose a fully automated AI system that produces short comedic videos similar to sketch shows such as Saturday Night Live. Starting with character references, the system employs a population of agents loosely based on real production…

Computer Vision and Pattern Recognition · Computer Science 2026-03-12 Susung Hong , Brian Curless , Ira Kemelmacher-Shlizerman , Steve Seitz