English
Related papers

Related papers: Polymind: Parallel Visual Diagramming with Large L…

200 papers

Prewriting is the process of discovering and developing ideas before a first draft, which requires divergent thinking and often implies unstructured strategies such as diagramming, outlining, free-writing, etc. Although large language…

Human-Computer Interaction · Computer Science 2024-03-01 Qian Wan , Siying Hu , Yu Zhang , Piaohong Wang , Bo Wen , Zhicong Lu

The integration of AI assistants into software development workflows is rapidly evolving, shifting from automation-assisted tasks to collaborative interactions between developers and AI. Large Language Models (LLMs) have demonstrated their…

Software Engineering · Computer Science 2025-06-16 Benedetta Donato , Leonardo Mariani , Daniela Micucci , Oliviero Riganelli , Marco Somaschini

Human reasoning relies on constructing and manipulating mental models -- simplified internal representations of situations used to understand and solve problems. Conceptual diagrams (e.g., a sketch drawn to aid reasoning) externalize these…

Artificial Intelligence · Computer Science 2025-09-30 Nasim Borazjanizadeh , Roei Herzig , Eduard Oks , Trevor Darrell , Rogerio Feris , Leonid Karlinsky

The rapidly evolving field of Robotic Process Automation (RPA) has made significant strides in automating repetitive processes, yet its effectiveness diminishes in scenarios requiring spontaneous or unpredictable tasks demanded by users.…

Computation and Language · Computer Science 2024-04-23 Zhen Zeng , William Watson , Nicole Cho , Saba Rahimi , Shayleen Reynolds , Tucker Balch , Manuela Veloso

Large Language Models (LLMs) have demonstrated exceptional abilities in reasoning for task planning. However, challenges remain under-explored for parallel schedules. This paper introduces a novel paradigm, plan-over-graph, in which the…

Artificial Intelligence · Computer Science 2025-02-21 Shiqi Zhang , Xinbei Ma , Zouying Cao , Zhuosheng Zhang , Hai Zhao

Recent advances in large language models (LLMs) have shown great potential in automating the process of visualization authoring through simple natural language utterances. However, instructing LLMs using natural language is limited in…

Human-Computer Interaction · Computer Science 2025-04-21 Zhen Wen , Luoxuan Weng , Yinghao Tang , Runjin Zhang , Yuxin Liu , Bo Pan , Minfeng Zhu , Wei Chen

Large language models (LLMs) have demonstrated remarkable potential in natural language understanding and generation, making them valuable tools for enhancing conversational interactions. However, LLMs encounter challenges such as lacking…

Human-Computer Interaction · Computer Science 2023-11-10 Guinan Su , Yanwu Yang , Jie Guo

Social interactions are fundamental to human life. The recent emergence of large language models (LLMs)-based virtual assistants has demonstrated their potential to revolutionize human interactions and lifestyles. However, existing…

Artificial Intelligence · Computer Science 2024-12-06 Bufang Yang , Yunqi Guo , Lilin Xu , Zhenyu Yan , Hongkai Chen , Guoliang Xing , Xiaofan Jiang

Table reasoning requires models to jointly perform comprehensive semantic understanding and precise numerical operations. Although recent large language model (LLM)-based methods have achieved promising results, most of them still rely on a…

Artificial Intelligence · Computer Science 2025-12-23 Chuang Jiang , Mingyue Cheng , Xiaoyu Tao , Qingyang Mao , Jie Ouyang , Qi Liu

In recent years, online lecture videos have become an increasingly popular resource for acquiring new knowledge. Systems capable of effectively understanding/indexing lecture videos are thus highly desirable, enabling downstream tasks like…

Computer Vision and Pattern Recognition · Computer Science 2025-03-04 Kangda Wei , Zhengyu Zhou , Bingqing Wang , Jun Araki , Lukas Lange , Ruihong Huang , Zhe Feng

Effective ideation requires both broad exploration of diverse ideas and deep evaluation of their potential. Generative AI can support such processes, but current tools typically emphasize either generating many ideas or supporting in-depth…

Human-Computer Interaction · Computer Science 2025-10-01 Yaqing Yang , Vikram Mohanty , Yan-Ying Chen , Matthew K. Hong , Nikolas Martelaro , Aniket Kittur

While Multimodal Large Language Models (MLLMs) excel at visual understanding, they often struggle in complex scenarios that require visual planning and imagination. Inspired by how humans use sketching as a form of visual thinking to…

Computer Vision and Pattern Recognition · Computer Science 2025-10-29 Huanyu Zhang , Wenshan Wu , Chengzu Li , Ning Shang , Yan Xia , Yangyu Huang , Yifan Zhang , Li Dong , Zhang Zhang , Liang Wang , Tieniu Tan , Furu Wei

Large Language Model (LLM) agents have developed rapidly in recent years to solve complex real-world problems using external tools. However, the scarcity of high-quality trajectories still hinders the development of stronger LLM agents.…

Artificial Intelligence · Computer Science 2025-12-08 Chen Yang , Ran Le , Yun Xing , Zhenwei An , Zongchao Chen , Wayne Xin Zhao , Yang Song , Tao Zhang

Information graphics are pivotal in effective information dissemination and storytelling. However, creating such graphics is extremely challenging for non-professionals, since the design process requires multifaceted skills and…

Human-Computer Interaction · Computer Science 2024-01-25 Qirui Huang , Min Lu , Joel Lanir , Dani Lischinski , Daniel Cohen-Or , Hui Huang

Large Language Models (LLMs) are increasingly employed in multi-turn conversational tasks, yet their pre-training data predominantly consists of continuous prose, creating a potential mismatch between required capabilities and training…

Computation and Language · Computer Science 2025-07-09 Jing Yang Lee , Hamed Bonab , Nasser Zalmout , Ming Zeng , Sanket Lokegaonkar , Colin Lockard , Binxuan Huang , Ritesh Sarkhel , Haodong Wang

Planning is an important capability of artificial agents that perform long-horizon tasks in real-world environments. In this work, we explore the use of pre-trained language models (PLMs) to reason about plan sequences from text…

Computation and Language · Computer Science 2023-03-17 Anthony Z. Liu , Lajanugen Logeswaran , Sungryull Sohn , Honglak Lee

MindMapping is a well-known technique used in note taking, which encourages learning and studying. MindMapping has been manually adopted to help present knowledge and concepts in a visual form. Unfortunately, there is no reliable automated…

Computation and Language · Computer Science 2014-12-24 Mohamed Elhoseiny , Ahmed Elgammal

The development of large language models (LLMs) capable of following instructions and engaging in conversational interactions sparked increased interest in their utilization across various support tools. We investigate the utility of modern…

Human-Computer Interaction · Computer Science 2024-01-31 Tuhin Chakrabarty , Vishakh Padmakumar , Faeze Brahman , Smaranda Muresan

The rapid progress of large language models (LLMs) has opened new opportunities for education. While learners can interact with academic papers through LLM-powered dialogue, limitations still exist: the lack of structured organization and…

Human-Computer Interaction · Computer Science 2026-04-02 Yuheng Yang , Wenjia Jiang , Yang Wang , Yi Song , Yiwei Wang , Chi Zhang

Consensus building is inherently challenging due to the diverse opinions held by stakeholders. Effective facilitation is crucial to support the consensus building process and enable efficient group decision making. However, the…

Human-Computer Interaction · Computer Science 2025-10-23 Wen Gu , Zhaoxing Li , Jan Buermann , Jim Dilkes , Dimitris Michailidis , Shinobu Hasegawa , Vahid Yazdanpanah , Sebastian Stein
‹ Prev 1 2 3 10 Next ›