English
Related papers

Related papers: Patchview: LLM-Powered Worldbuilding with Generati…

200 papers

Thanks to their generative capabilities, large language models (LLMs) have become an invaluable tool for creative processes. These models have the capacity to produce hundreds and thousands of visual and textual outputs, offering abundant…

Human-Computer Interaction · Computer Science 2024-03-15 Sangho Suh , Meng Chen , Bryan Min , Toby Jia-Jun Li , Haijun Xia

We introduce StorySim, a programmable framework for synthetically generating stories to evaluate the theory of mind (ToM) and world modeling (WM) capabilities of large language models (LLMs). Unlike prior benchmarks that may suffer from…

Computation and Language · Computer Science 2026-04-28 Nathaniel Getachew , Abulhair Saparov

Personalized interaction is highly valued by parents in their story-reading activities with children. While AI-empowered story-reading tools have been increasingly used, their abilities to support personalized interaction with children are…

Human-Computer Interaction · Computer Science 2025-03-28 Jiaju Chen , Minglong Tang , Yuxuan Lu , Bingsheng Yao , Elissa Fan , Xiaojuan Ma , Ying Xu , Dakuo Wang , Yuling Sun , Liang He

The emergence of large language models (LLMs) has revolutionized the capabilities of text comprehension and generation. Multi-modal generation attracts great attention from both the industry and academia, but there is little work on…

Information Retrieval · Computer Science 2024-04-16 Xiaoteng Shen , Rui Zhang , Xiaoyan Zhao , Jieming Zhu , Xi Xiao

Analyzing literature involves tracking interactions between characters, locations, and themes. Visualization has the potential to facilitate the mapping and analysis of these complex relationships, but capturing structured information from…

Human-Computer Interaction · Computer Science 2025-08-12 Catherine Yeh , Tara Menon , Robin Singh Arya , Helen He , Moira Weigel , Fernanda Viégas , Martin Wattenberg

Storytelling is a deeply personal and creative process, yet existing methods often treat users as passive consumers, offering generic plots with limited personalization. This undermines engagement and immersion, especially where individual…

Computer Vision and Pattern Recognition · Computer Science 2025-06-30 Minh-Loi Nguyen , Quang-Khai Le , Tam V. Nguyen , Minh-Triet Tran , Trung-Nghia Le

Information Visualization has been utilized to gain insights from complex data. In recent times, Large Language models (LLMs) have performed very well in many tasks. In this paper, we showcase the capabilities of different popular LLMs to…

Human-Computer Interaction · Computer Science 2025-08-01 Saadiq Rauf Khan , Vinit Chandak , Sougata Mukherjea

Personal development through self-directed learning is essential in today's fast-changing world, but many learners struggle to manage it effectively. While AI tools like large language models (LLMs) have the potential for personalized…

Human-Computer Interaction · Computer Science 2025-04-18 Jiwon Chun , Yankun Zhao , Hanlin Chen , Meng Xia

Recent advancements in text-to-image (T2I) generative models have shown remarkable capabilities in producing diverse and imaginative visuals based on text prompts. Despite the advancement, these diffusion models sometimes struggle to…

Computer Vision and Pattern Recognition · Computer Science 2023-11-30 Xiaohui Chen , Yongfei Liu , Yingxiang Yang , Jianbo Yuan , Quanzeng You , Li-Ping Liu , Hongxia Yang

Large Language Models (LLMs) have shown remarkable potential in recommending everyday actions as personal AI assistants, while Explainable AI (XAI) techniques are being increasingly utilized to help users understand why a recommendation is…

We present Large Language Model for Mixed Reality (LLMR), a framework for the real-time creation and modification of interactive Mixed Reality experiences using LLMs. LLMR leverages novel strategies to tackle difficult cases where ideal…

Human-Computer Interaction · Computer Science 2024-03-25 Fernanda De La Torre , Cathy Mengying Fang , Han Huang , Andrzej Banburski-Fahey , Judith Amores Fernandez , Jaron Lanier

We propose leveraging Large Language Models (LLMs) as an interaction layer for medical visualization systems. In domains like healthcare, where users must navigate high-dimensional, coded, and heterogeneous datasets, LLM-generated queries…

Human-Computer Interaction · Computer Science 2025-09-12 Ambre Assor , Hyeon Jeon , Sungbok Shin , Jean-Daniel Fekete

While Large Language Models (LLMs) have demonstrated impressive reasoning and planning abilities in textual domains and can effectively follow instructions for complex tasks, their ability to understand and manipulate spatial relationships…

Artificial Intelligence · Computer Science 2026-01-27 Sha Li , Stefano Petrangeli , Yu Shen , Xiang Chen , Naren Ramakrishnan

The increasing demand for intelligent systems capable of interpreting and reasoning about visual content requires the development of large Vision-and-Language Models (VLMs) that are not only accurate but also have explicit reasoning…

Computer Vision and Pattern Recognition · Computer Science 2024-07-19 Kohei Uehara , Nabarun Goswami , Hanqin Wang , Toshiaki Baba , Kohtaro Tanaka , Tomohiro Hashimoto , Kai Wang , Rei Ito , Takagi Naoya , Ryo Umagami , Yingyi Wen , Tanachai Anakewat , Tatsuya Harada

Large language models (LLMs) can be used to generate smaller, more refined datasets via few-shot prompting for benchmarking, fine-tuning or other use cases. However, understanding and evaluating these datasets is difficult, and the failure…

Computation and Language · Computer Science 2023-09-29 Emily Reif , Minsuk Kahng , Savvas Petridis

Large transformer-based language models (LMs) trained on huge text corpora have shown unparalleled generation capabilities. However, controlling attributes of the generated language (e.g. switching topic or sentiment) is difficult without…

Computation and Language · Computer Science 2020-03-04 Sumanth Dathathri , Andrea Madotto , Janice Lan , Jane Hung , Eric Frank , Piero Molino , Jason Yosinski , Rosanne Liu

While large language models (LLMs) have shown remarkable capability to generate convincing text across diverse domains, concerns around its potential risks have highlighted the importance of understanding the rationale behind text…

Computation and Language · Computer Science 2024-04-03 Seongmin Lee , Zijie J. Wang , Aishwarya Chakravarthy , Alec Helbling , ShengYun Peng , Mansi Phute , Duen Horng Chau , Minsuk Kahng

Current Large Language Models (LLMs) exhibit a critical modal disconnect: they possess vast semantic knowledge but lack the procedural grounding to respect the immutable laws of the physical world. Consequently, while these agents…

Computation and Language · Computer Science 2026-01-21 Baochang Ren , Yunzhi Yao , Rui Sun , Shuofei Qiao , Ningyu Zhang , Huajun Chen

Large language models (LLMs) can enhance writing by automating or supporting specific tasks in writers' workflows (e.g., paraphrasing, creating analogies). Leveraging this capability, a collection of interfaces have been developed that…

Human-Computer Interaction · Computer Science 2023-03-28 Tae Soo Kim , Arghya Sarkar , Yoonjoo Lee , Minsuk Chang , Juho Kim

Procedurally generating cohesive and interesting game environments is challenging and time-consuming. In order for the relationships between the game elements to be natural, common-sense has to be encoded into arrangement of the elements.…