English
Related papers

Related papers: Texterial: A Text-as-Material Interaction Paradigm…

200 papers

We present a graphical, node-based system through which users can visually chain generative AI models for creative tasks. Research in the area of chaining LLMs has found that while chaining provides transparency, controllability and…

Human-Computer Interaction · Computer Science 2025-07-14 Abhinav Sood , Maria Teresa Llano , Jon McCormack

Explainable AI (XAI) interfaces seek to make large language models more transparent, yet explanation alone does not produce understanding. Explaining a system's behavior is not the same as being able to engage with it, to probe and…

Human-Computer Interaction · Computer Science 2026-03-18 Gabrielle Benabdallah

Text-based reinforcement learning involves an agent interacting with a fictional environment using observed text and admissible actions in natural language to complete a task. Previous works have shown that agents can succeed in text-based…

Computation and Language · Computer Science 2024-04-17 Mauricio Gruppi , Soham Dan , Keerthiram Murugesan , Subhajit Chaudhury

Thanks to their generative capabilities, large language models (LLMs) have become an invaluable tool for creative processes. These models have the capacity to produce hundreds and thousands of visual and textual outputs, offering abundant…

Human-Computer Interaction · Computer Science 2024-03-15 Sangho Suh , Meng Chen , Bryan Min , Toby Jia-Jun Li , Haijun Xia

People with visual impairments perceive their environment non-visually and often use AI-powered assistive tools to obtain textual descriptions of visual information. Recent large vision-language model-based AI-powered tools like Be My AI…

Human-Computer Interaction · Computer Science 2024-07-15 Jingyi Xie , Rui Yu , He Zhang , Sooyeon Lee , Syed Masum Billah , John M. Carroll

Many conversational user interfaces facilitate linear conversations with turn-based dialogue, similar to face-to-face conversations between people. However, digital conversations can afford more than simple back-and-forth; they can be…

The increasing convergence of artificial intelligence has opened new avenues, including its emerging role in enhancing creativity. It is reshaping traditional creative practices such as actor improvisation, which often struggles with…

Human-Computer Interaction · Computer Science 2025-08-01 Sora Kang , Joonhwan Lee

We propose TextManiA, a text-driven manifold augmentation method that semantically enriches visual feature spaces, regardless of class distribution. TextManiA augments visual data with intra-class semantic perturbation by exploiting…

Computer Vision and Pattern Recognition · Computer Science 2023-09-12 Moon Ye-Bin , Jisoo Kim , Hongyeob Kim , Kilho Son , Tae-Hyun Oh

Prompting-based user interfaces (UIs) shift the task of defining and accessing relevant functions from developers to users. However, how UIs shape this flexibility has not yet been investigated explicitly. We explored interaction with Large…

Human-Computer Interaction · Computer Science 2024-10-15 Florian Lehmann , Daniel Buschek

Authoring realistic haptic textures typically requires low-level parameter tuning and repeated trial-and-error, limiting speed, transparency, and creative reach. We present a language-driven authoring system that turns natural-language…

Human-Computer Interaction · Computer Science 2026-04-09 Wanli Qian , Aiden Chang , Shihan Lu , Michael Gu , Heather Culbertson

Image aesthetics is a crucial metric in the field of image generation. However, textual aesthetics has not been sufficiently explored. With the widespread application of large language models (LLMs), previous work has primarily focused on…

Computation and Language · Computer Science 2024-11-06 Lingjie Jiang , Shaohan Huang , Xun Wu , Furu Wei

This study explores the integration of generative artificial intelligence (AI), specifically large language models, with multi-modal analogical reasoning as an innovative approach to enhance science, technology, engineering, and mathematics…

Artificial Intelligence · Computer Science 2023-08-22 Chen Cao , Zijian Ding , Gyeong-Geon Lee , Jiajun Jiao , Jionghao Lin , Xiaoming Zhai

As generative AI becomes part of everyday writing, questions of transparency and productive human effort are increasingly important. Educators, reviewers, and readers want to understand how AI shaped the process. Where was human effort…

Human-Computer Interaction · Computer Science 2025-09-30 Momin N. Siddiqui , Nikki Nasseri , Adam Coscia , Roy Pea , Hari Subramonyam

Exploring alternative ideas by rewriting text is integral to the writing process. State-of-the-art Large Language Models (LLMs) can simplify writing variation generation. However, current interfaces pose challenges for simultaneous…

Text-rich graphs, which integrate complex structural dependencies with abundant textual information, are ubiquitous yet remain challenging for existing learning paradigms. Conventional methods and even LLM-hybrids compress rich text into…

Machine Learning · Computer Science 2026-05-12 Ying Zhang , Hang Yu , Haipeng Zhang , Peng Di

With recent advances in large language models (LLMs), the concept of automatically generating children's educational materials has become increasingly realistic. Working toward the goal of age-appropriate simplicity in generated educational…

Computation and Language · Computer Science 2023-10-31 Maria Valentini , Jennifer Weber , Jesus Salcido , Téa Wright , Eliana Colunga , Katharina Kann

As large language models increasingly mediate firm - customer interactions, firms face a tradeoff: the most capable models perform well but are costly and difficult to control at scale. Existing knowledge distillation methods address this…

Computation and Language · Computer Science 2026-02-23 Tong Wang , K. Sudhir

Building machines that can understand text like humans is an AI-complete problem. A great deal of research has already gone into this, with astounding results, allowing everyday people to discuss with their telephones, or have their reading…

Information Retrieval · Computer Science 2017-09-13 Christina Lioma

Traditional recommender systems rely on high-dimensional (latent) embeddings for modeling user-item interactions, often resulting in opaque representations that lack interpretability. Moreover, these systems offer limited control to users…

Information Retrieval · Computer Science 2025-03-05 Emiliano Penaloza , Olivier Gouvert , Haolun Wu , Laurent Charlin

Large language models (LLMs) are used by over a billion people globally, most often to assist with writing. In this work, we demonstrate that LLMs not only alter the voice and tone of human writing, but also consistently alter the intended…

Computation and Language · Computer Science 2026-03-20 Marwa Abdulhai , Isadora White , Yanming Wan , Ibrahim Qureshi , Joel Leibo , Max Kleiman-Weiner , Natasha Jaques