English
Related papers

Related papers: A Game-Based Approach for Helping Designers Learn …

200 papers

Interactive machine learning (IML) allows users to build their custom machine learning models without expert knowledge. While most existing IML systems are designed with classification algorithms, they sometimes oversimplify the…

Human-Computer Interaction · Computer Science 2024-04-16 Wataru Kawabe , Yusuke Sugano

We report on a systematic, PRISMA-guided survey of research at the intersection of LLMs and visualization, with a particular focus on visio-verbal interaction -- where verbal and visual modalities converge to support data sense-making. The…

Human-Computer Interaction · Computer Science 2026-02-04 Mathis Brossier , Tobias Isenberg , Konrad Schönborn , Jonas Unger , Mario Romero , Johanna Björklund , Anders Ynnerman , Lonni Besançon

The advent of artificial intelligence (AI) and machine learning (ML) bring human-AI interaction to the forefront of HCI research. This paper argues that games are an ideal domain for studying and experimenting with how humans interact with…

Human-Computer Interaction · Computer Science 2021-01-19 Jichen Zhu , Jennifer Villareale , Nithesh Javvaji , Sebastian Risi , Mathias Löwe , Rush Weigelt , Casper Harteveld

Continual learning (CL) aims to enable learning systems to acquire new knowledge constantly without forgetting previously learned information. CL faces the challenge of mitigating catastrophic forgetting while maintaining interpretability…

Computer Vision and Pattern Recognition · Computer Science 2025-04-01 Lu Yu , Haoyu Han , Zhe Tao , Hantao Yao , Changsheng Xu

The development and deployment of systems using supervised machine learning (ML) remain challenging: mainly due to the limited reliability of prediction models and the lack of knowledge on how to effectively integrate human intelligence…

Software Engineering · Computer Science 2023-12-04 Jakob Smedegaard Andersen , Walid Maalej

Understanding large-scale, complex software systems is a major challenge for developers, who spend a significant portion of their time on program comprehension. Traditional tools such as static visualizations and reverse engineering…

Software Engineering · Computer Science 2025-08-11 Yoseph Berhanu Alebachew

It has been a long time that computer architecture and systems are optimized for efficient execution of machine learning (ML) models. Now, it is time to reconsider the relationship between ML and systems, and let ML transform the way that…

Machine Learning · Computer Science 2022-02-25 Nan Wu , Yuan Xie

The game industry is moving into an era where old-style game engines are being replaced by re-engineered systems with embedded machine learning technologies for the operation, analysis and understanding of game play. In this paper, we…

Computers and Society · Computer Science 2021-01-05 Yilei Zeng , Aayush Shah , Jameson Thai , Michael Zyda

Creating Computer Vision (CV) models remains a complex practice, despite their ubiquity. Access to data, the requirement for ML expertise, and model opacity are just a few points of complexity that limit the ability of end-users to build,…

Human-Computer Interaction · Computer Science 2024-03-19 Hayeong Song , Gonzalo Ramos , Peter Bodik

Visualisations drive all aspects of the Machine Learning (ML) Development Cycle but remain a vastly untapped resource by the research community. ML testing is a highly interactive and cognitive process which demands a human-in-the-loop…

Software Engineering · Computer Science 2023-05-23 Arumoy Shome , Luis Cruz , Arie van Deursen

The adoption of machine learning in high-stakes applications such as healthcare and law has lagged in part because predictions are not accompanied by explanations comprehensible to the domain user, who often holds the ultimate…

In this paper, we describe a research agenda for deriving design principles directly from data. We argue that it is time to go beyond manually curated and applied visualization design guidelines. We propose learning models of visualization…

Human-Computer Interaction · Computer Science 2018-08-17 Bahador Saket , Dominik Moritz , Halden Lin , Victor Dibia , Cagatay Demiralp , Jeffrey Heer

In this paper, we present the Draw-and-Understand framework, exploring how to integrate visual prompting understanding capabilities into Multimodal Large Language Models (MLLMs). Visual prompts allow users to interact through multi-modal…

Computer Vision and Pattern Recognition · Computer Science 2025-02-25 Weifeng Lin , Xinyu Wei , Ruichuan An , Peng Gao , Bocheng Zou , Yulin Luo , Siyuan Huang , Shanghang Zhang , Hongsheng Li

Extracting concepts and understanding relationships from videos is essential in Video-Based Design (VBD), where videos serve as a primary medium for exploration but require significant effort in managing meta-information. Mind maps, with…

Human-Computer Interaction · Computer Science 2025-01-17 Tianhao He , Karthi Saravanan , Evangelos Niforatos , Gerd Kortuem

In recent years, machine learning (ML) has become a key enabling technology for the sciences and industry. Especially through improvements in methodology, the availability of large databases and increased computational power, today's ML…

Artificial Intelligence · Computer Science 2019-09-27 Wojciech Samek , Klaus-Robert Müller

Interfaces for machine learning (ML), information and visualizations about models or data, can help practitioners build robust and responsible ML systems. Despite their benefits, recent studies of ML teams and our interviews with…

Human-Computer Interaction · Computer Science 2022-02-21 Alex Bäuerle , Ángel Alexander Cabrera , Fred Hohman , Megan Maher , David Koski , Xavier Suau , Titus Barik , Dominik Moritz

Artificial intelligence (AI) and machine learning (ML) are increasingly integrated into the functioning of physical and digital products, creating unprecedented opportunities for interaction and functionality. However, there is a challenge…

Human-Computer Interaction · Computer Science 2023-10-03 Dave Murray-Rust , Maria Luce Lupetti , Iohanna Nicenboim , Wouter van der Hoog

We study the problem of computer-assisted teaching with explanations. Conventional approaches for machine teaching typically only provide feedback at the instance level e.g., the category or label of the instance. However, it is intuitive…

Computer Vision and Pattern Recognition · Computer Science 2018-02-21 Oisin Mac Aodha , Shihan Su , Yuxin Chen , Pietro Perona , Yisong Yue

Visualization recommendation seeks to generate, score, and recommend to users useful visualizations automatically, and are fundamentally important for exploring and gaining insights into a new or existing dataset quickly. In this work, we…

Information Retrieval · Computer Science 2020-09-28 Xin Qian , Ryan A. Rossi , Fan Du , Sungchul Kim , Eunyee Koh , Sana Malik , Tak Yeon Lee , Joel Chan

The interactive game theoretical approach to the description of perception processes is proposed. The subject is treated formally in terms of a new class of the verbalizable interactive games which are called the perception games. An…

History and Overview · Mathematics 2007-05-23 Denis V. Juriev