English
Related papers

Related papers: Toward AI-driven Multimodal Interfaces for Industr…

200 papers

Professional software offers immense power but also presents significant learning challenges. Its complex interfaces, as well as insufficient built-in structured guidance and unfamiliar terminology, often make newcomers struggle with task…

Human-Computer Interaction · Computer Science 2025-05-20 Yimeng Liu , Misha Sra

This paper systematically analyzes the typical application scenarios and key technical challenges of AI in 6G air interface transmission, covering important areas such as performance enhancement of single functional modules, joint…

Signal Processing · Electrical Eng. & Systems 2025-03-18 Xiaoyun Wang , Shuangfeng Han , Zhiming Liu , Qixing Wang , Jiangzhou Wang , Chih-Lin I

Multimodal models are expected to be a critical component to future advances in artificial intelligence. This field is starting to grow rapidly with a surge of new design elements motivated by the success of foundation models in natural…

Computation and Language · Computer Science 2024-06-11 Sai Munikoti , Ian Stewart , Sameera Horawalavithana , Henry Kvinge , Tegan Emerson , Sandra E Thompson , Karl Pazdernik

Artificial intelligence (AI), including large language models and generative AI, is emerging as a significant force in software development, offering developers powerful tools that span the entire development lifecycle. Although software…

Software Engineering · Computer Science 2025-02-06 Christoph Treude , Marco A. Gerosa

In an era of exponential technological advancement, artificial intelligence (AI) has emerged as a transformative force in architecture, reshaping traditional design and construction practices. This article explores the multifaceted roles of…

Computers and Society · Computer Science 2025-08-01 Mustapha El Moussaoui

Model-Driven Engineering (MDE) provides a huge body of knowledge of automation for many different engineering tasks, especially those involving transitioning from design to implementation. With the huge progress made in Artificial…

Software Engineering · Computer Science 2025-02-11 Lola Burgueño , Davide Di Ruscio , Houari Sahraoui , Manuel Wimmer

The rapid development of artificial intelligence (AI) has fundamentally transformed creative work practices in the design industry. Existing studies have identified both opportunities and challenges for creative practitioners in their…

Human-Computer Interaction · Computer Science 2025-09-30 Nami Ogawa , Yuki Okafuji , Yuji Hatada , Jun Baba

Mobility is a complex phenomenon encompassing diverse transportation modes, infrastructure elements, and human behaviors. Tackling the persistent challenges of congestion, pollution, and accessibility requires a range of modeling approaches…

Physics and Society · Physics 2024-11-08 Marc Barthelemy

This paper presents a comprehensive examination of how multimodal artificial intelligence (AI) approaches are paving the way towards the realization of Artificial General Intelligence (AGI) in educational contexts. It scrutinizes the…

Understanding details of human multimodal interaction can elucidate many aspects of the type of information processing machines must perform to interact with humans. This article gives an overview of recent findings from Linguistics…

Computation and Language · Computer Science 2020-08-10 João Ranhel , Cacilda Vilela

Multimodal interfaces, combining the use of speech, graphics, gestures, and facial expressions in input and output, promise to provide new possibilities to deal with information in more effective and efficient ways, supporting for instance:…

Computation and Language · Computer Science 2009-09-24 Harry Bunt , Laurent Romary

Recent advances in generative modeling have spurred a resurgence in the field of Embodied Artificial Intelligence (EAI). EAI systems typically deploy large language models to physical systems capable of interacting with their environment.…

Robotics · Computer Science 2023-04-27 Selma Wanna , Fabian Parra , Robert Valner , Karl Kruusamäe , Mitch Pryor

Multimodal machine learning is a vibrant multi-disciplinary research field that aims to design computer agents with intelligent capabilities such as understanding, reasoning, and learning through integrating multiple communicative…

Machine Learning · Computer Science 2023-02-21 Paul Pu Liang , Amir Zadeh , Louis-Philippe Morency

Influenced by ChatGPT, artificial intelligence (AI) large models have witnessed a global upsurge in large model research and development. As people enjoy the convenience by this AI large model, more and more large models in subdivided…

Computer Vision and Pattern Recognition · Computer Science 2024-03-26 Liangrui Pan , Zhenyu Zhao , Ying Lu , Kewei Tang , Liyong Fu , Qingchun Liang , Shaoliang Peng

A paradigm shift is underway in Software Engineering, with AI systems such as LLMs playing an increasingly important role in boosting software development productivity. This trend is anticipated to persist. In the next years, we expect a…

Software Engineering · Computer Science 2026-03-27 Valerio Terragni , Annie Vella , Partha Roop , Kelly Blincoe

As artificial intelligence (AI) becomes increasingly embedded in daily life, designing intuitive, trustworthy, and emotionally resonant AI-human interfaces has emerged as a critical challenge. This editorial introduces a Special Issue that…

Human-Computer Interaction · Computer Science 2024-12-13 Aparna Sundar , Tony Russell-Rose , Udo Kruschwitz , Karen Machleit

Transformer-based architectures have shown remarkable performance in vision and language tasks but pose unique challenges for safety-critical applications. This paper presents a conceptual framework for integrating Transformers into…

Software Engineering · Computer Science 2026-01-28 Sven Kirchner , Nils Purschke , Chengdong Wu , Alois Knoll

Deep learning methods have revolutionized speech recognition, image recognition, and natural language processing since 2010. Each of these tasks involves a single modality in their input signals. However, many applications in the artificial…

Artificial Intelligence · Computer Science 2020-07-15 Chao Zhang , Zichao Yang , Xiaodong He , Li Deng

When novices fabricate, they start by choosing a workflow (e.g., laser cutting, 3D printing, etc.) and corresponding software from a narrow set they know. As they advance their design, another workflow might better suit their intent, but…

Human-Computer Interaction · Computer Science 2026-02-17 Shuo Feng , Xuening Wang , Yifan , Shan , Krista U Singh , Bo Liu , Amritansh Kwatra , Ritik Batra , Tobias M Weinberg , Thijs Roumen

Modern manufacturing systems typically require high degrees of flexibility, in terms of ability to customize the production lines to the constantly changing market requests. For this purpose, manufacturing systems are required to be able to…

Human-Computer Interaction · Computer Science 2017-06-27 Valeria Villani , Lorenzo Sabattini , Julia N. Czerniak , Alexander Mertens , Birgit Vogel-Heuser , Cesare Fantuzzi