English
Related papers

Related papers: Estuary: A Framework For Building Multimodal Low-L…

200 papers

This article presents a multimodal emotion recognition module integrated into a proactive Socially Interactive Agent (SIA) powered by generative artificial intelligence. The system evaluates real-time affective states through two distinct…

Human-Computer Interaction · Computer Science 2026-05-21 Adnana Dragut , Raquel Lacuesta , F. Xavier Gaya-Morey , Jose M. Buades-Rubio

Intelligent systems for the annotation of media content are increasingly being used for the automation of parts of social science research. In this domain the problem of integrating various Artificial Intelligence (AI) algorithms into a…

Multiagent Systems · Computer Science 2018-06-05 Ilias Flaounas , Thomas Lansdall-Welfare , Panagiota Antonakaki , Nello Cristianini

The exponential growth of academic publications poses challenges for the research process, such as literature review and procedural planning. Large Language Models (LLMs) have emerged as powerful AI tools, especially when combined with…

Applied Physics · Physics 2025-02-13 Joaquin Ramirez-Medina , Mohammadmehdi Ataei , Alidad Amirfazli

Flexible and natural nonverbal reactions to human behavior remain a challenge for socially interactive agents (SIAs) that are predominantly animated using hand-crafted rules. While recently proposed machine learning based approaches to…

Human-Computer Interaction · Computer Science 2024-02-14 Daksitha Withanage Don , Philipp Müller , Fabrizio Nunnari , Elisabeth André , Patrick Gebhard

Large Language Models have demonstrated remarkable capabilities in open-domain dialogues. However, current methods exhibit suboptimal performance in service dialogues, as they rely on noisy, low-quality human conversation data. This…

Computation and Language · Computer Science 2026-05-06 Yuqin Dai , Ning Gao , Wei Zhang , Jie Wang , Zichen Luo , Jinpeng Wang , Yujie Wang , Ruiyuan Wu , Chaozheng Wang

Artificial Intelligence (AI) has emerged as a transformative technology with the potential to revolutionize various sectors, from healthcare to finance, education, and beyond. However, successfully implementing AI systems remains a complex…

Computers and Society · Computer Science 2025-02-04 Dian Tjondronegoro

Generative AI is rapidly reshaping STEM higher education. Not only are our educational practices changing, but how we think about educational transformation must adapt. Existing models of institutional change in STEM, aimed at interactive…

Physics Education · Physics 2026-05-14 David Perl-Nussbaum , Noah D. Finkelstein

The rapid advancement of multimodal large language models has demonstrated impressive capabilities, yet nearly all operate in an offline paradigm, hindering real-time interactivity. Addressing this gap, we introduce the Real-tIme Video…

Computer Vision and Pattern Recognition · Computer Science 2026-03-05 Yansong Shi , Qingsong Zhao , Tianxiang Jiang , Xiangyu Zeng , Yi Wang , Limin Wang

The scarcity of data depicting dangerous situations presents a major obstacle to training AI systems for safety-critical applications, such as construction safety, where ethical and logistical barriers hinder real-world data collection.…

Artificial Intelligence · Computer Science 2025-05-21 Vu Dinh Xuan , Hao Vo , David Murphy , Hoang D. Nguyen

Conversational Artificial Intelligence (AI) systems have recently sky-rocketed in popularity and are now used in many applications, from car assistants to customer support. The development of conversational AI systems is supported by a…

Human-Computer Interaction · Computer Science 2020-12-23 Johan Aronsson , Philip Lu , Daniel Strüber , Thorsten Berger

Generative AI(GenAI) is a kind of AI model capable of producing human-like content in various modalities, including text, image, audio, video, and computer programming. Although GenAI offers great potential for education, its value often…

Human-Computer Interaction · Computer Science 2025-12-09 Yun Dai , Sichen Lai

Digital agents for automating tasks across different platforms by directly manipulating the GUIs are increasingly important. For these agents, grounding from language instructions to target elements remains a significant challenge due to…

Human-Computer Interaction · Computer Science 2025-07-09 Yuhao Yang , Yue Wang , Dongxu Li , Ziyang Luo , Bei Chen , Chao Huang , Junnan Li

The rapid development and adoption of Generative AI (GAI) technology in the form of chatbots such as ChatGPT and Claude has greatly increased interest in agentic machines. This paper introduces the Autonomous Cognitive Entity (ACE) model, a…

Human-Computer Interaction · Computer Science 2023-11-02 David Shapiro , Wangfan Li , Manuel Delaflor , Carlos Toxtli

The automation of scientific discovery represents a critical milestone in Artificial Intelligence (AI) research. However, existing agentic systems for science suffer from two fundamental limitations: rigid, pre-programmed workflows that…

Artificial Intelligence · Computer Science 2025-10-20 Ed Li , Junyu Ren , Xintian Pan , Cat Yan , Chuanhao Li , Dirk Bergemann , Zhuoran Yang

State of the art Artificial Intelligence (AI) techniques have reached an impressive complexity. Consequently, researchers are discovering more and more methods to use them in real-world applications. However, the complexity of such systems…

Artificial Intelligence · Computer Science 2021-11-08 Marco Matarese , Francesco Rea , Alessandra Sciutti

The collaboration of large artificial intelligence (AI) models in mobile edge networks has emerged as a promising paradigm to meet the growing demand for intelligent services at the network edge. By enabling multiple devices to…

Networking and Internet Architecture · Computer Science 2026-02-17 Peichun Li , Liping Qian , Dusit Niyato , Shiwen Mao , Yuan Wu

A common vision from science fiction is that robots will one day inhabit our physical spaces, sense the world as we do, assist our physical labours, and communicate with us through natural language. Here we study how to design artificial…

Recognizing the tremendous improvements that the integration of generative AI can bring to intelligent transportation systems, this article explores the integration of generative AI technologies in vehicular networks, focusing on their…

Networking and Internet Architecture · Computer Science 2023-04-24 Ruichen Zhang , Ke Xiong , Hongyang Du , Dusit Niyato , Jiawen Kang , Xuemin Shen , H. Vincent Poor

Machine learning powers diverse services in industry including search, translation, recommendation systems, and security. The scale and importance of these models require that they be efficient, expressive, and portable across an array of…

Programming Languages · Computer Science 2018-10-03 Jared Roesch , Steven Lyubomirsky , Logan Weber , Josh Pollock , Marisa Kirisame , Tianqi Chen , Zachary Tatlock

As AI moves beyond text, large language models (LLMs) increasingly power vision, audio, and document understanding; however, their high inference costs hinder real-time, scalable deployment. Conversely, smaller open-source models offer cost…

Computation and Language · Computer Science 2025-11-11 Mayank Saini , Arit Kumar Bishwas