English
Related papers

Related papers: A Dialogue-Based Framework for Correcting Multimod…

200 papers

Endowing Large Multimodal Models (LMMs) with visual grounding capability can significantly enhance AIs' understanding of the visual world and their interaction with humans. However, existing methods typically fine-tune the parameters of…

Computer Vision and Pattern Recognition · Computer Science 2025-04-14 Size Wu , Sheng Jin , Wenwei Zhang , Lumin Xu , Wentao Liu , Wei Li , Chen Change Loy

Large Language Models (LLMs) demonstrate complex responses to threat-based manipulations, revealing both vulnerabilities and unexpected performance enhancement opportunities. This study presents a comprehensive analysis of 3,390…

Cryptography and Security · Computer Science 2025-07-30 Atil Samancioglu

Large language models (LLMs) enable increasingly capable tutoring-style conversational agents, yet effective tutoring requires sensitivity to learners' affective and cognitive states beyond text alone. Facial expressions provide immediate…

Human-Computer Interaction · Computer Science 2026-04-20 Shuangquan Feng , Laura Fleig , Ruisen Tu , Philip Chi , Edmund Bu , Melinda Ozel , Junhua Ma , Teng Fei , Virginia R. de Sa

This study evaluates the performance of Large Language Models (LLMs) as an Artificial Intelligence-based tutor for a university course. In particular, different advanced techniques are utilized, such as prompt engineering,…

Educational technology innovations leveraging large language models (LLMs) have shown the potential to automate the laborious process of generating and analysing textual content. While various innovations have been developed to automate a…

Computation and Language · Computer Science 2023-08-29 Lixiang Yan , Lele Sha , Linxuan Zhao , Yuheng Li , Roberto Martinez-Maldonado , Guanliang Chen , Xinyu Li , Yueqiao Jin , Dragan Gašević

The study explores the role of large language models (LLMs) in the context of the architectural design studio, understood as the pedagogical core of architectural education. Traditionally, the studio has functioned as an experiential…

Computers and Society · Computer Science 2025-10-23 Juan David Salazar Rodriguez , Sam Conrad Joyce , Nachamma Sockalingam , Khoo Eng Tat , Julfendi

In-context learning (ICL) facilitates Large Language Models (LLMs) exhibiting emergent ability on downstream tasks without updating billions of parameters. However, in the area of multi-modal Large Language Models (MLLMs), two problems…

Multimedia · Computer Science 2024-07-02 Jun Gao , Qian Qiao , Ziqiang Cao , Zili Wang , Wenjie Li

The integration of large language models (LLMs) into conversational robots has made human-robot conversations more dynamic. Yet, LLM-powered conversational robots remain prone to errors, e.g., misunderstanding user intent, prematurely…

Connecting text and visual modalities plays an essential role in generative intelligence. For this reason, inspired by the success of large language models, significant research efforts are being devoted to the development of Multimodal…

Computer Vision and Pattern Recognition · Computer Science 2024-06-07 Davide Caffagni , Federico Cocchi , Luca Barsellotti , Nicholas Moratelli , Sara Sarto , Lorenzo Baraldi , Lorenzo Baraldi , Marcella Cornia , Rita Cucchiara

Instruction-tuned large language models (LLMs) have demonstrated promising zero-shot generalization capabilities across various downstream tasks. Recent research has introduced multimodal capabilities to LLMs by integrating independently…

Computation and Language · Computer Science 2023-11-29 Utsav Garg , Erhan Bas

In an era defined by the explosive growth of data and rapid technological advancements, Multimodal Large Language Models (MLLMs) stand at the forefront of artificial intelligence (AI) systems. Designed to seamlessly integrate diverse data…

The integration of Artificial Intelligence (AI), particularly Large Language Model (LLM)-based systems, in education has shown promise in enhancing teaching and learning experiences. However, the advent of Multimodal Large Language Models…

Large language models (LLMs) have demonstrated the ability to generate formative feedback and instructional hints in English, making them increasingly relevant for AI-assisted education. However, their ability to provide effective…

Computation and Language · Computer Science 2025-06-06 Junior Cedric Tonga , KV Aditya Srivatsa , Kaushal Kumar Maurya , Fajri Koto , Ekaterina Kochmar

While recent studies have examined the leaning impact of large language model (LLM) in educational contexts, the affective dynamics of LLM-mediated tutoring remain insufficiently understood. This work introduces the first ensemble-LLM…

Computation and Language · Computer Science 2025-10-17 Chenyu Zhang , Sharifa Alghowinem , Cynthia Breazeal

Large Language Models (LLMs) exhibit a significant "embodiment gap", where their text-based representations fail to align with human sensorimotor experiences. This study systematically investigates whether and how task-specific fine-tuning…

Computation and Language · Computer Science 2026-03-05 Minghua Wu , Javier Conde , Pedro Reviriego , Marc Brysbaert

Large multimodal language models (LMMs) have achieved significant success in general domains. However, due to the significant differences between medical images and text and general web content, the performance of LMMs in medical scenarios…

Computer Vision and Pattern Recognition · Computer Science 2023-06-23 Weihao Gao , Zhuo Deng , Zhiyuan Niu , Fuju Rong , Chucheng Chen , Zheng Gong , Wenze Zhang , Daimin Xiao , Fang Li , Zhenjie Cao , Zhaoyi Ma , Wenbin Wei , Lan Ma

While Large Language Models (LLMs) are increasingly envisioned as intelligent assistants for personalized learning, systematic head-to-head evaluations in authentic learning scenarios remain scarce. This study presents an empirical…

Artificial Intelligence · Computer Science 2025-10-23 Bo Yuan , Jiazi Hu

Large language models (LLMs) increasingly serve as educational tools, yet evaluating their teaching capabilities remains challenging due to the resource-intensive, context-dependent, and methodologically complex nature of teacher-student…

Artificial Intelligence · Computer Science 2025-08-01 Yao Shi , Rongkeng Liang , Yong Xu

Large language models (LLMs) have demonstrated self-improvement capabilities via feedback and refinement, but current small language models (SLMs) have had limited success in this area. Existing correction approaches often rely on…

Computation and Language · Computer Science 2024-10-25 Chia-Hsuan Lee , Hao Cheng , Mari Ostendorf

Large language models (LLMs) have demonstrated remarkable performance across a wide array of NLP tasks. However, their efficacy is undermined by undesired and inconsistent behaviors, including hallucination, unfaithful reasoning, and toxic…

Computation and Language · Computer Science 2023-08-31 Liangming Pan , Michael Saxon , Wenda Xu , Deepak Nathani , Xinyi Wang , William Yang Wang