English
Related papers

Related papers: MAGMA-Edu: Multi-Agent Generative Multimodal Frame…

200 papers

The use of question-based activities (QBAs) is wide-spread in education, traditionally forming an integral part of the learning and assessment process. In this paper, we design and evaluate an automated question generation tool for…

Computation and Language · Computer Science 2023-09-27 Ayan Kumar Bhowmick , Ashish Jagmohan , Aditya Vempaty , Prasenjit Dey , Leigh Hall , Jeremy Hartman , Ravi Kokku , Hema Maheshwari

Personalized learning represents a promising educational strategy within intelligent educational systems, aiming to enhance learners' practice efficiency. However, the discrepancy between offline metrics and online performance significantly…

Computers and Society · Computer Science 2026-05-29 Weibo Gao , Qi Liu , Linan Yue , Fangzhou Yao , Rui Lv , Zheng Zhang , Hao Wang , Zhenya Huang

Recent advances in AI-generated content (AIGC) have significantly accelerated image editing techniques, driving increasing demand for diverse and fine-grained edits. Despite these advances, existing image editing methods still face…

Computer Vision and Pattern Recognition · Computer Science 2025-05-27 Shuyu Wang , Weiqi Li , Qian Wang , Shijie Zhao , Jian Zhang

Most medical multimodal benchmarks focus on static tasks such as image question answering, report generation, and plain-language rewriting. Patient education is more demanding: systems must identify relevant evidence across images, show…

Artificial Intelligence · Computer Science 2026-04-17 Zonghai Yao , Zhipeng Tang , Chengtao Lin , Xiong Luo , Benlu Wang , Juncheng Huang , Chin Siang Ong , Hong Yu

Audiobook generation aims to create rich, immersive listening experiences from multimodal inputs, but current approaches face three critical challenges: (1) the lack of synergistic generation of diverse audio types (e.g., speech, sound…

Sound · Computer Science 2025-08-13 Yan Rong , Shan Yang , Chenxing Li , Dong Yu , Li Liu

Unified Multimodal Models (UMMs) have demonstrated remarkable performance in text-to-image generation (T2I) and editing (TI2I), whether instantiated as assembled unified frameworks which couple powerful vision-language model (VLM) with…

Computer Vision and Pattern Recognition · Computer Science 2025-10-01 Yuxin Song , Wenkai Dong , Shizun Wang , Qi Zhang , Song Xue , Tao Yuan , Hu Yang , Haocheng Feng , Hang Zhou , Xinyan Xiao , Jingdong Wang

The ability to organically reason over and with both text and images is a pillar of human intelligence, yet the ability of Multimodal Large Language Models (MLLMs) to perform such multimodal reasoning remains under-explored. Existing…

Computer Vision and Pattern Recognition · Computer Science 2025-01-10 Yunzhuo Hao , Jiawei Gu , Huichen Will Wang , Linjie Li , Zhengyuan Yang , Lijuan Wang , Yu Cheng

Although large language models (LLMs) have demonstrated adeptness in a range of tasks, they still lag behind human learning efficiency. This disparity is often linked to the inherent human capacity to learn from basic examples, gradually…

Computation and Language · Computer Science 2024-01-30 Jianqiao Lu , Wanjun Zhong , Yufei Wang , Zhijiang Guo , Qi Zhu , Wenyong Huang , Yanlin Wang , Fei Mi , Baojun Wang , Yasheng Wang , Lifeng Shang , Xin Jiang , Qun Liu

Based on powerful Large Language Models (LLMs), recent generative Multimodal Large Language Models (MLLMs) have gained prominence as a pivotal research area, exhibiting remarkable capability for both comprehension and generation. In this…

Computation and Language · Computer Science 2023-08-03 Bohao Li , Rui Wang , Guangzhi Wang , Yuying Ge , Yixiao Ge , Ying Shan

Mathematical problem generation (MPG) is a significant research direction in the field of intelligent education. In recent years, the rapid development of large language models (LLMs) has enabled new technological approaches to…

Artificial Intelligence · Computer Science 2026-01-21 Yifei Sun , Yongan Li , A. K. Qin , Sicheng Hou , Tamas Pflanzner

The emergence of Large Language Models (LLMs) presents transformative opportunities for education, generating numerous novel application scenarios. However, significant challenges remain: evaluation metrics vary substantially across…

Computers and Society · Computer Science 2025-08-01 Shou'ang Wei , Xinyun Wang , Shuzhen Bi , Jian Chen , Ruijia Li , Bo Jiang , Xin Lin , Min Zhang , Yu Song , BingDong Li , Aimin Zhou , Hao Hao

Collaborative dialogue offers rich insights into students' learning and critical thinking, which is essential for personalizing pedagogical agent interactions in STEM+C settings. While large language models (LLMs) facilitate dynamic…

Most multi-modal tasks can be formulated into problems of either generation or embedding. Existing models usually tackle these two types of problems by decoupling language modules into a text decoder for generation, and a text encoder for…

Computer Vision and Pattern Recognition · Computer Science 2024-05-30 Feipeng Ma , Hongwei Xue , Guangting Wang , Yizhou Zhou , Fengyun Rao , Shilin Yan , Yueyi Zhang , Siying Wu , Mike Zheng Shou , Xiaoyan Sun

The efficiency of multi-agent systems driven by large language models (LLMs) largely hinges on their communication topology. However, designing an optimal topology is a non-trivial challenge, as it requires balancing competing objectives…

Computation and Language · Computer Science 2026-05-19 Eric Hanchen Jiang , Mengting Li , Guancheng Wan , Sophia Yin , Yuchen Wu , Xiao Liang , Xinfeng Li , Yizhou Sun , Wei Wang , Kai-Wei Chang , Ying Nian Wu

Large Language Models (LLMs) have proven immensely beneficial in education by capturing vast amounts of literature-based information, allowing them to generate context without relying on external sources. In this paper, we propose a…

Information Retrieval · Computer Science 2025-07-03 Umar Ali Khan , Ekram Khan , Fiza Khan , Athar Ali Moinuddin

Multimodal empathetic response generation (MERG) aims to generate emotionally engaging and empathetic responses based on users' multimodal contexts. Existing approaches usually rely on an implicit one-pass generation paradigm from…

Computer Vision and Pattern Recognition · Computer Science 2026-04-22 Liping Wang , Cheng Ye , Weidong Chen , Peipei Song , Bo Hu , Zhendong Mao

For middle-school math students, interactive question-answering (QA) with tutors is an effective way to learn. The flexibility and emergent capabilities of generative large language models (LLMs) has led to a surge of interest in automating…

Computation and Language · Computer Science 2023-11-14 Zachary Levonian , Chenglu Li , Wangda Zhu , Anoushka Gade , Owen Henkel , Millie-Ellen Postle , Wanli Xing

Developing the logic necessary to solve mathematical problems or write mathematical proofs is one of the more difficult objectives for large language models (LLMS). Currently, the most popular methods in literature consists of fine-tuning…

Machine Learning · Computer Science 2025-02-11 Tianbo Yang , Mingqi Yan , Hongyi Zhao , Tianshuo Yang

Retrieval-augmented Large Language Models (LLMs) have reshaped traditional query-answering systems, offering unparalleled user experiences. However, existing retrieval techniques often struggle to handle multi-modal query contexts. In this…

Databases · Computer Science 2024-07-08 Mengzhao Wang , Haotian Wu , Xiangyu Ke , Yunjun Gao , Xiaoliang Xu , Lu Chen

Large Language Models (LLMs) have demonstrated substantial efficacy in advancing graph-structured data analysis. Prevailing LLM-based graph methods excel in adapting LLMs to text-rich graphs, wherein node attributes are text descriptions.…

Artificial Intelligence · Computer Science 2025-06-04 Dongzhe Fan , Yi Fang , Jiajin Liu , Djellel Difallah , Qiaoyu Tan