English
Related papers

Related papers: I See You: Teacher Analytics with GPT-4 Vision-Pow…

200 papers

Educational scholars have analyzed various image data acquired from teaching and learning situations, such as photos that shows classroom dynamics, students' drawings with regard to the learning content, textbook illustrations, etc.…

Physics Education · Physics 2024-05-14 Gyeong-Geon Lee , Xiaoming Zhai

This research study explores the conceptualization, development, and deployment of an innovative learning analytics tool, leveraging OpenAI's GPT-4 model to quantify student engagement, map learning progression, and evaluate diverse…

Computers and Society · Computer Science 2024-09-19 Ramteja Sajja , Yusuf Sermet , David Cwiertny , Ibrahim Demir

Classroom observation protocols standardize the assessment of teaching effectiveness and facilitate comprehension of classroom interactions. Whereas these protocols offer teachers specific feedback on their teaching practices, the manual…

Human-Computer Interaction · Computer Science 2024-07-04 Ruikun Hou , Tim Fütterer , Babette Bühler , Efe Bozkir , Peter Gerjets , Ulrich Trautwein , Enkelejda Kasneci

This paper explores the transformative impact of Generative Artificial Intelligence (GenAI) on teachers' roles and agencies in education, presenting a comprehensive framework that addresses teachers' perceptions, knowledge, acceptance, and…

Computers and Society · Computer Science 2024-10-07 Xiaoming Zhai

Intelligent tutoring systems leverage AI models of expert learning and student knowledge to deliver personalized tutoring to students. While these intelligent tutors have demonstrated improved student learning outcomes, it is still unclear…

Human-Computer Interaction · Computer Science 2024-04-22 Grace Guo , Aishwarya Mudgal Sunil Kumar , Adit Gupta , Adam Coscia , Chris MacLellan , Alex Endert

This paper does not present a novel method. Instead, it delves into an essential, yet must-know baseline in light of the latest advancements in Generative Artificial Intelligence (GenAI): the utilization of GPT-4 for visual understanding.…

Computer Vision and Pattern Recognition · Computer Science 2024-03-13 Wenhao Wu , Huanjin Yao , Mengxi Zhang , Yuxin Song , Wanli Ouyang , Jingdong Wang

Generative Artificial Intelligence (AI) is revolutionizing educational technology by enabling highly personalized and adaptive learning environments within Intelligent Tutoring Systems (ITS). This report delves into the integration of…

Computation and Language · Computer Science 2024-10-15 Subhankar Maity , Aniket Deroy

We introduce a pipeline that enhances a general-purpose Vision Language Model, GPT-4V(ision), to facilitate one-shot visual teaching for robotic manipulation. This system analyzes videos of humans performing tasks and outputs executable…

Robotics · Computer Science 2024-10-11 Naoki Wake , Atsushi Kanehira , Kazuhiro Sasabuchi , Jun Takamatsu , Katsushi Ikeuchi

As generative AI (Gen-AI) tools become more prevalent in education, there is a growing need to understand how educators, not just students, can actively shape their design and use. This study investigates how two instructors integrated four…

Human-Computer Interaction · Computer Science 2025-07-30 Qian Huang , Thijs Willems

The rapid advancement of generative AI technology, particularly video generative AI (Video GenAI), has opened new possibilities for K-12 education by enabling the creation of dynamic, customized, and high-quality visual content. Despite its…

Computers and Society · Computer Science 2025-03-12 Unggi Lee , Yeil Jeong , Seungha Kim , Yoorim Son , Gyuri Byun , Hyeoncheol Kim , Cheolil Lim

Automatically evaluating vision-language tasks is challenging, especially when it comes to reflecting human judgments due to limitations in accounting for fine-grained details. Although GPT-4V has shown promising results in various…

Computer Vision and Pattern Recognition · Computer Science 2023-11-03 Xinlu Zhang , Yujie Lu , Weizhi Wang , An Yan , Jun Yan , Lianke Qin , Heng Wang , Xifeng Yan , William Yang Wang , Linda Ruth Petzold

Existing visual instruction tuning methods typically prompt large language models with textual descriptions to generate instruction-following data. Despite the promising performance achieved, these descriptions are derived from image…

Computer Vision and Pattern Recognition · Computer Science 2023-11-30 Junke Wang , Lingchen Meng , Zejia Weng , Bo He , Zuxuan Wu , Yu-Gang Jiang

Recently, it has been recognized that large language models demonstrate high performance on various intellectual tasks. However, few studies have investigated alignment with humans in behaviors that involve sensibility, such as aesthetic…

Artificial Intelligence · Computer Science 2024-03-07 Yoshia Abe , Tatsuya Daikoku , Yasuo Kuniyoshi

Generative Artificial Intelligence (GenAI) has emerged as a valuable assistant in many fields such as marketing, finance, project management, and education. In education, many GenAI tools have been developed to aid teachers in preparing…

Physics Education · Physics 2024-12-30 Dimitrios Gousopoulos

Predicting pedestrian behavior is the key to ensure safety and reliability of autonomous vehicles. While deep learning methods have been promising by learning from annotated video frame sequences, they often fail to fully grasp the dynamic…

Computer Vision and Pattern Recognition · Computer Science 2024-01-29 Jia Huang , Peng Jiang , Alvika Gautam , Srikanth Saripalli

The Fourth Industrial Revolution (4IR) technologies, such as cloud computing, machine learning, and AI, have improved productivity but introduced challenges in workforce training and reskilling. This is critical given existing workforce…

The development in Artificial Intelligence (AI) offers transformative potential for redefining student assessment methodologies. This paper aims to establish the idea of the advancement of Artificial Intelligence (AI) and its prospect in…

Computers and Society · Computer Science 2025-03-10 Pushpalatha K S , Abhishek Mangalur , Ketan Hegde , Chetan Badachi , Mohammad Aamir

Supporting equitable instruction is an important issue for teachers attending diverse STEM classrooms. Visual learning analytics along with effective student survey measures can support providing on time feedback to teachers in making…

Human-Computer Interaction · Computer Science 2024-01-17 Ali Raza , William R. Penuel , Tamara Sumner

Classroom observation -- one of the most effective methods for teacher development -- remains limited due to high costs and a shortage of expert coaches. We present ClassMind, an AI-driven classroom observation system that integrates…

Human-Computer Interaction · Computer Science 2025-09-23 Ao Qu , Yuxi Wen , Jiayi Zhang , Yunge Wen , Yibo Zhao , Alok Prakash , Andrés F. Salazar-Gómez , Paul Pu Liang , Jinhua Zhao

Generative AI and large language models hold great promise in enhancing programming education by automatically generating individualized feedback for students. We investigate the role of generative AI models in providing human tutor-style…

‹ Prev 1 2 3 10 Next ›