English
Related papers

Related papers: Multimodal Behavioral Patterns Analysis with Eye-T…

200 papers

The deployment of large language models (LLMs) in production environments has created an urgent need for observability systems that span the full stack -- from model internals to GPU kernels. Yet existing monitoring approaches address…

Software Engineering · Computer Science 2026-04-30 Twinkll Sisodia

Recent advancements in Multimodal Large Language Models (MLLMs) have demonstrated remarkable progress in visual understanding. This impressive leap raises a compelling question: how can language models, initially trained solely on…

Computer Vision and Pattern Recognition · Computer Science 2025-11-12 Jing Bi , Junjia Guo , Yunlong Tang , Lianggong Bruce Wen , Zhang Liu , Chenliang Xu

With the rapid advancement of mathematical reasoning capabilities in Large Language Models (LLMs), AI systems are increasingly being adopted in educational settings to support students' comprehension of problem-solving processes. However, a…

Computation and Language · Computer Science 2025-12-18 Jaewoo Park , Jungyang Park , Dongju Jang , Jiwan Chung , Byungwoo Yoo , Jaewoo Shin , Seonjoon Park , Taehyeong Kim , Youngjae Yu

Understanding how interdisciplinary research teams converge on shared knowledge is a persistent challenge. This paper presents a novel, multi-layer, AI-driven analytical framework for mapping research convergence in interdisciplinary teams.…

Large language models (LLMs) solve complex problems yet fail on simpler variants, suggesting they achieve correct outputs through mechanisms fundamentally different from human reasoning. To understand this gap, we synthesize cognitive…

Large Language Models (LLMs) have emerged as foundation models for IoT applications such as human activity recognition (HAR). However, directly applying high-frequency and multi-dimensional sensor data, such as eye-tracking data, leads to…

Human-Computer Interaction · Computer Science 2026-04-14 Jae Young Choi , Seon Gyeom Kim , Hyungjun Yoon , Taeckyung Lee , Donggun Lee , Jaeryung Chung , Jihyung Kil , Ryan Rossi , Sung-Ju Lee , Tak Yeon Lee

In recent years, large language models (LLMs) have driven major advances in language understanding, marking a significant step toward artificial general intelligence (AGI). With increasing demands for higher-level semantics and cross-modal…

Computation and Language · Computer Science 2025-09-30 Yuntao Shou , Tao Meng , Wei Ai , Keqin Li

Recent advancements in time series forecasting have explored augmenting models with text or vision modalities to improve accuracy. While text provides contextual understanding, it often lacks fine-grained temporal details. Conversely,…

Computer Vision and Pattern Recognition · Computer Science 2025-05-27 Siru Zhong , Weilin Ruan , Ming Jin , Huan Li , Qingsong Wen , Yuxuan Liang

Endowing Large Multimodal Models (LMMs) with visual grounding capability can significantly enhance AIs' understanding of the visual world and their interaction with humans. However, existing methods typically fine-tune the parameters of…

Computer Vision and Pattern Recognition · Computer Science 2025-04-14 Size Wu , Sheng Jin , Wenwei Zhang , Lumin Xu , Wentao Liu , Wei Li , Chen Change Loy

Large Multimodal Models (LMMs) have recently gained prominence in autonomous driving research, showcasing promising capabilities across various emerging benchmarks. LMMs specifically designed for this domain have demonstrated effective…

Computer Vision and Pattern Recognition · Computer Science 2025-03-19 Ayesha Ishaq , Jean Lahoud , Fahad Shahbaz Khan , Salman Khan , Hisham Cholakkal , Rao Muhammad Anwer

Multimodal Large Language Models (MLLMs) mimic human perception and reasoning system by integrating powerful Large Language Models (LLMs) with various modality encoders (e.g., vision, audio), positioning LLMs as the "brain" and various…

Computer Vision and Pattern Recognition · Computer Science 2024-08-29 Jiaxing Huang , Jingyi Zhang

While Large Language Models (LLM) enable non-experts to specify open-world multi-robot tasks, the generated plans often lack kinematic feasibility and are not efficient, especially in long-horizon scenarios. Formal methods like Linear…

Robotics · Computer Science 2026-02-11 Shuyuan Hu , Tao Lin , Kai Ye , Yang Yang , Tianwei Zhang

As a prominent direction of Artificial General Intelligence (AGI), Multimodal Large Language Models (MLLMs) have garnered increased attention from both industry and academia. Building upon pre-trained LLMs, this family of models further…

Computer Vision and Pattern Recognition · Computer Science 2024-12-10 Chaoyou Fu , Yi-Fan Zhang , Shukang Yin , Bo Li , Xinyu Fang , Sirui Zhao , Haodong Duan , Xing Sun , Ziwei Liu , Liang Wang , Caifeng Shan , Ran He

Eye tracking data during reading is a useful source of information to understand the cognitive processes that take place during language comprehension processes. Different languages account for different brain triggers , however there seems…

Computation and Language · Computer Science 2022-03-31 Harshvardhan Srivastava

Large Language Models (LLMs) achieve remarkable performance through pretraining on extensive data. This enables efficient adaptation to diverse downstream tasks. However, the lack of interpretability in their underlying mechanisms limits…

Computation and Language · Computer Science 2025-06-03 Xintong Wang , Jingheng Pan , Liang Ding , Longyue Wang , Longqin Jiang , Xingshan Li , Chris Biemann

Reading comprehension is a fundamental skill in human cognitive development. With the advancement of Large Language Models (LLMs), there is a growing need to compare how humans and LLMs understand language across different contexts and…

Computation and Language · Computer Science 2025-07-17 Yuhong Zhang , Jialu Li , Shilai Yang , Yuchen Xu , Gert Cauwenberghs , Tzyy-Ping Jung

Current benchmarks for Large Language Models (LLMs) primarily focus on performance metrics, often failing to capture the nuanced behavioral characteristics that differentiate them. This paper introduces a novel ``Behavioral Fingerprinting''…

Computation and Language · Computer Science 2025-09-08 Zehua Pei , Hui-Ling Zhen , Ying Zhang , Zhiyuan Yang , Xing Li , Xianzhi Yu , Mingxuan Yuan , Bei Yu

Language models have recently advanced into the realm of reasoning, yet it is through multimodal reasoning that we can fully unlock the potential to achieve more comprehensive, human-like cognitive capabilities. This survey provides a…

Computation and Language · Computer Science 2025-03-25 Zhiyu Lin , Yifei Gao , Xian Zhao , Yunfan Yang , Jitao Sang

Power system time series analytics is critical in understanding the system operation conditions and predicting the future trends. Despite the wide adoption of Artificial Intelligence (AI) tools, many AI-based time series analytical models…

Signal Processing · Electrical Eng. & Systems 2025-11-12 Zhenghao Zhou , Yiyan Li , Xinjie Yu , Runlong Liu , Zelin Guo , Zheng Yan , Mo-Yuen Chow , Yuqi Yang , Yang Xu

While Large Language Models (LLMs) have significantly advanced natural language processing, aligning them with human preferences remains an open challenge. Although current alignment methods rely primarily on explicit feedback, eye-tracking…

Computation and Language · Computer Science 2025-06-04 Angela Lopez-Cardona , Sebastian Idesis , Miguel Barreda-Ángeles , Sergi Abadal , Ioannis Arapakis