English
Related papers

Related papers: Distill Visual Chart Reasoning Ability from LLMs t…

200 papers

Designers often create visualizations to achieve specific high-level analytical or communication goals. These goals require people to extract complex and interconnected data patterns. Prior perceptual studies of visualization effectiveness…

Human-Computer Interaction · Computer Science 2026-04-13 Hyotaek Jeon , Hyunwook Lee , Minjeong Shin , Tapendra Pandey , Joohee Kim , Shinwook Seon , Daeun Jeong , Sungahn Ko , Ghulam Jilani Quadri

LLMs demonstrate strong performance in auto-mated software engineering, particularly for code generation and issue resolution. While proprietary models like GPT-4o achieve high benchmarks scores on SWE-bench, their API dependence, cost, and…

Software Engineering · Computer Science 2025-06-17 Yibo Wang , Zhihao Peng , Ying Wang , Zhao Wei , Hai Yu , Zhiliang Zhu

Recent large vision-language models (LVLMs) can generate vision-text multimodal chain-of-thought (MCoT) traces after reinforcement fine-tuning (RFT). However, we observe that the visual information incorporated in MCoT is often inaccurate,…

Computer Vision and Pattern Recognition · Computer Science 2025-10-28 Zujing Liu , Junwen Pan , Qi She , Yuan Gao , Guisong Xia

We present ExpliCIT-QA, a system that extends our previous MRT approach for tabular question answering into a multimodal pipeline capable of handling complex table images and providing explainable answers. ExpliCIT-QA follows a modular…

The reasoning capabilities of Large Language Models (LLMs) have led to their increasing employment in several critical applications, particularly education, where they support problem-solving, tutoring, and personalized study.…

Human-Computer Interaction · Computer Science 2026-01-27 Runtao Zhou , Giang Nguyen , Nikita Kharya , Anh Totti Nguyen , Chirag Agarwal

While large audio-language models (LALMs) have demonstrated state-of-the-art audio understanding, their reasoning capability in complex soundscapes still falls behind large vision-language models (LVLMs). Compared to the visual domain, one…

Sound · Computer Science 2025-09-22 Qiaolin Wang , Xilin Jiang , Linyang He , Junkai Wu , Nima Mesgarani

Multimodal Large Language Models (MLLMs) have showcased exceptional Chain-of-Thought (CoT) reasoning ability in complex textual inference tasks including causal reasoning. However, will these causalities remain straightforward when crucial…

Computer Vision and Pattern Recognition · Computer Science 2025-05-28 Zhiyuan Li , Heng Wang , Dongnan Liu , Chaoyi Zhang , Ao Ma , Jieting Long , Weidong Cai

Chain-of-thought (CoT) reasoning has been highly successful in solving complex tasks in natural language processing, and recent multimodal large language models (MLLMs) have extended this paradigm to video reasoning. However, these models…

Computer Vision and Pattern Recognition · Computer Science 2025-12-11 Yiwu Zhong , Zi-Yuan Hu , Yin Li , Liwei Wang

Large Language Models (LLMs) have demonstrated potential in predicting mental health outcomes from online text, yet traditional classification methods often lack interpretability and robustness. This study evaluates structured reasoning…

Computation and Language · Computer Science 2026-01-09 Avinash Patil , Amardeep Kour Gedhu

Chain-of-thought (CoT) reasoning boosts large language models' (LLMs) performance on complex tasks but faces two key limitations: a lack of reliability when solely relying on LLM-generated reasoning chains and lower reasoning performance…

Computation and Language · Computer Science 2025-09-11 Feiyang Li , Peng Fang , Zhan Shi , Arijit Khan , Fang Wang , Weihao Wang , Xin Zhang , Yongjian Cui

Current multimodal large language models (MLLMs), while effective in natural image understanding, struggle with visualization understanding due to their inability to decode the data-to-visual mapping and extract structured information. To…

Human-Computer Interaction · Computer Science 2025-07-03 Can Liu , Chunlin Da , Xiaoxiao Long , Yuxiao Yang , Yu Zhang , Yong Wang

The current remote sensing image analysis task is increasingly evolving from traditional object recognition to complex intelligence reasoning, which places higher requirements on the model's reasoning ability and the flexibility of tool…

Artificial Intelligence · Computer Science 2025-12-04 Chujie Wang , Zhiyuan Luo , Ruiqi Liu , Can Ran , Shenghua Fan , Xi Chen , Chu He

With the remarkable success of Multimodal Large Language Models (MLLMs) in perception tasks, enhancing their complex reasoning capabilities has emerged as a critical research focus. Existing models still suffer from challenges such as…

Computation and Language · Computer Science 2025-12-01 Wenxin Zhu , Andong Chen , Yuchen Song , Kehai Chen , Conghui Zhu , Ziyan Chen , Tiejun Zhao

Multimodal large language models (MLLMs) have advanced the integration of visual and linguistic modalities, establishing themselves as the dominant paradigm for visual-language tasks. Current approaches like chain of thought (CoT) reasoning…

Computer Vision and Pattern Recognition · Computer Science 2024-11-20 Haojie Zheng , Tianyang Xu , Hanchi Sun , Shu Pu , Ruoxi Chen , Lichao Sun

Providing knowledge documents for large language models (LLMs) has emerged as a promising solution to update the static knowledge inherent in their parameters. However, knowledge in the document may conflict with the memory of LLMs due to…

Computation and Language · Computer Science 2024-04-05 Yantao Liu , Zijun Yao , Xin Lv , Yuchen Fan , Shulin Cao , Jifan Yu , Lei Hou , Juanzi Li

Information Visualization has been utilized to gain insights from complex data. In recent times, Large Language models (LLMs) have performed very well in many tasks. In this paper, we showcase the capabilities of different popular LLMs to…

Human-Computer Interaction · Computer Science 2025-08-01 Saadiq Rauf Khan , Vinit Chandak , Sougata Mukherjea

Despite significant evolution of CUDA programming and domain-specific libraries, effectively utilizing GPUs with massively parallel engines remains difficult. Large language models (LLMs) show strong potential in generating optimized CUDA…

Machine Learning · Computer Science 2025-10-24 Junfeng Gong , Zhiyi Wei , Junying Chen , Cheng Liu , Huawei Li

Large Language Models (LLMs) have recently demonstrated exceptional performance in various Natural Language Processing (NLP) tasks. They have also shown the ability to perform chain-of-thought (CoT) reasoning to solve complex problems.…

Computation and Language · Computer Science 2023-12-19 Lei Wang , Yi Hu , Jiabang He , Xing Xu , Ning Liu , Hui Liu , Heng Tao Shen

Large language models (LLMs) have become the cornerstone of modern AI. However, the existing paradigm of next-token prediction fundamentally limits their ability to form coherent, high-level concepts, making it a critical barrier to…

Machine Learning · Computer Science 2025-06-16 Michael K. Chen , Xikun Zhang , Jiaxing Huang , Dacheng Tao

Recent methods for customizing Large Vision Language Models (LVLMs) for domain-specific tasks have shown promising results in scientific chart comprehension. However, existing approaches face two major limitations: First, they rely on…

Computation and Language · Computer Science 2025-07-22 Wan-Cyuan Fan , Yen-Chun Chen , Mengchen Liu , Alexander Jacobson , Lu Yuan , Leonid Sigal