English
Related papers

Related papers: Evo-DKD: Dual-Knowledge Decoding for Autonomous On…

200 papers

Existing Vision Language Models (VLMs) architecturally rooted in "flatland" perception, fundamentally struggle to comprehend real-world 3D spatial intelligence. This failure stems from a dual-bottleneck: input-stage conflict between…

Computer Vision and Pattern Recognition · Computer Science 2025-11-19 Zhongbin Guo , Jiahe Liu , Yushan Li , Wenyu Gao , Zhen Yang , Chenzhi Li , Xinyue Zhang , Ping Jian

Visual document understanding (VDU) is a challenging task that involves understanding documents across various modalities (text and image) and layouts (forms, tables, etc.). This study aims to enhance generalizability of small VDU models by…

Computer Vision and Pattern Recognition · Computer Science 2024-10-07 Sungnyun Kim , Haofu Liao , Srikar Appalaraju , Peng Tang , Zhuowen Tu , Ravi Kumar Satzoda , R. Manmatha , Vijay Mahadevan , Stefano Soatto

Using Large Language Models (LLMs) to process graph-structured data is an active research area, yet current state-of-the-art approaches typically rely on multi-step pipelines with Graph Neural Network (GNN) encoders that compress rich…

Machine Learning · Computer Science 2026-05-12 Dario Vajda

CUDA kernel optimization has become a critical bottleneck for AI performance, as deep learning training and inference efficiency directly depends on highly optimized GPU kernels. Despite the promise of Large Language Models (LLMs) for…

Machine Learning · Computer Science 2025-10-07 Ping Guo , Chenyu Zhu , Siyuan Chen , Fei Liu , Xi Lin , Zhichao Lu , Qingfu Zhang

Extracting relevant and structured knowledge from large, complex technical documents within the Reliability and Maintainability (RAM) domain is labor-intensive and prone to errors. Our work addresses this challenge by presenting OntoKGen, a…

Artificial Intelligence · Computer Science 2024-12-11 Mohammad Sadeq Abolhasani , Rong Pan

Structured reasoning over natural language inputs remains a core challenge in artificial intelligence, as it requires bridging the gap between unstructured linguistic expressions and formal logical representations. In this paper, we propose…

Artificial Intelligence · Computer Science 2025-07-14 Keying Yang , Hao Wang , Kai Yang

Large-scale models (LSMs) can be an effective framework for semantic representation and understanding, thereby providing a suitable tool for designing semantic communication (SC) systems. However, their direct deployment is often hindered…

Machine Learning · Computer Science 2025-08-26 Kuiyuan Ding , Caili Guo , Yang Yang , Zhongtian Du , Walid Saad

Explorative flow visualization allows domain experts to analyze complex flow structures by interactively investigating flow patterns. However, traditional visual interfaces often rely on specialized graphical representations and…

Human-Computer Interaction · Computer Science 2025-08-11 Weihan Zhang , Jun Tao

Large language models (LLMs) have achieved remarkable success in natural language tasks, but their inference incurs substantial computational and memory overhead. To improve efficiency, parallel decoding methods like Skeleton-of-Thought…

Computation and Language · Computer Science 2025-04-15 Shuowei Jin , Xueshen Liu , Yongji Wu , Haizhong Zheng , Qingzhao Zhang , Atul Prakash , Matthew Lentz , Danyang Zhuo , Feng Qian , Z. Morley Mao

Large Language Models (LLMs) significantly benefit from Chain-of-Thought (CoT) prompting in performing various reasoning tasks. While CoT allows models to produce more comprehensive reasoning processes, its emphasis on intermediate…

Computation and Language · Computer Science 2023-10-05 Zhan Ling , Yunhao Fang , Xuanlin Li , Zhiao Huang , Mingu Lee , Roland Memisevic , Hao Su

Large Language Models (LLMs) have shown significant potential for ontology engineering. However, it is still unclear to what extent they are applicable to the task of domain-specific ontology generation. In this study, we explore the…

We study how to extend chain-of-thought (CoT) beyond language to better handle multimodal reasoning. While CoT helps LLMs and VLMs articulate intermediate steps, its text-only form often fails on vision-intensive problems where key…

Artificial Intelligence · Computer Science 2026-02-03 Yifei Shao , Kun Zhou , Ziming Xu , Mohammad Atif Quamar , Shibo Hao , Zhen Wang , Zhiting Hu , Biwei Huang

While multimodal large language models (MLLMs) have made groundbreaking progress in embodied intelligence, they still face significant challenges in spatial reasoning for complex long-horizon tasks. To address this gap, we propose…

Large Language Models (LLMs) have demonstrated strong capabilities in various natural language processing tasks; however, their application to graph-related problems remains limited, primarily due to scalability constraints and the absence…

Machine Learning · Computer Science 2025-05-08 Hyun Lee , Chris Yi , Maminur Islam , B. D. S. Aritra

Chain-of-thought (CoT) reasoning boosts large language models' (LLMs) performance on complex tasks but faces two key limitations: a lack of reliability when solely relying on LLM-generated reasoning chains and lower reasoning performance…

Computation and Language · Computer Science 2025-09-11 Feiyang Li , Peng Fang , Zhan Shi , Arijit Khan , Fang Wang , Weihao Wang , Xin Zhang , Yongjian Cui

Adapting large language models (LLMs) to a targeted task efficiently and effectively remains a fundamental challenge. Such adaptation often requires iteratively improving the model toward a targeted task, yet collecting high-quality…

Computation and Language · Computer Science 2026-04-30 Ting-Wei Li , Sirui Chen , Jiaru Zou , Yingbing Huang , Tianxin Wei , Jingrui He , Hanghang Tong

Automated kernel design is critical for overcoming software ecosystem barriers in emerging hardware platforms like RISC-V. While large language models (LLMs) have shown promise for automated kernel optimization, demonstrating success in…

Software Engineering · Computer Science 2025-09-19 Siyuan Chen , Zhichao Lu , Qingfu Zhang

We address a not-widely-recognized subset of exploratory search, where a user sets out on a typically long "search quest" for the perfect wedding dress, overlooked research topic, killer company idea, etc. The first few outputs of current…

Computation and Language · Computer Science 2026-04-01 Queenie Luo , Gary King , Michael Puett , Michael D. Smith

Generative inference in Large Language Models (LLMs) is impeded by the growing memory demands of Key-Value (KV) cache, especially for longer sequences. Traditional KV cache eviction strategies, which discard less critical KV pairs based on…

Computation and Language · Computer Science 2025-03-14 Zhongwei Wan , Xinjian Wu , Yu Zhang , Yi Xin , Chaofan Tao , Zhihong Zhu , Xin Wang , Siqi Luo , Jing Xiong , Longyue Wang , Mi Zhang

In the current development of large language models (LLMs), it is important to ensure the accuracy and reliability of the underlying data sources. LLMs are critical for various applications, but they often suffer from hallucinations and…

Artificial Intelligence · Computer Science 2025-01-14 Jiayang Wu , Wensheng Gan , Jiahao Zhang , Philip S. Yu