English
Related papers

Related papers: Structured Belief State and the First Precision-Aw…

200 papers

Extracting structured information from visual documents (Visual Information Extraction, VIE) is a cornerstone of business automation. While recent Multimodal Large Language Models (MLLMs) have shown promising capabilities, existing…

Computer Vision and Pattern Recognition · Computer Science 2026-05-22 Yandi Wang , Libin Zhan , Ziwei Huang , Tiancheng Luo , Yuxuan Jiang , Wang Dong , Leilei Gan , Jun Chen

Large language models (LLMs) have shown remarkable improvements in reasoning and many existing benchmarks have been addressed by models such as o1 and o3 either fully or partially. However, a majority of these benchmarks emphasize deductive…

Machine Learning · Computer Science 2025-05-15 Wenyue Hua , Tyler Wong , Sun Fei , Liangming Pan , Adam Jardine , William Yang Wang

Large language models often suffer from fact loss, timeline confusion, persona drift, and reduced stability during long-range interaction, especially under high-noise knowledge bases, context clearing, and cross-model transfer. To address…

Artificial Intelligence · Computer Science 2026-05-15 Zhao Yang , Wang Huan , Li Yingshuo , Tu Haomiao , Lin Hujite

Although LLM agents can leverage tools for complex tasks, they still need memory to maintain cross-turn consistency and accumulate reusable information in long-horizon interactions. However, retrieval-based external memory systems incur low…

Artificial Intelligence · Computer Science 2026-04-23 Jiaquan Zhang , Chaoning Zhang , Shuxu Chen , Zhenzhen Huang , Pengcheng Zheng , Zhicheng Wang , Ping Guo , Fan Mo , Sung-Ho Bae , Jie Zou , Jiwei Wei , Yang Yang

Theory of Mind (ToM), the ability to infer others' knowledge, intentions, and emotions, is commonly evaluated in large language models (LLMs) using end-point question answering, where performance is judged solely by the final answer to a…

Artificial Intelligence · Computer Science 2026-05-27 Adam Bawatneh , Sagar Sapkota , Amrit Singh Bedi , Santu Karmaker , Mubarak Shah

Automated building facade inspection is a critical component of urban resilience and smart city maintenance. Traditionally, this field has relied on specialized discriminative models (e.g., YOLO, Mask R-CNN) that excel at pixel-level…

Computer Vision and Pattern Recognition · Computer Science 2026-03-23 Hui Zhong , Yichun Gao , Luyan Liu , Hai Yang , Wang Wang , Haowei Zhang , Xinhu Zheng

Large Language Models (LLMs) have demonstrated potential in cybersecurity applications but have also caused lower confidence due to problems like hallucinations and a lack of truthfulness. Existing benchmarks provide general evaluations but…

Existing long-horizon memory benchmarks mostly use multi-turn dialogues or synthetic user histories, which makes retrieval performance an imperfect proxy for person understanding. We present \BenchName, a publicly releasable benchmark built…

Artificial Intelligence · Computer Science 2026-04-21 Tingyu Wu , Zhisheng Chen , Ziyan Weng , Shuhe Wang , Chenglong Li , Shuo Zhang , Sen Hu , Silin Wu , Qizhen Lan , Huacan Wang , Ronghao Chen

LLM agents that operate over long context depend on external memory to accumulate knowledge over time. However, existing methods typically store each observation as a single deterministic conclusion (e.g., inferring "API~X failed" from…

Artificial Intelligence · Computer Science 2026-05-11 Junfeng Liao , Qizhou Wang , Jianing Zhu , Bo Du , Rui Yan , Xiuying Chen

Large language models (LLMs) perform substantially below human level on existing theory-of-mind (ToM) benchmarks, even when augmented with chain-of-thought prompting or probabilistic belief updates. We argue that these failures primarily…

Computation and Language · Computer Science 2026-04-21 Wang Bill Zhu , Qiutong Tony Yi , Robin Jia , Jesse Thomason

Existing REST API testing tools are typically evaluated using code coverage and crash-based fault metrics. However, recent LLM-based approaches increasingly generate tests from NL requirements to validate functional behaviour, making…

Software Engineering · Computer Science 2026-04-29 Leon Kogler , Stefan Hangler , Maximilian Ehrhart , Benedikt Dornauer , Roland Wuersching , Peter Schrammel

End-to-end agent-memory benchmarks report a single hit@k per retriever, confounding lexical leakage (uncontrolled query/gold/distractor entity overlap) with tag-mixing (preferences, services, tools averaged together). We propose…

Computation and Language · Computer Science 2026-05-29 Youwang Deng

Large language models (LLMs) often generate content with unsupported or unverifiable content, known as "hallucinations." To address this, retrieval-augmented LLMs are employed to include citations in their content, grounding the content in…

Information Retrieval · Computer Science 2024-08-23 Weijia Zhang , Mohammad Aliannejadi , Jiahuan Pei , Yifei Yuan , Jia-Hong Huang , Evangelos Kanoulas

We present SCM (Sleep-Consolidated Memory), a research preview of a memory architecture for large language models that draws on neuroscientific principles to address a fundamental limitation in current systems: the absence of persistent,…

Machine Learning · Computer Science 2026-04-24 Saish Sachin Shinde

Across medical specialties, clinical practice is anchored in evidence-based guidelines that codify best studied diagnostic and treatment pathways. These pathways routinely fall short for the long tail of real-world care not covered by…

Memory and computation remain core bottlenecks in long-horizon LLM inference due to the quadratic cost of self-attention and the ever-growing key-value (KV) cache. Existing strategies for memory-bounded inference, such as quantization,…

Machine Learning · Computer Science 2026-03-03 Ngoc Bui , Shubham Sharma , Simran Lamba , Saumitra Mishra , Rex Ying

The black-box nature of Large Language Models necessitates novel evaluation frameworks that transcend surface-level performance metrics. This study investigates the internal neural representations of cognitive complexity using Bloom's…

Artificial Intelligence · Computer Science 2026-02-20 Bianca Raimondi , Maurizio Gabbrielli

LLMs show strong performance in code generation, but their outputs lack correctness guarantees. Sample-based uncertainty estimators address this by generating multiple candidate programs and measuring their disagreement. However, existing…

Software Engineering · Computer Science 2026-05-12 Weilin He , Arindam Sharma , Cristina David

In many sequential tasks, a model needs to remember relevant events from the distant past to make correct predictions. Unfortunately, a straightforward application of gradient based training requires intermediate computations to be stored…

Machine Learning · Computer Science 2023-08-14 Artyom Sorokin , Nazar Buzun , Leonid Pugachev , Mikhail Burtsev

Instruction-tuned large language models produce helpful, structured responses, but how robust is this helpfulness under trivial constraints? We show that simple lexical constraints (banning a single punctuation character or common word)…

Computation and Language · Computer Science 2026-04-28 Erfan Baghaei Potraghloo , Seyedarmin Azizi , Souvik Kundu , Massoud Pedram