English
Related papers

Related papers: LLM-State: Open World State Representation for Lon…

200 papers

Large Language Models (LLMs) have recently developed new advanced functionalities. Their effectiveness relies on statistical learning and generalization capabilities. However, they face limitations in internalizing the data they process and…

Machine Learning · Computer Science 2026-01-14 Farah Ben Slama , Frédéric Armetta

Recent studies have uncovered the potential of Large Language Models (LLMs) in addressing complex sequential decision-making tasks through the provision of high-level instructions. However, LLM-based agents lack specialization in tackling…

Artificial Intelligence · Computer Science 2024-05-28 Zihao Zhou , Bin Hu , Chenyang Zhao , Pu Zhang , Bin Liu

Skeleton-based action recognition has attracted lots of research attention. Recently, to build an accurate skeleton-based action recognizer, a variety of works have been proposed. Among them, some works use large model architectures as…

Computer Vision and Pattern Recognition · Computer Science 2024-04-02 Haoxuan Qu , Yujun Cai , Jun Liu

With the advent of Large Language Models (LLMs), generating rule-based data for real-world applications has become more accessible. Due to the inherent ambiguity of natural language and the complexity of rule sets, especially in long…

Computation and Language · Computer Science 2025-04-21 Teng Wang , Zhenqi He , Wing-Yin Yu , Xiaojin Fu , Xiongwei Han

Large language models (LLMs) are being applied as actors for sequential decision making tasks in domains such as robotics and games, utilizing their general world knowledge and planning abilities. However, previous work does little to…

Machine Learning · Computer Science 2023-07-25 Kolby Nottingham , Yasaman Razeghi , Kyungmin Kim , JB Lanier , Pierre Baldi , Roy Fox , Sameer Singh

Large Language Models (LLMs) excel in various natural language tasks but often struggle with long-horizon planning problems requiring structured reasoning. This limitation has drawn interest in integrating neuro-symbolic approaches within…

Artificial Intelligence · Computer Science 2025-10-28 Marcus Tantakoun , Xiaodan Zhu , Christian Muise

Large Language Models (LLMs) have demonstrated exceptional proficiency in text understanding and embedding tasks. However, their potential in multimodal representation, particularly for item-to-item (I2I) recommendations, remains…

Information Retrieval · Computer Science 2025-01-22 Chao Zhang , Haoxin Zhang , Shiwei Wu , Di Wu , Tong Xu , Xiangyu Zhao , Yan Gao , Yao Hu , Enhong Chen

Recent work reports that Large Reasoning Models (LRMs) undergo a collapse in performance on solving puzzles beyond certain perplexity thresholds. In subsequent discourse, questions have arisen as to whether the nature of the task muddles an…

Artificial Intelligence · Computer Science 2025-10-21 Chris Su , Harrison Li , Matheus Marques , George Flint , Kevin Zhu , Sunishchal Dev

Recent advances in Large Language Models (LLMs) have opened new perspectives for automation in optimization. While several studies have explored how LLMs can generate or solve optimization models, far less is understood about what these…

Artificial Intelligence · Computer Science 2025-12-16 Francesca Da Ros , Luca Di Gaspero , Kevin Roitero

Efficient processing of long contexts has been a persistent pursuit in Natural Language Processing. With the growing number of long documents, dialogues, and other textual data, it is important to develop Long Context Language Models…

The continued success of Large Language Models (LLMs) and other generative artificial intelligence approaches highlights the advantages that large information corpora can have over rigidly defined symbolic models, but also serves as a…

Motivated by the substantial achievements observed in Large Language Models (LLMs) in the field of natural language processing, recent research has commenced investigations into the application of LLMs for complex, long-horizon sequential…

Robotics · Computer Science 2023-08-29 Zhehua Zhou , Jiayang Song , Kunpeng Yao , Zhan Shu , Lei Ma

Large language models (LLMs) have brought autonomous agents closer to artificial general intelligence (AGI) due to their promising generalization and emergent capabilities. There is, however, a lack of studies on how LLM-based agents…

Artificial Intelligence · Computer Science 2024-08-13 Yanan Chen , Ali Pesaranghader , Tanmana Sadhu , Dong Hoon Yi

With the success of large language models (LLMs), integrating the vision model into LLMs to build vision-language foundation models has gained much more interest recently. However, existing LLM-based large multimodal models (e.g.,…

Computer Vision and Pattern Recognition · Computer Science 2024-04-25 Bo He , Hengduo Li , Young Kyun Jang , Menglin Jia , Xuefei Cao , Ashish Shah , Abhinav Shrivastava , Ser-Nam Lim

Recently, large language models (LLMs) have achieved widespread application across various fields. Despite their impressive capabilities, LLMs suffer from a lack of structured reasoning ability, particularly for complex tasks requiring…

Artificial Intelligence · Computer Science 2025-09-03 Boqi Chen , Kua Chen , José Antonio Hernández López , Gunter Mussbacher , Dániel Varró , Amir Feizpour

We show that large language models (LLMs) are remarkably good at working with interpretable models that decompose complex outcomes into univariate graph-represented components. By adopting a hierarchical approach to reasoning, LLMs can…

Numerous applications of large language models (LLMs) rely on their ability to perform step-by-step reasoning. However, the reasoning behavior of LLMs remains poorly understood, posing challenges to research, development, and safety. To…

Machine Learning · Computer Science 2026-03-04 Zhanke Zhou , Zhaocheng Zhu , Xuan Li , Mikhail Galkin , Xiao Feng , Sanmi Koyejo , Jian Tang , Bo Han

Large Language Models (LLMs) hold the potential to perform a variety of text processing tasks and provide textual explanations for proposed actions or decisions. In the era of hybrid work, LLMs can provide intelligent decision support for…

Computation and Language · Computer Science 2024-02-07 Yujin Kim , Chin-Chia Hsu

Multi-modal Large Language Models (MLLMs) integrate visual and linguistic reasoning to address complex tasks such as image captioning and visual question answering. While MLLMs demonstrate remarkable versatility, MLLMs appears limited…

Computation and Language · Computer Science 2025-03-07 Wenke Huang , Jian Liang , Xianda Guo , Yiyang Fang , Guancheng Wan , Xuankun Rong , Chi Wen , Zekun Shi , Qingyun Li , Didi Zhu , Yanbiao Ma , Ke Liang , Bin Yang , He Li , Jiawei Shao , Mang Ye , Bo Du

Large Vision-Language Models (LVLMs) show promise for embodied planning tasks but struggle with complex scenarios involving unfamiliar environments and multi-step goals. Current approaches rely on environment-agnostic imitation learning…

Artificial Intelligence · Computer Science 2025-07-03 Junhao Shi , Zhaoye Fei , Siyin Wang , Qipeng Guo , Jingjing Gong , Xipeng Qiu