English
Related papers

Related papers: LLMSense: Harnessing LLMs for High-level Reasoning…

200 papers

We propose integration of reasoning into speech large language models (speechLLMs) for the end-to-end slot-filling task. Inspired by the recent development of reasoning LLMs, we use a chain-of-thought framework to decompose the slot-filling…

Computation and Language · Computer Science 2026-02-04 Kadri Hacioglu , Manjunath K E , Andreas Stolcke

Long-context modeling has drawn more and more attention in the area of Large Language Models (LLMs). Continual training with long-context data becomes the de-facto method to equip LLMs with the ability to process long inputs. However, it…

Computation and Language · Computer Science 2025-10-14 Jianghao Chen , Junhong Wu , Yangyifan Xu , Jiajun Zhang

Recent advances in large language models (LLMs) have revolutionized the landscape of reasoning tasks. To enhance the capabilities of LLMs to emulate human reasoning, prior studies have focused on modeling reasoning steps using various…

Artificial Intelligence · Computer Science 2024-05-28 Hongda Sun , Weikai Xu , Wei Liu , Jian Luan , Bin Wang , Shuo Shang , Ji-Rong Wen , Rui Yan

Reasoning in Large Language Models incurs significant inference-time compute, yet the token-level information structure of reasoning traces remains underexplored. We observe that reasoning tokens split into two functional types: low-entropy…

Computation and Language · Computer Science 2026-05-06 Zhenyu Zhao , Sander Land , Daniel M. Bikel , Waseem Alshikh

Sustaining long-term interactions remains a bottleneck for Large Language Models (LLMs), as their limited context windows struggle to manage dialogue histories that extend over time. Existing memory systems often treat interactions as…

Computation and Language · Computer Science 2026-02-11 Yiming Shu , Pei Liu , Tiange Zhang , Ruiyang Gao , Jun Ma , Chen Sun

There is a burgeoning discussion around the capabilities of Large Language Models (LLMs) in acting as fundamental components that can be seamlessly incorporated into Artificial Intelligence of Things (AIoT) to interpret complex…

Computation and Language · Computer Science 2024-03-12 Huanqi Yang , Sijie Ji , Rucheng Wu , Weitao Xu

Event log analysis is an important task that security professionals undertake. Event logs record key information on activities that occur on computing devices, and due to the substantial number of events generated, they consume a large…

Artificial Intelligence · Computer Science 2025-02-04 Siraaj Akhtar , Saad Khan , Simon Parkinson

Large language models (LLMs) are increasingly applied to sequential decision-making through in-context learning (ICL), yet their effectiveness is highly sensitive to prompt quality. Effective prompts should meet three principles: focus on…

Artificial Intelligence · Computer Science 2025-11-19 Ruomeng Ding , Wei Cheng , Minglai Shao , Chen Zhao

Empowering LLMs with the ability to precisely understand long contexts is crucial for many downstream applications. However, handling long contexts with conventional transformer architecture requires substantial training and inference…

Computation and Language · Computer Science 2024-12-24 Zhenyu Li , Yike Zhang , Tengyu Pan , Yutao Sun , Zhichao Duan , Junjie Fang , Rong Han , Zixuan Wang , Jianyong Wang

Recent advancements in Large Language Models (LLMs) have brought them closer to matching human cognition across a variety of tasks. How well do these models align with human performance in detecting and mapping analogies? Prior research has…

Computation and Language · Computer Science 2025-07-16 Kalit Inani , Keshav Kabra , Vijay Marupudi , Sashank Varma

Despite great performance on Olympiad-level reasoning problems, frontier large language models can still struggle on high school math when presented with novel problems outside standard benchmarks. Going beyond final accuracy, we propose a…

Computation and Language · Computer Science 2025-04-10 Atharva Pandey , Kshitij Dubey , Rahul Sharma , Amit Sharma

This paper proposes CES, a task to evaluate the abilities of LLMs in simulating program execution and using that reasoning in programming tasks. Besides measuring the correctness of variable predictions during execution simulation, CES…

Software Engineering · Computer Science 2026-04-08 Changshu Liu , Yang Chen , Reyhaneh Jabbarvand

Large Language Models (LLMs) changed the way we design and interact with software systems. Their ability to process and extract information from text has drastically improved productivity in a number of routine tasks. Developers that want…

Machine Learning · Computer Science 2025-08-26 Federico Errica , Giuseppe Siracusano , Davide Sanvito , Roberto Bifulco

Understanding human mobility patterns is essential for various applications, from urban planning to public safety. The individual trajectory such as mobile phone location data, while rich in spatio-temporal information, often lacks semantic…

Artificial Intelligence · Computer Science 2024-05-31 Yuxiao Luo , Zhongcai Cao , Xin Jin , Kang Liu , Ling Yin

Multimodal large language models (MLLMs), with their expansive world knowledge and reasoning capabilities, present a unique opportunity for end-users to create personalized AI sensors capable of reasoning about complex situations. A user…

Human-Computer Interaction · Computer Science 2025-01-28 Michael Xieyang Liu , Savvas Petridis , Vivian Tsai , Alexander J. Fiannaca , Alex Olwal , Michael Terry , Carrie J. Cai

This paper explores the use of large language models (LLMs) as research tools in the history, philosophy, and sociology of science (HPSS). LLMs are remarkably effective at processing unstructured text and inferring meaning from context,…

Computation and Language · Computer Science 2025-06-17 Arno Simons , Michael Zichert , Adrian Wüthrich

Deploying LLMs raises two coupled challenges: (1) monitoring--estimating where a model underperforms as traffic and domains drift--and (2) improvement--prioritizing data acquisition to close the largest performance gaps. We test whether an…

Computation and Language · Computer Science 2026-05-27 Pedro Memoli Buffa , Luciano Del Corro

This demo presents a novel end-to-end framework that combines on-device large language models (LLMs) with smartphone sensing technologies to achieve context-aware and personalized services. The framework addresses critical limitations of…

Human-Computer Interaction · Computer Science 2024-07-25 Shiquan Zhang , Ying Ma , Le Fang , Hong Jia , Simon D'Alfonso , Vassilis Kostakos

Autonomous control systems face significant challenges in performing complex tasks in the presence of latent risks. To address this, we propose an integrated framework that combines Large Language Models (LLMs), numerical optimization, and…

Systems and Control · Electrical Eng. & Systems 2025-05-08 Xiyu Deng , Quan Khanh Luu , Anh Van Ho , Yorie Nakahira

The need to recognise long-term dependencies in sequential data such as video streams has made Long Short-Term Memory (LSTM) networks a prominent Artificial Intelligence model for many emerging applications. However, the high computational…

Signal Processing · Electrical Eng. & Systems 2019-10-31 Alexandros Kouris , Stylianos I. Venieris , Michail Rizakis , Christos-Savvas Bouganis