English
Related papers

Related papers: Learning-at-Criticality in Large Language Models f…

200 papers

Large language models (LLMs) have achieved remarkable advancements in natural language processing, showcasing exceptional performance across various tasks. However, the expensive memory and computational requirements present significant…

Artificial Intelligence · Computer Science 2025-11-13 Ruihao Gong , Yifu Ding , Zining Wang , Chengtao Lv , Xingyu Zheng , Jinyang Du , Haotong Qin , Jinyang Guo , Michele Magno , Xianglong Liu

While Large Language Models (LLMs) are increasingly applied in student-facing educational tools, their potential to directly support educators through locally deployable and customizable solutions remains underexplored. Many existing…

Computers and Society · Computer Science 2025-11-18 Zarreen Reza , Alexander Mazur , Michael T. Dugdale , Robin Ray-Chaudhuri

Large Reasoning Models (LRMs) demonstrate remarkable capabilities on complex tasks, exhibiting emergent, human-like thinking patterns. Despite their advances, we identify a fundamental limitation: current LRMs lack a dedicated meta-level…

Artificial Intelligence · Computer Science 2025-08-26 Haonan Dong , Haoran Ye , Wenhao Zhu , Kehan Jiang , Guojie Song

Generative artificial intelligence (AI) systems based on large-scale pretrained foundation models (PFMs) such as vision-language models, large language models (LLMs), diffusion models and vision-language-action (VLA) models have…

Artificial Intelligence · Computer Science 2025-01-07 Alhassan Mumuni , Fuseini Mumuni

Studies have underscored how, regardless of the recent breakthrough and swift advances in AI research, even state-of-the-art Large Language models (LLMs) continue to struggle when performing logical and mathematical reasoning. The results…

Artificial Intelligence · Computer Science 2024-12-20 Federico Castagna , Isabel Sassoon , Simon Parsons

Scientific progress is tightly coupled to the emergence of new research tools. Today, machine learning (ML)-especially deep learning (DL)-has become a transformative instrument for quantum science and technology. Owing to the intrinsic…

Quantum Physics · Physics 2025-08-15 Timothy Heightman , Marcin Płodzień

Long-context reasoning is essential for complex real-world applications, yet remains a significant challenge for Large Language Models (LLMs). Despite the rapid evolution in long-context reasoning, current research often overlooks the…

Computation and Language · Computer Science 2026-04-10 Yanling Xiao , Huaibing Xie , Guoliang Zhao , Shihan Dou , Shaolei Wang , Yiting Liu , Nantao Zheng , Cheng Zhang , Pluto Zhou , Zhisong Zhang , Lemao Liu

Critiques are important for enhancing the performance of Large Language Models (LLMs), enabling both self-improvement and constructive feedback for others by identifying flaws and suggesting improvements. However, evaluating the critique…

Computation and Language · Computer Science 2025-01-27 Zhengyang Tang , Ziniu Li , Zhenyang Xiao , Tian Ding , Ruoyu Sun , Benyou Wang , Dayiheng Liu , Fei Huang , Tianyu Liu , Bowen Yu , Junyang Lin

Large Language Models (LLMs) have recently emerged as a powerful paradigm for Knowledge Graph Completion (KGC), offering strong reasoning and generalization capabilities beyond traditional embedding-based approaches. However, existing…

Computation and Language · Computer Science 2025-10-14 Wenbin Guo , Xin Wang , Jiaoyan Chen , Lingbing Guo , Zhao Li , Zirui Chen

Reinforcement learning (RL) is a promising approach for aligning large language models (LLMs) knowledge with sequential decision-making tasks. However, few studies have thoroughly investigated the impact on LLM agents capabilities of…

Large Language Models (LLMs) demonstrate impressive capabilities but lack robust temporal intelligence, struggling to integrate reasoning about the past with predictions and plausible generations of the future. Meanwhile, existing methods…

Computation and Language · Computer Science 2025-06-04 Zijia Liu , Peixuan Han , Haofei Yu , Haoru Li , Jiaxuan You

Large language models (LLMs) with billions of parameters exhibit in-context learning abilities, enabling few-shot learning on tasks that the model was not specifically trained for. Traditional models achieve breakthrough performance on…

Artificial Intelligence · Computer Science 2025-11-04 Aske Plaat , Annie Wong , Suzan Verberne , Joost Broekens , Niki van Stein , Thomas Back

In recommendation systems, diversity and novelty are essential for capturing varied user preferences and encouraging exploration, yet many systems prioritize click relevance. While reinforcement learning (RL) has been explored to improve…

Machine Learning · Computer Science 2025-07-30 Jiin Woo , Alireza Bagheri Garakani , Tianchen Zhou , Zhishen Huang , Yan Gao

The deployment of unmanned aerial vehicles (UAVs) for reliable and energy-efficient data collection from spatially distributed devices holds great promise in supporting diverse Internet of Things (IoT) applications. Nevertheless, the…

Systems and Control · Electrical Eng. & Systems 2025-09-23 Zhixion Chen , Jiangzhou Wang , Hyundong Shin , Arumugam Nallanathan

Recent large reasoning models (LRMs) have demonstrated strong reasoning capabilities through reinforcement learning (RL). These improvements have primarily been observed within the short-context reasoning tasks. In contrast, extending LRMs…

Computation and Language · Computer Science 2025-05-28 Fanqi Wan , Weizhou Shen , Shengyi Liao , Yingcheng Shi , Chenliang Li , Ziyi Yang , Ji Zhang , Fei Huang , Jingren Zhou , Ming Yan

The increasing capacities of large language models (LLMs) have been shown to present an unprecedented opportunity to scale up data analytics in the humanities and social sciences, by automating complex qualitative tasks otherwise typically…

Computation and Language · Computer Science 2024-10-22 Andres Karjus

Large reasoning models (LRMs) already possess a latent capacity for long chain-of-thought reasoning. Prior work has shown that outcome-based reinforcement learning (RL) can incidentally elicit advanced reasoning behaviors such as…

Computation and Language · Computer Science 2025-05-28 Zhiyuan Hu , Yibo Wang , Hanze Dong , Yuhui Xu , Amrita Saha , Caiming Xiong , Bryan Hooi , Junnan Li

Large-Language Models (LLMs) are changing the way learners acquire knowledge outside the classroom setting. Previous studies have shown that LLMs seem effective in generating to short and simple questions in introductory CS courses using…

Programming Languages · Computer Science 2026-03-09 Yihan Zhang , Brigitte Pientka , Xujie Si

Incremental learning is the ability of systems to acquire knowledge over time, enabling their adaptation and generalization to novel tasks. It is a critical ability for intelligent, real-world systems, especially when data changes…

Machine Learning · Computer Science 2025-09-03 Mladjan Jovanovic , Peter Voss

Large Language Models (LLMs) pre-trained on internet-scale datasets have shown impressive capabilities in code understanding, synthesis, and general purpose question-and-answering. Key to their performance is the substantial prior knowledge…

Robotics · Computer Science 2023-11-03 Andrea Tagliabue , Kota Kondo , Tong Zhao , Mason Peterson , Claudius T. Tewari , Jonathan P. How