English
Related papers

Related papers: Learning Like Humans: Advancing LLM Reasoning Capa…

200 papers

Despite their remarkable performance, Large Language Models (LLMs) face a critical challenge: providing feedback for tasks where human evaluation is difficult or where LLMs potentially outperform humans. In such scenarios, leveraging the…

Computation and Language · Computer Science 2025-08-05 Zhengyang Tang , Ziniu Li , Zhenyang Xiao , Tian Ding , Ruoyu Sun , Benyou Wang , Dayiheng Liu , Fei Huang , Tianyu Liu , Bowen Yu , Junyang Lin

Curriculum learning (CL) mimics human learning, in which easy samples are learned first, followed by harder samples, and has become an effective method for training deep networks. However, many existing automatic CL methods maintain a…

Machine Learning · Computer Science 2026-01-23 Wensheng Li , Yichao Tian , Hao Wang , Ruifeng Zhou , Hanting Guan , Chao Zhang , Dacheng Tao

Recently, large language models (LLMs) have emerged as a groundbreaking technology and their unparalleled text generation capabilities have sparked interest in their application to the fundamental sentence representation learning task.…

Computation and Language · Computer Science 2024-05-20 Huiming Wang , Zhaodonghui Li , Liying Cheng , Soh De Wen , Lidong Bing

Large language models (LLMs) are not amenable to frequent re-training, due to high training costs arising from their massive scale. However, updates are necessary to endow LLMs with new skills and keep them up-to-date with rapidly evolving…

Computation and Language · Computer Science 2024-02-08 Tongtong Wu , Linhao Luo , Yuan-Fang Li , Shirui Pan , Thuy-Trang Vu , Gholamreza Haffari

The complexity of learning problems, such as Generative Adversarial Network (GAN) and its variants, multi-task and meta-learning, hyper-parameter learning, and a variety of real-world vision applications, demands a deeper understanding of…

Computer Vision and Pattern Recognition · Computer Science 2023-07-31 Risheng Liu , Jiaxin Gao , Xuan Liu , Xin Fan

Large language models (LLMs) are increasingly embedded in AI-based tutoring systems. Can they faithfully model novice reasoning and metacognitive judgments? Existing evaluations emphasize problem-solving accuracy, overlooking the fragmented…

Computation and Language · Computer Science 2026-05-12 Conrad Borchers , Jill-Jênn Vie , Roger Azevedo

Domain-specific large language models (LLMs), typically developed by fine-tuning a pre-trained general-purpose LLM on specialized datasets, represent a significant advancement in applied AI. A common strategy in LLM fine-tuning is…

Machine Learning · Computer Science 2026-01-08 Jing-Cheng Pang , Liu Sun , Chang Zhou , Xian Tang , Haichuan Ma , Kun Jiang , Jianlong Wang , Kai Zhang , Sijie Wu , Haoran Cai , Chenwei Wu , Xubin Li , Xin Chen

Although Large Audio-Language Models (LALMs) have exhibited outstanding performance in auditory understanding, their performance in affective computing scenarios, particularly in emotion recognition, reasoning, and subtle sentiment…

Sound · Computer Science 2025-09-23 Pengcheng Li , Botao Zhao , Zuheng Kang , Junqing Peng , Xiaoyang Qu , Yayun He , Jianzong Wang

Reinforcement learning from verifiable rewards (RLVR) has improved the reasoning abilities of LLMs, yet a fundamental limitation remains: models cannot learn from problems that are too difficult to solve under their current policy, as these…

Machine Learning · Computer Science 2026-04-07 Justin Chih-Yao Chen , Archiki Prasad , Zaid Khan , Joykirat Singh , Runchu Tian , Elias Stengel-Eskin , Mohit Bansal

A central goal of cognitive modeling is to develop models that not only predict human behavior but also provide insight into the underlying cognitive mechanisms. While neural network models trained on large-scale behavioral data often…

Artificial Intelligence · Computer Science 2026-02-03 Jian-Qiao Zhu , Hanbo Xie , Dilip Arumugam , Robert C. Wilson , Thomas L. Griffiths

Reinforcement Learning (RL) has emerged as a transformative approach for aligning and enhancing Large Language Models (LLMs), addressing critical challenges in instruction following, ethical alignment, and reasoning capabilities. This…

Artificial Intelligence · Computer Science 2025-07-08 Saksham Sahai Srivastava , Vaneet Aggarwal

Reinforcement Learning with Verifiable Rewards (RLVR) has emerged as a prevailing paradigm for enhancing reasoning in Multimodal Large Language Models (MLLMs). However, relying solely on outcome supervision risks reward hacking, where…

Computation and Language · Computer Science 2026-03-04 Yukun Chen , Jiaming Li , Longze Chen , Ze Gong , Jingpeng Li , Zhen Qin , Hengyu Chang , Ancheng Xu , Zhihao Yang , Hamid Alinejad-Rokny , Qiang Qu , Bo Zheng , Min Yang

Large language models (LLMs) often suffer from catastrophic forgetting in continual learning: after learning new tasks sequentially, they perform worse on earlier tasks. Existing methods mitigate catastrophic forgetting by data replay,…

Machine Learning · Computer Science 2026-05-08 Yazheng Liu , Yuxuan Wan , Rui Xu , Xi Zhang , Sihong Xie , Hui Xiong

Code generation has attracted increasing attention with the rise of Large Language Models (LLMs). Many studies have developed powerful code LLMs by synthesizing code-related instruction data and applying supervised fine-tuning. However,…

Computation and Language · Computer Science 2025-08-22 Changzhi Zhou , Xinyu Zhang , Dandan Song , Xiancai Chen , Wanli Gu , Huipeng Ma , Yuhang Tian , Mengdi Zhang , Linmei Hu

Modern large reasoning models demonstrate impressive problem-solving capabilities by employing sophisticated reasoning strategies. However, they often struggle to balance efficiency and effectiveness, frequently generating unnecessarily…

Artificial Intelligence · Computer Science 2025-12-23 Shijue Huang , Hongru Wang , Wanjun Zhong , Zhaochen Su , Jiazhan Feng , Bowen Cao , Yi R. Fung

Large Language Models (LLMs) have shown the potential to be valuable teaching tools, with the potential of giving every student a personalized tutor. However, one challenge with using LLMs to learn new concepts is that when learning a topic…

Human-Computer Interaction · Computer Science 2024-11-19 Steve Oney , Yue Shen , Fei Wu , Young Suh Hong , Ziang Wang , Yamini Khajekar , Jiacheng Zhang , April Yi Wang

Large language models (LLMs) often make reasoning errors when solving mathematical problems, and how to automatically detect and correct these errors has become an important research direction. However, existing approaches \textit{mainly…

Computation and Language · Computer Science 2025-11-19 Biaojie Zeng , Min Zhang , Juan Zhou , Fengrui Liu , Ruiyang Huang , Xin Lin

Large language models (LLMs) can transform education, but their optimization for direct question-answering often undermines effective pedagogy which requires strategically withholding answers. To mitigate this, we propose an online…

Computation and Language · Computer Science 2025-10-14 David Dinucu-Jianu , Jakub Macina , Nico Daheim , Ido Hakimi , Iryna Gurevych , Mrinmaya Sachan

While search-augmented large language models (LLMs) exhibit impressive capabilities, their reliability in complex multi-hop reasoning remains limited. This limitation arises from three fundamental challenges: decomposition errors, where…

Computation and Language · Computer Science 2026-04-21 Ziliang Wang , Kang An , Xuhui Zheng , Faqiang Qian , Weikun Zhang , Cijun Ouyang , Jialu Cai , Yuhang Wang , Yichao Wu

Curriculum learning (CL) posits that machine learning models -- similar to humans -- may learn more efficiently from data that match their current learning progress. However, CL methods are still poorly understood and, in particular for…

Machine Learning · Computer Science 2023-08-24 Lucas Weber , Jaap Jumelet , Paul Michel , Elia Bruni , Dieuwke Hupkes