English
Related papers

Related papers: LDC: Learning to Generate Research Idea with Dynam…

200 papers

While Large language models (LLMs) have proved able to address some complex reasoning tasks, we also know that they are highly sensitive to input variation, which can lead to different solution paths and final answers. Answer consistency…

Computation and Language · Computer Science 2025-03-05 Huiyuan Lai , Xiao Zhang , Malvina Nissim

Large language models (LLMs) have transformed human writing by enhancing grammar correction, content expansion, and stylistic refinement. However, their widespread use raises concerns about authorship, originality, and ethics, even…

Computation and Language · Computer Science 2024-10-21 Zhen Tao , Zhiyu Li , Runyu Chen , Dinghao Xi , Wei Xu

Fine-tuning Large Language Models (LLMs) typically involves either full fine-tuning, which updates all model parameters, or Parameter-Efficient Fine-Tuning (PEFT), which adjusts a small subset of parameters. However, both approaches have…

Artificial Intelligence · Computer Science 2026-04-14 Shaocong Ma , Peiran Yu , Heng Huang

Large language models (LLMs) have achieved remarkable progress in code generation, yet their true programming competence remains underexplored. We introduce the Code Triangle framework, which systematically evaluates LLMs across three…

Computation and Language · Computer Science 2025-07-09 Taolin Zhang , Zihan Ma , Maosong Cao , Junnan Liu , Songyang Zhang , Kai Chen

Large language models (LLMs) have emerged as effective action policies for sequential decision-making (SDM) tasks due to their extensive prior knowledge. However, this broad yet general knowledge is often insufficient for specific…

Machine Learning · Computer Science 2025-10-01 Xue Yan , Zijing Ou , Mengyue Yang , Yan Song , Haifeng Zhang , Yingzhen Li , Jun Wang

Large language models (LLMs) have demonstrated significant potential to accelerate scientific discovery as valuable tools for analyzing data, generating hypotheses, and supporting innovative approaches in various scientific fields. In this…

Computation and Language · Computer Science 2025-10-30 Jin Huang , Silviu Cucerzan , Sujay Kumar Jauhar , Ryen W. White

Large Language Models (LLMs) are powerful but prone to hallucinations due to static knowledge. Retrieval-Augmented Generation (RAG) helps by injecting external information, but current methods often are costly, generalize poorly, or ignore…

Computation and Language · Computer Science 2025-05-23 Huatong Song , Jinhao Jiang , Wenqing Tian , Zhipeng Chen , Yuhuan Wu , Jiahao Zhao , Yingqian Min , Wayne Xin Zhao , Lei Fang , Ji-Rong Wen

Large Language Models (LLMs) have shown remarkable reasoning capabilities, while their practical applications are limited by severe factual hallucinations due to limitations in the timeliness, accuracy, and comprehensiveness of their…

Artificial Intelligence · Computer Science 2025-06-10 Xinyan Guan , Jiali Zeng , Fandong Meng , Chunlei Xin , Yaojie Lu , Hongyu Lin , Xianpei Han , Le Sun , Jie Zhou

Owing to the unprecedented capability in semantic understanding and logical reasoning, the pre-trained large language models (LLMs) have shown fantastic potential in developing the next-generation recommender systems (RSs). However, the…

Large language models (LLMs) are increasingly used in scientific research and discovery, supporting tasks ranging from literature retrieval and synthesis to hypothesis generation, autonomous experimentation, and research evaluation.…

Digital Libraries · Computer Science 2026-05-13 Haoxuan Zhang , Ruochi Li , Yang Zhang , Ting Xiao , Jiangping Chen , Junhua Ding , Haihua Chen

Measuring innovation often relies on context-specific proxies and on expert evaluation. Hence, empirical innovation research is often limited to settings where such data is available. We investigate how large language models (LLMs) can be…

Computation and Language · Computer Science 2025-08-05 Robin Nowak , Patrick Figge , Carolin Haeussler

Large Language Models (LLMs) have achieved remarkable performance across a wide range of mathematical benchmarks. However, concerns remain as to whether these successes reflect genuine reasoning or superficial pattern recognition. Existing…

Artificial Intelligence · Computer Science 2026-04-21 Yujie Hou , Mei Wang , Yaoyao Zhong , Ting Zhang , Xuetao Ma , Hua Huang

Improving Multi-modal Large Language Models (MLLMs) in the post-training stage typically relies on supervised fine-tuning (SFT) or reinforcement learning (RL), which require expensive and manually annotated multi-modal data--an ultimately…

Computation and Language · Computer Science 2025-10-28 Lai Wei , Yuting Li , Chen Wang , Yue Wang , Linghe Kong , Weiran Huang , Lichao Sun

Thinking Large Language Models (LLMs) generate explicit intermediate reasoning traces before final answers, potentially improving transparency, interpretability, and solution accuracy for code generation. However, the quality of these…

Artificial Intelligence · Computer Science 2025-11-11 Haoran Xue , Gias Uddin , Song Wang

Recent advancements in large language models (LLMs) have demonstrated impressive chain-of-thought reasoning capabilities, with reinforcement learning (RL) playing a crucial role in this progress. While "aha moment" patterns--where models…

Computation and Language · Computer Science 2025-07-24 Lai Wei , Yuting Li , Kaipeng Zheng , Chen Wang , Yue Wang , Linghe Kong , Lichao Sun , Weiran Huang

Large Language Models (LLMs) consistently benefit from scaled Chain-of-Thought (CoT) reasoning, but also suffer from heavy computational overhead. To address this issue, efficient reasoning aims to incentivize short yet accurate thinking…

Computation and Language · Computer Science 2026-03-23 Taiqiang Wu , Zenan Xu , Bo Zhou , Ngai Wong

Large language models (LLMs) have demonstrated emergent capabilities across diverse reasoning tasks via popular Chains-of-Thought (COT) prompting. However, such a simple and fast COT approach often encounters limitations in dealing with…

Computation and Language · Computer Science 2024-07-02 Jiabao Pan , Yan Zhang , Chen Zhang , Zuozhu Liu , Hongwei Wang , Haizhou Li

Scientific progress increasingly relies on effective collaboration among researchers, a dynamic that large language models (LLMs) have only begun to emulate. While recent LLM-based scientist agents show promise in autonomous scientific…

Artificial Intelligence · Computer Science 2025-08-04 Weilun Yu , Shixiang Tang , Yonggui Huang , Nanqing Dong , Li Fan , Honggang Qi , Wei Liu , Xiaoli Diao , Xi Chen , Wanli Ouyang

Large Language Models (LLMs) have transformed natural language processing and hold growing promise for advancing science, healthcare, and decision-making. Yet their training paradigms remain dominated by affirmation-based inference, akin to…

Artificial Intelligence · Computer Science 2025-12-05 Peter B. Walker , Hannah Davidson , Aiden Foster , Matthew Lienert , Thomas Pardue , Dale Russell

Large language models (LLMs) bring unprecedented flexibility in defining and executing complex, creative natural language generation (NLG) tasks. Yet, this flexibility brings new challenges, as it introduces new degrees of freedom in…

Computation and Language · Computer Science 2024-07-08 Furkan Şahinuç , Ilia Kuznetsov , Yufang Hou , Iryna Gurevych