English
Related papers

Related papers: RefTool: Reference-Guided Tool Creation for Knowle…

200 papers

Recent advancements in Large Language Models (LLMs) have demonstrated exceptional capabilities in natural language understanding and generation. While these models excel in general complex reasoning tasks, they still face challenges in…

Artificial Intelligence · Computer Science 2024-10-25 Graziano A. Manduzio , Federico A. Galatolo , Mario G. C. A. Cimino , Enzo Pasquale Scilingo , Lorenzo Cominelli

Despite the impressive capabilities of Large Language Models (LLMs) on various tasks, they still struggle with scenarios that involves complex reasoning and planning. Recent work proposed advanced prompting techniques and the necessity of…

Computation and Language · Computer Science 2024-12-11 Ye Tian , Baolin Peng , Linfeng Song , Lifeng Jin , Dian Yu , Haitao Mi , Dong Yu

While Large Language Models (LLMs) achieve near-human performance on standard benchmarks, their capabilities often fail to generalize to complex, real-world problems. To bridge this gap, we introduce DeepQuestion, a scalable, automated…

Computation and Language · Computer Science 2026-03-02 Ali Khoramfar , Ali Ramezani , Mohammad Mahdi Mohajeri , Mohammad Javad Dousti , Majid Nili Ahmadabadi , Heshaam Faili

The study of biological materials and bio-inspired materials science is well established; however, surprisingly little knowledge has been systematically translated to engineering solutions. To accelerate discovery and guide insights, an…

Materials Science · Physics 2023-12-12 Rachel K. Luu , Markus J. Buehler

Generative retrieval (GR) is an emerging paradigm that leverages large language models (LLMs) to autoregressively generate document identifiers (docids) relevant to a given query. Prior works have focused on leveraging the generative…

Information Retrieval · Computer Science 2025-10-22 Yingchen Zhang , Ruqing Zhang , Jiafeng Guo , Wenjun Peng , Sen Li , Fuyu Lv

Large language models (LLMs) have demonstrated rapid progress across a wide array of domains. Owing to the very large number of parameters and training data in LLMs, these models inherently encompass an expansive and comprehensive materials…

Materials Science · Physics 2024-11-20 Siyu Liu , Tongqi Wen , A. S. L. Subrahmanyam Pattamatta , David J. Srolovitz

Foundation models have demonstrated a great ability to achieve general human-level intelligence far beyond traditional approaches. As the technique keeps attracting attention from the AI community, an increasing number of foundation models…

Computation and Language · Computer Science 2024-05-07 Shizhe Diao , Rui Pan , Hanze Dong , Ka Shun Shum , Jipeng Zhang , Wei Xiong , Tong Zhang

Chain-of-thought (CoT) reasoning has enabled large language models (LLMs) to utilize additional computation through intermediate tokens to solve complex tasks. However, we posit that typical reasoning traces contain many redundant tokens,…

Computation and Language · Computer Science 2025-06-11 Tergel Munkhbat , Namgyu Ho , Seo Hyun Kim , Yongjin Yang , Yujin Kim , Se-Young Yun

Large language models (LLMs) have demonstrated impressive capabilities in natural language generation. However, their output quality can be inconsistent, posing challenges for generating natural language from logical forms (LFs). This task…

Computation and Language · Computer Science 2023-09-22 Levon Haroutunian , Zhuang Li , Lucian Galescu , Philip Cohen , Raj Tumuluri , Gholamreza Haffari

Large language models (LLMs) have revolutionized artificial intelligence by enabling complex reasoning capabilities. While recent advancements in reinforcement learning (RL) have primarily focused on domain-specific reasoning tasks (e.g.,…

Despite rapid advancements in large language models (LLMs), the token-level autoregressive nature constrains their complex reasoning capabilities. To enhance LLM reasoning, inference-time techniques, including…

Artificial Intelligence · Computer Science 2026-01-28 Qianyue Hao , Sibo Li , Jian Yuan , Yong Li

Large-scale language models (LLMs) have achieved remarkable success across various language tasks but suffer from hallucinations and temporal misalignment. To mitigate these shortcomings, Retrieval-augmented generation (RAG) has been…

Computation and Language · Computer Science 2024-04-30 Zhongzhen Huang , Kui Xue , Yongqi Fan , Linjie Mu , Ruoyu Liu , Tong Ruan , Shaoting Zhang , Xiaofan Zhang

Long-context language models (LCLMs) have exhibited impressive capabilities in long-context understanding tasks. Among these, long-context referencing -- a crucial task that requires LCLMs to attribute items of interest to specific parts of…

Computation and Language · Computer Science 2025-08-05 Junjie Wu , Gefei Gu , Yanan Zheng , Dit-Yan Yeung , Arman Cohan

Large language models (LLMs) can face factual limitations when responding to time-sensitive queries about recent events that arise after their knowledge thresholds in the training corpus. Existing search-augmented approaches fall into two…

Information Retrieval · Computer Science 2025-06-11 Wentao Shi , Yiqing Shen

Existing retrieval-augmented code generation (RACG) methods typically use an external retrieval module to fetch semantically similar code snippets used for generating subsequent fragments. However, even for consecutive code fragments, the…

Information Retrieval · Computer Science 2025-10-10 Qian Dong , Jia Chen , Qingyao Ai , Hongning Wang , Haitao Li , Yi Wu , Yao Hu , Yiqun Liu , Shaoping Ma

Large Language Models (LLMs) are powerful computational models trained on extensive corpora of human-readable text, enabling them to perform general-purpose language understanding and generation. LLMs have garnered significant attention in…

Computation and Language · Computer Science 2024-10-28 Liam Barkley , Brink van der Merwe

Large language models (LLMs) are a promising venue for natural language understanding and generation tasks. However, current LLMs are far from reliable: they are prone to generate non-factual information and, more crucially, to contradict…

Machine Learning · Computer Science 2024-04-22 Diego Calanzone , Stefano Teso , Antonio Vergari

While the recent developments in large language models (LLMs) have successfully enabled generative recommenders with natural language interactions, their recommendation behavior is limited, leaving other simpler yet crucial components such…

Information Retrieval · Computer Science 2025-10-09 Seungheon Doh , Keunwoo Choi , Juhan Nam

Large language models have achieved remarkable success on general NLP tasks, but they may fall short for domain-specific problems. Recently, various Retrieval-Augmented Large Language Models (RALLMs) are proposed to address this…

Computation and Language · Computer Science 2024-06-18 Shangqing Tu , Yuanchun Wang , Jifan Yu , Yuyang Xie , Yaran Shi , Xiaozhi Wang , Jing Zhang , Lei Hou , Juanzi Li

The rise of large language models (LLMs) has significantly transformed both the construction and application of information retrieval (IR) systems. However, current interactions between IR systems and LLMs remain limited, with LLMs merely…

Information Retrieval · Computer Science 2024-11-05 Qiaoyu Tang , Jiawei Chen , Zhuoqun Li , Bowen Yu , Yaojie Lu , Cheng Fu , Haiyang Yu , Hongyu Lin , Fei Huang , Ben He , Xianpei Han , Le Sun , Yongbin Li