中文
相关论文

相关论文: Hint-before-Solving Prompting: Guiding LLMs to Eff…

200 篇论文

Large language models (LLMs) have demonstrated remarkable capabilities in natural language understanding, reasoning, and problem-solving across various domains. However, their ability to perform complex, multi-step reasoning task-essential…

The MEDIQA-CORR 2024 shared task aims to assess the ability of Large Language Models (LLMs) to identify and correct medical errors in clinical notes. In this study, we evaluate the capability of general LLMs, specifically GPT-3.5 and GPT-4,…

计算与语言 · 计算机科学 2024-05-29 Aryo Pradipta Gema , Chaeeun Lee , Pasquale Minervini , Luke Daines , T. Ian Simpson , Beatrice Alex

Pretrained large language models (LLMs) are increasingly utilized across a wide range of natural language processing (NLP) tasks due to their impressive capabilities as few-shot learners. Recent techniques, such as chain-of-thought (CoT)…

机器学习 · 计算机科学 2024-12-02 Kamesh R

Large language models (LLMs) demonstrate their promise in tackling complicated practical challenges by combining action-based policies with chain of thought (CoT) reasoning. Having high-quality prompts on hand, however, is vital to the…

机器学习 · 计算机科学 2024-03-01 Xue Yan , Yan Song , Xinyu Cui , Filippos Christianos , Haifeng Zhang , David Henry Mguni , Jun Wang

The increasing scale of large language models (LLMs) brings emergent abilities to various complex tasks requiring reasoning, such as arithmetic and commonsense reasoning. It is known that the effective design of task-specific prompts is…

计算与语言 · 计算机科学 2024-07-23 Shizhe Diao , Pengcheng Wang , Yong Lin , Rui Pan , Xiang Liu , Tong Zhang

Prior work has combined chain-of-thought prompting in large language models (LLMs) with programmatic representations to perform effective and transparent reasoning. While such an approach works well for tasks that only require forward…

计算与语言 · 计算机科学 2023-10-13 Xi Ye , Qiaochu Chen , Isil Dillig , Greg Durrett

This paper addresses two limitations of large language models (LLMs) in solving complex problems: (1) their reasoning processes exhibit Bayesian-like stochastic generation, where each token is sampled from a context-dependent probability…

人工智能 · 计算机科学 2026-04-20 Lei Lin , Jizhao Zhu , Yong Liu , Donghong Sun , Hongbo He , Yihua Du

Large Language Models (LLMs) have limited performance when solving arithmetic reasoning tasks and often provide incorrect answers. Unlike natural language understanding, math problems typically have a single correct answer, making the task…

计算与语言 · 计算机科学 2023-03-10 Shima Imani , Liang Du , Harsh Shrivastava

Pre-trained language models (LMs) have shown remarkable reasoning performance using explanations or chain-of-thoughts (CoT)) for in-context learning. On the other hand, these reasoning tasks are usually presumed to be more approachable for…

计算与语言 · 计算机科学 2024-03-29 Yi-Fan Zhang , Hanlin Zhang , Li Erran Li , Eric Xing

Assessing the effectiveness of large language models (LLMs) in performing different tasks is crucial for understanding their strengths and weaknesses. This paper presents Hierarchical Prompting Taxonomy (HPT), grounded on human cognitive…

计算与语言 · 计算机科学 2025-07-22 Devichand Budagam , Ashutosh Kumar , Mahsa Khoshnoodi , Sankalp KJ , Vinija Jain , Aman Chadha

Hallucination remains a key obstacle to the reliable deployment of large language models (LLMs) in real-world question answering tasks. A widely adopted strategy to detect hallucination, known as self-assessment, relies on the model's own…

人工智能 · 计算机科学 2025-06-04 Jinyuan Luo , Zhen Fang , Yixuan Li , Seongheon Park , Ling Chen

While large language models (LLMs) have demonstrated exceptional performance in recent natural language processing (NLP) tasks, their deployment poses substantial challenges due to high computational and memory demands in real-world…

计算与语言 · 计算机科学 2024-02-27 Chenglin Li , Qianglong Chen , Liangyue Li , Caiyu Wang , Yicheng Li , Zulong Chen , Yin Zhang

Large language models (LLMs) have demonstrated remarkable capabilities in tasks requiring reasoning and multi-step problem-solving through the use of chain-of-thought (CoT) prompting. However, generating the full CoT process results in…

计算与语言 · 计算机科学 2024-09-16 Tianqiao Liu , Zui Chen , Zitao Liu , Mi Tian , Weiqi Luo

We introduce Meta-Reasoning Prompting (MRP), a novel and efficient system prompting method for large language models (LLMs) inspired by human meta-reasoning. Traditional in-context learning-based reasoning techniques, such as…

计算与语言 · 计算机科学 2024-06-18 Peizhong Gao , Ao Xie , Shaoguang Mao , Wenshan Wu , Yan Xia , Haipeng Mi , Furu Wei

The automatic generation of hints by Large Language Models (LLMs) within Intelligent Tutoring Systems (ITSs) has shown potential to enhance student learning. However, generating pedagogically sound hints that address student misconceptions…

计算与语言 · 计算机科学 2024-11-07 Junior Cedric Tonga , Benjamin Clement , Pierre-Yves Oudeyer

While state-of-the-art LLMs have shown poor logical and basic mathematical reasoning, recent works try to improve their problem-solving abilities using prompting techniques. We propose giving "hints" to improve the language model's…

计算与语言 · 计算机科学 2024-11-12 Vansh Agrawal , Pratham Singla , Amitoj Singh Miglani , Shivank Garg , Ayush Mangal

When prompted with a few examples and intermediate steps, large language models (LLMs) have demonstrated impressive performance in various reasoning tasks. However, prompting methods that rely on implicit knowledge in an LLM often generate…

人工智能 · 计算机科学 2024-12-23 Zhaocheng Zhu , Yuan Xue , Xinyun Chen , Denny Zhou , Jian Tang , Dale Schuurmans , Hanjun Dai

Generative large language models (LLMs) with instruct training such as GPT-4 can follow human-provided instruction prompts and generate human-like responses to these prompts. Apart from natural language responses, they have also been found…

Large Language Models prompting, such as using in-context demonstrations, is a mainstream technique for invoking LLMs to perform high-performance and solid complex reasoning (e.g., mathematical reasoning, commonsense reasoning), and has the…

人工智能 · 计算机科学 2024-10-08 Zhicheng Yang , Yinya Huang , Jing Xiong , Liang Feng , Xiaodan Liang , Yiwei Wang , Jing Tang

The answering quality of an aligned large language model (LLM) can be drastically improved if treated with proper crafting of prompts. In this paper, we propose ExpertPrompting to elicit the potential of LLMs to answer as distinguished…

计算与语言 · 计算机科学 2025-03-06 Benfeng Xu , An Yang , Junyang Lin , Quan Wang , Chang Zhou , Yongdong Zhang , Zhendong Mao