中文
相关论文

相关论文: Finding the Sweet Spot: Trading Quality, Cost, and…

200 篇论文

Large language models (LLMs) are now used in multi-turn workflows, but we still lack a clear way to measure when iteration helps and when it hurts. We present an evaluation framework for iterative refinement that spans ideation, code, and…

人工智能 · 计算机科学 2025-09-16 Shashidhar Reddy Javaji , Bhavul Gauri , Zining Zhu

Financial sentiment analysis plays a crucial role in uncovering latent patterns and detecting emerging trends, enabling individuals to make well-informed decisions that may yield substantial advantages within the constantly changing realm…

机器学习 · 计算机科学 2023-12-15 Sorouralsadat Fatemi , Yuheng Hu

Reasoning Large Language Models (LLMs) have shown promising results when tasked with solving complex problems. In this paper, we propose and evaluate a multi-stage workflow that leverages the capabilities of fine-tuned reasoning LLMs to…

计算与语言 · 计算机科学 2026-01-13 Alberto Purpura , Emily Chen , Swapnil Shinde

Large Language Models (LLMs) generate responses to questions; however, their effectiveness is often hindered by sub-optimal quality of answers and occasional failures to provide accurate responses to questions. To address these challenges,…

计算与语言 · 计算机科学 2024-02-06 Liang Zhang , Katherine Jijo , Spurthi Setty , Eden Chung , Fatima Javid , Natan Vidra , Tommy Clifford

Large Language Models (LLMs) are increasingly used in settings where reliable self-assessment is critical. Assessing model reliability has evolved from using probabilistic correctness estimates to, more recently, eliciting verbalized…

计算与语言 · 计算机科学 2026-05-11 Sree Bhattacharyya , Samarth Khanna , Leona Chen , Lucas Craig , Tharun Dilliraj , James Z. Wang

The dominance of proprietary LLMs has led to restricted access and raised information privacy concerns. High-performing open-source alternatives are crucial for information-sensitive and high-volume applications but often lag behind in…

计算与语言 · 计算机科学 2024-06-05 Sumuk Shashidhar , Abhinav Chinta , Vaibhav Sahai , Zhenhailong Wang , Heng Ji

Many challenging reasoning tasks require not just rapid, intuitive responses, but a more deliberate, multi-step approach. Recent progress in large language models (LLMs) highlights an important shift from the "System 1" way of quick…

计算与语言 · 计算机科学 2025-06-03 Guizhen Chen , Weiwen Xu , Hao Zhang , Hou Pong Chan , Chaoqun Liu , Lidong Bing , Deli Zhao , Anh Tuan Luu , Yu Rong

Like humans, large language models (LLMs) do not always generate the best output on their first try. Motivated by how humans refine their written text, we introduce Self-Refine, an approach for improving initial outputs from LLMs through…

Recent advances in test-time scaling have led to the emergence of thinking LLMs that exhibit self-reflective behaviors and multi-step reasoning. While RL drives this self-improvement paradigm, a recent study (Gandhi et al., 2025) shows that…

人工智能 · 计算机科学 2025-08-22 Aswin RRV , Jacob Dineen , Divij Handa , Md Nayem Uddin , Mihir Parmar , Chitta Baral , Ben Zhou

Negotiation is a fundamental challenge for AI agents, as it requires an ability to reason strategically, model opponents, and balance cooperation with competition. We present the first comprehensive study that systematically evaluates how…

Large Language Models (LLMs) have the unique capability to understand and generate human-like text from input queries. When fine-tuned, these models show enhanced performance on domain-specific queries. OpenAI highlights the process of…

计算与语言 · 计算机科学 2024-07-02 Scott Barnett , Zac Brannelly , Stefanus Kurniawan , Sheng Wong

Large Language Models (LLMs) are increasingly used to generate textual explanations of process models discovered from event logs. Producing explanations from large behavioral abstractions (e.g., directly-follows graphs or Petri nets) can be…

机器学习 · 计算机科学 2025-10-14 P. van Oerle , R. H. Bemthuis , F. A. Bukhsh

Language Models (LMs) have shown impressive performance in various natural language tasks. However, when it comes to natural language reasoning, LMs still face challenges such as hallucination, generating incorrect intermediate reasoning…

计算与语言 · 计算机科学 2023-10-20 Deepak Nathani , David Wang , Liangming Pan , William Yang Wang

Test-time compute has emerged as a powerful paradigm for improving the performance of large language models (LLMs), where generating multiple outputs or refining individual chains can significantly boost answer accuracy. However, existing…

机器学习 · 计算机科学 2025-09-26 Sheng Liu , Tianlang Chen , Pan Lu , Haotian Ye , Yizheng Chen , Lei Xing , James Zou

Financial sentiment analysis is crucial for trading and investment decision-making. This study introduces an adaptive retrieval augmented framework for Large Language Models (LLMs) that aligns with human instructions through Instruction…

计算工程、金融与科学 · 计算机科学 2024-10-22 Zijie Zhao , Roy E. Welsch

With large language models (LLMs) increasingly deployed as cognitive engines for AI agents, the reliability and effectiveness critically hinge on their intrinsic epistemic agency, which remains understudied. Epistemic agency, the ability to…

人工智能 · 计算机科学 2025-06-05 Lingyu Li , Yixu Wang , Haiquan Zhao , Shuqi Kong , Yan Teng , Chunbo Li , Yingchun Wang

Large language models (LLMs) excel in many natural language tasks, yet they struggle with complex mathemat-ical problem-solving, particularly in symbolic reasoning and maintaining consistent output. This study evalu-ates 10 LLMs with 7 to 8…

机器学习 · 计算机科学 2025-01-29 Evgenii Evstafev

LLM-based Automatic Prompt Optimization, which typically utilizes LLMs as Prompt Optimizers to self-reflect and refine prompts, has shown promising performance in recent studies. Despite the success, the underlying mechanism of this…

计算与语言 · 计算机科学 2024-02-06 Ruotian Ma , Xiaolei Wang , Xin Zhou , Jian Li , Nan Du , Tao Gui , Qi Zhang , Xuanjing Huang

Recent deep-thinking large language models often reason extensively to improve performance, but such lengthy reasoning is not always desirable, as it incurs excessive inference costs with disproportionate performance gains. Controlling…

计算与语言 · 计算机科学 2025-06-17 Junyan Li , Wenshuo Zhao , Yang Zhang , Chuang Gan

This paper investigates the impact of domain-specific model fine-tuning and of reasoning mechanisms on the performance of question-answering (Q&A) systems powered by large language models (LLMs) and Retrieval-Augmented Generation (RAG).…