中文
相关论文

相关论文: Locally Coherent, Globally Incoherent: Bounding Co…

200 篇论文

When LLM agents autonomously design ML experiments, do they perform genuine architecture search -- or do they default to hyperparameter tuning within a narrow region of the design space? We answer this question by analyzing 10,469…

机器学习 · 计算机科学 2026-03-18 Xiaoyi Li

Multi-agent LLM debate improves factuality and reasoning, but most recipes pick a fixed round count, over-spending on easy items and under-spending on hard ones. We adapt Wald's Sequential Probability Ratio Test (SPRT) as a plug-in compute…

机器学习 · 计算机科学 2026-05-20 Andrea Morandi

Predicting the complexity of source code is essential for software development and algorithm analysis. Recently, Baik et al. (2025) introduced CodeComplex for code time complexity prediction. The paper shows that LLMs without fine-tuning…

人工智能 · 计算机科学 2025-10-13 Joonghyuk Hahn , Soohan Lim , Yo-Sub Han

Regression by composition provides a flexible framework for constructing conditional distributions through sequential group actions. However, when multiple flows act on the same distribution, the model becomes non-identifiable, leading to…

统计方法学 · 统计学 2026-03-30 Safaa K. Kadhem

Large language model (LLM) agents on multi-step tasks suffer reasoning degradation, looping, drift, stuck states, at rates up to 30% on hard tasks. Current solutions include hard step limits (abrupt) or LLM-as-judge monitoring (10-15%…

人工智能 · 计算机科学 2026-04-16 Rafflesia Khan , Nafiul Islam Khan

New Large Language Models (LLMs) become available every few weeks, and modern application developers confronted with the unenviable task of having to decide if they should switch to a new model. While human evaluation remains the gold…

人工智能 · 计算机科学 2025-12-25 Suryaansh Jain , Umair Z. Ahmed , Shubham Sahai , Ben Leong

Multi-stage LLM pipelines that perform multi-agent debate, intrinsic self-correction, or retrieval-augmented verification exhibit puzzling aggregate behaviors: accuracy plateaus and reversals across rounds, non-replication of debate gains…

多智能体系统 · 计算机科学 2026-05-28 Prashanti Nilayam , Kiran Ramanna , Prashil Tumbade

Large Language Models (LLMs) have shown impressive capabilities in various applications, but they still face various inconsistency issues. Existing works primarily focus on the inconsistency issues within a single LLM, while we…

计算与语言 · 计算机科学 2024-11-15 Kai Xiong , Xiao Ding , Yixin Cao , Ting Liu , Bing Qin

When multiple LLM-based code agents independently implement parts of the same class, they must agree on shared internal representations, even when the specification leaves those choices implicit. We study this coordination problem across 51…

软件工程 · 计算机科学 2026-03-26 Camilo Chacón Sartori

High-dimensional compositional data are frequently encountered in many fields of modern scientific research. In regression analysis of compositional data, the presence of covariate measurement errors poses grand challenges for existing…

统计方法学 · 统计学 2024-07-23 Wenxi Tan , Lingzhou Xue , Songshan Yang , Xiang Zhan

Large Language Models (LLMs) are increasingly used as evaluators of reasoning quality, yet their reliability and bias in payments-risk settings remain poorly understood. We introduce a structured multi-evaluator framework for assessing LLM…

人工智能 · 计算机科学 2026-02-06 Liang Wang , Junpeng Wang , Chin-chia Michael Yeh , Yan Zheng , Jiarui Sun , Xiran Fan , Xin Dai , Yujie Fan , Yiwei Cai

Large language models (LLMs) have demonstrated remarkable performance, yet their diverse strengths and weaknesses prevent any single LLM from achieving dominance across all tasks. Ensembling multiple LLMs is a promising approach to generate…

计算与语言 · 计算机科学 2025-03-17 Jiaxin Zhang , Zhuohang Li , Wendi Cui , Kamalika Das , Bradley malin , Sricharan Kumar

Recent work has shown that models trained to the same objective, and which achieve similar measures of accuracy on consistent test data, may nonetheless behave very differently on individual predictions. This inconsistency is undesirable in…

机器学习 · 计算机科学 2021-11-17 Emily Black , Klas Leino , Matt Fredrikson

Recent work shows that pricing with symmetric LLM agents leads to algorithmic collusion. We show that collusion is fragile under the heterogeneity typical of real deployments. In a stylized repeated-pricing model, heterogeneity in patience…

计算机科学与博弈论 · 计算机科学 2026-03-24 Jussi Keppo , Yuze Li , Gerry Tsoukalas , Nuo Yuan

Large language models (LLMs) have achieved widespread success on a variety of in-context few-shot tasks, but this success is typically evaluated via correctness rather than consistency. We argue that self-consistency is an important…

计算与语言 · 计算机科学 2024-02-09 Angelica Chen , Jason Phang , Alicia Parrish , Vishakh Padmakumar , Chen Zhao , Samuel R. Bowman , Kyunghyun Cho

While large language models (LLMs) perform strongly on diverse tasks, their trustworthiness is limited by erratic behavior that is unfaithful to their internal knowledge. In particular, LLMs often fail on multiple-choice questions (MCQs)…

计算与语言 · 计算机科学 2026-02-05 Yoonah Park , Haesung Pyun , Yohan Jo

Recent advances in code generation models have unlocked unprecedented opportunities for automating feature engineering, yet their adoption in real-world ML teams remains constrained by critical challenges: (i) the scarcity of datasets…

机器学习 · 计算机科学 2026-01-19 Himanshu Thakur , Anusha Kamath , Anurag Muthyala , Dhwani Sanmukhani , Smruthi Mukund , Jay Katukuri

LLM agents often fail in closed-world embodied environments because actions must satisfy strict preconditions -- such as location, inventory, and container states -- and failure feedback is sparse. We identify two structurally coupled…

人工智能 · 计算机科学 2026-03-19 Zhenhang Yuan , Shenghai Yuan , Lihua Xie

This study proposes a multi-resolution Convolutional Long Short-Term Memory (ConvLSTM) ensemble framework that leverages diverse temporal input resolutions to mitigate error accumulation and improve long-horizon forecasting of…

机器学习 · 计算机科学 2026-05-25 Jihoon Kim , Heejung Youn

Due to their architecture and vast pre-training data, large language models (LLMs) demonstrate strong text classification performance. However, LLM output - here, the category assigned to a text - depends heavily on the wording of the…

计算与语言 · 计算机科学 2025-12-04 Kylie L. Anglin , Stephanie Milan , Brittney Hernandez , Claudia Ventura