English
Related papers

Related papers: VeriLA: A Human-Centered Evaluation Framework for …

200 papers

Integrating Large Language Models (LLMs) into autonomous agents marks a significant shift in the research landscape by offering cognitive abilities that are competitive with human planning and reasoning. This paper explores the…

Software Engineering · Computer Science 2025-07-21 Junda He , Christoph Treude , David Lo

The growing complexity of power systems has made accurate load forecasting more important than ever. An increasing number of advanced load forecasting methods have been developed. However, the static design of current methods offers no…

Machine Learning · Computer Science 2025-05-23 Yu Zuo , Dalin Qin , Yi Wang

Large Language Models (LLMs) have become foundational to modern AI agent systems, enabling autonomous agents to reason and plan. In most existing systems, inter-agent communication relies primarily on natural language. While this design…

Artificial Intelligence · Computer Science 2025-06-04 Pengcheng Zhou , Yinglun Feng , Halimulati Julaiti , Zhongliang Yang

Artificial Intelligence (AI) models increasingly drive high-stakes consumer interactions, yet their decision logic often remains opaque. Prevailing explainable AI techniques rely on post hoc numerical feature attributions, which fail to…

Computation and Language · Computer Science 2026-01-09 Xiang Cheng , Wen Wang , Anindya Ghose

As we consider entrusting Large Language Models (LLMs) with key societal and decision-making roles, measuring their alignment with human cognition becomes critical. This requires methods that can assess how these systems represent…

Artificial Intelligence · Computer Science 2025-10-03 Mattson Ogg , Ritwik Bose , Jamie Scharf , Christopher Ratto , Michael Wolmetz

As artificial intelligence (AI) models continue to scale up, they are becoming more capable and integrated into various forms of decision-making systems. For models involved in moral decision-making, also known as artificial moral agents…

Artificial Intelligence · Computer Science 2023-07-04 Avish Vijayaraghavan , Cosmin Badea

Large Language Models (LLMs) offer a promising approach to enhancing Explainable AI (XAI) by transforming complex machine learning outputs into easy-to-understand narratives, making model predictions more accessible to users, and helping…

Artificial Intelligence · Computer Science 2025-04-02 Ahsan Bilal , David Ebert , Beiyu Lin

LLMs' remarkable ability to tackle a wide range of language tasks opened new opportunities for collaborative human-AI problem solving. LLMs can amplify human capabilities by applying their intuitions and reasoning strategies at scale. We…

Computation and Language · Computer Science 2025-09-23 Abhishek Sharma , Dan Goldwasser

Large Language Models (LLMs) have become increasingly popular for generating RTL code. However, producing error-free RTL code in a zero-shot setting remains highly challenging for even state-of-the-art LLMs, often leading to issues that…

Hardware Architecture · Computer Science 2024-12-09 Mubashir ul Islam , Humza Sami , Pierre-Emmanuel Gaillardon , Valerio Tenace

Agentic workflows are composed of sequences of interdependent Large Language Model (LLM) calls, and they have become a dominant workload in modern AI systems. These workflows exhibit extensive redundancy from overlapping prompts and…

Multiagent Systems · Computer Science 2026-03-18 Noppanat Wadlom , Junyi Shen , Yao Lu

Large language models (LLMs), a recent advance in deep learning and machine intelligence, have manifested astonishing capacities, now considered among the most promising for artificial general intelligence. With human-like capabilities,…

Artificial Intelligence · Computer Science 2025-09-19 Zhilun Zhou , Jing Yi Wang , Nicholas Sukiennik , Chen Gao , Fengli Xu , Yong Li , James Evans

Large Language Models (LLMs) have achieved impressive results in knowledge-based Visual Question Answering (VQA). However existing methods still have challenges: the inability to use external tools autonomously, and the inability to work in…

Computation and Language · Computer Science 2025-08-08 Zhongjian Hu , Peng Yang , Bing Li , Zhenqi Wang

Large language models and autonomous AI agents have evolved rapidly, resulting in a diverse array of evaluation benchmarks, frameworks, and collaboration protocols. Driven by the growing need for standardized evaluation and integration, we…

Artificial Intelligence · Computer Science 2026-03-10 Mohamed Amine Ferrag , Norbert Tihanyi , Merouane Debbah

Artificial intelligence systems, particularly large language models (LLMs), are increasingly being employed in high-stakes decisions that impact both individuals and society at large, often without adequate safeguards to ensure safety,…

Artificial Intelligence · Computer Science 2024-06-24 N. Zöller , J. Berger , I. Lin , N. Fu , J. Komarneni , G. Barabucci , K. Laskowski , V. Shia , B. Harack , E. A. Chu , V. Trianni , R. H. J. M. Kurvers , S. M. Herzog

Despite the utility of Large Language Models (LLMs) across a wide range of tasks and scenarios, developing a method for reliably evaluating LLMs across varied contexts continues to be challenging. Modern evaluation approaches often use LLMs…

Computation and Language · Computer Science 2024-01-31 Steffi Chern , Ethan Chern , Graham Neubig , Pengfei Liu

Large Language Models (LLMs) are increasingly applied in healthcare, yet ensuring their ethical integrity and safety compliance remains a major barrier to clinical deployment. This work introduces a multi-agent refinement framework designed…

Artificial Intelligence (AI) is taking on increasingly autonomous roles, e.g., browsing the web as a research assistant and managing money. But specifying goals and restrictions for AI behavior is difficult. Similar to how parties to a…

Computation and Language · Computer Science 2023-01-31 John J. Nay

This paper presents an AI-generated review of Vision-Language-Action (VLA) models, summarizing key methodologies, findings, and future directions. The content is produced using large language models (LLMs) and is intended only for…

Recent studies have used both automatic metrics and human evaluations to assess the simplification abilities of LLMs. However, the suitability of existing evaluation methodologies for LLMs remains in question. First, the suitability of…

Computation and Language · Computer Science 2025-07-15 Xuanxin Wu , Yuki Arase

In large language model (LLM) agents, reasoning trajectories are treated as reliable internal beliefs for guiding actions and updating memory. However, coherent reasoning can still violate logical or evidential constraints, allowing…

Artificial Intelligence · Computer Science 2026-04-10 Wenhao Yuan , Chenchen Lin , Jian Chen , Jinfeng Xu , Xuehe Wang , Edith Cheuk Han Ngai