English
Related papers

Related papers: TaskEval: Synthesised Evaluation for Foundation-Mo…

200 papers

In recent years, Multi-modal Foundation Models (MFMs) and Embodied Artificial Intelligence (EAI) have been advancing side by side at an unprecedented pace. The integration of the two has garnered significant attention from the AI research…

Artificial Intelligence · Computer Science 2024-10-08 Min Zhang , Xian Fu , Jianye Hao , Peilong Han , Hao Zhang , Lei Shi , Hongyao Tang , Yan Zheng

Foundation Models (FMs) have demonstrated unprecedented capabilities including zero-shot learning, high fidelity data synthesis, and out of domain generalization. However, as we show in this paper, FMs still have poor out-of-the-box…

Despite the successes of language models, their evaluation remains a daunting challenge for new and existing tasks. We consider the task of text simplification, commonly used to improve information accessibility, where evaluation faces two…

Computation and Language · Computer Science 2025-04-17 Joseph Liu , Yoonsoo Nam , Xinyue Cui , Swabha Swayamdipta

Recent advancements in large language models (LLMs) have significantly enhanced their ability to understand both natural language and code, driving their use in tasks like natural language-to-code (NL2Code) and code summarisation. However,…

Large Language Models (LLMs) excel in code-related tasks like code generation, but benchmark evaluations often overlook task characteristics, such as difficulty. Moreover, benchmarks are usually built using tasks described with a single…

Software Engineering · Computer Science 2025-10-27 Florian Tambon , Amin Nikanjam , Cyrine Zid , Foutse Khomh , Giuliano Antoniol

Foundation models (FMs) have achieved significant success across various tasks, leading to research on benchmarks for reasoning abilities. However, there is a lack of studies on FMs performance in exceptional scenarios, which we define as…

Artificial Intelligence · Computer Science 2024-12-06 Suho Kang , Jungyang Park , Joonseo Ha , SoMin Kim , JinHyeong Kim , Subeen Park , Kyungwoo Song

Multi-round incomplete information tasks are crucial for evaluating the lateral thinking capabilities of large language models (LLMs). Currently, research primarily relies on multiple benchmarks and automated evaluation metrics to assess…

Computation and Language · Computer Science 2025-06-02 Wenhan Dong , Tianyi Hu , Jingyi Zheng , Zhen Sun , Yuemeng Zhao , Yule Liu , Xinlei He , Xinyi Huang

The rapid development of Large Language Models (LLMs) has led to great strides in model capabilities like long-context understanding and reasoning. However, as LLMs are able to process longer contexts, it becomes more challenging to…

Computation and Language · Computer Science 2024-04-09 Fangyu Lei , Qian Liu , Yiming Huang , Shizhu He , Jun Zhao , Kang Liu

Contemporary Text-to-Image (T2I) models frequently depend on qualitative human evaluations to assess the consistency between synthesized images and the text prompts. There is a demand for quantitative and automatic evaluation tools, given…

Computer Vision and Pattern Recognition · Computer Science 2024-12-10 Ziyuan Qin , Dongjie Cheng , Haoyu Wang , Huahui Yi , Yuting Shao , Zhiyuan Fan , Kang Li , Qicheng Lao

The complexity of modern software has led to a drastic increase in the time and cost associated with detecting and rectifying software bugs. In response, researchers have explored various methods to automatically generate fixes for buggy…

Software Engineering · Computer Science 2023-03-31 Md Mahim Anjum Haque , Wasi Uddin Ahmad , Ismini Lourentzou , Chris Brown

Grounded text generation systems often generate text that contains factual inconsistencies, hindering their real-world applicability. Automatic factual consistency evaluation may help alleviate this limitation by accelerating evaluation…

Comprehensive evaluation of mobile agents can significantly advance their development and real-world applicability. However, existing benchmarks lack practicality and scalability due to the extensive manual effort in defining task reward…

Artificial Intelligence · Computer Science 2025-09-25 Jiahui Sun , Zhichao Hua , Yubin Xia

Large language models (LLMs) frequently hallucinate on abstractive summarization tasks such as document-based question-answering, meeting summarization, and clinical report generation, even though all necessary information is included in…

Computation and Language · Computer Science 2023-11-08 Erik Jones , Hamid Palangi , Clarisse Simões , Varun Chandrasekaran , Subhabrata Mukherjee , Arindam Mitra , Ahmed Awadallah , Ece Kamar

With the growth of high-quality data and advancement in visual pre-training paradigms, Video Foundation Models (VFMs) have made significant progress recently, demonstrating their remarkable performance on traditional video understanding…

Computer Vision and Pattern Recognition · Computer Science 2024-07-10 Xinhao Li , Zhenpeng Huang , Jing Wang , Kunchang Li , Limin Wang

In this paper, we have defined a novel task of affective feedback synthesis that deals with generating feedback for input text & corresponding image in a similar way as humans respond towards the multimodal data. A feedback synthesis system…

Multimedia · Computer Science 2022-04-01 Puneet Kumar , Gaurav Bhat , Omkar Ingle , Daksh Goyal , Balasubramanian Raman

Recent advancements in imitation learning have led to transformer-based behavior foundation models (BFMs) that enable multi-modal, human-like control for humanoid agents. While excelling at zero-shot generation of robust behaviors, BFMs…

Machine Learning · Computer Science 2026-03-30 Ron Vainshtein , Zohar Rimon , Shie Mannor , Chen Tessler

The impressive advances and applications of large language and joint language-and-visual understanding models has led to an increased need for methods of probing their potential reasoning capabilities. However, the difficulty of gather…

Machine Learning · Computer Science 2023-06-05 Nathan Vaska , Victoria Helus

Large Language Models (LLMs) with extended context windows promise direct reasoning over long documents, reducing the need for chunking or retrieval. Constructing annotated resources for training and evaluation, however, remains costly.…

Computation and Language · Computer Science 2025-11-13 Mohamed Elaraby , Jyoti Prakash Maheswari

When developing new large language models (LLMs), a key step is evaluating their final performance, often by computing the win-rate against a reference model based on external feedback. Human feedback is the gold standard, particularly for…

Machine Learning · Computer Science 2025-02-26 Zhaoyi Zhou , Yuda Song , Andrea Zanette

The emergent phenomena of large foundation models have revolutionized natural language processing. However, evaluating these models presents significant challenges due to their size, capabilities, and deployment across diverse applications.…

Computation and Language · Computer Science 2025-02-17 Jiayi Yuan , Jiamu Zhang , Andrew Wen , Xia Hu
‹ Prev 1 2 3 10 Next ›