中文
相关论文

相关论文: Creative Beam Search: LLM-as-a-Judge For Improving…

200 篇论文

Iterative retrieval refers to the process in which the model continuously queries the retriever during generation to enhance the relevance of the retrieved knowledge, thereby improving the performance of Retrieval-Augmented Generation…

计算与语言 · 计算机科学 2024-12-02 Tian Yu , Shaolei Zhang , Yang Feng

The continued success of Large Language Models (LLMs) and other generative artificial intelligence approaches highlights the advantages that large information corpora can have over rigidly defined symbolic models, but also serves as a…

Multimodal Large Language Models (MLLMs) demonstrate remarkable capabilities but often struggle with complex, multi-step mathematical reasoning, where minor errors in visual perception or logical deduction can lead to complete failure.…

计算与语言 · 计算机科学 2025-08-08 Jianghangfan Zhang , Yibo Yan , Kening Zheng , Xin Zou , Song Dai , Xuming Hu

Evaluating Natural Language Generation (NLG) is crucial for the practical adoption of AI, but has been a longstanding research challenge. While human evaluation is considered the de-facto standard, it is expensive and lacks scalability.…

计算与语言 · 计算机科学 2025-08-20 Maria Paz Oliva , Adriana Correia , Ivan Vankov , Viktor Botev

Scientific idea generation is central to discovery, requiring the joint satisfaction of novelty and scientific soundness. Unlike standard reasoning or general creative generation, scientific ideation is inherently open-ended and…

Natural language processing (NLP) systems are increasingly trained to generate open-ended text rather than classifying between responses. This makes research on evaluation metrics for generated language -- functions that score system output…

计算与语言 · 计算机科学 2021-10-19 Thomas Scialom , Felix Hill

Understanding how humans collaborate and communicate in teams is essential for improving human-agent teaming and AI-assisted decision-making. However, relying solely on data from large-scale user studies is impractical due to logistical,…

Modern businesses are increasingly challenged by the time and expense required to generate and assess high-quality content. Human writers face time constraints, and extrinsic evaluations can be costly. While Large Language Models (LLMs)…

人工智能 · 计算机科学 2025-12-10 Thanh Vu , Richi Nayak , Thiru Balasubramaniam

Despite the crucial importance of accelerating text generation in large language models (LLMs) for efficiently producing content, the sequential nature of this process often leads to high inference latency, posing challenges for real-time…

计算与语言 · 计算机科学 2024-05-27 Mahsa Khoshnoodi , Vinija Jain , Mingye Gao , Malavika Srikanth , Aman Chadha

Knowledge retrieval with multi-modal queries plays a crucial role in supporting knowledge-intensive multi-modal applications. However, existing methods face challenges in terms of their effectiveness and training efficiency, especially when…

信息检索 · 计算机科学 2024-01-17 Xinwei Long , Jiali Zeng , Fandong Meng , Zhiyuan Ma , Kaiyan Zhang , Bowen Zhou , Jie Zhou

Recent advancements in large language models (LLMs) have demonstrated their potential in automating the scientific research ideation. Existing approaches primarily focus on prompting techniques, often producing ideas misaligned with expert…

计算与语言 · 计算机科学 2025-11-17 Ruochen Li , Liqiang Jing , Chi Han , Jiawei Zhou , Xinya Du

Large language models (LLMs) are being widely applied across various fields, but as tasks become more complex, evaluating their responses is increasingly challenging. Compared to human evaluators, the use of LLMs to support performance…

人工智能 · 计算机科学 2025-04-25 Yuran Li , Jama Hussein Mohamud , Chongren Sun , Di Wu , Benoit Boulet

Tree-search-based reasoning methods have significantly enhanced the reasoning capability of large language models (LLMs) by facilitating the exploration of multiple intermediate reasoning steps, i.e., thoughts. However, these methods suffer…

计算与语言 · 计算机科学 2025-05-27 Zhihai Wang , Jie Wang , Jilai Pan , Xilin Xia , Huiling Zhen , Mingxuan Yuan , Jianye Hao , Feng Wu

This paper offers an insightful examination of how currently top-trending AI technologies, i.e., generative artificial intelligence (Generative AI) and large language models (LLMs), are reshaping the field of video technology, including…

计算机视觉与模式识别 · 计算机科学 2024-04-26 Pengyuan Zhou , Lin Wang , Zhi Liu , Yanbin Hao , Pan Hui , Sasu Tarkoma , Jussi Kangasharju

Retrieval-Augmented Generation (RAG) has proven its effectiveness in alleviating hallucinations for Large Language Models (LLMs). However, existing automated evaluation metrics cannot fairly evaluate the outputs generated by RAG models…

计算与语言 · 计算机科学 2025-02-27 Shuliang Liu , Xinze Li , Zhenghao Liu , Yukun Yan , Cheng Yang , Zheni Zeng , Zhiyuan Liu , Maosong Sun , Ge Yu

The emergence of Large Language Models (LLMs) as chat assistants capable of generating human-like conversations has amplified the need for robust evaluation methods, particularly for open-ended tasks. Conventional metrics such as EM and F1,…

计算与语言 · 计算机科学 2025-11-12 Sher Badshah , Hassan Sajjad

Materials synthesis is vital for innovations such as energy storage, catalysis, electronics, and biomedical devices. Yet, the process relies heavily on empirical, trial-and-error methods guided by expert intuition. Our work aims to support…

When developing text classification models for real world applications, one major challenge is the difficulty to collect sufficient data for all text classes. In this work, we address this challenge by utilizing large language models (LLMs)…

计算与语言 · 计算机科学 2025-08-15 Chenhao Xue , Yuanzhe Jin , Adrian Carrasco-Revilla , Joyraj Chakraborty , Min Chen

Our work addresses the critical issue of distinguishing text generated by Large Language Models (LLMs) from human-produced text, a task essential for numerous applications. Despite ongoing debate about the feasibility of such…

计算与语言 · 计算机科学 2023-10-04 Souradip Chakraborty , Amrit Singh Bedi , Sicheng Zhu , Bang An , Dinesh Manocha , Furong Huang

While diffusion models excel at generating high-quality images from text prompts, they struggle with visual consistency when generating image sequences. Existing methods generate each image independently, leading to disjointed narratives -…

计算机视觉与模式识别 · 计算机科学 2025-09-24 Guilherme Fernandes , Vasco Ramos , Regev Cohen , Idan Szpektor , João Magalhães