中文
相关论文

相关论文: Language Models Don't Know What You Want: Evaluati…

200 篇论文

Personalization in Information Retrieval is a topic studied for a long time. Nevertheless, there is still a lack of high-quality, real-world datasets to conduct large-scale experiments and evaluate models for personalized search. This paper…

信息检索 · 计算机科学 2024-03-18 Pranav Kasela , Marco Braga , Gabriella Pasi , Raffaele Perego

Responding to the thousands of student questions on online QA platforms each semester has a considerable human cost, particularly in computing courses with rapidly growing enrollments. To address the challenges of scalable and intelligent…

机器学习 · 计算机科学 2023-12-20 Yann Hicke , Anmol Agarwal , Qianou Ma , Paul Denny

With the advancement of large language models (LLMs) in their knowledge base and reasoning capabilities, their interactive modalities have evolved from pure text to multimodality and further to agentic tool use. Consequently, their…

人工智能 · 计算机科学 2026-03-31 Yipeng Yu

Web agents have emerged as a promising direction to automate Web task completion based on user instructions, significantly enhancing user experience. Recently, Web agents have evolved from traditional agents to Large Language Models…

计算与语言 · 计算机科学 2025-03-25 Hongru Cai , Yongqi Li , Wenjie Wang , Fengbin Zhu , Xiaoyu Shen , Wenjie Li , Tat-Seng Chua

Large language models (LLMs) increasingly serve as educational tools, yet evaluating their teaching capabilities remains challenging due to the resource-intensive, context-dependent, and methodologically complex nature of teacher-student…

人工智能 · 计算机科学 2025-08-01 Yao Shi , Rongkeng Liang , Yong Xu

Academic Search is a search task aimed to manage and retrieve scientific documents like journal articles and conference papers. Personalization in this context meets individual researchers' needs by leveraging, through user profiles, the…

信息检索 · 计算机科学 2025-07-21 Pranav Kasela , Gabriella Pasi , Raffaele Perego

Personalization in social robotics is critical for fostering effective human-robot interactions, yet systems often face the cold start problem, where initial user preferences or characteristics are unavailable. This paper proposes a novel…

With advances in large language models (LLMs), researchers are creating new systems that can perform AI-driven analytics over large unstructured datasets. Recent work has explored executing such analytics queries using semantic operators --…

人工智能 · 计算机科学 2025-09-04 Matthew Russo , Tim Kraska

The growing popularity and widespread adoption of large language models (LLMs) necessitates the development of tools that enhance the effectiveness of user interactions with these models. Understanding the structures and functions of these…

人机交互 · 计算机科学 2025-03-03 Divya Perumal , Swaroop Panda

Evaluating answers from state-of-the-art large language models (LLMs) is challenging: lexical metrics miss semantic nuances, whereas "LLM-as-Judge" scoring is computationally expensive. We re-evaluate a lightweight alternative --…

计算与语言 · 计算机科学 2025-11-12 Sai Shridhar Balamurali , Lu Cheng

Personalization has traditionally depended on platform-specific user models that are optimized for prediction but remain largely inaccessible to the people they describe. As LLM-based assistants increasingly mediate search, shopping,…

信息检索 · 计算机科学 2026-04-23 Jiahao Liu , Mingzhe Han , Guanming Liu , Weihang Wang , Dongsheng Li , Hansu Gu , Peng Zhang , Tun Lu , Ning Gu

Large language models (LLMs) have demonstrated remarkable capabilities but often struggle to align with human preferences, leading to harmful or undesirable outputs. Preference learning, which trains models to distinguish between preferred…

机器学习 · 计算机科学 2025-10-16 Shawn Im , Sharon Li

Recent advancements in generative AI have significantly increased interest in personalized agents. With increased personalization, there is also a greater need for being able to trust decision-making and action taking capabilities of these…

信息检索 · 计算机科学 2025-04-10 Chirag Shah , Hideo Joho , Kirandeep Kaur , Preetam Prabhu Srikar Dammu

Online learning has experienced rapid growth due to its flexibility and accessibility. Personalization, adapted to the needs of individual learners, is crucial for enhancing the learning experience, particularly in online settings. A key…

计算机与社会 · 计算机科学 2025-06-13 Mohammadreza Molavi , Mohammadreza Tavakoli , Mohammad Moein , Abdolali Faraji , Gábor Kismihók

Recent advances in large language models (LLMs) have enabled deep research systems that synthesize comprehensive, report-style answers to open-ended queries by combining retrieval, reasoning, and generation. Yet most frameworks rely on…

计算与语言 · 计算机科学 2026-05-26 Lin Ai , Victor S. Bursztyn , Xiang Chen , Julia Hirschberg , Saayan Mitra

Recent advancements in Natural Language Processing and Deep Learning have enabled the development of Large Language Models (LLMs), which have significantly advanced the state-of-the-art across a wide range of tasks, including Question…

计算与语言 · 计算机科学 2026-02-20 Charalampos Mastrokostas , Nikolaos Giarelis , Nikos Karacapilidis

Question answering on free-form tables (a.k.a. TableQA) is a challenging task because of the flexible structure and complex schema of tables. Recent studies use Large Language Models (LLMs) for this task, exploiting their capability in…

计算与语言 · 计算机科学 2025-06-17 Yuxiang Wang , Jianzhong Qi , Junhao Gan

Many AI systems focus solely on providing solutions or explaining outcomes. However, complex tasks like research and strategic thinking often benefit from a more comprehensive approach to augmenting the thinking process rather than…

人机交互 · 计算机科学 2024-12-25 Soya Park , Hari Subramonyam , Chinmay Kulkarni

We introduce SealQA, a new challenge benchmark for evaluating SEarch-Augmented Language models on fact-seeking questions where web search yields conflicting, noisy, or unhelpful results. SealQA comes in three flavors: (1) Seal-0 (main) and…

计算与语言 · 计算机科学 2026-04-10 Thinh Pham , Nguyen Nguyen , Pratibha Zunjare , Weiyuan Chen , Yu-Min Tseng , Tu Vu

Personalized search is a problem where models benefit from learning user preferences from per-user historical interaction data. The inferred preferences enable personalized ranking models to improve the relevance of documents for users.…

信息检索 · 计算机科学 2025-05-02 Sheshera Mysore , Garima Dhanania , Kishor Patil , Surya Kallumadi , Andrew McCallum , Hamed Zamani