English
Related papers

Related papers: Language Models Don't Know What You Want: Evaluati…

200 papers

Personalization in Information Retrieval is a topic studied for a long time. Nevertheless, there is still a lack of high-quality, real-world datasets to conduct large-scale experiments and evaluate models for personalized search. This paper…

Information Retrieval · Computer Science 2024-03-18 Pranav Kasela , Marco Braga , Gabriella Pasi , Raffaele Perego

Responding to the thousands of student questions on online QA platforms each semester has a considerable human cost, particularly in computing courses with rapidly growing enrollments. To address the challenges of scalable and intelligent…

Machine Learning · Computer Science 2023-12-20 Yann Hicke , Anmol Agarwal , Qianou Ma , Paul Denny

With the advancement of large language models (LLMs) in their knowledge base and reasoning capabilities, their interactive modalities have evolved from pure text to multimodality and further to agentic tool use. Consequently, their…

Artificial Intelligence · Computer Science 2026-03-31 Yipeng Yu

Web agents have emerged as a promising direction to automate Web task completion based on user instructions, significantly enhancing user experience. Recently, Web agents have evolved from traditional agents to Large Language Models…

Computation and Language · Computer Science 2025-03-25 Hongru Cai , Yongqi Li , Wenjie Wang , Fengbin Zhu , Xiaoyu Shen , Wenjie Li , Tat-Seng Chua

Large language models (LLMs) increasingly serve as educational tools, yet evaluating their teaching capabilities remains challenging due to the resource-intensive, context-dependent, and methodologically complex nature of teacher-student…

Artificial Intelligence · Computer Science 2025-08-01 Yao Shi , Rongkeng Liang , Yong Xu

Academic Search is a search task aimed to manage and retrieve scientific documents like journal articles and conference papers. Personalization in this context meets individual researchers' needs by leveraging, through user profiles, the…

Information Retrieval · Computer Science 2025-07-21 Pranav Kasela , Gabriella Pasi , Raffaele Perego

Personalization in social robotics is critical for fostering effective human-robot interactions, yet systems often face the cold start problem, where initial user preferences or characteristics are unavailable. This paper proposes a novel…

Human-Computer Interaction · Computer Science 2025-04-03 Hamed Rahimi , Jeanne Cattoni , Meriem Beghili , Mouad Abrini , Mahdi Khoramshahi , Maribel Pino , Mohamed Chetouani

With advances in large language models (LLMs), researchers are creating new systems that can perform AI-driven analytics over large unstructured datasets. Recent work has explored executing such analytics queries using semantic operators --…

Artificial Intelligence · Computer Science 2025-09-04 Matthew Russo , Tim Kraska

The growing popularity and widespread adoption of large language models (LLMs) necessitates the development of tools that enhance the effectiveness of user interactions with these models. Understanding the structures and functions of these…

Human-Computer Interaction · Computer Science 2025-03-03 Divya Perumal , Swaroop Panda

Evaluating answers from state-of-the-art large language models (LLMs) is challenging: lexical metrics miss semantic nuances, whereas "LLM-as-Judge" scoring is computationally expensive. We re-evaluate a lightweight alternative --…

Computation and Language · Computer Science 2025-11-12 Sai Shridhar Balamurali , Lu Cheng

Personalization has traditionally depended on platform-specific user models that are optimized for prediction but remain largely inaccessible to the people they describe. As LLM-based assistants increasingly mediate search, shopping,…

Information Retrieval · Computer Science 2026-04-23 Jiahao Liu , Mingzhe Han , Guanming Liu , Weihang Wang , Dongsheng Li , Hansu Gu , Peng Zhang , Tun Lu , Ning Gu

Large language models (LLMs) have demonstrated remarkable capabilities but often struggle to align with human preferences, leading to harmful or undesirable outputs. Preference learning, which trains models to distinguish between preferred…

Machine Learning · Computer Science 2025-10-16 Shawn Im , Sharon Li

Recent advancements in generative AI have significantly increased interest in personalized agents. With increased personalization, there is also a greater need for being able to trust decision-making and action taking capabilities of these…

Information Retrieval · Computer Science 2025-04-10 Chirag Shah , Hideo Joho , Kirandeep Kaur , Preetam Prabhu Srikar Dammu

Online learning has experienced rapid growth due to its flexibility and accessibility. Personalization, adapted to the needs of individual learners, is crucial for enhancing the learning experience, particularly in online settings. A key…

Computers and Society · Computer Science 2025-06-13 Mohammadreza Molavi , Mohammadreza Tavakoli , Mohammad Moein , Abdolali Faraji , Gábor Kismihók

Recent advances in large language models (LLMs) have enabled deep research systems that synthesize comprehensive, report-style answers to open-ended queries by combining retrieval, reasoning, and generation. Yet most frameworks rely on…

Computation and Language · Computer Science 2026-05-26 Lin Ai , Victor S. Bursztyn , Xiang Chen , Julia Hirschberg , Saayan Mitra

Recent advancements in Natural Language Processing and Deep Learning have enabled the development of Large Language Models (LLMs), which have significantly advanced the state-of-the-art across a wide range of tasks, including Question…

Computation and Language · Computer Science 2026-02-20 Charalampos Mastrokostas , Nikolaos Giarelis , Nikos Karacapilidis

Question answering on free-form tables (a.k.a. TableQA) is a challenging task because of the flexible structure and complex schema of tables. Recent studies use Large Language Models (LLMs) for this task, exploiting their capability in…

Computation and Language · Computer Science 2025-06-17 Yuxiang Wang , Jianzhong Qi , Junhao Gan

Many AI systems focus solely on providing solutions or explaining outcomes. However, complex tasks like research and strategic thinking often benefit from a more comprehensive approach to augmenting the thinking process rather than…

Human-Computer Interaction · Computer Science 2024-12-25 Soya Park , Hari Subramonyam , Chinmay Kulkarni

We introduce SealQA, a new challenge benchmark for evaluating SEarch-Augmented Language models on fact-seeking questions where web search yields conflicting, noisy, or unhelpful results. SealQA comes in three flavors: (1) Seal-0 (main) and…

Computation and Language · Computer Science 2026-04-10 Thinh Pham , Nguyen Nguyen , Pratibha Zunjare , Weiyuan Chen , Yu-Min Tseng , Tu Vu

Personalized search is a problem where models benefit from learning user preferences from per-user historical interaction data. The inferred preferences enable personalized ranking models to improve the relevance of documents for users.…

Information Retrieval · Computer Science 2025-05-02 Sheshera Mysore , Garima Dhanania , Kishor Patil , Surya Kallumadi , Andrew McCallum , Hamed Zamani