English
Related papers

Related papers: Are LLMs Prescient? A Continuous Evaluation using …

200 papers

Recommender systems have traditionally followed modular architectures comprising candidate generation, multi-stage ranking, and re-ranking, each trained separately with supervised objectives and hand-engineered features. While effective in…

Information Retrieval · Computer Science 2025-10-06 Rahul Raja , Anshaj Vats , Arpita Vats , Anirban Majumder

In commercial web search, aligning content freshness with user intent remains challenging due to the highly varied lifespans of information. Traditional industrial approaches rely on static time-window filtering, resulting in…

Information Retrieval · Computer Science 2026-05-14 Tingyu Chen , Wenkai Zhang , Li Gao , Lixin Su , Ge Chen , Dawei Yin , Daiting Shi

Optimization algorithms and large language models (LLMs) enhance decision-making in dynamic environments by integrating artificial intelligence with traditional techniques. LLMs, with extensive domain knowledge, facilitate intelligent…

Neural and Evolutionary Computing · Computer Science 2024-05-17 Sen Huang , Kaixiang Yang , Sheng Qi , Rui Wang

Large Language Models (LLMs) have been widely used as general-purpose AI agents showing comparable performance on many downstream tasks. However, existing work shows that it is challenging for LLMs to integrate structured data (e.g. KG,…

Computation and Language · Computer Science 2024-02-23 Younghun Lee , Sungchul Kim , Tong Yu , Ryan A. Rossi , Xiang Chen

As large language models (LLMs) are increasingly deployed in multi-turn dialogue and other sustained interactive scenarios, it is essential to understand how extended context affects their performance. Popular benchmarks, focusing primarily…

Computation and Language · Computer Science 2025-06-03 Robert Hankache , Kingsley Nketia Acheampong , Liang Song , Marek Brynda , Raad Khraishi , Greig A. Cowan

Qualitative data collection and analysis approaches, such as those employing interviews and focus groups, provide rich insights into customer attitudes, sentiment, and behavior. However, manually analyzing qualitative data requires…

Computers and Society · Computer Science 2024-08-21 Sreyoshi Bhaduri , Satya Kapoor , Alex Gil , Anshul Mittal , Rutu Mulkar

Large language models (LLMs) are increasingly used as automated judges to evaluate recommendation systems, search engines, and other subjective tasks, where relying on human evaluators can be costly, time-consuming, and unscalable. LLMs…

Computation and Language · Computer Science 2025-02-10 Gerrit J. J. van den Burg , Gen Suzuki , Wei Liu , Murat Sensoy

Large Language Models (LLMs) have shown remarkable capabilities in solving diverse tasks. However, their proficiency in iteratively optimizing complex solutions through learning from previous feedback remains insufficiently explored. To…

Artificial Intelligence · Computer Science 2025-06-13 Xiaozhe Li , Jixuan Chen , Xinyu Fang , Shengyuan Ding , Haodong Duan , Qingwen Liu , Kai Chen

Lifelong learning is essential for intelligent agents operating in dynamic environments. Current large language model (LLM)-based agents, however, remain stateless and unable to accumulate or transfer knowledge over time. Existing…

Artificial Intelligence · Computer Science 2025-06-02 Junhao Zheng , Xidi Cai , Qiuke Li , Duzhen Zhang , ZhongZhi Li , Yingying Zhang , Le Song , Qianli Ma

Large Language Models (LLMs) have emerged as a powerful tool in advancing the Text-to-SQL task, significantly outperforming traditional methods.Nevertheless, as a nascent research field, there is still no consensus on the optimal prompt…

Computation and Language · Computer Science 2026-03-20 Bin Zhang , Yuxiao Ye , Guoqing Du , Xiaoru Hu , Zhishuai Li , Chi Harold Liu , Zhiwei Xu , Guoliang Fan , Rui Zhao , Ziyue Li , Hangyu Mao

The versatility of large language models (LLMs) led to the creation of diverse benchmarks that thoroughly test a variety of language models' abilities. These benchmarks consist of tens of thousands of examples making evaluation of LLMs very…

Computation and Language · Computer Science 2024-05-28 Felipe Maia Polo , Lucas Weber , Leshem Choshen , Yuekai Sun , Gongjun Xu , Mikhail Yurochkin

Large language models (LLMs) have recently shown great advances in a variety of tasks, including natural language understanding and generation. However, their use in high-stakes decision-making scenarios is still limited due to the…

Computation and Language · Computer Science 2023-11-14 Jiefeng Chen , Jinsung Yoon , Sayna Ebrahimi , Sercan O Arik , Tomas Pfister , Somesh Jha

The sequential recommendation problem has attracted considerable research attention in the past few years, leading to the rise of numerous recommendation models. In this work, we explore how Large Language Models (LLMs), which are nowadays…

Information Retrieval · Computer Science 2025-01-14 Artun Boz , Wouter Zorgdrager , Zoe Kotti , Jesse Harte , Panos Louridas , Dietmar Jannach , Vassilios Karakoidas , Marios Fragkoulis

Large Language Models (LLMs) have demonstrated remarkable capabilities in reasoning, generalization, and simulating human-like behavior across a wide range of tasks. These strengths present new opportunities to enhance traditional…

Information Retrieval · Computer Science 2025-12-01 Nachiket Subbaraman , Jaskinder Sarai , Aniruddh Nath , Lichan Hong , Lukasz Heldt , Li Wei , Zhe Zhao

Validating Large Language Models with ReLM explores the application of formal languages to evaluate and control Large Language Models (LLMs) for memorization, bias, and zero-shot performance. Current approaches for evaluating these types…

Computation and Language · Computer Science 2025-04-18 Reece Adamson , Erin Song

The swift advancement in the scales and capabilities of Large Language Models (LLMs) positions them as promising tools for a variety of downstream tasks. In addition to the pursuit of better performance and the avoidance of violent feedback…

Computation and Language · Computer Science 2023-09-28 Haoyu Wang , Guozheng Ma , Cong Yu , Ning Gui , Linrui Zhang , Zhiqi Huang , Suwei Ma , Yongzhe Chang , Sen Zhang , Li Shen , Xueqian Wang , Peilin Zhao , Dacheng Tao

Large Language Models (LLMs) generate text token-by-token in discrete time, yet real-world communication, from therapy sessions to business negotiations, critically depends on continuous time constraints. Current LLM architectures and…

Artificial Intelligence · Computer Science 2026-01-21 Neil K. R. Sehgal , Sharath Chandra Guntuku , Lyle Ungar

Continual learning (CL) in large language models (LLMs) is an evolving domain that focuses on developing efficient and sustainable training strategies to adapt models to emerging knowledge and achieve robustness in dynamic environments. Our…

Computation and Language · Computer Science 2025-02-13 Çağatay Yıldız , Nishaanth Kanna Ravichandran , Nitin Sharma , Matthias Bethge , Beyza Ermis

The current paradigm of evaluating Large Language Models (LLMs) through static benchmarks comes with significant limitations, such as vulnerability to data contamination and a lack of adaptability to the evolving capabilities of LLMs.…

Computation and Language · Computer Science 2024-06-26 Zhehao Zhang , Jiaao Chen , Diyi Yang

There are many methods and systems to tackle the ontology alignment problem, yet a major challenge persists in producing high-quality mappings among a set of input ontologies. Adopting a human-in-the-loop approach during the alignment…

Artificial Intelligence · Computer Science 2026-02-17 Sviatoslav Lushnei , Dmytro Shumskyi , Severyn Shykula , Ernesto Jimenez-Ruiz , Artur d'Avila Garcez