English
Related papers

Related papers: Closing the Gap at CRAC 2026: Two-Stage Adaptation…

200 papers

Recent studies show that large language models (LLMs) struggle with technical standards in telecommunications. We propose a fine-tuned retrieval-augmented generation (RAG) system based on the Phi-2 small language model (SLM) to serve as an…

Computation and Language · Computer Science 2025-01-17 Omar Erak , Nouf Alabbasi , Omar Alhussein , Ismail Lotfi , Amr Hussein , Sami Muhaidat , Merouane Debbah

Large Language Models (LLMs) have shown strong general capabilities in many applications. However, how to make them reliable tools for some specific tasks such as automated short answer grading (ASAG) remains a challenge. We present SteLLA…

Computation and Language · Computer Science 2025-05-26 Hefei Qiu , Brian White , Ashley Ding , Reinaldo Costa , Ali Hachem , Wei Ding , Ping Chen

Retrieval Augmented Generation (RAG) has greatly improved the performance of Large Language Model (LLM) responses by grounding generation with context from existing documents. These systems work well when documents are clearly relevant to a…

Computation and Language · Computer Science 2024-05-29 Jialin Dong , Bahare Fatemi , Bryan Perozzi , Lin F. Yang , Anton Tsitsulin

Large language models (LLMs) remain unreliable for global enterprise applications due to substantial performance gaps between high-resource and mid/low-resource languages, driven by English-centric pretraining and internal reasoning biases.…

Computation and Language · Computer Science 2025-10-28 Amit Agarwal , Hansa Meghwani , Hitesh Laxmichand Patel , Tao Sheng , Sujith Ravi , Dan Roth

Large language models (LLMs) are reshaping the recommender system paradigm by enabling users to express preferences and receive recommendations through conversations. Yet, aligning LLMs to the recommendation task remains challenging:…

Information Retrieval · Computer Science 2026-02-17 Yaochen Zhu , Harald Steck , Dawen Liang , Yinhan He , Vito Ostuni , Jundong Li , Nathan Kallus

This paper presents a neural network classifier approach to detecting both within- and cross- document event coreference effectively using only event mention based features. Our approach does not (yet) rely on any event argument features…

Computation and Language · Computer Science 2018-10-11 Arun Pandian , Lamana Mulaffer , Kemal Oflazer , Amna AlZeyara

Previous studies have proved that cross-lingual knowledge distillation can significantly improve the performance of pre-trained models for cross-lingual similarity matching tasks. However, the student model needs to be large in this…

Computation and Language · Computer Science 2022-09-14 Kunbo Ding , Weijie Liu , Yuejian Fang , Zhe Zhao , Qi Ju , Xuefeng Yang

We present the Charles University system for the MRL~2023 Shared Task on Multi-lingual Multi-task Information Retrieval. The goal of the shared task was to develop systems for named entity recognition and question answering in several…

Computation and Language · Computer Science 2023-10-26 Jindřich Helcl , Jindřich Libovický

In this paper we present a multi-adapter retrieval augmented generation system (MARAGS) for Meta's Comprehensive RAG (CRAG) competition for KDD CUP 2024. CRAG is a question answering dataset contains 3 different subtasks aimed at realistic…

Computation and Language · Computer Science 2024-11-05 Mitchell DeHaven

As global e-commerce platforms continue to expand, companies are entering new markets where they encounter cold-start challenges due to limited human labels and user behaviors. In this paper, we share our experiences in Coupang to provide a…

In the U.S. inpatient payment system, the Diagnosis-Related Group (DRG) is pivotal, but its assignment process is inefficient. The study introduces DRG-LLaMA, an advanced large language model (LLM) fine-tuned on clinical notes to enhance…

Artificial Intelligence · Computer Science 2023-10-02 Hanyin Wang , Chufan Gao , Christopher Dantona , Bryan Hull , Jimeng Sun

In this paper, we introduce a method for fine-tuning Large Language Models (LLMs), inspired by Multi-Task learning in a federated manner. Our approach leverages the structure of each client's model and enables a learning scheme that…

Machine Learning · Computer Science 2024-10-22 Ahmed Elbakary , Chaouki Ben Issaid , Tamer ElBatt , Karim Seddik , Mehdi Bennis

We study the potential synergy between two different NLP tasks, both confronting predicate lexical variability: identifying predicate paraphrases, and event coreference resolution. First, we used annotations from an event coreference…

Computation and Language · Computer Science 2020-10-12 Yehudit Meged , Avi Caciularu , Vered Shwartz , Ido Dagan

Retrieval-augmented generation (RAG) enhances large language models (LLMs) with external knowledge but still suffers from long contexts and disjoint retrieval-generation optimization. In this work, we propose CLaRa (Continuous Latent…

Computation and Language · Computer Science 2026-02-09 Jie He , Richard He Bai , Sinead Williamson , Jeff Z. Pan , Navdeep Jaitly , Yizhe Zhang

We present the setup and the tasks of the FinMMEval Lab at CLEF 2026, which introduces the first multilingual and multimodal evaluation framework for financial Large Language Models (LLMs). While recent advances in financial natural…

Fine-tuning large language models (LLMs) with low-rank adaptation (LoRA) is a cost-effective way to incorporate information from a specific dataset. However, when a problem requires incorporating information from multiple datasets - as in…

Machine Learning · Computer Science 2026-04-03 Liyi Zhang , Jake Snell , Thomas L. Griffiths

Selectional preferences have long been claimed to be essential for coreference resolution. However, they are mainly modeled only implicitly by current coreference resolvers. We propose a dependency-based embedding model of selectional…

Computation and Language · Computer Science 2017-07-21 Benjamin Heinzerling , Nafise Sadat Moosavi , Michael Strube

Causal Language Modeling (CLM) and Masked Language Modeling (MLM) are two mainstream learning paradigms based on Transformer networks, specifically the Decoder-only and Encoder-only architectures. The strengths of each paradigm in…

Computation and Language · Computer Science 2024-12-05 Xinru Yu , Bin Guo , Shiwei Luo , Jie Wang , Tao Ji , Yuanbin Wu

In this paper, we present our system for SemEval-2026 Task 6 (CLARITY) on response clarity and evasion detection in question-answer pairs from U.S. presidential interviews, comparing fine-tuned encoders with prompt-based LLMs. Our LLM…

Computation and Language · Computer Science 2026-05-05 Nawar Turk , Lucas Miquet-Westphal , Leila Kosseim

Supervised ranking methods based on bi-encoder or cross-encoder architectures have shown success in multi-stage text ranking tasks, but they require large amounts of relevance judgments as training data. In this work, we propose Listwise…

Information Retrieval · Computer Science 2023-05-04 Xueguang Ma , Xinyu Zhang , Ronak Pradeep , Jimmy Lin