English
Related papers

Related papers: Online Domain-aware LLM Decoding for Continual Dom…

200 papers

Motivated by the success of pre-trained language models such as BERT in a broad range of natural language processing (NLP) tasks, recent research efforts have been made for adapting these models for different application domains. Along this…

Computation and Language · Computer Science 2021-12-07 Denghui Zhang , Zixuan Yuan , Yanchi Liu , Hao Liu , Fuzhen Zhuang , Hui Xiong , Haifeng Chen

Consistency is a key requirement of high-quality translation. It is especially important to adhere to pre-approved terminology and adapt to corrected translations in domain-specific projects. Machine translation (MT) has achieved…

Computation and Language · Computer Science 2024-01-29 Yasmin Moslem

We revisit the likelihood ratio between a pretrained large language model (LLM) and its finetuned variant as a criterion for out-of-distribution (OOD) detection. The intuition behind such a criterion is that, the pretrained LLM has the…

Computation and Language · Computer Science 2025-03-07 Andi Zhang , Tim Z. Xiao , Weiyang Liu , Robert Bamler , Damon Wischik

LiDAR semantic segmentation provides 3D semantic information about the environment, an essential cue for intelligent systems during their decision making processes. Deep neural networks are achieving state-of-the-art results on large public…

Computer Vision and Pattern Recognition · Computer Science 2021-12-06 Inigo Alonso , Luis Riazuelo , Luis Montesano , Ana C. Murillo

Adapting general large language models (LLMs) to specialized domains presents great challenges due to varied data distributions. This adaptation typically requires continual pre-training on massive domain-specific corpora to facilitate…

Computation and Language · Computer Science 2024-07-16 Jinhao Jiang , Junyi Li , Wayne Xin Zhao , Yang Song , Tao Zhang , Ji-Rong Wen

Accurate network synchronization is a key enabler for services such as coherent transmission, cooperative decoding, and localization in distributed and cell-free networks. Unlike centralized networks, where synchronization is generally…

Signal Processing · Electrical Eng. & Systems 2023-03-03 Dieter Verbruggen , Hazem Sallouha , Sofie Pollin

The primary goal of online change detection (OCD) is to promptly identify changes in the data stream. OCD problem find a wide variety of applications in diverse areas, e.g., security detection in smart grids and intrusion detection in…

Machine Learning · Statistics 2024-06-05 Yancheng Huang , Kai Yang , Zelin Zhu , Leian Chen

Fault detection is crucial in industrial systems to prevent failures and optimize performance by distinguishing abnormal from normal operating conditions. Data-driven methods have been gaining popularity for fault detection tasks as the…

Machine Learning · Computer Science 2024-06-12 Han Sun , Kevin Ammann , Stylianos Giannoulakis , Olga Fink

Domain generalization aims to improve the generalization capability of machine learning systems to out-of-distribution (OOD) data. Existing domain generalization techniques embark upon stationary and discrete environments to tackle the…

Machine Learning · Computer Science 2022-06-17 Tiexin Qin , Shiqi Wang , Haoliang Li

Integrating large language models (LLMs) with knowledge graphs derived from domain-specific data represents an important advancement towards more powerful and factual reasoning. As these models grow more capable, it is crucial to enable…

Artificial Intelligence · Computer Science 2024-04-19 Stefan Dernbach , Khushbu Agarwal , Alejandro Zuniga , Michael Henry , Sutanay Choudhury

Real-time forecasting from streaming data poses critical challenges: handling non-stationary dynamics, operating under strict computational limits, and adapting rapidly without catastrophic forgetting. However, many existing approaches face…

Machine Learning · Computer Science 2025-10-20 Christopher Salazar , Krithika Manohar , Ashis G. Banerjee

Recent improvement in large language model performance have, in all likelihood, been accompanied by improvement in how well they can approximate the distribution of their training data. In this work, we explore the following question: which…

Computation and Language · Computer Science 2025-06-03 Da Ju , Hagen Blix , Adina Williams

This paper introduces an extension of generalised filtering for online applications. Generalised filtering refers to data assimilation schemes that jointly infer latent states, learn unknown model parameters, and estimate uncertainty in an…

Machine Learning · Statistics 2026-05-05 Mehran H. Z. Bazargani , Szymon Urbas , Adeel Razi , Thomas Brendan Murphy , Karl Friston

Large language models (LLMs) are emerging as few-shot learners capable of handling a variety of tasks, including comprehension, planning, reasoning, question answering, arithmetic calculations, and more. At the core of these capabilities is…

Databases · Computer Science 2024-11-05 Yu Pan , Hongfeng Yu , Tianjiao Zhao , Jianxin Sun

Large Language Models (LLMs) have demonstrated remarkable progress in translating natural language to SQL, but a significant semantic gap persists between their general knowledge and domain-specific semantics of databases. Historical…

Databases · Computer Science 2025-11-05 Yiwen Jiao , Tonghui Ren , Yuche Gao , Zhenying He , Yinan Jing , Kai Zhang , X. Sean Wang

Prior research on out-of-distribution detection (OoDD) has primarily focused on single-modality models. Recently, with the advent of large-scale pretrained vision-language models such as CLIP, OoDD methods utilizing such multi-modal…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Jeonghyeon Kim , Sangheum Hwang

Effective object detection in autonomous vehicles is challenged by deployment in diverse and unfamiliar environments. Online Source-Free Domain Adaptation (O-SFDA) offers model adaptation using a stream of unlabeled data from a target…

Computer Vision and Pattern Recognition · Computer Science 2024-09-02 Xiangyu Shi , Yanyuan Qiao , Qi Wu , Lingqiao Liu , Feras Dayoub

Unsupervised domain adaptation (UDA) is important for applications where large scale annotation of representative data is challenging. For semantic segmentation in particular, it helps deploy on real "target domain" data models that are…

Computer Vision and Pattern Recognition · Computer Science 2019-08-20 Tuan-Hung Vu , Himalaya Jain , Maxime Bucher , Matthieu Cord , Patrick Pérez

Object detection models trained on a source domain often exhibit significant performance degradation when deployed in unseen target domains, due to various kinds of variations, such as sensing conditions, environments and data…

Computer Vision and Pattern Recognition · Computer Science 2026-04-10 Saniya M. Deshmukh , Kailash A. Hambarde , Hugo Proença

The real-world adoption of portrait relighting is hindered by dataset domain gaps, camera sensitivity, and computational costs. We address these challenges with Hybrid Domain Knowledge Fusion, a paradigm that fuses the specialized strengths…

Computer Vision and Pattern Recognition · Computer Science 2026-04-28 Qian Huang , Mayoore Selvarasa Jaiswal , Zhen Zhong , Rochelle Pereira , Jianyuan Min