English
Related papers

Related papers: Utterance Rewriting with Contrastive Learning in M…

200 papers

The effectiveness of large language models (LLMs) in conversational AI is hindered by their reliance on single-turn supervised fine-tuning (SFT) data, which limits contextual coherence in multi-turn dialogues. Existing methods for…

Computation and Language · Computer Science 2025-07-08 Jiangxu Wu , Cong Wang , TianHuang Su , Jun Yang , Haozhi Lin , Chao Zhang , Ming Peng , Kai Shi , SongPan Yang , BinQing Pan , ZiXian Li , Ni Yang , ZhenYu Yang

Short feedback responses, such as backchannels, play an important role in spoken dialogue. So far, most of the modeling of feedback responses has focused on their timing, often neglecting how their lexical and prosodic form influence their…

Computation and Language · Computer Science 2024-09-25 Livia Qian , Gabriel Skantze

Conversational Question Answering (CQA) aims to answer questions contained within dialogues, which are not easily interpretable without context. Developing a model to rewrite conversational questions into self-contained ones is an emerging…

Computation and Language · Computer Science 2022-11-02 Zhiyu Chen , Jie Zhao , Anjie Fang , Besnik Fetahu , Oleg Rokhlenko , Shervin Malmasi

Large Language Models (LLMs) have demonstrated impressive capabilities in creative tasks such as storytelling and E-mail generation. However, as LLMs are primarily trained on final text results rather than intermediate revisions, it might…

Computation and Language · Computer Science 2023-12-21 Lei Shu , Liangchen Luo , Jayakumar Hoskere , Yun Zhu , Yinxiao Liu , Simon Tong , Jindong Chen , Lei Meng

Change captioning aims to succinctly describe the semantic change between a pair of similar images, while being immune to distractors (illumination and viewpoint changes). Under these distractors, unchanged objects often appear pseudo…

Computer Vision and Pattern Recognition · Computer Science 2024-07-17 Yunbin Tu , Liang Li , Li Su , Chenggang Yan , Qingming Huang

Effective feedback is essential for refining instructional practices in mathematics education, and researchers often turn to advanced natural language processing (NLP) models to analyze classroom dialogues from multiple perspectives.…

Computation and Language · Computer Science 2025-08-05 Jannatun Naim , Jie Cao , Fareen Tasneem , Jennifer Jacobs , Brent Milne , James Martin , Tamara Sumner

Contrastive learning is a popular form of self-supervised learning that encourages augmentations (views) of the same input to have more similar representations compared to augmentations of different inputs. Recent attempts to theoretically…

Machine Learning · Computer Science 2022-03-01 Nikunj Saunshi , Jordan Ash , Surbhi Goel , Dipendra Misra , Cyril Zhang , Sanjeev Arora , Sham Kakade , Akshay Krishnamurthy

Query rewriting (QR) is an increasingly important technique to reduce customer friction caused by errors in a spoken language understanding pipeline, where the errors originate from various sources such as speech recognition errors,…

Computation and Language · Computer Science 2020-02-14 Zheng Chen , Xing Fan , Yuan Ling , Lambert Mathias , Chenlei Guo

Large language models (LLMs), optimized through human feedback, have rapidly emerged as a leading paradigm for developing intelligent conversational assistants. However, despite their strong performance across many benchmarks, LLM-based…

Computation and Language · Computer Science 2025-07-29 Maximillian Chen , Ruoxi Sun , Tomas Pfister , Sercan Ö. Arık

Contrastive learning has become a new paradigm for unsupervised sentence embeddings. Previous studies focus on instance-wise contrastive learning, attempting to construct positive pairs with textual data augmentation. In this paper, we…

Computation and Language · Computer Science 2022-12-13 Jiali Zeng , Yongjing Yin , Yufan Jiang , Shuangzhi Wu , Yunbo Cao

Meta-learning enables learning systems to adapt quickly to new tasks, similar to humans. Different meta-learning approaches all work under/with the mini-batch episodic training framework. Such framework naturally gives the information about…

Machine Learning · Computer Science 2025-11-10 Shiguang Wu , Yaqing Wang , Yatao Bian , Quanming Yao

Dialogue systems are frequently updated to accommodate new services, but naively updating them by continually training with data for new services in diminishing performance on previously learnt services. Motivated by the insight that…

Computation and Language · Computer Science 2025-09-30 Hyundong Cho , Andrea Madotto , Zhaojiang Lin , Khyathi Raghavi Chandu , Satwik Kottur , Jing Xu , Jonathan May , Chinnadhurai Sankar

Multi-choice machine reading comprehension (MRC) requires models to choose the correct answer from candidate options given a passage and a question. Our research focuses dialogue-based MRC, where the passages are multi-turn dialogues. It…

Computation and Language · Computer Science 2020-09-11 Junlong Li , Zhuosheng Zhang , Hai Zhao

Large Language Models demonstrate strong capabilities in single-turn instruction following but suffer from Lost-in-Conversation (LiC), a degradation in performance as information is revealed progressively in multi-turn settings. Motivated…

Computation and Language · Computer Science 2026-05-01 Ming Li , Pei Chen , Zhenhao Zhang , Tao Yang , Xinyang Zhang , Han Li , Tianyu Cao , Ming Zeng , Zhuofeng Wu , Meng Jiang , Huasheng Li , Lihong Li , Bing Yin

Table pretrain-then-finetune paradigm has been proposed and employed at a rapid pace after the success of pre-training in the natural language domain. Despite the promising findings in tabular pre-trained language models (TPLMs), there is…

Computation and Language · Computer Science 2023-02-21 Nuo Chen , Linjun Shou , Ming Gong , Jian Pei , Chenyu You , Jianhui Chang , Daxin Jiang , Jia Li

A huge number of multi-participant dialogues happen online every day, which leads to difficulty in understanding the nature of dialogue dynamics for both humans and machines. Dialogue disentanglement aims at separating an entangled dialogue…

Computation and Language · Computer Science 2023-02-17 Jingsheng Gao , Zeyu Li , Suncheng Xiang , Ting Liu , Yuzhuo Fu

Text embedding models play a crucial role in natural language processing, particularly in information retrieval, and their importance is further highlighted with the recent utilization of RAG (Retrieval- Augmented Generation). This study…

Information Retrieval · Computer Science 2024-12-24 Jeongsu Yu

In this work we focus on multi-turn passage retrieval as a crucial component of conversational search. One of the key challenges in multi-turn passage retrieval comes from the fact that the current turn query is often underspecified due to…

Information Retrieval · Computer Science 2020-05-26 Nikos Voskarides , Dan Li , Pengjie Ren , Evangelos Kanoulas , Maarten de Rijke

Though offering amazing contextualized token-level representations, current pre-trained language models actually take less attention on acquiring sentence-level representation during its self-supervised pre-training. If self-supervised…

Computation and Language · Computer Science 2022-10-24 Bohong Wu , Hai Zhao

Pre-trained language models have achieved remarkable success across diverse applications but remain susceptible to spurious, concept-driven correlations that impair robustness and fairness. In this work, we introduce CURE, a novel and…

Computation and Language · Computer Science 2025-09-11 Aysenur Kocak , Shuo Yang , Bardh Prenkaj , Gjergji Kasneci