English
Related papers

Related papers: DialogCC: An Automated Pipeline for Creating High-…

200 papers

Recently, substantial advancements in pre-trained vision-language models have greatly enhanced the capabilities of multi-modal dialog systems. These models have demonstrated significant improvements by fine-tuning on downstream tasks.…

Computation and Language · Computer Science 2024-01-04 Zhichao Yin , Binyuan Hui , Min Yang , Fei Huang , Yongbin Li

This article presents a pipeline for automated fact-checking leveraging publicly available Language Models and data. The objective is to assess the accuracy of textual claims using evidence from a ground-truth evidence corpus. The pipeline…

Computation and Language · Computer Science 2024-08-23 Jan Drchal , Herbert Ullrich , Tomáš Mlynář , Václav Moravec

With the development of the Internet, more and more people get accustomed to online shopping. When communicating with customer service, users may express their requirements by means of text, images, and videos, which precipitates the need…

Computation and Language · Computer Science 2021-09-28 Nan Zhao , Haoran Li , Youzheng Wu , Xiaodong He , Bowen Zhou

Responsing with image has been recognized as an important capability for an intelligent conversational agent. Yet existing works only focus on exploring the multimodal dialogue models which depend on retrieval-based methods, but neglecting…

Computation and Language · Computer Science 2022-03-30 Qingfeng Sun , Yujing Wang , Can Xu , Kai Zheng , Yaming Yang , Huang Hu , Fei Xu , Jessica Zhang , Xiubo Geng , Daxin Jiang

Humans share a wide variety of images related to their personal experiences within conversations via instant messaging tools. However, existing works focus on (1) image-sharing behavior in singular sessions, leading to limited long-term…

Computation and Language · Computer Science 2024-07-08 Young-Jun Lee , Dokyong Lee , Junyoung Youn , Kyeongjin Oh , Byungsoo Ko , Jonghwan Hyeon , Ho-Jin Choi

Text-conditional diffusion models are able to generate high-fidelity images with diverse contents. However, linguistic representations frequently exhibit ambiguous descriptions of the envisioned objective imagery, requiring the…

Computer Vision and Pattern Recognition · Computer Science 2024-03-01 Minghui Hu , Jianbin Zheng , Daqing Liu , Chuanxia Zheng , Chaoyue Wang , Dacheng Tao , Tat-Jen Cham

The advancements of neural dialogue generation models show promising results on modeling short-text conversations. However, training such models usually needs a large-scale high-quality dialogue corpus, which is hard to access. In this…

Computation and Language · Computer Science 2022-04-27 Yida Wang , Pei Ke , Yinhe Zheng , Kaili Huang , Yong Jiang , Xiaoyan Zhu , Minlie Huang

At the beginning era of large language model, it is quite critical to generate a high-quality financial dataset to fine-tune a large language model for financial related tasks. Thus, this paper presents a carefully designed data creation…

Computation and Language · Computer Science 2023-08-04 Ziao Wang , Jianning Wang , Junda Wu , Xiaofeng Zhang

Dialogue data has been a key source for understanding learning processes, offering critical insights into how students engage in collaborative discussions and how these interactions shape their knowledge construction. The advent of Large…

Computation and Language · Computer Science 2025-04-29 Ying Na , Shihui Feng

In this paper, we introduce a novel Face-to-Face spoken dialogue model. It processes audio-visual speech from user input and generates audio-visual speech as the response, marking the initial step towards creating an avatar chatbot system…

Computer Vision and Pattern Recognition · Computer Science 2024-08-05 Se Jin Park , Chae Won Kim , Hyeongseop Rha , Minsu Kim , Joanna Hong , Jeong Hun Yeo , Yong Man Ro

Incorporating multi-modal contexts in conversation is important for developing more engaging dialogue systems. In this work, we explore this direction by introducing MMChat: a large-scale Chinese multi-modal dialogue corpus (32.4M raw…

Computation and Language · Computer Science 2022-05-03 Yinhe Zheng , Guanyi Chen , Xin Liu , Jian Sun

Most of the existing multi-modal models, hindered by their incapacity to adeptly manage interleaved image-and-text inputs in multi-image, multi-round dialogues, face substantial constraints in resource allocation for training and data…

Computer Vision and Pattern Recognition · Computer Science 2023-11-30 Zhewei Yao , Xiaoxia Wu , Conglong Li , Minjia Zhang , Heyang Qin , Olatunji Ruwase , Ammar Ahmad Awan , Samyam Rajbhandari , Yuxiong He

Developing language model-based dialogue agents requires effective data to train models that can follow specific task logic. However, most existing data simulation methods focus on increasing diversity in language, topics, or dialogue acts…

Computation and Language · Computer Science 2025-03-04 Wanyu Du , Song Feng , James Gung , Lijia Sun , Yi Zhang , Saab Mansour , Yanjun Qi

Goal-oriented dialog systems enable users to complete specific goals like requesting information about a movie or booking a ticket. Typically the dialog system pipeline contains multiple ML models, including natural language understanding,…

The study illustrates a first step towards an ongoing work aimed at developing a dataset of dialogues potentially useful for customer service conversation management between humans and AI chatbots. The approach exploits ChatGPT 3.5 to…

Human-Computer Interaction · Computer Science 2025-01-03 Alfredo Cuzzocrea , Giovanni Pilato , Pablo Garcia Bringas

Building a socially intelligent agent involves many challenges, one of which is to teach the agent to speak guided by its value like a human. However, value-driven chatbots are still understudied in the area of dialogue systems. Most…

Computation and Language · Computer Science 2022-07-25 Liang Qiu , Yizhou Zhao , Jinchao Li , Pan Lu , Baolin Peng , Jianfeng Gao , Song-Chun Zhu

The rapid proliferation of misinformation across online platforms underscores the urgent need for robust, up-to-date, explainable, and multilingual fact-checking resources. However, existing datasets are limited in scope, often lacking…

Computation and Language · Computer Science 2026-03-18 Z. Melce Hüsünbeyi , Virginie Mouilleron , Leonie Uhling , Daniel Foppe , Tatjana Scheffler , Djamé Seddah

Nowadays, open-domain dialogue models can generate acceptable responses according to the historical context based on the large-scale pre-trained language models. However, they generally concatenate the dialogue history directly as the model…

Computation and Language · Computer Science 2021-06-07 Zekang Li , Jinchao Zhang , Zhengcong Fei , Yang Feng , Jie Zhou

Recently, there has been an increasing focus on audio-text cross-modal learning. However, most of the existing audio-text datasets contain only simple descriptions of sound events. Compared with classification labels, the advantages of such…

Sound · Computer Science 2024-03-08 Xuenan Xu , Xiaohang Xu , Zeyu Xie , Pingyue Zhang , Mengyue Wu , Kai Yu

Sharing ideas through communication with peers is the primary mode of human interaction. Consequently, extensive research has been conducted in the area of conversational AI, leading to an increase in the availability and diversity of…

Computation and Language · Computer Science 2024-05-24 Shivani Kumar , Sumit Bhatia , Milan Aggarwal , Tanmoy Chakraborty