English
Related papers

Related papers: Persona-Coded Poly-Encoder: Persona-Guided Multi-S…

200 papers

A reliable and comprehensive evaluation metric that aligns with manual preference assessments is crucial for conversational head video synthesis methods development. Existing quantitative evaluations often fail to capture the full…

Computer Vision and Pattern Recognition · Computer Science 2023-08-03 Mohan Zhou , Yalong Bai , Wei Zhang , Ting Yao , Tiejun Zhao , Tao Mei

Question-answering (QA) that comes naturally to humans is a critical component in seamless human-computer interaction. It has emerged as one of the most convenient and natural methods to interact with the web and is especially desirable in…

Computation and Language · Computer Science 2022-11-15 Deepak Gupta

Identifying relevant persona or knowledge for conversational systems is critical to grounded dialogue response generation. However, each grounding has been mostly researched in isolation with more practical multi-context dialogue tasks…

Computation and Language · Computer Science 2024-08-13 Minsik Oh , Joosung Lee , Jiwei Li , Guoyin Wang

Personalized dialogue systems are an essential step toward better human-machine interaction. Existing personalized dialogue agents rely on properly designed conversational datasets, which are mostly monolingual (e.g., English), which…

Computation and Language · Computer Science 2020-04-09 Zhaojiang Lin , Zihan Liu , Genta Indra Winata , Samuel Cahyawijaya , Andrea Madotto , Yejin Bang , Etsuko Ishii , Pascale Fung

Due to the lack of human resources for mental health support, there is an increasing demand for employing conversational agents for support. Recent work has demonstrated the effectiveness of dialogue models in providing emotional support.…

Computation and Language · Computer Science 2023-05-30 Jiale Cheng , Sahand Sabour , Hao Sun , Zhuang Chen , Minlie Huang

This paper addresses user-specific dialogs. In contrast to previous research on personalized dialogue focused on achieving virtual user dialogue as defined by persona descriptions, user-specific dialogue aims to reproduce real-user dialogue…

Computation and Language · Computer Science 2024-09-04 Atsushi Otsuka , Kazuya Matsuo , Ryo Ishii , Narichika Nomoto , Hiroaki Sugiyama

The increasing demand for personalized interactions with large language models (LLMs) calls for methodologies capable of accurately and efficiently identifying user opinions and preferences. Retrieval augmentation emerges as an effective…

Computation and Language · Computer Science 2025-02-04 Chenkai Sun , Ke Yang , Revanth Gangi Reddy , Yi R. Fung , Hou Pong Chan , Kevin Small , ChengXiang Zhai , Heng Ji

Personality computing and affective computing have gained recent interest in many research areas. The datasets for the task generally have multiple modalities like video, audio, language and bio-signals. In this paper, we propose a flexible…

Computer Vision and Pattern Recognition · Computer Science 2023-01-13 Tanay Agrawal , Dhruv Agarwal , Michal Balazia , Neelabh Sinha , Francois Bremond

The creation of artificial polyglot voices remains a challenging task, despite considerable progress in recent years. This paper investigates self-supervised learning for voice conversion to create native-sounding polyglot voices. We…

Sound · Computer Science 2024-09-27 Giuseppe Ruggiero , Matteo Testa , Jurgen Van de Walle , Luigi Di Caro

In the coming decade, artificial intelligence systems will continue to improve and revolutionise every industry and facet of human life. Designing effective, seamless and symbiotic communication paradigms between humans and AI agents is…

Human-Computer Interaction · Computer Science 2024-08-13 Suyi Zhang , Ekram Alam , Jack Baber , Francesca Bianco , Edward Turner , Maysam Chamanzar , Hamid Dehghani

Memorizing and utilizing speakers' personas is a common practice for response generation in long-term conversations. Yet, human-authored datasets often provide uninformative persona sentences that hinder response quality. This paper…

Computation and Language · Computer Science 2024-02-13 Hana Kim , Kai Tzu-iunn Ong , Seoyeon Kim , Dongha Lee , Jinyoung Yeo

Nowadays, automatical personality inference is drawing extensive attention from both academia and industry. Conventional methods are mainly based on user generated contents, e.g., profiles, likes, and texts of an individual, on social…

Computation and Language · Computer Science 2020-09-29 Qiang Liu

Large language models has catalyzed the development of personalized dialogue systems, numerous role-playing conversational agents have emerged. While previous research predominantly focused on enhancing the model's capability to follow…

Computation and Language · Computer Science 2024-11-18 Yuxuan Huang

Personalized speech enhancement (PSE) methods typically rely on pre-trained speaker verification models or self-designed speaker encoders to extract target speaker clues, guiding the PSE model in isolating the desired speech. However, these…

Audio and Speech Processing · Electrical Eng. & Systems 2025-01-22 Ziling Huang , Haixin Guan , Haoran Wei , Yanhua Long

Explainable AI is increasingly employing argumentation methods to facilitate interactive explanations between AI agents and human users. While existing approaches typically rely on predetermined human user models, there remains a critical…

Artificial Intelligence · Computer Science 2025-02-25 Yinxu Tang , Stylianos Loukas Vasileiou , William Yeoh

While improvements have been made in automatic speech recognition performance over the last several years, machines continue to have significantly lower performance on accented speech than humans. In addition, the most significant…

Audio and Speech Processing · Electrical Eng. & Systems 2021-04-13 Xiangyun Chu , Elizabeth Combs , Amber Wang , Michael Picheny

Behavioral logs provide rich signals for user modeling, but are noisy and interleaved across diverse intents. Recent work uses LLMs to generate interpretable natural-language personas from user logs, yet evaluation often emphasizes…

Artificial Intelligence · Computer Science 2026-04-30 Nayoung Choi , Haeyu Jeong , Changbong Kim , Hongjun Lim , Jinho D. Choi

To advance personalized applications such as recommendation systems and user behavior prediction, recent research increasingly adopts large language models (LLMs) for human -readable persona modeling. In dynamic real -world scenarios,…

Computation and Language · Computer Science 2025-07-17 Aili Chen , Chengyu Du , Jiangjie Chen , Jinghan Xu , Yikai Zhang , Siyu Yuan , Zulong Chen , Liangyue Li , Yanghua Xiao

In this paper, we extended the method proposed in [21] to enable humans to interact naturally with autonomous agents through vocal and textual conversations. Our extended method exploits the inherent capabilities of pre-trained large…

Robotics · Computer Science 2024-12-31 Linus Nwankwo , Elmar Rueckert

Multi-encoder models are a broad family of context-aware neural machine translation systems that aim to improve translation quality by encoding document-level contextual information alongside the current sentence. The context encoding is…

Computation and Language · Computer Science 2022-10-25 Lorenzo Lupo , Marco Dinarelli , Laurent Besacier