English
Related papers

Related papers: Transformers, Contextualism, and Polysemy

200 papers

This paper advances a novel architectural schema anchored upon the Transformer paradigm and innovatively amalgamates the K-means categorization algorithm to augment the contextual apprehension capabilities of the schema. The transformer…

Computation and Language · Computer Science 2025-01-22 Yuwei Zhang , Junming Huang , Sitong Liu , Zexi Chen , Zizheng Li

As artificial intelligence (AI) becomes a prominent part of modern life, AI literacy is becoming important for all citizens, not just those in technology careers. Previous research in AI education materials has largely focused on the…

Computation and Language · Computer Science 2022-12-16 Kate Pearce , Sharifa Alghowinem , Cynthia Breazeal

This study introduces a groundbreaking approach to simultaneous interpretation by directly leveraging the predictive capabilities of Large Language Models (LLMs). We present a novel algorithm that generates real-time translations by…

Computation and Language · Computer Science 2024-07-22 Kurando Iida , Kenjiro Mimura , Nobuo Ito

What kind of internal mechanisms might Transformers use to conduct fluid, natural-sounding conversations? Prior work has illustrated by construction how Transformers can solve various synthetic tasks, such as sorting a list or recognizing…

Computation and Language · Computer Science 2025-02-13 Dan Friedman , Abhishek Panigrahi , Danqi Chen

Some exciting new approaches to neural architectures for the analysis of conversation have been introduced over the past couple of years. These include neural architectures for detecting emotion, dialogue acts, and sentiment polarity. They…

Computation and Language · Computer Science 2022-04-01 Chloé Clavel , Matthieu Labeau , Justine Cassell

The transformer neural network architecture allows for autoregressive sequence-to-sequence modeling through the use of attention layers. It was originally created with the application of machine translation but has revolutionized natural…

Computer Vision and Pattern Recognition · Computer Science 2024-06-25 Abhi Kamboj

This study explores the integration of contextual explanations into AI-powered loan decision systems to enhance trust and usability. While traditional AI systems rely heavily on algorithmic transparency and technical accuracy, they often…

Human-Computer Interaction · Computer Science 2025-10-07 Allen Daniel Sunny

Against rising global loneliness, AI companions promise connection, yet accumulating evidence suggests that, for some users and contexts, intensive companion-style use can correlate with increased loneliness and reduced offline…

Human-Computer Interaction · Computer Science 2026-03-23 Yao Xiao , Rafael A. Calvo

Transformer-based open-domain dialog models have become increasingly popular in recent years. These models typically represent context as a concatenation of a dialog history. However, there is no criterion to decide how many utterances…

Computation and Language · Computer Science 2024-09-04 Xinyi Shen , Zuoquan Lin

Multi-turn interaction in the dialogue system research refers to a system's ability to maintain context across multiple dialogue turns, enabling it to generate coherent and contextually relevant responses. Recent advancements in large…

Computation and Language · Computer Science 2025-01-20 Chen Zhang , Xinyi Dai , Yaxiong Wu , Qu Yang , Yasheng Wang , Ruiming Tang , Yong Liu

This technical paper introduces a chatting robot system that utilizes recent advancements in large-scale language models (LLMs) such as GPT-3 and ChatGPT. The system is integrated with a co-speech gesture generation system, which selects…

Robotics · Computer Science 2023-06-12 Naoki Wake , Atsushi Kanehira , Kazuhiro Sasabuchi , Jun Takamatsu , Katsushi Ikeuchi

With the rapid evolution of Natural Language Processing (NLP), Large Language Models (LLMs) like ChatGPT have emerged as powerful tools capable of transforming various sectors. Their vast knowledge base and dynamic interaction capabilities…

Computers and Society · Computer Science 2024-01-02 Kevin Wang , Jason Ramos , Ramon Lawrence

Recent dialogue datasets like MultiWOZ 2.1 and Taskmaster-1 constitute some of the most challenging tasks for present-day dialogue models and, therefore, are widely used for system evaluation. We identify several issues with the…

Computation and Language · Computer Science 2020-04-23 Johannes E. M. Mosig , Vladimir Vlasov , Alan Nichol

A concise overview is provided of selected theoretical models of communication competence in the fields of linguistics, interpersonal communication, second language use, and human-robot interaction. The following practical research…

Human-Computer Interaction · Computer Science 2025-11-06 Goran Bubas

Karl Marx once wrote that ``the human essence is the ensemble of social relations'', suggesting that individuals are not isolated entities but are fundamentally shaped by their interactions with other entities, within which contexts play a…

Artificial Intelligence · Computer Science 2025-10-31 Qishuo Hua , Lyumanshan Ye , Dayuan Fu , Yang Xiao , Xiaojie Cai , Yunze Wu , Jifan Lin , Junfei Wang , Pengfei Liu

Despite the recent success of automatic metrics for assessing translation quality, their application in evaluating the quality of machine-translated chats has been limited. Unlike more structured texts like news, chat conversations are…

Computation and Language · Computer Science 2024-03-14 Sweta Agrawal , Amin Farajian , Patrick Fernandes , Ricardo Rei , André F. T. Martins

Transformers have had a significant impact on natural language processing and have recently demonstrated their potential in computer vision. They have shown promising results over convolution neural networks in fundamental computer vision…

Computer Vision and Pattern Recognition · Computer Science 2023-11-14 Rojina Kashefi , Leili Barekatain , Mohammad Sabokrou , Fatemeh Aghaeipoor

Artificial intelligence is making spectacular progress, and one of the best examples is the development of large language models (LLMs) such as OpenAI's GPT series. In these lectures, written for readers with a background in mathematics or…

Computation and Language · Computer Science 2023-10-09 Michael R. Douglas

After their successful debut in natural language processing, Transformer architectures are now becoming the de-facto standard in many domains. An obstacle for their deployment over new modalities is the architectural configuration: the…

Machine Learning · Computer Science 2021-06-10 Noam Wies , Yoav Levine , Daniel Jannai , Amnon Shashua

Contextual utility theory integrates context-sensitive factors into utility-based decision-making models. It stresses the importance of understanding individual decision-makers' preferences, values, and beliefs and the situational factors…

Human-Computer Interaction · Computer Science 2023-03-27 Minal Suresh Patil , Kary Främling