English
Related papers

Related papers: Learning to Think Like a Cartoon Captionist: Incon…

200 papers

Large neural networks can now generate jokes, but do they really "understand" humor? We challenge AI models with three tasks derived from the New Yorker Cartoon Caption Contest: matching a joke to a cartoon, identifying a winning caption,…

Computation and Language · Computer Science 2023-07-07 Jack Hessel , Ana Marasović , Jena D. Hwang , Lillian Lee , Jeff Da , Rowan Zellers , Robert Mankoff , Yejin Choi

We present HumorBench, a benchmark designed to evaluate large language models' (LLMs) ability to reason about and explain sophisticated humor in cartoon captions. As reasoning models increasingly saturate existing benchmarks in mathematics…

Computation and Language · Computer Science 2025-07-30 Reuben Narad , Siddharth Suresh , Jiayi Chen , Pine S. L. Dysart-Bricken , Bob Mankoff , Robert Nowak , Jifan Zhang , Lalit Jain

Sarcasm is a type of irony, characterized by an inherent mismatch between the literal interpretation and the intended connotation. Though sarcasm detection in text has been extensively studied, there are situations in which textual input…

Computer Vision and Pattern Recognition · Computer Science 2024-08-06 Sajal Aggarwal , Ananya Pandey , Dinesh Kumar Vishwakarma

Large Language Models (LLMs) have shown significant limitations in understanding creative content, as demonstrated by Hessel et al. (2023)'s influential work on the New Yorker Cartoon Caption Contest (NYCCC). Their study exposed a…

Computation and Language · Computer Science 2025-02-28 Kuan Lok Zhou , Jiayi Chen , Siddharth Suresh , Reuben Narad , Timothy T. Rogers , Lalit K Jain , Robert D Nowak , Bob Mankoff , Jifan Zhang

The New Yorker publishes a weekly captionless cartoon. More than 5,000 readers submit captions for it. The editors select three of them and ask the readers to pick the funniest one. We describe an experiment that compares a dozen automatic…

Recent advancements in large multimodal language models have demonstrated remarkable proficiency across a wide range of tasks. Yet, these models still struggle with understanding the nuances of human humor through juxtaposition,…

Computation and Language · Computer Science 2026-04-16 Zhe Hu , Tuo Liang , Jing Li , Yiren Lu , Yunlai Zhou , Yiran Qiao , Jing Ma , Yu Yin

Interpreting figurative language such as sarcasm across multi-modal inputs presents unique challenges, often requiring task-specific fine-tuning and extensive reasoning steps. However, current Chain-of-Thought approaches do not efficiently…

Computation and Language · Computer Science 2025-08-26 Aashish Anantha Ramakrishnan , Aadarsh Anantha Ramakrishnan , Dongwon Lee

Humor recognition has been widely studied as a text classification problem using data-driven approaches. However, most existing work does not examine the actual joke mechanism to understand humor. We break down any joke into two distinct…

Computation and Language · Computer Science 2021-08-11 Yubo Xie , Junze Li , Pearl Pu

Understanding humor-particularly when it involves complex, contradictory narratives that require comparative reasoning-remains a significant challenge for large vision-language models (VLMs). This limitation hinders AI's ability to engage…

Computer Vision and Pattern Recognition · Computer Science 2026-04-16 Tuo Liang , Zhe Hu , Jing Li , Hao Zhang , Yiren Lu , Yunlai Zhou , Yiran Qiao , Disheng Liu , Jeirui Peng , Jing Ma , Yu Yin

This paper focuses on sarcasm detection, which aims to identify whether given statements convey criticism, mockery, or other negative sentiment opposite to the literal meaning. To detect sarcasm, humans often require a comprehensive…

Computation and Language · Computer Science 2024-12-23 Ziqi Qiu , Jianxing Yu , Yufeng Zhang , Hanjiang Lai , Yanghui Rao , Qinliang Su , Jian Yin

Humor is a natural and fundamental component of human interactions. When correctly applied, humor allows us to express thoughts and feelings conveniently and effectively, increasing interpersonal affection, likeability, and trust. However,…

Computation and Language · Computer Science 2020-11-25 Felipe Godoy

Humor is an essential human trait. Efforts to understand humor have called out links between humor and the foundations of cognition, as well as the importance of humor in social engagement. As such, it is a promising and important subject…

Artificial Intelligence · Computer Science 2019-08-14 Robert West , Eric Horvitz

Comic understanding presents a significant challenge for Multimodal Large Language Models (MLLMs), as the intended meaning of a comic often emerges from the joint interpretation of visual, textual, and social cues. This naturally motivates…

Computer Vision and Pattern Recognition · Computer Science 2026-04-03 Chengcheng Feng , Haojie Yin , Yucheng Jin , Kaizhu Huang

Metaphor and sarcasm are common figurative expressions in people's communication, especially on the Internet or the memes popular among teenagers. We create a new benchmark named NYK-MS (NewYorKer for Metaphor and Sarcasm), which contains…

Computation and Language · Computer Science 2024-09-04 Ke Chang , Hao Li , Junzhao Zhang , Yunfang Wu

Recent multimodal large language models have shown promising ability in generating humorous captions for images, yet they still lack stable control over explicit cultural context, making it difficult to jointly maintain image relevance,…

Computation and Language · Computer Science 2026-04-21 Run Xu , Lu Li , Rongzhao Zhang , Jie Xu

Metaphor and humor share a lot of common ground, and metaphor is one of the most common humorous mechanisms. This study focuses on the humorous capacity of multimodal metaphors, which has not received due attention in the community. We take…

Computation and Language · Computer Science 2026-01-21 Xiaoyu Tong , Zhi Zhang , Pia Sommerauer , Martha Lewis , Ekaterina Shutova

Despite significant advancements in image segmentation and object detection, understanding complex scenes remains a significant challenge. Here, we focus on graphical humor as a paradigmatic example of image interpretation that requires…

Computer Vision and Pattern Recognition · Computer Science 2025-10-20 Vedaant Jain , Felipe dos Santos Alves Feitosa , Gabriel Kreiman

Humor and Offense are highly subjective due to multiple word senses, cultural knowledge, and pragmatic competence. Hence, accurately detecting humorous and offensive texts has several compelling use cases in Recommendation Systems and…

Computation and Language · Computer Science 2021-04-05 Aishwarya Gupta , Avik Pal , Bholeshwar Khurana , Lakshay Tyagi , Ashutosh Modi

Humor is previously regarded as a gift exclusive to humans for the following reasons. Humor is a culturally nuanced aspect of human language, presenting challenges for its understanding and generation. Humor generation necessitates a…

Artificial Intelligence · Computer Science 2025-04-14 Han Wang , Yilin Zhao , Dian Li , Xiaohan Wang , Gang Liu , Xuguang Lan , Hui Wang

Visual understanding goes well beyond object recognition. With one glance at an image, we can effortlessly imagine the world beyond the pixels: for instance, we can infer people's actions, goals, and mental states. While this task is easy…

Computer Vision and Pattern Recognition · Computer Science 2019-03-27 Rowan Zellers , Yonatan Bisk , Ali Farhadi , Yejin Choi
‹ Prev 1 2 3 10 Next ›