中文
相关论文

相关论文: Measuring an Artificial Intelligence System's Perf…

200 篇论文

Understanding how children design and what they value in AI interfaces that allow them to explicitly train their models such as teachable machines, could help increase such activities' impact and guide the design of future technologies. In…

人机交互 · 计算机科学 2023-09-28 Utkarsh Dwivedi , Salma Elsayed-ali , Elizabeth Bonsignore , Hernisa Kacorri

Inspired by humans' exceptional ability to master arithmetic and generalize to new problems, we present a new dataset, Handwritten arithmetic with INTegers (HINT), to examine machines' capability of learning generalizable concepts at three…

机器学习 · 计算机科学 2023-04-19 Qing Li , Siyuan Huang , Yining Hong , Yixin Zhu , Ying Nian Wu , Song-Chun Zhu

Background. Few studies on the relations between sleep quantity and/or quality and cognition were conducted among pre-schoolers from healthy general population. We aimed at identifying, among 3 years old children, early factors associated…

Reasoning benchmarks such as the Abstraction and Reasoning Corpus (ARC) and ARC-AGI are widely used to assess progress in artificial intelligence and are often interpreted as probes of core, so-called ``fluid'' reasoning abilities. Despite…

计算与语言 · 计算机科学 2026-01-12 Xinhe Wang , Jin Huang , Xingjian Zhang , Tianhao Wang , Jiaqi W. Ma

Large Language Models (LLMs) are recruited in applications that span from clinical assistance and legal support to question answering and education. Their success in specialized tasks has led to the claim that they possess human-like…

计算与语言 · 计算机科学 2024-07-10 Vittoria Dentella , Fritz Guenther , Elliot Murphy , Gary Marcus , Evelina Leivada

We present dialogue management routines for a system to engage in multiparty agent-infant interaction. The ultimate purpose of this research is to help infants learn a visual sign language by engaging them in naturalistic and socially…

We developed a benchmark set to assess the generalization of state-of-the-art large language models on problems beyond linguistic tasks and evaluate it on a systematic progression of GPT models (GPT-3.5, GPT-4, GPT-4o, GPT-4o-mini). Using…

人工智能 · 计算机科学 2025-03-03 Gonçalo Hora de Carvalho , Oscar Knap , Robert Pollice

With children talking to smart-speakers, smart-phones and even smart-microwaves daily, it is increasingly important to educate students on how these agents work-from underlying mechanisms to societal implications. Researchers are developing…

计算机与社会 · 计算机科学 2020-09-15 Jessica Van Brummelen , Tommy Heng , Viktoriya Tabunshchyk

Abstract reasoning from minimal examples remains a core unsolved problem for frontier foundation models such as GPT-5 and Grok 4. These models still fail to infer structured transformation rules from a handful of examples, which is a key…

计算机视觉与模式识别 · 计算机科学 2025-11-27 Beichen Zhang , Yuhang Zang , Xiaoyi Dong , Yuhang Cao , Haodong Duan , Dahua Lin , Jiaqi Wang

While artificial intelligence (AI) models have achieved human or even superhuman performance in many well-defined applications, they still struggle to show signs of broad and flexible intelligence. The Abstraction and Reasoning Corpus…

人工智能 · 计算机科学 2023-06-23 Giacomo Camposampiero , Loic Houmard , Benjamin Estermann , Joël Mathys , Roger Wattenhofer

High-level reasoning can be defined as the capability to generalize over knowledge acquired via experience, and to exhibit robust behavior in novel situations. Such form of reasoning is a basic skill in humans, who seamlessly use it in a…

人工智能 · 计算机科学 2023-11-15 Alessandro Oltramari

Children's cognitive abilities are sometimes cited as AI benchmarks. How can the most common 1,000 concepts (89\% of everyday use) be learnt in a naturalistic children's setting? Cognitive development in children is about quality, and new…

人工智能 · 计算机科学 2022-06-13 Jieyi Ye , Jiafei Duan , Samson Yu , Bihan Wen , Cheston Tan

This article explores the evaluation method for the language communication proficiency of AI-driven robots engaging in interactive communication with children. The utilization of AI-driven robots in children's everyday communication is…

人机交互 · 计算机科学 2024-05-16 Siqi Xie , Jiantao Li

Generative AI (GenAI) tools allow for effortless task completion, potentially fostering cognitive and metacognitive laziness in students. While surveys indicate widespread GenAI use among students as young as 11, their interactions…

计算机与社会 · 计算机科学 2026-03-03 Rania Abdelghani , Kou Murayama , Celeste Kidd , Hélène Sauzéon , Pierre-Yves Oudeyer

Acquiring commonsense knowledge and reasoning is recognized as an important frontier in achieving general Artificial Intelligence (AI). Recent research in the Natural Language Processing (NLP) community has demonstrated significant progress…

人工智能 · 计算机科学 2021-01-20 Ke Shen , Mayank Kejriwal

Preschool evaluation is crucial because it gives teachers and parents influential knowledge about children's growth and development. The COVID-19 pandemic has highlighted the necessity of online assessment for preschool children. One of the…

计算与语言 · 计算机科学 2023-08-25 Amirhossein Abaskohi , Fatemeh Mortazavi , Hadi Moradi

Research has shown that human-agent relationships form in similar ways to human-human relationships. Since children do not have the same critical analysis skills as adults (and may over-trust technology, for example), this…

人机交互 · 计算机科学 2022-09-13 Jessica Van Brummelen , Mingyan Claire Tian , Maura Kelleher , Nghi Hoang Nguyen

We introduce MMCRICBENCH-3K, a benchmark for Visual Question Answering (VQA) on cricket scorecards, designed to evaluate large vision-language models (LVLMs) on complex numerical and cross-lingual reasoning over semi-structured tabular…

计算机视觉与模式识别 · 计算机科学 2025-08-27 Somraj Gautam , Abhirama Subramanyam Penamakuri , Abhishek Bhandari , Gaurav Harit

This paper introduces a novel benchmark dataset designed to evaluate the capabilities of Vision Language Models (VLMs) on tasks that combine visual reasoning with subject-specific background knowledge in the German language. In contrast to…

人工智能 · 计算机科学 2025-06-30 René Peinl , Vincent Tischler

While many action recognition techniques have great success on public benchmarks, such performance is not necessarily replicated in real-world scenarios, where the data comes from specific application requirements. The specific real-world…

计算机视觉与模式识别 · 计算机科学 2021-11-29 Saif Sayed , Vassilis Athitsos