English
Related papers

Related papers: Three IQs of AI Systems and their Testing Methods

200 papers

A fundamental problem in artificial intelligence is that nobody really knows what intelligence is. The problem is especially acute when we need to consider artificial systems which are significantly different to humans. In this paper we…

Artificial Intelligence · Computer Science 2008-06-26 Shane Legg , Marcus Hutter

A short review of the literature on measurement and detection of artificial general intelligence is made. Proposed benchmarks and tests for artificial general intelligence are critically evaluated against multiple criteria. Based on the…

Artificial Intelligence · Computer Science 2021-01-07 Mark McPherson

One of the most important aims of the fields of robotics, artificial intelligence and artificial life is the design and construction of systems and machines as versatile and as reliable as living organisms at performing high level…

Artificial Intelligence · Computer Science 2014-12-24 Hector Zenil

Recent benchmark studies have claimed that AI has approached or even surpassed human-level performances on various cognitive tasks. However, this position paper argues that current AI evaluation paradigms are insufficient for assessing…

Researchers are increasingly subjecting artificial intelligence systems to psychological testing. But to rigorously compare their cognitive capacities with humans and other animals, we must avoid both over- and under-stating our…

Artificial Intelligence · Computer Science 2025-03-05 Konstantinos Voudouris , Lucy G. Cheke , Eric Schulz

In this paper we discuss how systems with Artificial Intelligence (AI) can undergo safety assessment. This is relevant, if AI is used in safety related applications. Taking a deeper look into AI models, we show, that many models of…

Artificial Intelligence · Computer Science 2021-05-17 Jens Braband , Hendrik Schäbe

Traditionally, the way one evaluates the performance of an Artificial Intelligence (AI) system is via a comparison to human performance in specific tasks, treating humans as a reference for high-level cognition. However, these comparisons…

Artificial Intelligence · Computer Science 2019-11-25 Camilo M. Signorelli , Xerxes D. Arsiwalla

Independent from the still ongoing research in measuring individual intelligence, we anticipate and provide a framework for measuring collective intelligence. Collective intelligence refers to the idea that several individuals can…

Artificial Intelligence · Computer Science 2013-07-01 Michel Halmes

With the rise of AI systems in real-world applications comes the need for reliable and trustworthy AI. An essential aspect of this are explainable AI systems. However, there is no agreed standard on how explainable AI systems should be…

Artificial Intelligence · Computer Science 2022-07-04 Sascha Saralajew , Ammar Shaker , Zhao Xu , Kiril Gashteovski , Bhushan Kotnis , Wiem Ben Rim , Jürgen Quittek , Carolin Lawrence

As artificial intelligence becomes increasingly integrated into professional and personal domains, traditional metrics of human intelligence require reconceptualization. This paper introduces the Artificial Intelligence Quotient (AIQ), a…

Human-Computer Interaction · Computer Science 2025-03-24 Venkat Ram Reddy Ganuthula , Krishna Kumar Balaraman

A traditional approach to assessing emerging intelligence in the theory of intelligent systems is based on the similarity, "imitation" of human-like actions and behaviors, benchmarking the performance of intelligent systems on the scale of…

Neural and Evolutionary Computing · Computer Science 2025-05-28 Serge Dolgikh

Developments in machine learning and computing power suggest that artificial general intelligence is within reach. This raises the question of artificial consciousness: if a computer were to be functionally equivalent to a human, being able…

Artificial Intelligence · Computer Science 2025-03-04 Graham Findlay , William Marshall , Larissa Albantakis , Isaac David , William GP Mayner , Christof Koch , Giulio Tononi

The use of Artificial Intelligence (AI), or more generally data-driven algorithms, has become ubiquitous in today's society. Yet, in many cases and especially when stakes are high, humans still make final decisions. The critical question,…

Artificial Intelligence · Computer Science 2024-10-15 Eli Ben-Michael , D. James Greiner , Melody Huang , Kosuke Imai , Zhichao Jiang , Sooahn Shin

How smart is your kettle? How smart are things in your kitchen, your house, your neighborhood, on the internet? With the advent of Internet of Things, and the move of making devices `smart' by utilizing AI, a natural question arrises, how…

Artificial Intelligence · Computer Science 2014-12-15 Neil Rubens

This paper aims to propose a universal definition of intelligence that enables fair and consistent comparison of human and artificial intelligence (AI). With the rapid development of AI technology in recent years, how to compare and…

Artificial Intelligence · Computer Science 2026-01-13 Joseph Chen

Focusing on Business AI, this article introduces the AIQ quadrant that enables us to measure AI for business applications in a relative comparative manner, i.e. to judge that software A has more or less intelligence than software B.…

Artificial Intelligence · Computer Science 2018-08-13 Moshe BenBassat

As artificial intelligence (AI) systems are getting ubiquitous within our society, issues related to its fairness, accountability, and transparency are increasing rapidly. As a result, researchers are integrating humans with AI systems to…

Artificial Intelligence · Computer Science 2020-12-14 Nikhil Prakash , Kory W. Mathewson

The Turing Test is no longer adequate for distinguishing human and machine intelligence. With advanced artificial intelligence systems already passing the original Turing Test and contributing to serious ethical and environmental concerns,…

Machine Learning · Computer Science 2026-01-01 Adam Winchell

With the rise of artificial intelligence (A.I.) and large language models like ChatGPT, a new race for achieving artificial general intelligence (A.G.I) has started. While many speculate how and when A.I. will achieve A.G.I., there is no…

Artificial Intelligence · Computer Science 2025-12-05 Georgios Mappouras

As artificial intelligence (AI) is integrated into various services and systems in society, many companies and organizations have proposed AI principles, policies, and made the related commitments. Conversely, some have proposed the need…

Computers and Society · Computer Science 2023-12-04 Arisa Ema , Ryo Sato , Tomoharu Hase , Masafumi Nakano , Shinji Kamimura , Hiromu Kitamura