Questions tagged [intelligence-testing]

For questions about ways of measuring intelligence of AI, either in relation to other AIs, in relation to humans, or in absolute terms on a certain scale.

Filter by
Sorted by
Tagged with
2 votes
0 answers
29 views

Are there standardized forms of the Turing Test?

Most computer science instructors will tell you that the Turing Test is more a theoretical or conceptual thought experiment than an actual exam that someone (or something!) can formally sit and ...
1 vote
1 answer
71 views

Do text compression tests qualify winRar or 7zip as intelligent?

I read this paper Text Compression as a Test for Artificial Intelligence, Mahoney, 1999. So far I understood the following: Text Compression tests can be used as an alternative to Turing Tests for ...
  • 235
1 vote
1 answer
57 views

Based on the Turing test, what would be the criteria for an agent to be considered smart?

Based on the Turing test, what would be the criteria for an agent to be considered smart?
1 vote
2 answers
486 views

What is the Turing test?

I'm looking for intuition in simple words but also some simple insights (I don't know if the latter is possible). Can anybody shed some light on the Turing test?
  • 1,203
8 votes
6 answers
416 views

What event would confirm that we have implemented an AGI system?

I was listening to a podcast on the topic of AGI and a guest made an argument that if strong music generation were to happen, it would be a sign of "true" intelligence in machines because of ...
  • 490
2 votes
1 answer
85 views

How is the reCaptcha useful for Google?

I am wondering where Google uses the result from deep learning of reCaptcha (how can a system that knows to recognize street signs is useful somewhere? how they profit from it?)
20 votes
2 answers
2k views

Problems that only humans will ever be able to solve

With the increasing complexity of reCAPTCHA, I wondered about the existence of some problem, that only a human will ever be able to solve (or that AI won't be able to solve as long as it doesn't ...
2 votes
0 answers
51 views

RNN: Different test results on balanced and unbalanced data

I trained a recurrent neural network (if it matters - it contains three CuDNNLSTM cells and 3 Dense layers, Dropout = 0.2). The result of data preparation is one array of ~330.000 sequences. Each ...
  • 68
4 votes
1 answer
113 views

How to use Machine Learning to create a "Draw-A-Person Test"

The process revolves around a child's drawing. Each part of each drawing corresponds to a score as in the Draw a Person Test conceived by Dr. Florence Goodenough in 1926. The goal of the machine is to ...
2 votes
1 answer
151 views

How can we compare the intelligence of AI systems?

One way of ranking human intelligence is based on IQ tests. But how can we compare the intelligence of AI systems? For example, is there a test that tells me that a spam filter system is more ...
6 votes
2 answers
915 views

If the Turing test is passed, does this imply that computers exhibit intelligence?

Turing test was created to test machines exhibiting behavior equivalent or indistinguishable from that of a human. Is that the sufficient condition of intelligence?
  • 63
1 vote
4 answers
299 views

How will we recognize a conscious machine?

How will we recognize a conscious machine (or AI)? Is there any consciousness test? For example, if a machine is aware of its previous experiences, can it be considered conscious?
4 votes
1 answer
256 views

Why is chess still a benchmark for Artificial Intelligence?

Even though modern chess playing programs have demonstrated themselves to be as strong (or stronger) than even the best human players for nearly 20 years now (1997 when IBM's Deep Blue defeated the ...
  • 143
3 votes
1 answer
855 views

Goal oriented Action Planning with multiple Agents

I'm a little bit stuck: I implemented an AI with GOAP (Goal oriented Action Planning, http://alumni.media.mit.edu/~jorkin/gdc2006_orkin_jeff_fear.pdf) for a simulation game. That works fine. Now I ...
  • 116
1 vote
2 answers
100 views

Is there a formal name for this philosophical AI problem?

Expressed in my own words: Suppose we create something that passes all of our tests and is indistinguishable from another human. How can you know if this is truly a conscious being as a human ...
3 votes
4 answers
354 views

How can one distinguish between an AI and a "sufficiently advanced algorithm"?

Any sufficiently advanced algorithm is indistinguishable from AI.---Michael Paulukonis According to What are the minimum requirements to call something AI?, there are certain requirements that a ...
1 vote
1 answer
121 views

Are there any refutation of the original Lovelace Test?

The original Lovelace Test, published in 2001, is used generally as a thought experiment to prove that AI cannot be creative (or, more specifically, that it cannot originate a creative artifact). From ...
4 votes
2 answers
238 views

How to detect a full-fledged self-aware AI?

The premise: A full-fledged self-aware artificial intelligence may have come to exist in a distributed environment like the internet. The possible A.I. in question may be quite unwilling to reveal ...
3 votes
2 answers
353 views

When will artificial intelligence equal human intelligence?

What are the current best estimates as to what year artificial intelligence will be able to score 100 points on the Stanford Binet IQ test?
  • 354
3 votes
1 answer
577 views

How do we test if an model or algorithm is AI-complete?

How do we test if a model or algorithm is AI-complete?
8 votes
1 answer
228 views

Is the AI Effect caused by bad tests of intelligence?

According to Wikipedia... The AI effect occurs when onlookers discount the behavior of an artificial intelligence program by arguing that it is not real intelligence. Pamela McCorduck writes: "...
10 votes
2 answers
565 views

If IQ is used as a measure of intelligence in humans, could it also be used as a measure of intelligence in machines?

If IQ were used as a measure of the intelligence of machines, as in humans, at this point in time, what would be the IQ of our most intelligent AI systems? If not IQ, then how best to compare our ...
  • 531
6 votes
2 answers
72 views

What is a good way to create an artificial self-recognition?

Self-Recognition seems to be an item that designers are trying to integrate into artificial intelligence. Is there a generally recognized method of doing this in a machine, and how would one test the ...
  • 531
9 votes
3 answers
2k views

What are the criteria for a system to be considered intelligent? [duplicate]

For example, could you provide reasons why a sundial is not "intelligent"? A sundial senses its environment and acts rationally. It outputs the time. It also stores percepts. (The numbers the ...
27 votes
4 answers
1k views

Are Siri and Cortana AI programs?

Siri and Cortana communicate pretty much like humans. Unlike Google Now, which mainly gives us search results when asked some questions (not setting alarms or reminders), Siri and Cortana provide us ...
  • 1,032
21 votes
1 answer
1k views

Has the Lovelace Test 2.0 been successfully used in an academic setting?

In October 2014, Dr. Mark Riedl published an approach to testing AI intelligence, called the "Lovelace Test 2.0", after being inspired by the original Lovelace Test (published in 2001). Mark believed ...
5 votes
3 answers
99 views

Do specific units exists for measuring the intelligence of a machine?

We can measure the power of the machine with the number of operation per second or the frequency of the processor. But does units similar of IQ for humans exist for a AI? I'm asking for a unit which ...
  • 51
13 votes
2 answers
470 views

Are there any AI that have passed the MIST test so far?

MIST is a quantiative test of humanness, consisting of ~80k propositions such as: Is Earth a planet? Is the sun bigger than my foot? Do people sometimes lie? etc. Have any AI attempted and passed ...
  • 10.1k
10 votes
1 answer
265 views

How can the emotional quotient of an AI program be measured?

Can an AI program have an EQ (emotional intelligence or emotional quotient)? In other words, can the EQ of an AI program be measured? If EQ is more problematic to measure than IQ (at least with a ...
2 votes
0 answers
103 views

Which objective tests have been developed to test the intelligence of AI?

Which objective and measurable tests have been developed to test the intelligence of AI? The classical test is the Turing Test, which has objective criteria and is measurable since it can be ...
  • 1,471
14 votes
3 answers
2k views

What are the specific requirements of the Turing test?

What are the specific requirements of the Turing test? What requirements if any must the evaluator fulfill in order to be qualified to give the test? Must there always be two participants in the ...
  • 253
12 votes
4 answers
1k views

Can the IQ of an AI program be measured?

Can an AI program have an IQ? In other words, can the IQ of an AI program be measured? Like how humans can do an IQ test.
  • 1,032