Questions tagged [intelligence-testing]

For questions about ways of measuring intelligence of AI, either in relation to other AIs, in relation to humans, or in absolute terms on a certain scale.

Filter by
Sorted by
Tagged with
0 votes
0 answers
76 views

Intentionally corrupting LLM weights (lobotomy)

It is largely unknown how LLMs work inside. Has anyone scientifically tried to corrupt (open source) model's weights in an organized manner to maybe detect which parts of the model are doing what or ...
Kozuch's user avatar
  • 281
2 votes
2 answers
209 views

At what text-based tasks are "dumb humans" still better than the best language models?

I ran into this AI-SE question from 5 years ago and I believe that an updated version could be interesting to discuss nowadays: Is the smartest robot more clever than the stupidest human? Today's best ...
Blue Nebula's user avatar
3 votes
0 answers
48 views

Are there standardized forms of the Turing Test?

Most computer science instructors will tell you that the Turing Test is more a theoretical or conceptual thought experiment than an actual exam that someone (or something!) can formally sit and ...
Robert Columbia's user avatar
2 votes
2 answers
133 views

Do text compression tests qualify winRar or 7zip as intelligent?

I read this paper Text Compression as a Test for Artificial Intelligence, Mahoney, 1999. So far I understood the following: Text Compression tests can be used as an alternative to Turing Tests for ...
Aether's user avatar
  • 265
1 vote
1 answer
70 views

Based on the Turing test, what would be the criteria for an agent to be considered smart?

Based on the Turing test, what would be the criteria for an agent to be considered smart?
Rodrigo Franco's user avatar
1 vote
2 answers
652 views

What is the Turing test?

I'm looking for intuition in simple words but also some simple insights (I don't know if the latter is possible). Can anybody shed some light on the Turing test?
Pluviophile's user avatar
  • 1,263
8 votes
6 answers
524 views

What event would confirm that we have implemented an AGI system?

I was listening to a podcast on the topic of AGI and a guest made an argument that if strong music generation were to happen, it would be a sign of "true" intelligence in machines because of ...
Landon G's user avatar
  • 500
2 votes
1 answer
89 views

How is the reCaptcha useful for Google?

I am wondering where Google uses the result from deep learning of reCaptcha (how can a system that knows to recognize street signs is useful somewhere? how they profit from it?)
hyperscience's user avatar
20 votes
2 answers
2k views

Problems that only humans will ever be able to solve

With the increasing complexity of reCAPTCHA, I wondered about the existence of some problem, that only a human will ever be able to solve (or that AI won't be able to solve as long as it doesn't ...
Marc Perlade's user avatar
2 votes
0 answers
59 views

RNN: Different test results on balanced and unbalanced data

I trained a recurrent neural network (if it matters - it contains three CuDNNLSTM cells and 3 Dense layers, Dropout = 0.2). The result of data preparation is one array of ~330.000 sequences. Each ...
ketzul's user avatar
  • 68
4 votes
1 answer
194 views

How to use Machine Learning to create a "Draw-A-Person Test"

The process revolves around a child's drawing. Each part of each drawing corresponds to a score as in the Draw a Person Test conceived by Dr. Florence Goodenough in 1926. The goal of the machine is to ...
Sidney Guaro's user avatar
2 votes
1 answer
155 views

How can we compare the intelligence of AI systems?

One way of ranking human intelligence is based on IQ tests. But how can we compare the intelligence of AI systems? For example, is there a test that tells me that a spam filter system is more ...
Maheshwar Ligade's user avatar
6 votes
2 answers
1k views

If the Turing test is passed, does this imply that computers exhibit intelligence?

Turing test was created to test machines exhibiting behavior equivalent or indistinguishable from that of a human. Is that the sufficient condition of intelligence?
Xitish's user avatar
  • 163
1 vote
4 answers
375 views

How will we recognize a conscious machine?

How will we recognize a conscious machine (or AI)? Is there any consciousness test? For example, if a machine is aware of its previous experiences, can it be considered conscious?
pranshu vinayak's user avatar
4 votes
1 answer
314 views

Why is chess still a benchmark for Artificial Intelligence?

Even though modern chess playing programs have demonstrated themselves to be as strong (or stronger) than even the best human players for nearly 20 years now (1997 when IBM's Deep Blue defeated the ...
DJ2's user avatar
  • 143
3 votes
1 answer
991 views

Goal oriented Action Planning with multiple Agents

I'm a little bit stuck: I implemented an AI with GOAP (Goal oriented Action Planning, http://alumni.media.mit.edu/~jorkin/gdc2006_orkin_jeff_fear.pdf) for a simulation game. That works fine. Now I ...
james's user avatar
  • 116
1 vote
2 answers
108 views

Is there a formal name for this philosophical AI problem?

Expressed in my own words: Suppose we create something that passes all of our tests and is indistinguishable from another human. How can you know if this is truly a conscious being as a human ...
Tim Atkinson's user avatar
3 votes
4 answers
427 views

How can one distinguish between an AI and a "sufficiently advanced algorithm"?

Any sufficiently advanced algorithm is indistinguishable from AI.---Michael Paulukonis According to What are the minimum requirements to call something AI?, there are certain requirements that a ...
Left SE On 10_6_19's user avatar
1 vote
1 answer
130 views

Are there any refutation of the original Lovelace Test?

The original Lovelace Test, published in 2001, is used generally as a thought experiment to prove that AI cannot be creative (or, more specifically, that it cannot originate a creative artifact). From ...
Left SE On 10_6_19's user avatar
5 votes
2 answers
316 views

How to detect a full-fledged self-aware AI?

The premise: A full-fledged self-aware artificial intelligence may have come to exist in a distributed environment like the internet. The possible A.I. in question may be quite unwilling to reveal ...
user4327's user avatar
3 votes
2 answers
397 views

When will artificial intelligence equal human intelligence?

What are the current best estimates as to what year artificial intelligence will be able to score 100 points on the Stanford Binet IQ test?
Tom Hale's user avatar
  • 364
3 votes
1 answer
592 views

How do we test if an model or algorithm is AI-complete?

How do we test if a model or algorithm is AI-complete?
Mudit Sharma's user avatar
8 votes
1 answer
249 views

Is the AI Effect caused by bad tests of intelligence?

According to Wikipedia... The AI effect occurs when onlookers discount the behavior of an artificial intelligence program by arguing that it is not real intelligence. Pamela McCorduck writes: "...
Left SE On 10_6_19's user avatar
11 votes
2 answers
590 views

If IQ is used as a measure of intelligence in humans, could it also be used as a measure of intelligence in machines?

If IQ were used as a measure of the intelligence of machines, as in humans, at this point in time, what would be the IQ of our most intelligent AI systems? If not IQ, then how best to compare our ...
D. Wade's user avatar
  • 541
6 votes
2 answers
73 views

What is a good way to create an artificial self-recognition?

Self-Recognition seems to be an item that designers are trying to integrate into artificial intelligence. Is there a generally recognized method of doing this in a machine, and how would one test the ...
D. Wade's user avatar
  • 541
9 votes
3 answers
2k views

What are the criteria for a system to be considered intelligent? [duplicate]

For example, could you provide reasons why a sundial is not "intelligent"? A sundial senses its environment and acts rationally. It outputs the time. It also stores percepts. (The numbers the ...
conor's user avatar
  • 554
28 votes
4 answers
2k views

Are Siri and Cortana AI programs?

Siri and Cortana communicate pretty much like humans. Unlike Google Now, which mainly gives us search results when asked some questions (not setting alarms or reminders), Siri and Cortana provide us ...
Vishnu JK's user avatar
  • 1,072
22 votes
1 answer
1k views

Has the Lovelace Test 2.0 been successfully used in an academic setting?

In October 2014, Dr. Mark Riedl published an approach to testing AI intelligence, called the "Lovelace Test 2.0", after being inspired by the original Lovelace Test (published in 2001). Mark believed ...
Left SE On 10_6_19's user avatar
5 votes
3 answers
134 views

Do specific units exists for measuring the intelligence of a machine?

We can measure the power of the machine with the number of operation per second or the frequency of the processor. But does units similar of IQ for humans exist for a AI? I'm asking for a unit which ...
latmos's user avatar
  • 51
13 votes
2 answers
490 views

Are there any AI that have passed the MIST test so far?

MIST is a quantiative test of humanness, consisting of ~80k propositions such as: Is Earth a planet? Is the sun bigger than my foot? Do people sometimes lie? etc. Have any AI attempted and passed ...
kenorb's user avatar
  • 10.5k
10 votes
1 answer
274 views

How can the emotional quotient of an AI program be measured?

Can an AI program have an EQ (emotional intelligence or emotional quotient)? In other words, can the EQ of an AI program be measured? If EQ is more problematic to measure than IQ (at least with a ...
1010101 Lifestyle's user avatar
2 votes
1 answer
134 views

Which objective tests have been developed to test the intelligence of AI?

Which objective and measurable tests have been developed to test the intelligence of AI? The classical test is the Turing Test, which has objective criteria and is measurable since it can be ...
wythagoras's user avatar
  • 1,521
14 votes
3 answers
2k views

What are the specific requirements of the Turing test?

What are the specific requirements of the Turing test? What requirements if any must the evaluator fulfill in order to be qualified to give the test? Must there always be two participants in the ...
Luke's user avatar
  • 253
15 votes
4 answers
1k views

Can the IQ of an AI program be measured?

Can an AI program have an IQ? In other words, can the IQ of an AI program be measured? Like how humans can do an IQ test.
Vishnu JK's user avatar
  • 1,072