Questions tagged [intelligence-testing]
For questions about ways of measuring intelligence of AI, either in relation to other AIs, in relation to humans, or in absolute terms on a certain scale.
34
questions
0
votes
0
answers
24
views
Intentionally corrupting LLM weights (lobotomy)
It is largely unknown how LLMs work inside. Has anyone scientifically tried to corrupt (open source) model's weights in an organized manner to maybe detect which parts of the model are doing what or ...
- 271
2
votes
2
answers
187
views
At what text-based tasks are "dumb humans" still better than the best language models?
I ran into this AI-SE question from 5 years ago and I believe that an updated version could be interesting to discuss nowadays: Is the smartest robot more clever than the stupidest human?
Today's best ...
- 123
3
votes
0
answers
46
views
Are there standardized forms of the Turing Test?
Most computer science instructors will tell you that the Turing Test is more a theoretical or conceptual thought experiment than an actual exam that someone (or something!) can formally sit and ...
- 131
2
votes
2
answers
132
views
Do text compression tests qualify winRar or 7zip as intelligent?
I read this paper Text Compression as a Test for Artificial Intelligence, Mahoney, 1999.
So far I understood the following:
Text Compression tests can be used as an alternative to Turing Tests for ...
- 265
1
vote
1
answer
69
views
Based on the Turing test, what would be the criteria for an agent to be considered smart?
Based on the Turing test, what would be the criteria for an agent to be considered smart?
1
vote
2
answers
633
views
What is the Turing test?
I'm looking for intuition in simple words but also some simple insights (I don't know if the latter is possible). Can anybody shed some light on the Turing test?
- 1,243
8
votes
6
answers
507
views
What event would confirm that we have implemented an AGI system?
I was listening to a podcast on the topic of AGI and a guest made an argument that if strong music generation were to happen, it would be a sign of "true" intelligence in machines because of ...
- 500
2
votes
1
answer
89
views
How is the reCaptcha useful for Google?
I am wondering where Google uses the result from deep learning of reCaptcha (how can a system that knows to recognize street signs is useful somewhere? how they profit from it?)
- 123
20
votes
2
answers
2k
views
Problems that only humans will ever be able to solve
With the increasing complexity of reCAPTCHA, I wondered about the existence of some problem, that only a human will ever be able to solve (or that AI won't be able to solve as long as it doesn't ...
- 303
2
votes
0
answers
58
views
RNN: Different test results on balanced and unbalanced data
I trained a recurrent neural network (if it matters - it contains three CuDNNLSTM cells and 3 Dense layers, Dropout = 0.2). The result of data preparation is one array of ~330.000 sequences. Each ...
- 68
4
votes
1
answer
177
views
How to use Machine Learning to create a "Draw-A-Person Test"
The process revolves around a child's drawing. Each part of each drawing corresponds to a score as in the Draw a Person Test conceived by Dr. Florence Goodenough in 1926. The goal of the machine is to ...
- 83
2
votes
1
answer
155
views
How can we compare the intelligence of AI systems?
One way of ranking human intelligence is based on IQ tests. But how can we compare the intelligence of AI systems?
For example, is there a test that tells me that a spam filter system is more ...
- 816
6
votes
2
answers
1k
views
If the Turing test is passed, does this imply that computers exhibit intelligence?
Turing test was created to test machines exhibiting behavior equivalent or indistinguishable from that of a human. Is that the sufficient condition of intelligence?
- 163
1
vote
4
answers
372
views
How will we recognize a conscious machine?
How will we recognize a conscious machine (or AI)? Is there any consciousness test? For example, if a machine is aware of its previous experiences, can it be considered conscious?
4
votes
1
answer
312
views
Why is chess still a benchmark for Artificial Intelligence?
Even though modern chess playing programs have demonstrated themselves to be as strong (or stronger) than even the best human players for nearly 20 years now (1997 when IBM's Deep Blue defeated the ...
- 143
3
votes
1
answer
970
views
Goal oriented Action Planning with multiple Agents
I'm a little bit stuck:
I implemented an AI with GOAP (Goal oriented Action Planning, http://alumni.media.mit.edu/~jorkin/gdc2006_orkin_jeff_fear.pdf) for a simulation game. That works fine.
Now I ...
- 116
1
vote
2
answers
107
views
Is there a formal name for this philosophical AI problem?
Expressed in my own words:
Suppose we create something that passes all of our tests and is
indistinguishable from another human. How can you know if this is
truly a conscious being as a human ...
- 712
3
votes
4
answers
413
views
How can one distinguish between an AI and a "sufficiently advanced algorithm"?
Any sufficiently advanced algorithm is indistinguishable from AI.---Michael Paulukonis
According to What are the minimum requirements to call something AI?, there are certain requirements that a ...
- 1,660
1
vote
1
answer
128
views
Are there any refutation of the original Lovelace Test?
The original Lovelace Test, published in 2001, is used generally as a thought experiment to prove that AI cannot be creative (or, more specifically, that it cannot originate a creative artifact). From ...
- 1,660
5
votes
2
answers
311
views
How to detect a full-fledged self-aware AI?
The premise: A full-fledged self-aware artificial intelligence may have come to exist in a distributed environment like the internet. The possible A.I. in question may be quite unwilling to reveal ...
- 61
3
votes
2
answers
392
views
When will artificial intelligence equal human intelligence?
What are the current best estimates as to what year artificial intelligence will be able to score 100 points on the Stanford Binet IQ test?
- 364
3
votes
1
answer
586
views
How do we test if an model or algorithm is AI-complete?
How do we test if a model or algorithm is AI-complete?
- 41
8
votes
1
answer
247
views
Is the AI Effect caused by bad tests of intelligence?
According to Wikipedia...
The AI effect occurs when onlookers discount the behavior of an artificial intelligence program by arguing that it is not real intelligence.
Pamela McCorduck writes: "...
- 1,660
11
votes
2
answers
584
views
If IQ is used as a measure of intelligence in humans, could it also be used as a measure of intelligence in machines?
If IQ were used as a measure of the intelligence of machines, as in humans, at this point in time, what would be the IQ of our most intelligent AI systems?
If not IQ, then how best to compare our ...
- 541
6
votes
2
answers
73
views
What is a good way to create an artificial self-recognition?
Self-Recognition seems to be an item that designers are trying to integrate into artificial intelligence. Is there a generally recognized method of doing this in a machine, and how would one test the ...
- 541
9
votes
3
answers
2k
views
What are the criteria for a system to be considered intelligent? [duplicate]
For example, could you provide reasons why a sundial is not "intelligent"?
A sundial senses its environment and acts rationally. It outputs the time. It also stores percepts. (The numbers the ...
- 554
28
votes
4
answers
2k
views
Are Siri and Cortana AI programs?
Siri and Cortana communicate pretty much like humans. Unlike Google Now, which mainly gives us search results when asked some questions (not setting alarms or reminders), Siri and Cortana provide us ...
- 1,062
22
votes
1
answer
1k
views
Has the Lovelace Test 2.0 been successfully used in an academic setting?
In October 2014, Dr. Mark Riedl published an approach to testing AI intelligence, called the "Lovelace Test 2.0", after being inspired by the original Lovelace Test (published in 2001). Mark believed ...
- 1,660
5
votes
3
answers
126
views
Do specific units exists for measuring the intelligence of a machine?
We can measure the power of the machine with the number of operation per second or the frequency of the processor. But does units similar of IQ for humans exist for a AI?
I'm asking for a unit which ...
- 51
13
votes
2
answers
490
views
Are there any AI that have passed the MIST test so far?
MIST is a quantiative test of humanness, consisting of ~80k propositions such as:
Is Earth a planet?
Is the sun bigger than my foot?
Do people sometimes lie?
etc.
Have any AI attempted and passed ...
- 10.4k
10
votes
1
answer
272
views
How can the emotional quotient of an AI program be measured?
Can an AI program have an EQ (emotional intelligence or emotional quotient)?
In other words, can the EQ of an AI program be measured?
If EQ is more problematic to measure than IQ (at least with a ...
2
votes
0
answers
104
views
Which objective tests have been developed to test the intelligence of AI?
Which objective and measurable tests have been developed to test the intelligence of AI?
The classical test is the Turing Test, which has objective criteria and is measurable since it can be ...
- 1,511
14
votes
3
answers
2k
views
What are the specific requirements of the Turing test?
What are the specific requirements of the Turing test?
What requirements if any must the evaluator fulfill in order to be qualified to give the test?
Must there always be two participants in the ...
- 253
14
votes
4
answers
1k
views
Can the IQ of an AI program be measured?
Can an AI program have an IQ? In other words, can the IQ of an AI program be measured? Like how humans can do an IQ test.
- 1,062