Is randomness (either true randomness or simulated randomness) necessary for AI? If true, does it mean "intelligence comes from randomness"? If not, can a robot lacking the ability to generate random numbers be called an artificial general intelligence?
$\begingroup$
$\endgroup$
5
-
$\begingroup$ What do you mean by "necessary for AI"? I know it may seem obvious, but I think you should be more explicit and clear. $\endgroup$– nbroCommented Sep 23, 2019 at 12:33
-
1$\begingroup$ This is a good core question, in that the statistical approach to AI, which allows machine learning, has eclipsed GOFAI, but it might be useful to elaborate a little in the question. Pseudo-random number generation may not be entirely sufficient, in that, given sufficient time/iterations, it would result in unintended bias. $\endgroup$– DukeZhouCommented Sep 23, 2019 at 19:30
-
$\begingroup$ Even if the claim - randomness being necessary for AI- is true, how does the question does it mean intelligence comes from randomness follow? $\endgroup$– naiveCommented Sep 25, 2019 at 9:48
-
1$\begingroup$ Being able to generate random numbers does not imply intelligence, not even close to it. Intelligence might follow from the why of random number generation. That why is generally coded in the models for AI such as in neural networks by a human - and that is for weights and bias initialization which in turn is essential for solving the optimization problem using gradient descent. $\endgroup$– naiveCommented Sep 25, 2019 at 9:53
-
$\begingroup$ we're probably missing words here. randomness is the apparent lack of pattern or predictability in events. the more predictable something is, the dumber it becomes. of course just a bunch of random numbers doesn't make anything intelligent. it's much to the opposite: randomness is an artifact of intelligence. but if while we're reverse engineering intelligence (making ai) we can in practice see it does need rng to exist, then there's evidently something there between randomness and intelligence that's not just artifacts. could we call it chaos? rather continue there: cregox.net/random $\endgroup$– cregoxCommented Feb 27, 2020 at 15:48
Add a comment
|
3 Answers
$\begingroup$
$\endgroup$
0
Is randomness (either true randomness or simulated randomness) necessary for AI
It depends on how you define Artificial Intelligence. If you regard it strictly as an intentionally created construct which demonstrates utility, then no. (For instance, Nimatron, potentially the first functioning AI, beat most human competitors at NIM. But Nimatron was classical AI, entirely rules based with no learning.) That said:
- Randomness has proved a useful component in machine learning, and any feasible AGI would likely require ML.
Given sufficient computing power, aka time and space, it would absolutely be possibly to brute force anything, including AGI, but the resulting algorithm would be "brittle", unable to "compute" anything not previously defined. A learning algorithm, presented a problem outside of its domain of knowledge may initially degrade in performance, but it can learn from those outcomes, and gradually improve performance.
IBM brute forced Chess with Deep Blue, but Chess is a strictly narrow problem that turned out not to require general intelligence. AGI requires human level performance in all tasks engaged in by humans, which, even if they could be broken down to a set of individual narrow problems, it's an ever expanding set of problems.
Does it mean "intelligence comes from randomness"?
Not if the definition of intelligence is rooted in utility because deterministic processes can demonstrate utility.
- In statistical AI, the intelligence arises from the analysis of random search or the fitness of the genetic algorithm, not the randomness per se.
In other words, if you have the randomness without the analysis, every decision is an unqualified guess.
My sense is that it is free will that would arise from randomness—effects unrelated to causes—because without true randomness, the universe and everything in it is purely deterministic.
$\begingroup$
$\endgroup$
2
Yes, randomness is necessary to achieve generality in theory. Right now AIs we have are on the basis of seeking pattern and use them to predict future moves or outcomes. If we don't include randomness in data then machine might consider that as pattern and behave according to that (Which will be bias for us). Generating random numbers is a different story in itself and won't be a criterion alone to judge. While this might be one of the conditions for sure.
-
$\begingroup$ Brute force (exhaustion) would not more limited than random composition--in both cases there would still be the same number of potential configurations. Only the approach to forming them is different. (See "The Library of Babel") But there is still the "needle in the haystack" problem, and the statistical approach has proven effective where brute force is insufficient. $\endgroup$– DukeZhouCommented Sep 23, 2019 at 21:12
-
$\begingroup$ Why it will be a limited number of stories to come up with? Given word 0 and word 1 we can generate all (which is infinite) binary stories without randomness. $\endgroup$– lambdaCommented Sep 23, 2019 at 23:50
$\begingroup$
$\endgroup$
2
It might be too philosophical answer, but maybe first we need to answer the question whether a human way of thinking or his creativeness includes random elements. For example if an author writing a book uses some randomness in developing some side thread or some episodic character and I would say, that yes - sometimes we think up of something random.
Some algorithms uses randomness at their basis, for example evolutionary algorithms for generating first population.
-
1$\begingroup$ All machine learning algorithms that have proven effective seem to use the statistical approach, which definitely involves randomness. So not just genetic algorithms, NNs in all of their flavors, native Bayes, et al. $\endgroup$– DukeZhouCommented Sep 23, 2019 at 21:10
-
$\begingroup$ I think the randomness we observe in human decision may not be true randomness, it may just be a function taking history, environment as arguments which is too complicated that it behaves like random function. $\endgroup$– lambdaCommented Sep 23, 2019 at 23:38