12
$\begingroup$

Currently, within the AI development field, the main focus seems to be on pattern recognition and machine learning. Learning is about adjusting internal variables based on a feedback loop.

Maslow's hierarchy of needs is a theory in psychology proposed by Abraham Maslow that claims that individuals' most basic needs must be met before they become motivated to achieve higher-level needs.

What could possibly motivate a machine to act? Should a machine have some sort of DNA-like structure that would describe its hierarchy of needs (similar to Maslow's theory)? What could be the fundamental needs of a machine?

$\endgroup$
  • 1
    $\begingroup$ Interesting question, and welcome to AI! (I have a few thoughts on the subject, related to game theory, and other contributors have talked about goal oriented learning in relation to algorithms.) $\endgroup$ – DukeZhou Aug 27 '17 at 20:25
  • 1
    $\begingroup$ Simply saying it would be utility function. This answer might help $\endgroup$ – Ugnes Aug 27 '17 at 21:00
5
$\begingroup$

The current method to implement motivation is some kind of artificial reward. Deepmind's DQN for example is driven by the score of the game. The higher the score, the better. The AI learns to adjust its actions to get the most points and therefore the most reward. This is called reinforcement learing. The reward motivates the AI to adapt its actions, so to speak.

In a more technical term, the AI wants to maximize utility, which depends on the implemented utility function. In the case of DQN, this would be maximizing the score in the game.

The human brain functions in a similar fashion, although a little more complex and often not as straight forward. We as humans usually try to adjust our actions to produce a high output of dopamine and serotonin. This is in a way similar to the reward used to control AIs during reinforcement learning. The human brain learns which actions produce the most amount of those substances and finds strategies to maximize the output. This is, of course, a simplification of this complex process, but you get the picture.

When you talk about motivation, please don't mix it up with consciousness or qualia. Those are not required for motivation at all. If you want to discuss consciousness and qualia in AI, that's a totally different ball game.

A child isn't curious for the sake of curiosity. It gets positive reinforcement when exploring because the utility function of the child's brain rewards exploration by releasing rewarding neurotransmitters. So the mechanism is the same. Applying this to AI means defining a utility function that rewards new experiences. There is no inner drive without some kind of reinforcing reward.

$\endgroup$
  • $\begingroup$ in regards to the edit i think a good example of "a utility function that rewards new experience" would be the novelty search fitness functions proposed by ken stanley to be used in his neat algorithm. $\endgroup$ – nickw Oct 7 at 20:18
5
$\begingroup$

This is an interesting question actually.

There's a quite realistic idea about "where can the curiosity originate from" in the book "On intelligence" written by Jeff Hawkins and Sandra Blakeslee.

It's based on such statements:

  • Mind creates its own model of the world it exists in.

  • It makes predictions about everything all the time (actually Jeff Hawkins states that this is the main characteristic of intelligence).

  • When prediction about something wasn't followed by appropriate behavior of the world, then this thing gets very interesting to the mind (the model is wrong and should be corrected) and needs more attention.

For example, when you look at left human eye your brain predicts that it's a human face and there should be second eye to the right. You look to the right and see a.. nose! What a surprise! It now takes all your attention and you have this motivation to make more observations about such a strange thing that did not fit into your model.

So I'd say that AI might do something certain according to its model or behave randomly while the predictions it is making about the world are true. But once some prediction is broken the AI gets a motivation to do error-correction to its model.

In a simple case a machine starts at a total randomness just doing everything it can with its output. While it has no model or a random model when it detects some kind of order or repeated patterns it is getting "interested" and adds it to the model. After a while, the model becomes more sophisticated making more complex predictions and detecting higher level mistakes in a model. Slowly it gets to know what to do to observe something interesting to it, instead of just remembering everything.

$\endgroup$
  • $\begingroup$ Thank you for the contribution! I have come to basically the same conclusions... now thinking of a way to implement it :) $\endgroup$ – Aleksei Maide Sep 15 '17 at 9:38
  • $\begingroup$ This answer makes an important point. Error correction on prediction models would provide a great incentive for an intelligent AI to learn and act in curious manner. $\endgroup$ – Seth Simba Jan 16 '18 at 9:21
3
$\begingroup$

I asked professor Richard Sutton a similar question, in the first lecture of the reinforcement learning course. It seems that there are different ways to motivate the machine. In fact, machine motivation seems to me like a dedicated field of research.

Typically, machines are motivated by what we call an objective function or a cost function or a loss function. These are different names for the same concept. Sometimes, they are denoted by

$$L(a)$$

The goal of the machine is then to solve either a minimization problem, $\min_a L(a)$, or a maximization problem, $\max_a L(a)$, depending on the definition of $L$.

$\endgroup$
1
$\begingroup$

I've spent some time thinking about this in the context of games.

The problem with reward functions is that they generally involve weighting nodes, which is useful but ultimately materially meaningless.

Here are two materially meaningful rewards:

COMPUTATIONAL RESOURCES

Consider a game where an AI is competing not for points, but for processor time and memory.

The better the algorithm performs at the game, the more memory and processing it has access to. This has a practical effect--the more resources available to the automata, the stronger its capabilities. (i.e. it's rationality is less bounded in terms of time and space to make a decision.) Thus the algorithm would be "motivated" to prevail such a contest.

ENERGY

Any automata with a sufficient degree of "self awareness", here specifically referring to the knowledge that it requires energy to process, would be motivated to self-optimize its own code to eliminate unnecessary flipping of bits (unnecessary energy consumption.)

Such an algorithm would also be motivated to ensure its power supply so that it can continue to function.

$\endgroup$

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.