10
$\begingroup$

Let's consider this example:

It's John's birthday, let's buy him a kite.

We humans most likely would say the kite is a birthday gift, if asked why it's being bought; and we refer to this reasoning as common sense.

Why do we need this in artificially intelligent agents? I think it could cause a plethora of problems, since a lot of our human errors are caused by these vague assumptions.

Imagine an AI ignoring doing certain things because it assumes it has already been done by someone else (or another AI), using its common sense.

Wouldn't that bring human errors into AI systems?

$\endgroup$
  • 1
    $\begingroup$ Could you cite some sources where it is claimed common sense is needed? $\endgroup$ – Lio Elbammalf Jul 8 at 14:25
  • 2
    $\begingroup$ @LioElbammalf well, maybe there isn't a consensus that common sense is vital, but based on what I've read and watched on youtube, it seems that there's a lot of effort to achieve common sense in AI. Seemingly it's being considered the only way to achieve AGI. $\endgroup$ – Titan Jul 8 at 14:32
  • 8
    $\begingroup$ That is hardly common sense - that is very culturally specific knowledge. $\endgroup$ – curiousdannii Jul 8 at 23:16
  • $\begingroup$ @curiousdannii are you talking about the birthday example? $\endgroup$ – Titan Jul 9 at 9:52
  • $\begingroup$ Yes, kites being appropriate birthday presents is pretty contextual. $\endgroup$ – curiousdannii Jul 9 at 12:57
15
$\begingroup$

Common sense knowledge is the collection of premises that everyone, in a certain context (hence common sense knowledge might be a function of the context), takes for granted. There would exist a lot of miscommunication between a human and an AI if the AI did not possess common sense knowledge. Therefore, common sense knowledge is fundamental to human-AI interaction.

There are also premises that every human takes for granted independently of the country, culture or, in general, context. For example, every human (almost since its birth) has a mechanism for reasoning about naive physics, such as space, time and physical interactions. If an AI does not possess this knowledge, then it cannot perform the tasks that require this knowledge.

Any task that requires a machine to have common sense knowledge (of an average human) is believed to be AI-complete, that is, it requires human-level (or general) intelligence. See section 3 of the article Common Sense Knowledge (2009), by Christian Andrich, Leo Novosel and Bojan Hrnkas.

Of course, the problems that arise while humans communicate because of different assumptions or premises might also arise between humans and AIs (that possess common sense knowledge).

$\endgroup$
  • 1
    $\begingroup$ The OP and we are also Probably confused whether we want to create an ideal AI or we want to act it like humans which is bound to be erroneous in it's judgement. $\endgroup$ – DuttaA Jul 8 at 15:05
  • 1
    $\begingroup$ @Titan If I say "DOWN" while I am jumping on a swimming pool ramp, we will all think that it is towards the swimming pool and not in any other direction. We want the AI to have this type of knowledge. Furthermore, not all knowledge might be derivable and, as you say, we don't want to spend millions of years explaining the AI what we mean by "DOWN", especially in situations that require immediate action. $\endgroup$ – nbro Jul 8 at 15:07
  • 1
    $\begingroup$ @Titan we humans can make pretty good judgements if all the information is given to us. But it requires intelligence to extrapolate based on incomplete data. Top tier Scientists and economists are able to extrapolate this data to create new theorems. Basically working on concepts which are not obvious. So do you want AI to be like that, or be like an engineer apply a well known concept with just some modifications. $\endgroup$ – DuttaA Jul 8 at 15:09
  • 1
    $\begingroup$ Yeah, I hope AI could both have enough common sense to make interactions easier (and also be able to derive nonobvious things), and be strict enough (in necessary cases) to avoid the pitfalls/humanlike errors. $\endgroup$ – Titan Jul 8 at 15:20
  • 2
    $\begingroup$ @Titan What does "every bit of information" mean though, and how would it be provided if not through the form of common sense? Would a user have to tell your AI every single time what a person is, what a birthday is, what a kite is, what a birthday present is, what a particular culture generally considers to be good and bad birthday presents, etc...? It all depends on your application, of course, but it would be exceedingly painful to have to patiently explain all this knowledge to the AI every time you want to use it. $\endgroup$ – Zach Lipton Jul 9 at 3:51
10
$\begingroup$

We need this kind of common sense knowledge if we want to get computers to understand human language. It's easy for a computer program to analyse the grammatical structure of the example you give, but in order to understand its meaning we need to know the possible contexts, which is what you refer to as "common sense" here.

This was emphasised a lot in Roger Schank et al.'s work on computer understanding of stories, and lead to a lot of research into knowledge representation, scripts, plans, goals. One example from Schank's work is Mary was hungry. She picked up a Michelin Guide. -- this seems like a non-sequitur: if you are hungry, why pick up a book? Until you realise that it is a restaurant guide, and that Mary is presumably planning to go to a restaurant to eat. If you know that going to a restaurant is a potential solution to the problem of being hungry, then you have no problem understanding this story fragment.

Any story needs common sense to be understood, because no story is completely explicit. Common things are "understood" and aren't explicitly mentioned. Stories relate to human experience, and a story that would make everything explicit would probably read like a computer program. You also need common sense to understand how characters in a story behave, and how they are affected by what is happening. Again, this is very subjective, but it is necessary. Some common sense might be generally applicable, other aspects of it won't be. It's a complex issue, which is why researchers have struggled with it for at least half a century of AI research.

Of course this would introduce "human errors" into an AI system. All this is very subjective and culture-specific. Going to a restaurant in the USA is different from going to one in France -- this is why going abroad can be a challenge. And my reading of a story will probably be different from yours. But if you want to simulate human intelligence, you cannot do that without potential human "errors".

$\endgroup$
  • $\begingroup$ We say more or less the same thing, but you also give examples. $\endgroup$ – nbro Jul 8 at 14:55
  • $\begingroup$ The big question is how to get an AI to get this context right with such incomplete information/data. $\endgroup$ – DuttaA Jul 8 at 15:03
  • 1
    $\begingroup$ @Titan The questions are then: 1. Is it possible to do something (not random) without any premise or assumption? For example, in mathematics, you have assumptions (the axioms). Also, a trained neural network has implicit assumptions too. I don't see how you can even do something (that is not random) without any premises or knowledge. and 2. Can an AI be created that makes fewer errors than a human (that is, is super-intelligence even possible)? There are always trade-offs and I believe that an AI that will be better than humans at doing something will be worse in others. $\endgroup$ – nbro Jul 8 at 15:35
  • 1
    $\begingroup$ @nbro There are humans who make fewer errors than the average human, so it depends how you are defining "super-intelligence". If it means above the average human, then we already know it is possible (just by simulating an above average brain). If it means above the most intelligent human, then it is probably still possible. It is hard to believe that the most intelligent human is beyond all improvement in their abilities. $\endgroup$ – JBentley Jul 8 at 22:59
  • 1
    $\begingroup$ @nbro I don't follow how that contradicts what I said? I'm not referring to narrow AI. I'm merely pointing out that we know that general intelligence greater than average human intelligence is definitely possible, because every human with above average intelligence demonstrates it. There's no reason to think that what is possible via a human brain is impossible to achieve in AI. $\endgroup$ – JBentley Jul 8 at 23:06
2
$\begingroup$

I'll answer this question in several parts:

Why do AGI systems need to have common sense?

Humans in the wild reason and communicate using common sense more than they do with strict logic, you can see this by noting that it is easier to appeal to someone's emotion than logic. So any system that seeks to replicate human cognition (as in AGI) should also replicate this tendency to use common sense.

More simply put, we'd wish that our AGI system can speak to us in common sense language simply because that is what we understand best (otherwise we wouldn't understand our friendly AGI would we?). Obtuse theory and strict logic might technically be correct, but don't appeal to our understanding.

Isn't the goal of AGI the create the most cognitively advance system? Why should the "most perfect" AGI system need to deal with such imperfections and impreciseness present in common sense?

First, it might only appear to be the case that common sense logic is "irrational". Perhaps there is a consistent mathematical way to model common sense such that all the subtleties of common sense are represented in a rigour fashion.

Second, the early study of Artificial Intelligence started in the study of cognitive science, where researchers tried to replicate "algorithms of the mind", or more precisely: decidable procedures which replicated human thought. To that extent then, the study of AI isn't to create the "most supreme cognitive agent" but to merely replicate human thought/behavior. Once we can replicate human behavior we can perhaps try to create something super-human by giving it more computational power, but that is not guaranteed.

I still don't see why common sense is needed in AGI systems. Isn't AGI about being the most intelligent and powerful computational system? Why should it care or conform towards the limits of human understanding, which requires common sense?

Perhaps then you have a bit of a misaligned understanding of what AGI entails. AGI doesn't mean unbounded computational power (physically impossible due to physical constraints on computation such as Bremermann's limit) or unbounded intelligence (perhaps physically impossible due to the prior constraint). It usually just means artificial "general intelligence", general meaning broad and common.

Considerations about unbounded agents are studied in more detail in fields such as theoretical computer science (type theory I believe), decision theory, and perhaps even set theory, where we are able to pose questions about agents with unbounded computational power. We might say that there are questions even an AGI system with unbounded power can't answer due to the Halting Problem, but only if the assumptions on those fields map onto the structure of the given AGI, which might not be true.

For a better understanding of what AGI might entail and its goals, I might recommend two books: Artificial Intelligence: The Very Idea by John Haugeland for a more pragmatic approach (as pragmatic as AI-philosophy can be, and On the Origin of Objects by Brian Cantwell Smith for a more philosophically inclined approach.

As a fun aside, the collection of Zen koan's: The Gateless Gate, includes the following passage: (quoted and edited from wikipedia)

A monk asked Zhaozhou, a Chinese Zen master, "Has a dog Buddha-nature or not?" Zhaozhou answered, "Wú"

Wú (無) translates to "none", "nonesuch", or "nothing", which can be interpreted as to avoid answering either yes or no. This enlightened individual doesn't seek to strictly answer every question, but just to respond in a way that makes sense. It doesn't really matter as to wether the dog has Buddha-nature or not (whatever Buddha-nature means), so the master defaults to absolve the question rather than resolving it.

$\endgroup$
  • 3
    $\begingroup$ It would have been much funnier if the master had answered "wúf wúf!" $\endgroup$ – m3characters Jul 9 at 9:21
1
$\begingroup$

Perhaps it would help to give an example of what can go wrong without common sense: At the start of the novel "The Two Faces of Tomorrow" by James Hogan, a construction supervisor on the Moon files a request with an automated system, asking that a particular large piece of construction equipment be delivered to his site as soon as possible. The system replies that it will arrive in twenty minutes. Twenty minutes later, the supervisor is killed as the equipment crashes into his construction site. The system had determined that the fastest way to deliver the equipment to that site was to mount it on a mass-driver and launch it at the site. Had the system in question been given common sense, it would have inferred additional unstated constraints on the query, such as 'the equipment should arrive intact', 'the arrival of the equipment should not cause damage or loss of life', and so on. (the rest of the novel describes an experiment designed to produce a new system with common sense)

$\endgroup$
  • $\begingroup$ Quite interesting example. Though, maybe it could go the other way around as well. Imagine an AI checking in on a patient, and by seeing the patient's overall normal looks, conclude that the patient might/should be fine (based on it's common sense that if you look fine then probably you are); however, the patient is in need of serious help. However, I think it's clear by now that common sense is not the problem, it's faulty common sense/knowledge that might turn out to be dangerous in critical situations. So I guess we should control and make sure that the AI has a flawless common sense. $\endgroup$ – Titan Jul 10 at 15:56
0
$\begingroup$

Is this common sense, or is this natural language understanding?

It's been said that natural language understanding is one of the hardest AI tasks. This is one of the examples showing why. The first part of the sentence is related to the second part, that how sentences work.

Now the relevant question is how the two parts are related. There are a few standard relations that we encounter, for instance a temporal order. In this specific example, the nature of the relation is closer to a cause-and-effect.

You see this effect when we insert a word to make this relation explicit:

It's John's birthday, so let's buy him a kite. or Let's buy John a kite, because it's his birthday.

This is a technique for humans to make these implicit relations explicit.

Now, as curiousdannii notes, you also need the cultural knowledge to understand how a birthdays can be a cause for a present. No amount of common sense helps with that.

$\endgroup$
  • $\begingroup$ We use the "common sense" we have to understand a sentence like that. NLP is really hard, I agree, and that's because so far AI hasn't possessed this comprehensive knowledge and model of the world that we humans have; hence it lacks in connecting the dots and understanding those implicit relations. That "cultural knowledge" you mentioned is basically considered our common sense. $\endgroup$ – Titan Jul 9 at 15:25

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.