1
$\begingroup$

The more I think about machine learning the more I realize the importance of finding similarities by using analogies as a way of learning.

If I want to categorize words into hierarchical tree this method would work I think, if not tell me why?

Find two sentences that contain same words but their order is different and some words can also be different.

Find another two such sentences.

Evaluate strength of analogy between these 4 sentences.

The stronger it is the more probability that words mean similar thing, that they belong to same category.

When you learn categories you can do analogies on abstract sentences that contain these found categories and in this manner you can build hierarchy of categories.

For example:

Deer eats grass. ...is to... Man eats deer.

as Cow eats grass is to ?

If we can find sentence Man eats cow. being used in texts that we analyze then we have confirmed that cow and deer belong to category Animals that eat grass and that human eats them.

|improve this question
$\endgroup$
  • $\begingroup$ Kind of opinion based $\endgroup$ – DuttaA Feb 17 '18 at 11:26
  • 1
    $\begingroup$ The first idea is similar to word2vec and skip-gram models. They make word vectors closer to eachother based on if they are frequently used in the same context. $\endgroup$ – Daniel Feb 17 '18 at 23:51
  • $\begingroup$ There are 2 things there is no doubt about: that words are defined only by that in which sentences they can be used. and second thing, that if two words belong to same categories they are similar. so by the method above we can put words into hierarchical categories. and when we do that we can know which words are similar. $\endgroup$ – Tone Škoda Feb 18 '18 at 0:08
  • $\begingroup$ Why analogies work? Because they are a way to find out hidden SIMILARITY between two sentences. And if two unknown words are used in two sentences that have similarities then we can put them into the same category "words, that can be used in sentence, that has this structure". Analogies and categories are the most important part of intelligence. And IQ tests test also use these two things the most. Analogies look at similarity of relations between elements. $\endgroup$ – Tone Škoda Feb 18 '18 at 0:15

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Browse other questions tagged or ask your own question.