Questions tagged [intuition]

Intuition has been defined as the ability to acquire knowledge without recourse to conscious reasoning. Logical Intuition has been defined as the ability to solve mathematical challenges efficiently. Use for questions about AI concepts analogous to human reasoning and human inference.

Filter by
Sorted by
Tagged with
0 votes
1 answer
75 views

Is my intuition about RNN wrong?

Until today, my intuition about RNN (LSTM/GRU) was that this is some kind of NN that can remember previous inputs. Consider a task where you need to predict 0 if the previous input was 1. For example: ...
user avatar
  • 109
1 vote
1 answer
164 views

How do very rare words tend to have very high PMI values?

Consider the following formulation for pointwise mutual information (PMI): $$\text{PMI}(w, c) = \dfrac{p(w, c)}{p(w)p(c)}$$ Suppose there are $W$ words with $C$ context words. Then one can write in ...
user avatar
  • 3,191