Questions tagged [intuition]

Intuition has been defined as the ability to acquire knowledge without recourse to conscious reasoning. Logical Intuition has been defined as the ability to solve mathematical challenges efficiently. Use for questions about AI concepts analogous to human reasoning and human inference.

Filter by
Sorted by
Tagged with
0
votes
1answer
46 views

Is my intuition about RNN wrong?

Until today, my intuition about RNN (LSTM/GRU) was that this is some kind of NN that can remember previous inputs. Consider a task where you need to predict 0 if the previous input was 1. For example: ...
0
votes
0answers
30 views

What exactly "adjusted count" tells us in Laplace smoothing?

The probability/frequency of a word $w_i$ in an $N$-word corpus is given by $$p(w_i) = \dfrac{c_i}{N}$$ where $c_i$ is the number of times the word $w_i$ appears in the corpus. Suppose there are $V$ ...
1
vote
1answer
120 views

How do very rare words tend to have very high PMI values?

Consider the following formulation for pointwise mutual information (PMI): $$\text{PMI}(w, c) = \dfrac{p(w, c)}{p(w)p(c)}$$ Suppose there are $W$ words with $C$ context words. Then one can write in ...