2 votes
Accepted

Is categorical encoding a type of word embedding?

One-hot encoding is different than the concept of a word embedding, although both approaches use vectors to represent the objects (e.g. words). A one-hot vector contains one element that is 1 and all ...
nbro's user avatar
  • 40.2k
1 vote

Backpropagation with CrossEntropy and Softmax, HOW?

The derivation of the softmax function is a bit tricky because except the other common activation functions(sigmoid, relu...) all the Zs values impact each other. It is because when you are ...
Ege's user avatar
  • 25
1 vote

Backpropagation with CrossEntropy and Softmax, HOW?

No it's not the same. First the derivative of the cost function is taken with respect to the weight and not the input. This is usually done using the chain rule of calculus. To calculate this using ...
Chiho's user avatar
  • 11
1 vote

How to embed game grid state with walls as an input to neural network

If there can be multiple items on a square something more complex than one-hot is needed. As the name implies, only one category can be hot (set to true) in one-hot. You need multi-hot. Further, ...
foreverska's user avatar
1 vote

How to embed game grid state with walls as an input to neural network

The way you describe with one hot encoding is correct. Note that how the state is encoded is a separate question from the neural network, so I'm not sure what convolutional neural networks have to do ...
Taw's user avatar
  • 1,241

Only top scored, non community-wiki answers of a minimum length are eligible