Questions tagged [padding]
For questions related to padding (the input) in the context of neural networks.
4
questions with no upvoted or accepted answers
3
votes
0
answers
93
views
What is the difference between zero-padding and character-padding in Recurrent Neural Networks?
For RNN's to work efficiently, we vectorize the operations, which results in an input matrix of shape
(m, max_seq_len)
where m ...
- 31
2
votes
0
answers
77
views
How do neural networks deal with inputs of different sizes that are padded in order to have them of the same size?
I am trying to create an environment for RL where the size of my input (observation space) is not fixed. As a way around it, I thought about padding the size to a maximum value and then assigning &...
- 61
1
vote
0
answers
60
views
Transpose convolution in TiF-GAN: How does "same" padding works?
This question should be quite generic but I faced the problem in the case of the TiF-GAN generator so I am going to use it as an example. (Link to paper)
If you check the penultimate page in the ...
- 597
0
votes
0
answers
25
views
How is padding masking considered in the Attention Head of a Transformer?
For purely educational purposes, my goal is to implement basic Transformer architecture from scratch. So far I focused on the encoder for classification tasks and assumed that all samples in a batch ...
- 101