Questions tagged [padding]
For questions related to padding (the input) in the context of neural networks.
7
questions
0
votes
0
answers
20
views
How is padding masking considered in the Attention Head of a Transformer?
For purely educational purposes, my goal is to implement basic Transformer architecture from scratch. So far I focused on the encoder for classification tasks and assumed that all samples in a batch ...
- 101
2
votes
0
answers
70
views
How do neural networks deal with inputs of different sizes that are padded in order to have them of the same size?
I am trying to create an environment for RL where the size of my input (observation space) is not fixed. As a way around it, I thought about padding the size to a maximum value and then assigning &...
- 61
1
vote
1
answer
26
views
Is reconciling shape discrepancies the only purpose of padding?
Padding is a technique used in some of the domains of artificial intelligence.
Data is generally available in different shapes. But in order to pass the data as input to a model in deep learning, the ...
- 3,531
1
vote
1
answer
65
views
Is it a good practice to pad signal before feature extraction?
Is padding, before feature extraction with VGGish, a good practice?
Our padding technique is to find the longest signal (which is loaded .wav signal), and then, in ...
- 13
3
votes
0
answers
93
views
What is the difference between zero-padding and character-padding in Recurrent Neural Networks?
For RNN's to work efficiently, we vectorize the operations, which results in an input matrix of shape
(m, max_seq_len)
where m ...
- 31
0
votes
1
answer
65
views
Text classification of non-equal length texts, should I pad left or right?
Text classification of equal length texts works without padding, but in reality, practically, texts never have the same length.
For example, spam filtering on blog article:
...
- 1,283
1
vote
0
answers
56
views
Transpose convolution in TiF-GAN: How does "same" padding works?
This question should be quite generic but I faced the problem in the case of the TiF-GAN generator so I am going to use it as an example. (Link to paper)
If you check the penultimate page in the ...
- 587