Skip to main content

Questions tagged [padding]

For questions related to padding (the input) in the context of neural networks.

5 questions with no upvoted or accepted answers
Filter by
Sorted by
Tagged with
3 votes
0 answers
101 views

What is the difference between zero-padding and character-padding in Recurrent Neural Networks?

For RNN's to work efficiently, we vectorize the operations, which results in an input matrix of shape (m, max_seq_len) where m ...
PhysicsMan's user avatar
2 votes
0 answers
98 views

How do neural networks deal with inputs of different sizes that are padded in order to have them of the same size?

I am trying to create an environment for RL where the size of my input (observation space) is not fixed. As a way around it, I thought about padding the size to a maximum value and then assigning &...
user101464's user avatar
1 vote
0 answers
66 views

Transpose convolution in TiF-GAN: How does "same" padding works?

This question should be quite generic but I faced the problem in the case of the TiF-GAN generator so I am going to use it as an example. (Link to paper) If you check the penultimate page in the ...
MattSt's user avatar
  • 597
0 votes
0 answers
27 views

Is token mask masked in attention of encoders of bert?

I have recently researched on Bert structure. And the paper says we will mask some token at the input in 80%, 10% input be changed and 10% left remained. But I wonder if the mask token in the input be ...
Thành An's user avatar
0 votes
0 answers
20 views

How to construct source padding mask for embedded audio?

I'm attempting a music transcription task - similar to speech recognition but with music and notes (string representations) instead of speech audio and sentences. The model consists of a CNN audio ...
jy99's user avatar
  • 1