New answers tagged recurrent-neural-networks
1
vote
Accepted
Would it be possible to involve a proof assistant in the process of training a LLM?
Your post has links with:
An article by Stephen Wolfram [ https://writings.stephenwolfram.com/2023/01/wolframalpha-as-the-way-to-bring-computational-knowledge-superpowers-to-chatgpt/ ], stating that ...
- 26
2
votes
How to deal with varying number of input images?
There are are couple methods that you may wish to consider for this challenging but interesting problem.
In some cases, multiple images are captured because of artifacts in the initial images, so ...
- 862
0
votes
How can Transformers handle arbitrary length input?
The accepted answer is wonderful; this answer provides an alternative approach for dealing with variable length inputs. More specifically, what might be done when the input is longer than the maximum ...
- 496
2
votes
Accepted
Which calculation to use for GRU
Firstly, I am assuming $r$ is the update to the hidden state. I will call it $\tilde{\mathbf{h}}_t$, because this is how it's called in the paper by Cho et al. that introduced the GRU (where $\mathbf{...
- 1,157
Top 50 recent answers are included
Related Tags
recurrent-neural-networks × 334neural-networks × 114
long-short-term-memory × 94
deep-learning × 59
machine-learning × 50
natural-language-processing × 46
convolutional-neural-networks × 34
time-series × 28
tensorflow × 23
comparison × 17
keras × 15
transformer × 15
attention × 15
reference-request × 14
sequence-modeling × 14
gated-recurrent-unit × 13
python × 11
prediction × 11
feedforward-neural-networks × 11
terminology × 10
word-embedding × 10
seq2seq × 10
training × 9
papers × 9
backpropagation × 9