New answers tagged comparison
0
votes
How do neural scaling laws explain the improvements from LSTMs to Transformer based models
Notice the architectural change your reference above is only about optimizer, regularizer, and loss functions which only affect the proportionality factor as claimed, but $D$ here has other ...
Top 50 recent answers are included
Related Tags
comparison × 458reinforcement-learning × 111
machine-learning × 85
neural-networks × 83
deep-learning × 63
terminology × 53
convolutional-neural-networks × 34
definitions × 23
search × 22
recurrent-neural-networks × 17
q-learning × 15
value-functions × 15
natural-language-processing × 13
papers × 13
long-short-term-memory × 11
objective-functions × 11
optimization × 11
genetic-algorithms × 11
evolutionary-algorithms × 10
supervised-learning × 10
a-star × 10
computer-vision × 9
markov-decision-process × 9
classification × 8
applications × 8