All Questions
Tagged with comparison recurrent-neural-networks
17 questions
2
votes
1
answer
74
views
Can teacher forcing in RNN ensure Turing completeness?
RNN has the same capability as a universal Turing machine. But I am confused whether RNN holds the same capabilities if we use teacher forcing.
Consider the following excerpts from paragraphs taken ...
CommunityBot
- 1
4
votes
1
answer
255
views
Is there any relation between the recursive neural network and recurrent neural network?
Recurrent neural networks, abbreviated as RNNs, are widely used in deep learning literature, especially for text processing.
Are they related to recursive neural networks in any way?
I am asking for ...
CommunityBot
- 1
13
votes
3
answers
3k
views
What is a recurrent neural network?
Surprisingly, this wasn't asked before - at least I didn't find anything besides some vaguely related questions.
So, what is a recurrent neural network, and what are their advantages over regular (or ...
13
votes
5
answers
8k
views
What is the fundamental difference between CNN and RNN?
What is the fundamental difference between convolutional neural networks and recurrent neural networks? Where are they applied?
- 2,925
0
votes
1
answer
1k
views
What is the difference between CNN-LSTM and RNN?
I'm starting to study RNN for a project of video prediction, but I encounter these CNN-LSTM models. Initially, I thought that is another name for RNN, but I think I get it wrong. Since I'm a beginner ...
- 41.4k
1
vote
0
answers
81
views
Is the capability of RNN more than the capability of MLP?
Consider the following excerpt paragraph taken from the section titled "Recurrent Neural Networks" of the chapter 10: Sequence Modeling: Recurrent and Recursive Nets of the textbook named ...
- 41.4k
8
votes
1
answer
31k
views
What is the difference between LSTM and RNN?
What is the difference between LSTM and RNN? I know that RNN is a layer used in neural networks, but what exactly is an LSTM? Is it also a layer with the same characteristics?
- 41.4k
1
vote
1
answer
994
views
Do Seq2Seq models and the Bidirectional RNN do the same thing?
It seems to me that Seq2Seq models and Bidirectional RNNs try to do the same thing. Is that true?
Also, when would you recommend one setup over another?
- 41.4k
6
votes
1
answer
2k
views
What's the difference between LSTM and GRU?
I have been reading about LSTMs and GRUs, which are recurrent neural networks (RNNs). The difference between the two is the number and specific type of gates that they have. The GRU has an update gate,...
- 41.4k
1
vote
0
answers
78
views
Is there a mechanism in the human brain that works analog to LSTMs?
Is there a mechanism in the human brain that works analog to LSTMs? Is there a biological/neuroscientific interpretation of LSTMs and recurrent neural networks? How do long-term and short-term ...
- 41.4k
3
votes
1
answer
88
views
From an implementation point of view, what are the main differences between an RNN and a CNN?
I understand that in general an RNN is good for time series data and a CNN image data, and have noticed many blogs explaining the fundamental differences in the models.
As a beginner in machine ...
- 825
3
votes
1
answer
3k
views
What is the difference between LSTM and fully connected LSTM?
I'm currently trying to understand the difference between a vanilla LSTM and a fully connected LSTM. In a paper I'm reading, the FC-LSTM gets introduced as
FC-LSTM may be seen as a multivariate ...
- 131
6
votes
2
answers
433
views
Why are GRU and LSTM better than standard RNNs?
It seems that older RNNs have a limitation for their use cases and have been outperformed by other recurrent architectures, such as the LSTM and GRU.
- 41.4k
4
votes
2
answers
135
views
Do convolutional neural networks also have recurrent connections? [duplicate]
I asked my self this simple question while reading "Comment Abuse Classification with Deep Learning" by Chu and Jue. Indeed, they say at the end of the that
It is clear that RNNs, specifically ...
- 41.4k
1
vote
0
answers
56
views
What is the difference between an generalised estimating equation and a recurrent neural network?
What is the difference between a generalised estimating equation (GEE) model and a recurrent neural network (RNN) model, in terms of what these two models are doing? Apart from the differences in the ...
- 41.4k
2
votes
1
answer
952
views
What is an identity recurrent neural network?
What is an identity recurrent neural network (IRNN)? What is the difference between an IRNN and RNN?
- 41.4k
19
votes
1
answer
628
views
Could a Boltzmann machine store more patterns than a Hopfield net?
This is from a closed beta for AI, with this question being posted by user number 47. All credit to them.
According to Wikipedia,
Boltzmann machines can be seen as the stochastic, generative ...
- 3,857