Skip to main content

All Questions

Filter by
Sorted by
Tagged with
0 votes
1 answer
1k views

What is the difference between CNN-LSTM and RNN?

I'm starting to study RNN for a project of video prediction, but I encounter these CNN-LSTM models. Initially, I thought that is another name for RNN, but I think I get it wrong. Since I'm a beginner ...
mario corradetti's user avatar
2 votes
1 answer
74 views

Can teacher forcing in RNN ensure Turing completeness?

RNN has the same capability as a universal Turing machine. But I am confused whether RNN holds the same capabilities if we use teacher forcing. Consider the following excerpts from paragraphs taken ...
hanugm's user avatar
  • 3,990
1 vote
0 answers
81 views

Is the capability of RNN more than the capability of MLP?

Consider the following excerpt paragraph taken from the section titled "Recurrent Neural Networks" of the chapter 10: Sequence Modeling: Recurrent and Recursive Nets of the textbook named ...
hanugm's user avatar
  • 3,990
4 votes
1 answer
255 views

Is there any relation between the recursive neural network and recurrent neural network?

Recurrent neural networks, abbreviated as RNNs, are widely used in deep learning literature, especially for text processing. Are they related to recursive neural networks in any way? I am asking for ...
hanugm's user avatar
  • 3,990
3 votes
1 answer
3k views

What is the difference between LSTM and fully connected LSTM?

I'm currently trying to understand the difference between a vanilla LSTM and a fully connected LSTM. In a paper I'm reading, the FC-LSTM gets introduced as FC-LSTM may be seen as a multivariate ...
nn3112337's user avatar
  • 131
6 votes
1 answer
2k views

What's the difference between LSTM and GRU?

I have been reading about LSTMs and GRUs, which are recurrent neural networks (RNNs). The difference between the two is the number and specific type of gates that they have. The GRU has an update gate,...
Pluviophile's user avatar
  • 1,283
1 vote
1 answer
994 views

Do Seq2Seq models and the Bidirectional RNN do the same thing?

It seems to me that Seq2Seq models and Bidirectional RNNs try to do the same thing. Is that true? Also, when would you recommend one setup over another?
ADSBJason's user avatar
8 votes
1 answer
31k views

What is the difference between LSTM and RNN?

What is the difference between LSTM and RNN? I know that RNN is a layer used in neural networks, but what exactly is an LSTM? Is it also a layer with the same characteristics?
Mao76's user avatar
  • 83
1 vote
0 answers
56 views

What is the difference between an generalised estimating equation and a recurrent neural network?

What is the difference between a generalised estimating equation (GEE) model and a recurrent neural network (RNN) model, in terms of what these two models are doing? Apart from the differences in the ...
Leockl's user avatar
  • 151
3 votes
1 answer
88 views

From an implementation point of view, what are the main differences between an RNN and a CNN?

I understand that in general an RNN is good for time series data and a CNN image data, and have noticed many blogs explaining the fundamental differences in the models. As a beginner in machine ...
nilsinelabore's user avatar
2 votes
1 answer
952 views

What is an identity recurrent neural network?

What is an identity recurrent neural network (IRNN)? What is the difference between an IRNN and RNN?
nbro's user avatar
  • 41.4k
13 votes
3 answers
3k views

What is a recurrent neural network?

Surprisingly, this wasn't asked before - at least I didn't find anything besides some vaguely related questions. So, what is a recurrent neural network, and what are their advantages over regular (or ...
olinarr's user avatar
  • 759
1 vote
0 answers
78 views

Is there a mechanism in the human brain that works analog to LSTMs?

Is there a mechanism in the human brain that works analog to LSTMs? Is there a biological/neuroscientific interpretation of LSTMs and recurrent neural networks? How do long-term and short-term ...
mrk's user avatar
  • 111
6 votes
2 answers
433 views

Why are GRU and LSTM better than standard RNNs?

It seems that older RNNs have a limitation for their use cases and have been outperformed by other recurrent architectures, such as the LSTM and GRU.
Deep Analytics's user avatar
4 votes
2 answers
135 views

Do convolutional neural networks also have recurrent connections? [duplicate]

I asked my self this simple question while reading "Comment Abuse Classification with Deep Learning" by Chu and Jue. Indeed, they say at the end of the that It is clear that RNNs, specifically ...
Revolucion for Monica's user avatar
13 votes
5 answers
8k views

What is the fundamental difference between CNN and RNN?

What is the fundamental difference between convolutional neural networks and recurrent neural networks? Where are they applied?
Pradeep BV's user avatar
19 votes
1 answer
628 views

Could a Boltzmann machine store more patterns than a Hopfield net?

This is from a closed beta for AI, with this question being posted by user number 47. All credit to them. According to Wikipedia, Boltzmann machines can be seen as the stochastic, generative ...
Mithical's user avatar
  • 2,925