All Questions
Tagged with tensorflow recurrent-neural-networks
24 questions
0
votes
0
answers
22
views
How do I find a similar RNN as a starting point?
I am new to machine learning and neural networks and I want to create a neural network for a study project.
I would like to create a RNN, that uses one (A) or several time series (with the same length,...
- 1
0
votes
2
answers
72
views
How to improve classification accuracy in TF deep neural network model?
I need help in increasing the accuracy of a classification model using Neural Networks on Tensorflow.
I am trying to train a model on sequential data ...
- 457
1
vote
0
answers
283
views
Why can't I reproduce my results in keras using random seed? [closed]
I was doing a task using RNN to predict a time series movement.
I want to make my results reproducible. So I strictly followed this post:
https://stackoverflow.com/questions/32419510/how-to-get-...
- 121
-2
votes
1
answer
243
views
My accuracy wont improve in tensorflow [closed]
I've been trying to figure out why this model won't train (the accuracy stays at 0).
...
- 135
2
votes
1
answer
1k
views
Multiple GRU layers to improve a text generation
I am using the model in this colab https://colab.research.google.com/github/tensorflow/text/blob/master/docs/tutorials/text_generation.ipynb#scrollTo=AM2Uma_-yVIq for Shakespeare like text generation.
...
- 121
0
votes
0
answers
189
views
What do RNN, LSTM, and GRU layers do in Tensorflow?
I have gone through some theoretical introductions of RNN and LSTM, which do not contain any code, and they describe in fair detail what the cells do, how they apply operations like forget, sigmoid, ...
- 121
0
votes
0
answers
24
views
Document clustering from ordered pages list
I have a series of ordered pdf pages which own to different documents. Let me give you an example:
Pages: 1 2 3 4 5 6
True Pages: 1 2 | 1 2 3 4
So I have like six ordered pages, two of which from ...
- 1
0
votes
0
answers
120
views
Are there any inverse RNN layers?
Given the model:
Sequence([
GRU(200, input_shape=(None,100), return_sequences=False)
])
Which maps the space ...
- 141
1
vote
0
answers
140
views
Is a true RNN auto encoder possible with Keras/TF
I want to get some encodings for temporal data (with a highly varying number of timesteps).
The dataset is of the format: ...
- 141
2
votes
0
answers
53
views
If I want to predict two unrelated values given the same sequence of data points, should I have a model with two outputs or two models?
I want to predict two separate y-values (not really logically connected) based on an input sequence of data (values x). Using LSTM cells.
Should I train two models separately or should I just increase ...
- 181
1
vote
1
answer
3k
views
1
vote
0
answers
210
views
Keras model accuracy not improving beyond threshold
I am currently working on a public project for the National Weather Model. We are experimenting with using a recurrent neural network to replace the output of a quadratic formula that is in use. The ...
1
vote
0
answers
221
views
Simple sequential model with LSTM which doesn't converge
I'm actually trying to create a sequential neural network in order to translate a "human" sentence in a "machine" sentence understandable by an algorithm. Like It didn't work, I've try to create a NN ...
- 11
1
vote
0
answers
24
views
Is there a way to use RNN (in tensorflow) to do something like a batch Kalman with the weight dynamics specified in the loss?
Or would you simply do this as a time series of models.
Basically I think you can think of time series of weights as the hidden states and the dynamics driving the weight time series as the RNN ...
- 141
2
votes
0
answers
32
views
How are batch statistics computed in Recurrent Batch Normalization?
I'm implementing recurrent BN per this paper in Keras, but looking at it and those citing it, a detail remains unclear to me: how are batch statistics computed? Authors omit explicit clarification, ...
1
vote
0
answers
125
views
What is the correct input shape for my LSTM network?
My professor gave us a workshop where we have to do classification of a dataset of ECG signals between healthy and unhealthy types using LSTM. Each signal consists of 1,285 time steps.
What my prof ...
- 181
0
votes
1
answer
62
views
Do we have anything like accuracy and loss in RNN models?
I have a paper about trading which has been implemented with RNN on Tensorflow. We have about 2 years of data from trading. Here are some samples :
Date, Open, High, Low, Last, Close, Total Trade ...
- 209
14
votes
3
answers
7k
views
What is the relationship between the size of the hidden layer and the size of the cell state layer in an LSTM?
I was following some examples to get familiar with TensorFlow's LSTM API, but noticed that all LSTM initialization functions require only the num_units parameter, ...
- 241
0
votes
1
answer
49
views
How to change this RNN text classification code to become text generation code?
I can do text classification with RNN, in which the last output of RNN (rnn_outputs[-1]) is used to matmul with output layer weight and plus bias. That is getting a word (class name) after the last T ...
- 1,318
0
votes
1
answer
83
views
How to map X to Y for TensorFlow RNN training data
Usually for DNN, I have the training data of matching X (2D) to Y (2D), for example, XOR data:
X = [[0,0],[0,1],[1,0],[1,1]];
Y = [[0], [1], [1], [0] ];
...
- 1,318
5
votes
1
answer
3k
views
How does the CTC loss work?
I am trying to implement CTC loss in TensorFlow, but their documentation is pretty limited. So I am not sure how to approach the problem. I found a good example in Theano.
Are any other resources that ...
- 51
1
vote
0
answers
49
views
Dynamic frames processing with CNN LSTM combination or otherwise
I have a unique implementation where I have to process videos with dynamic frame rates (that is the number of frames is different for each video in a batch). I am stacking all the frames in a single ...
- 111
3
votes
1
answer
2k
views
Seq2Seq dialogs predicts only most common words like `you` after couple of epoches
I'm training Seq2Seq model on OpenSubtitles dialogs - Cornell-Movie-Dialogs-Corpus.
My work based on the following papers (but currently I'm not implemented Attention yet):
Sequence to Sequence ...
- 223
1
vote
0
answers
209
views
Trajectory classification using RNN
The problem: I want to classify a trajectory if it has some properties, for example I want to create a simple 0/1 classifier for circular trajectories. If a target is moving in a circular trajectory ...
- 111