The Stack Overflow podcast is back! Listen to an interview with our new CEO.

Questions tagged [recurrent-neural-networks]

Use for questions about Recurrent Neural Networks

Filter by
Sorted by
Tagged with
2
votes
0answers
35 views

Detecting symmetry in small images with RNN

My network works on 32x32 normalized (translationally) but noisy images. Its task it to determine whether image has simple symmetry (horizontal/vertical). It needs to be reasonably robust to rotation (...
2
votes
0answers
46 views

Recommendations on which architecture to use to guess appointment

I'm currently developping an application which allows psychologists to manage their schedule and budget. As a proof of concept, I would like to create an intelligent appointment service. There can be ...
1
vote
0answers
24 views

Can one use a trained recurrent neural network to find the most probable sequence of a set?

Let's say I train an RNN on the sequence of characters in War and Peace. After doing so is there a way I can take an arbitrary set of letters, e.g. HNTASK, and have it (ideally) tell me that the most ...
2
votes
0answers
49 views

Are gradients of weights in RNNs dependent on the gradient of every neuron in that layer?

I am writing my own recurrent neural network in Java to understand the inner workings better. While working through the math, I found that in timesteps later than 2 the gradient of weight w of neuron ...
2
votes
0answers
64 views

seq2seq vector to letters model

I'm looking to build a sequence-to-sequence model that takes in a 2048-long vector of 1s and 0s as my input and translating it to my known output of (a variable length) 1-20 long characters (ex. ...
5
votes
2answers
2k views

Spam Detection using Recurrent Neural Networks

I am working on this code for spam detection using recurrent neural networks. Question 1. I am wondering whether this field (using RNNs for email spam detection) worths more researches or it is a ...
2
votes
0answers
140 views

Preprocessing of training dataset for machine learning

I'm developing a log analyzer to predict and find errors in an equipment. Each logged data contains the following format: ...
2
votes
1answer
198 views

What is a state in a recurrent neural network?

I am Reading "Supervised Sequence Labelling with Recurrent Neural Networks" written by Alex Graves to try to understand LSTM networks and I am a bit confused about the equations. Specifically, what I ...
28
votes
4answers
38k views

How to select number of hidden layers and number of memory cells in an LSTM?

I am trying to find some existing research on how to select the number of hidden layers and the size of these of an LSTM-based RNN. Is there an article where this problem is being investigated, i.e., ...
1
vote
1answer
3k views

Neural network algorythms without any libraries [closed]

I am a php developer learning python for one reason, i wanna learn ai and i think that python would be better than php at that. I tried finding tutorials on how to build a neural network but they all ...
1
vote
0answers
95 views

Infer dependent variables to produce output aligned to trained data

Hypothetical example, say I wanted: P(gender,ethnicity|age,hair); so that the input would aligned to a trained dataset of: ...
4
votes
1answer
94 views

Are Neurons instantly feed forward when input arrives?

Lets say I have a Neural Network with 5 layers, including input and output layer. Each Layer has 5 nodes. Assume the Layers are fully connected, but the 3rd Node in the 2nd Layer is connected to the ...
2
votes
1answer
358 views

Good books to read on Artificial/Recurrent Neural Networks? [closed]

A professor and I have been learning about artificial neural networks. We have a pretty good idea of the basics- backpropagation, convolutional networks, and all that jazz. We finished one book and ...
9
votes
2answers
4k views

How to train a chatbot

I wanted to started experimenting with neural network and as a toy problem I wished to train one to chat, i.e. implement a chatting bot like cleverbot. Not that clever anyway. I looked around for ...
8
votes
4answers
661 views

Arbitrarily big neural network

If neurons and synapses can be implemented using transistors, what prevents us from creating arbitrarily large neural networks using the same methods with which GPUs are made? In essence, we have ...
4
votes
1answer
931 views

Recurrent neural networks with hidden layer

In the lecture, there was a statement: "Recurrent neural networks with multiple hidden layers are just a special case that has some of the hidden to hidden connections missing." I understand ...
16
votes
1answer
341 views

Could a Boltzmann machine store more patterns than a Hopfield net?

This is from a closed beta for AI, with this question being posted by user number 47. All credit to them. According to Wikipedia, Boltzmann machines can be seen as the stochastic, generative ...
-6
votes
2answers
289 views

What are the approaches to predict sequence of π numbers? [closed]

Given list of fixed numbers from a mathematical constant such as Pi, is it is possible to train AI to attempt to predict the next numbers? Which AI or neural network would be more suitable for this ...
2
votes
2answers
232 views

Can we ever achieve hypercomputation using recurrent neural networks?

It is proved that a recurrent neural net with rational weights can be a super-Turing machine. Can we achieve this in practice ?