Questions tagged [neural-networks]

For questions about a artificial networks, such as MLPs, CNNs, RNNs, LSTM, and GRU networks, their variants or any other AI system components that qualify as a neural networks in that they are, in part, inspired by biological neural networks.

Filter by
Sorted by
Tagged with
3
votes
1answer
123 views

What linear rectifier is better?

What rectifier is better in general case of Convolutional Neural Network and how about empirical rules to use each type? ReLU PReLU RReLU ELU Leacky ReLU
2
votes
0answers
123 views

What resources are good for learning to program AI? [closed]

I know how to program. I've familiar with C++, Python, and Java, and I've known how to program for years now. I've experimented with genetic algorithms, but I want to go further. What resources should ...
33
votes
3answers
25k views

Why is Lisp such a good language for AI?

I've heard before from computer scientists and from researchers in the area of AI that that Lisp is a good language for research and development in artificial intelligence. Does this still apply, with ...
4
votes
3answers
407 views

Why would neural networks be a particularly good framework for "embodied AI"?

There is this claim around that the brain's cognitive capabilities are tightly linked to the way it processes sensorimotor information and that, in this or a similar sense, our intelligence is "...
13
votes
2answers
2k views

How are generative adversarial networks trained?

I am reading about generative adversarial networks (GANs) and I have some doubts regarding it. So far, I understand that in a GAN there are two different types of neural networks: one is generative ($...
10
votes
4answers
772 views

Are we technically able to make, in hardware, arbitrarily large neural networks with current technology?

If neurons and synapses can be implemented using transistors, what prevents us from creating arbitrarily large neural networks using the same methods with which GPUs are made? In essence, we have ...
6
votes
4answers
4k views

What is the purpose of hidden nodes in neural network?

If I have a set of sensory nodes taking in information and a set of "action nodes" which determine the behavior of my robot, why do I need hidden nodes between them when I can let all sensory nodes ...
3
votes
1answer
126 views

Will it ever be possible to construct a neural network that could have the features of human brain? [duplicate]

I have a question. Will we be able to build a neural network that thinks abstractly, has the creativity, feels and is conscious?
3
votes
1answer
295 views

Is it possible to build an AGI with neural networks on neuromorphic chips?

I read a lot about the structure of the human brain and artificial neural networks. Is it possible to build an AGI (or human-level AI) with artificial neural networks on neuromorphic chips, which ...
9
votes
2answers
518 views

Was DeepMind's DQN Atari game learning simultaneous?

DeepMind state that their deep Q-network (DQN) was able to continually adapt its behavior while learning to play 49 Atari games. After learning all games with the same neural net, was the agent ...
6
votes
4answers
808 views

What are some datasets to train an MLP on simple tasks? [closed]

I have implemented an MLP. Now, I want to train it to solve simple tasks. Are there any data sets to train the MLP on simple tasks, that is, tasks with a small number of inputs and outputs? I ...
1
vote
3answers
2k views

What sort of game problems can neural networks trained/evolved with evolutionary algorithms solve, and how are they typically implemented?

I'm interested mostly in the application of AI in gaming; in case this adjusts the way you answer, but general answers are more than welcome as well. I was reading up on Neural Networks and combining ...
3
votes
1answer
143 views

Feasibility of sorting a basket of clothes in the real world

I'm wondering how feasible it is to create a machine that can separate clothing from a basket. At the most basic level it would distinguish between tops, pants, button downs and socks ...
1
vote
2answers
276 views

Wouldn't an AI that specializes in making other AI be an AGI if they can cooperate?

If said AI can assess scenarios and decide what AI is best suited and construct new AI for new tasks. In sufficient time would the AI not have developed a suite of AIs powerful/specialized for their ...
2
votes
3answers
4k views

When using neural networks to detect features in an image, how can locate that specific feature in the original image?

I understand how a neural network can be trained to recognise certain features in an image (faces, cars, ...), where the inputs are the image's pixels, and the output is a set of boolean values ...
74
votes
3answers
52k views

How can neural networks deal with varying input sizes?

As far as I can tell, neural networks have a fixed number of neurons in the input layer. If neural networks are used in a context like NLP, sentences or blocks of text of varying sizes are fed to a ...
1
vote
2answers
4k views

Simple text recognition with neural network [closed]

In my attempt at trying to learn neural network and machine learning I'm am trying to create a simple neural network which can be trained to recognise one word from a given string (which contains only ...
14
votes
2answers
720 views

Should deep residual networks be viewed as an ensemble of networks?

The question is about the architecture of Deep Residual Networks (ResNets). The model that won the 1-st places at "Large Scale Visual Recognition Challenge 2015" (ILSVRC2015) in all five main tracks: ...
5
votes
1answer
831 views

Which neural networks can be used only for storing and retrieving information?

Is there a neural network(NN) system or architecture which can be used for only storing and retrieving information. For example; to store whole Avatar movie in HD format inside a neural network and ...
12
votes
8answers
16k views

How to classify data which is spiral in shape?

I have been messing around in tensorflow playground. One of the input data sets is a spiral. No matter what input parameters I choose, no matter how wide and deep the neural network I make, I cannot ...
10
votes
2answers
1k views

Do deep learning algorithms represent ensemble-based methods?

According to the Wikipedia article on deep learning: Deep learning is a branch of machine learning based on a set of algorithms that attempt to model high-level abstractions in data by using a deep ...
15
votes
3answers
1k views

Has anyone thought about making a neural network ask questions, instead of only answering them?

Most of the people is trying to answer question with a neural network. However, has anyone came up with some thoughts about how to make neural network ask questions, instead of answer questions? For ...
2
votes
1answer
828 views

Are FFNN (MLP) Lipschitz functions?

My question is regarding standard dense-connected feed forward neural networks with sigmoidal activation. I am studying Bayesian Optimization for hyper-parameter selection for neural networks. There ...
3
votes
2answers
112 views

Are ANNs just highly distributed lossy compression schemes?

Conceptually speaking, aren't artificial neural networks just highly distributed, lossy compression schemes? They're certainly efficient at compressing images. And aren't brains (at least, the ...
6
votes
5answers
327 views

Emulating human brain - with analogous NN chips

Considering the answers of this question, emulating a human brain with the current computing capacity is currently impossible, but we aren't very far from it. Note, 1 or 2 decades ago, similar ...
18
votes
1answer
450 views

Are these two versions of back-propagation equivalent?

Just for fun, I am trying to develop a neural network. Now, for backpropagation I saw two techniques. The first one is used here and in many other places too. What it does is: It computes the ...
9
votes
2answers
869 views

Power efficiency of human brains vs. neural networks

How big artificial neural networks can we run now (either with full train-backprop cycle or just evaluating network outputs) if our total energy budget for computation is equivalent to human brain ...
3
votes
1answer
175 views

How can thought vectors be used outside of an Artificial Neural Network (ANN) context?

We hear a lot today about how thought vectors are the Next Big Thing in AI, and how they serve as the underlying representation of thought/knowledge in ANN's. But how can one use thought vectors in ...
4
votes
1answer
201 views

What can be done to correct for sampling bias introduced from (noisy) training data while training a DNN?

The obvious solution is to ensure that the training data is balanced - but in my particular case that is impossible. What corrections can one perform in such a scenario? I know that my training data ...
6
votes
1answer
206 views

How do Artificial Neural Networks store data compared to Biological Neural Networks?

Do scientists know by what mechanism biological brains/biological neural networks store data? I was thinking about @kenorbs question about implanting nanobots to build an AGI on top of human wetware. ...
10
votes
4answers
3k views

How does using ASIC for the acceleration of AI work?

We can read on Wikipedia page that Google built a custom ASIC chip for machine learning and tailored for TensorFlow which helps to accelerate AI. Since ASIC chips are specially customized for one ...
4
votes
2answers
800 views

Can neural networks be better than human experts at prediction of greyhound racing results?

Were there any studies which checked the accuracy of neural network predictions of greyhound racing results, compared to a human expert? Would it achieve a better payoff?
14
votes
2answers
442 views

How should I encode the structure of a neural network into a genome?

For a deterministic problem space, I need to find a neural network with the optimal node and link structure. I want to use a genetic algorithm to simulate many neural networks to find the best network ...
2
votes
1answer
169 views

What are the approaches to teach AI to how to render html page based on its source code?

I'm wondering, instead of implementing new web browsers over and over again with millions line of code which is very difficult to manage, would it be possible to use ANN or GA algorithm to teach it ...
3
votes
1answer
38 views

Research for misbehavior detection in WiFI networks

I'm looking for research which discusses misbehavior detection in public internet access networks using ANN approaches. So it can be used by ISP to detect suspicious users connected to their network.
1
vote
1answer
158 views

What are the minimum requirements to call something artificial neural network?

I've found this short Python code which implements neural network in 11 lines of code: ...
2
votes
1answer
789 views

Are there any machine learning techniques to detect coding standard violations?

Are there any machine learning techniques (such as deep learning or evolutionary algorithms) to detect coding standard violations? Which one would be more suitable? I don't have any specific ...
9
votes
2answers
152 views

How do evolutionary algorithms have advantages over the conventional backpropagation methods?

How does employing evolutionary algorithms to design and train artificial neural networks have advantages over using the conventional backpropagation algorithms?
2
votes
3answers
399 views

How exactly is the value of each node determined? Is it the same formula throughout the network?

When it comes to neural networks, it's often only explained what abstract task they do, say for example detect a number in an image. I never understood what's going on under the hood essentially. ...
17
votes
1answer
418 views

Could a Boltzmann machine store more patterns than a Hopfield net?

This is from a closed beta for AI, with this question being posted by user number 47. All credit to them. According to Wikipedia, Boltzmann machines can be seen as the stochastic, generative ...
7
votes
2answers
7k views

Which neural network has capabilities of sorting input?

I believe normally you can use genetic programming for sorting, however I'd like to check whether it's possible using ANN. Given the unsorted text data from input, which neural network is suitable ...
1
vote
1answer
177 views

How close we are to replacing guide dogs with AI?

Were there any successful attempts to replace poor guide dogs used for blind people with AI to achieve similar rate of success? I guess dogs could be easily distracted and not reliable for every ...
3
votes
2answers
108 views

How to separate image recognition from logic?

For example I would like to implement transparent AI in the RTS game which doesn't offer any AI API (like old games), and I'd like to use image recognition algorithm for detecting the objects which ...
88
votes
7answers
16k views

Do scientists know what is happening inside artificial neural networks?

Do scientists or research experts know from the kitchen what is happening inside complex "deep" neural network with at least millions of connections firing at an instant? Do they understand the ...
13
votes
2answers
205 views

Is there any artificial intelligence that possesses "concentration"?

Humans can do multiple tasks at the same (e.g. reading while listening to music), but we memorize information from less focused sources with worse efficiency than we do from our main focus or task. ...
14
votes
2answers
674 views

How can I automate the choice of the topology of a neural network for an arbitrary problem?

Assume that I want to solve an issue with a neural network that either I can't fit to already existing topologies (perceptron, Konohen, etc) or I'm simply not aware of the existence of those or I'm ...
9
votes
3answers
539 views

Is it beneficial to represent a neural net as a matrix?

A neural network is a directed weighted graph. These can be represented by a (sparse) matrix. Doing so can expose some elegant properties of the network. Is this technique beneficial for examining ...
6
votes
1answer
4k views

How to avoid falling into the "local minima" trap?

How do I avoid my gradient descent algorithm into falling into the "local minima" trap while backpropogating on my neural network? Are there any methods which help me avoid it?
3
votes
2answers
72 views

Is there a way to define the boundaries of the optimal size of a training set?

At a related question in Computer Science SE, a user told: Neural networks typically require a large training set. Is there a way to define the boundaries of the "optimal" size of a training set ...
3
votes
2answers
3k views

Can PHP be considered as a serious programming language for AI? [closed]

I read some information1 about attempts to build neural networks in the PHP programming language. Personally I think PHP is not the right language to do so at all probably because it's a high-level ...