Stack Exchange Network

Stack Exchange network consists of 174 Q&A communities including Stack Overflow, the largest, most trusted online community for developers to learn, share their knowledge, and build their careers.

Visit Stack Exchange

Questions tagged [neurons]

For questions about all aspects of a biological or artificial neuron.

2
votes
1answer
36 views

Is input normalization built-in into mammals sensory neurons?

The spectrum of human sensory inputs seems to fall within certain ranges suggesting normalization is built-in into biological NNs? It also adapts to circumstantial conditions, e.g. people living in a ...
3
votes
2answers
79 views

How do biological neurons weights get initialized?

When trying to map artificial neuronal models to biological facts it was not possible to find an answer regarding the biological justification of randomly initializing the weights. Perhaps this is ...
1
vote
0answers
11 views

Since there are different types of neurons in adjacent positions in the brain's arrays, should heterogeneous layers be developed?

Below is a taxonomy of neurons. Some of these types occur in different locations in the brain, but there are adjacent neurons of varying types with clearly functional type diversity in many parts of ...
1
vote
1answer
27 views

Neurological interpretation of LSTMs

I am searching for an Interpretation of LSTMs and recurrent neural Networks within Cognitive Neuroscience. Is there a mechanism in the human brain, that works analog to LSTMs? How does Long-term ...
1
vote
1answer
39 views

Maximum number of neurons in a layer given number of neurons in previous layer

Consider an extremely complicated feed-forward neural network training example but with no need of computational efficiency or limiting of processing time. What is the maximum number of hidden ...
7
votes
1answer
61 views

Are Modular Neural Networks more effective than large, monolithic networks at any tasks?

Modular/Multiple Neural networks (MNNs) revolve around training smaller, independent networks that can feed into each other or another higher network. In principle, the hierarchical organization ...
1
vote
0answers
41 views

How does the degree of neuronal realism affect computing in a deep learning scenario?

Neurons can be simulated using different models that vary in the degree of biophysical realism. When designing an artificial neuronal network, I am interested in the consequences of choosing a degree ...
6
votes
3answers
75 views

Realistic models of neurons and especially implications of Rosehip neurons?

Is there research that employs realistic models of neurons. Usually the model of neuron for neural network is quite simple as opposite the realistic neuron with involves hundreds of proteins and ...
2
votes
3answers
293 views

Are AI algorithms capable of self-repair?

Do AI algorithms exist which are capable of healing themselves or regenerating a hurt area when they detect so? For example: In humans if a certain part of brain gets hurt or removed, neighbouring ...
6
votes
3answers
123 views

How to model inhibitory synapses in the artificial neuron? [Biological inspiration]

In the brain some synapses are stimulating and some inhibiting. ReLu erases that property to only stimulating once, since in the brain inhibition doesn't mean 0 output, but more precisely - negative ...
4
votes
1answer
1k views

Do we know what the units of neural networks will do before we train them?

I apologize if this is a repeated question or if this is too simple. I was learning about back-propagation and looking at the algorithm there is no particular 'partiality' given to any unit. What I ...
7
votes
3answers
510 views

What makes animal brain so special?

So this is an introductory question. Whenever I read any book about Neural Nets or Machine Learning, their introductory chapter says that we haven't been able to replicate the brain's power due to its ...
3
votes
1answer
91 views

Spiking Neural Network Resources

I'm very interested in writing a Spiking Neural Network engine (SNN) from scratch, but I can't find the basic information I need to get started. For example, I've seen pictures of the individual ...
5
votes
1answer
221 views

Is the neuron adequately comprehended?

It is possible that the signal handling of a neuron is outside the engineering comprehension of the most astute of human brains, even after the relationships of inputs to outputs are statistically ...
1
vote
1answer
135 views

Comments on my proposed “Jitter” neuron

I have an application of neural networks (standard MLP architecture) where I want to forecast a tanh output (ranging from -1 to +1) with about 1500 input features in ~700 samples. Each sample ...
2
votes
1answer
48 views

Why expression of cost function divides by 2? [closed]

Here is formula for calculating cost value of single neuron: C_x = (1/2) * || y - a ||^2 why there is 1/2?
6
votes
1answer
295 views

How many nodes/hidden layers are required to solve a classification problem where the boundary is a sinusoidal function?

A single neuron is capable of forming a decision boundary between linearly seperable data. Is there any intuition as to how many, and in what configuration, would be necessary to correctly approximate ...
5
votes
5answers
3k views

When will the number of neurons in AI systems equal the human brain?

Based on fitting to historical data and extrapolation, when is it expected that the number of neurons in AI systems will equal those of the human brain? I'm interested in a possible direct ...
5
votes
1answer
189 views

What is the calcium equivalent role in neural networks

I understand that neural networks model biological neurons. Each node in the network represents a neuron cell and the connections between nodes represent the connections between cells. As in nature, ...
24
votes
4answers
772 views

How to find the optimal number of neurons per layer?

When you're writing your algorithm, how do you know how many neurons you need per single layer? Are there any methods for finding the optimal number of them, or is it a rule of thumb?