Questions tagged [artificial-neuron]
For questions about what constitutes an artificial neuron and how artificial neurons can be utilized as part of a neural network.
-1
votes
0answers
20 views
Set model weights to preset tensor with torch
I am attempting to train a torch model with neuro-evolution. I cannot seem to be able to set weights of a model to a preset tensor. I am able to:
Assign weights based on random values,
...
0
votes
0answers
16 views
What is the highest number of Hardware Neurons implemented?
The hardware-based Neural Networks seem to be a way to solve the lack of efficiency for massive data classification, pattern recognition and AI.
So, at the moment, What is the maximum number of ...
0
votes
1answer
18 views
How to decide which model have to use? Simple vs Complex
I have come across the question simple model vs complex model. How to decide which one have to use? and one more question connect to this. How to decide which is a ...
2
votes
1answer
36 views
Is input normalization built-in into mammals sensory neurons?
The spectrum of human sensory inputs seems to fall within certain ranges suggesting normalization is built-in into biological NNs?
It also adapts to circumstantial conditions, e.g. people living in a ...
3
votes
2answers
79 views
How do biological neurons weights get initialized?
When trying to map artificial neuronal models to biological facts it was not possible to find an answer regarding the biological justification of randomly initializing the weights.
Perhaps this is ...
1
vote
1answer
129 views
Would this formula be relevant to the field of A.I?
Background
My understanding is the input neurons seem to seem to compute a weighted sum moving from one layer to another.
$$ \sum_i a_i w_i = a'_{k} $$
But to compute this weighted sum the sum ...
1
vote
0answers
11 views
Since there are different types of neurons in adjacent positions in the brain's arrays, should heterogeneous layers be developed?
Below is a taxonomy of neurons. Some of these types occur in different locations in the brain, but there are adjacent neurons of varying types with clearly functional type diversity in many parts of ...
1
vote
0answers
16 views
neuralnetworksanddeeplearning.com chapter 5 problems
For http://neuralnetworksanddeeplearning.com/chap5.html , could anyone suggest:
1) how to approach the derivation of expression (123) ?
2) what constitutes value ~ 0.45 ?
3) why the need of taylor ...
-1
votes
0answers
23 views
What is local consistency? Explain different types
What is local consistency?
Explain different types used in AI, with the help of Sudoku example.
Node
Arc
Path
k
Global
Please provide detail.
1
vote
1answer
27 views
Neurological interpretation of LSTMs
I am searching for an Interpretation of LSTMs and recurrent neural
Networks within Cognitive Neuroscience.
Is there a mechanism in the human brain, that works analog to LSTMs?
How does Long-term ...
1
vote
0answers
41 views
How does the degree of neuronal realism affect computing in a deep learning scenario?
Neurons can be simulated using different models that vary in the degree of biophysical realism. When designing an artificial neuronal network, I am interested in the consequences of choosing a degree ...
6
votes
3answers
75 views
Realistic models of neurons and especially implications of Rosehip neurons?
Is there research that employs realistic models of neurons. Usually the model of neuron for neural network is quite simple as opposite the realistic neuron with involves hundreds of proteins and ...
6
votes
3answers
123 views
How to model inhibitory synapses in the artificial neuron? [Biological inspiration]
In the brain some synapses are stimulating and some inhibiting. ReLu erases that property to only stimulating once, since in the brain inhibition doesn't mean 0 output, but more precisely - negative ...
5
votes
2answers
125 views
What do neural connection weights represent 'conceptually'?
I understand how Neural Networks work and have studied its theory well. My question is at the intricacies of Deep Neural networks and perhaps is a bit beyond common understanding (as I have been told (...
6
votes
1answer
608 views
Meaning of evaluation metrics in Tensorflow
I am pretty much a beginner in Tensorflow and simply follow a tutorial. There is no problem with my code, but I have a question regarding the output
...
1
vote
0answers
24 views
Feature set out of grayscale Images for training a neural network?
Previously I had trained a Neural Networkupon 20,000 character images. This Neural Net generally works well, it uses ...
4
votes
1answer
117 views
Back-of-the-envelope machine learning (specifically Neural-Network) calculations
I'm a mechanical engineer by training, so please forgive my ignorance in this area.
There is a popular story regarding the back-of-the-envelope calculation performed by a British physicist named G. I....
2
votes
3answers
172 views
Can't find papers about Limitations of NN
Please if you know good research about limitations of neural network give me a link. There are a lot papers about expressive power of neural networks but I need researches about limitations. I know ...
0
votes
2answers
51 views
Is understanding value for different features next step for object recognition?
Once the artificially intelligent machines are able to identify objects, we might want to teach them how to value different things differently based on their utility, demand, life, etc. How can we ...
0
votes
1answer
165 views
Planning a Neural Network
I'm trying to understand how to effectively plan and write a Neural Network but running into problems with understanding how they should be written. I'm working with classification with writing a ...
3
votes
4answers
100 views
Could a large number of interconnected tiny turing-complete computer chips be patterned across a wafer to simulate a programmable neural network?
The Intel 8080 had 4500 transistors and ran at 2-3.125 MHz. By comparison, the 18-core Xeon Haswell-E5 han 5,560,000,000 transistors and can run at 2 GHz. Would it be possible or prudent to simulate a ...
1
vote
0answers
19 views
The ANN is based on cognitrons
I'm trying to understand how to build the ANN on cognitrons, so I have read theory for that topic and found the scheme:
As I got neurons are subdivided in two classes: the exciting and the inhibitory....
-1
votes
1answer
59 views
Text Capturing on the Images
I want to capture text and letters on images (png, jpeg, etc.). Is it Possible Which algorithm/software can I use?
Right now I am using R with the ...
1
vote
2answers
168 views
Why do we need weights when training a perceptron as an OR gate?
Without using any of Matlab's neural network tools, I'm writing a program to simulate an OR gate with a perceptron. I have seen many tutorials, but I still can't understand why we need weights to ...
2
votes
1answer
89 views
What is the difference between Encoders and Auto-encoders in Deep Learning?
How are the layers in a encoder connected across the network for normal encoders and Auto-encoders in deep neural networks
15
votes
2answers
5k views
Is it possible to train Neural Network incrementally?
I am fairly new to Neural Networks and have a requirement where the output classes are not defined from the start.
More and more classes will be introduced later on based on incoming data.
This ...
5
votes
1answer
221 views
Is the neuron adequately comprehended?
It is possible that the signal handling of a neuron is outside the engineering comprehension of the most astute of human brains, even after the relationships of inputs to outputs are statistically ...
3
votes
2answers
74 views
Different Suggestion for Estimating Number of layers in Neural Network
In this note Justin Domke says that
In practice, neural networks seem to usually find a reasonable solution when the number of layers is not too large, but find poor solutions when using more than, ...
1
vote
1answer
65 views
debugging perceptron for digital AND circuit
I was trying to code a single layer perceptron to understand binary AND:
1 1 1
0 1 0
1 0 0
0 0 0
I made up this code
...
9
votes
2answers
198 views
Are biological neurons organized in consecutive layers as well?
I'm now reading a book titled Hands-On Machine Learning with Scikit-Learn and TensorFlow and in the Chapter 10 of the book, the author writes the following:
The architecture of biological neural ...
-1
votes
1answer
82 views
Neural Network training
I was trying to build an OCR system and heard about ANNs. I am weak at mathematics and statistics and couldn't stick up to reading those massive mathematical documents (research papers or ANN related ...
2
votes
1answer
48 views
Why expression of cost function divides by 2? [closed]
Here is formula for calculating cost value of single neuron:
C_x = (1/2) * || y - a ||^2
why there is 1/2?
2
votes
1answer
37 views
Hardware immutability and sentience
Hardware comes in two forms, basically: immutable, such as RAM, and mutable, such as FPGAs.
In animals, neurological connections gain in strength by changing the physical structure of the brain. This ...
1
vote
2answers
359 views
Neural Network learning to play Connect 4
I want to make a Connect 4 AI using machine learning but I'm a complete beginner to the topic. From what I've seen an ANN is the way to go; some phrases I've heard are "neuroevolution" and the acronym ...
2
votes
1answer
58 views
Backpropagation in Decoupled Neural Interfaces
I am attempting to create a fully decoupled feed-forward neural network by using decoupled neural interfaces as explained in the paper (https://arxiv.org/abs/1608.05343). As in the paper, the DNI is ...
6
votes
1answer
295 views
How many nodes/hidden layers are required to solve a classification problem where the boundary is a sinusoidal function?
A single neuron is capable of forming a decision boundary between linearly seperable data. Is there any intuition as to how many, and in what configuration, would be necessary to correctly approximate ...
5
votes
3answers
132 views
Which ANN can mimic biological neurons the most?
On the Wikipedia page we can read the basic structure of an artificial neuron (a model of biological neurons) which consist:
Dendrites - acts as the input vector,
Soma - acts as the summation ...
