Questions tagged [alexnet]

For questions related to the convolutional neural network denoted as AlexNet, designed by Alex Krizhevsky (hence the name AlexNet), and published with Ilya Sutskever and Krizhevsky's doctoral advisor Geoffrey Hinton.

Filter by
Sorted by
Tagged with
0
votes
0answers
35 views

Why does the validation loss not go down when training my TensorFlow implementation of AlexNet?

I am trying to implement AlexNet in Tensorflow. Matlab has a built-in AlexNet implementation that I use with the cats and dogs dataset (mledu-datasets/cats_and_dogs_filtered.zip). In Matlab, ...
1
vote
1answer
166 views

Can the (sparse) categorical cross-entropy be greater than one?

I am using AlexNet CNN to classify my dataset which contains 10 classes and 1000 data for each class, with 60-30-10, splits for train, validation, and test. I used different batch sizes, learning ...
1
vote
0answers
37 views

What is the reason for different learned features in upper and lower half in AlexNet?

I was reading AlexNet paper and the authors quoted the kernels on one GPU were "largely color agnostic," whereas the kernels on the other GPU were largely "color-specific." The upper GPU takes ...
2
votes
1answer
41 views

What could cause a big fluctuation of the loss in the last epochs of training an AlexNet?

I am training an AlexNet neural network, with about 12000 images which 80% is for training, 10% is for validation and another 10% is for testing. I have a problem in my plots. There is a big ...
2
votes
1answer
207 views

Why am I getting a difference between training accuracy and accuracy calculated with Keras' predict_classes on a subset of the training data?

I'm trying to solve a binary classification problem with AlexNet. I split the original dataset into training and validation datasets using a 70/30 ratio. I have trained my neural network with a ...
2
votes
1answer
55 views

How is a neural network where the majority of inputs are 0 trained?

Consider AlexNet, which has 1000 output nodes, each of which classifies an image: The problem I have been having with training a neural network of similar proportions, is that it does what any ...
2
votes
2answers
168 views

Why do we need 10 bits to represent the 1000 classes in AlexNet?

I'm reading the AlexNet paper. In section 4, where the authors explain how they prevent overfitting, they mention Although the 1000 classes of ILSVRC make each training example impose 10 bits of ...
3
votes
0answers
135 views

How can I calculate the number of matrix additions, multiplications and divisions in AlexNet?

I'm a first-year student in machine learning and I really recently started to immerse myself. I need to calculate number of: matrix additions matrix multiplications matrix divisions which are ...