2 votes

Can a concept/feature be represented using more than one layer of a Neural Network?

You cannot reason in a mathematical way over features in my opinion, as they are not defined. However, you can think of deep neurons as a hierarchy of always more high level concepts, as observed in ...
Alberto's user avatar
  • 911
2 votes

Is it possible to reconstruct convolutional layers' input using transposed convolution?

Alexander has some great explanations above. After doing some more research myself I came up with some understandings as well. One interpretation of transposed convolution is that it can be seen as ...
Shawn Li's user avatar
  • 143
2 votes
Accepted

Is it possible to reconstruct convolutional layers' input using transposed convolution?

You're not able reconstruct convolutional layers' inputs using transposed convolutions (in most cases). The term invert is a bit confusing here -- I interpret this to mean inverting the space of ...
Alexander Wan's user avatar
2 votes

How translation invariance is achieved in CNNs?

Take a vector: $V_1 = [v_1, v_2, ..., v_n]$ Calculate the max: $m_1 = \max V_1 = v_i$ Shuffle the vector: $V_2 = mix(V_1)$ Calculate the max: $m_2 = \max V_2 = v_j$ The only possible outcome is that $...
Alberto's user avatar
  • 911
2 votes

Temporally Non-Aware RNN

Listen, this is not an answer to your question, but it seems that you are missing the whole point of convolution. Simplified explanation: Convolution is just a weighted sum of the neighbors of a pixel ...
Alberto's user avatar
  • 911
1 vote
Accepted

What is the best lightweight alternative to VGG16 for image fingerprinting?

If you are looking for lightweights architecture, take a look at backbones designed for mobile such as MobileNet V3 or GhostNet V2 .
Lelouch's user avatar
  • 126
1 vote

When training a CNN, what are the hyperparameters to tune first?

It depends a lot on what type of architecture you are using. However, most of the standard architectures are quite stable and there is no need for much hypreparameter tuning. Choose whether you want ...
pi-tau's user avatar
  • 600
1 vote

Image segmentation with varying resolution

Usually the solution would be just to add padding, and use a model that is trained to handle padding. In other words, fix a resolution, and then downscale the image you are handling to fit in that ...
Alberto's user avatar
  • 911
1 vote

How translation invariance is achieved in CNNs?

When you apply a convolutional layer to an image $x$, you obtain a certain list of values: $$h_1(x), h_2(x), h_3(x), ..., h_n(x) \tag 1$$ where each $h_i$ is just the function that applies the ...
Jack M's user avatar
  • 242

Only top scored, non community-wiki answers of a minimum length are eligible