1
$\begingroup$

I have way more unlabeled data than labeled data. Therefore I would like to train an Autoencoder using MobileNetV2 as the encoder. Then I will use the pretrained model for the classification of the labeled data.

I think it is rather difficult to "invert" the MobileNet architecture to create a Decoder. Therefore, my question is: can I use a different architecture for the decoder, or will this introduce weird artifacts?

$\endgroup$
1
$\begingroup$

can I use a different architecture for the decoder, or will this introduce weird artifacts?

If you are using U-net -like architecture with skip connection from corresponding encoding to decoding layer outputs of corresponding layers should have the same spatial resolution. There is no other commonly recognized limitations on decoder architecture for convolutional networks.

$\endgroup$
  • $\begingroup$ So if I would like to add skip connection I just have to make sure the dimensions are corresponding? $\endgroup$ – oezguensi Jun 10 at 18:07
  • 1
    $\begingroup$ Yes, otherwise you will not be able to concatenate skip with output by channels, which is whole point of the skip connection $\endgroup$ – mirror2image Jun 10 at 19:50
1
$\begingroup$

Other replies are commenting on the skip connections for a U-Net. I believe you want to exclude these skip connections from your auto-encoder. You say you want to use the auto-encoder for unsupervised pretraining, for which you want to pass the data through a bottle neck, so adding skip connections would work against you if you want to use the encoder for a classification task.

You ask whether the decoder should 'mirror' the MobileNet encoder. This is actually an interesting one, and I think it could work even if the decoder does not look like the encoder at all. Since you don't need to (and in fact shouldn't) add skip connections, this should be easy to try.

$\endgroup$

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.