0
$\begingroup$

I am currently working on an autoencoder that connect two images. The first one can be seen as the electron flow and the second one is the electrostatic potential seen by the electrons. Long story short, the neural network connects those pairs of images that are very different but related by physical law. I have already something working, but I have a hard time trying to find similar kinds of application of neural networks. Most of the time an autoencoder connect images that are very similar (denoising for example). My two questions are the following:

  1. Are you aware of other similar application of autoencoder?

  2. What methods can I use to explain the working procedure of my neural networks? (In the literature the methods concerne mainly classification tasks.)

Improve this question
$\endgroup$
4
  • $\begingroup$ It's not really an autoencoder if the output is expected to be different to the input. What you appear to have is an image-to-image function, and I guess the only "auto" part is that you have some other reliable method of calculating the output from the input as opposed to measuring it for a dataset? The architecture can be very similar to an autoencoder of course. Maybe look up image encoder/decoder architectures, because there are many similar applications IMO. $\endgroup$
    – Neil Slater
    Mar 16, 2022 at 11:51
  • $\begingroup$ Thank you for your answer. Indeed, I am looking for an image-to-image function. It might be a stupid question, but I don't know the difference the architecture of an autoencoder and an encoder-decoder. Is there a well defined difference between them? $\endgroup$
    – Gaetan Percebois
    Mar 17, 2022 at 9:22
  • $\begingroup$ There isn't really a clear architecture difference. The difference is the training process and the eventual role that the network components will take. You may prefer an architecture without a bottleneck in your case, making it less like an autoencoder (because there will not be a compressed "embedding" vector in the middle layer). But that depends on how many degrees of freedom are in the input $\endgroup$
    – Neil Slater
    Mar 17, 2022 at 9:30
  • $\begingroup$ I see what mean, thank you for the clear explanation. I will take this difference into account. Are you aware of application of such encoder decoder architecture? Because so far I didn't find any image to image neural network in the case of the input images is very different of the output image $\endgroup$
    – Gaetan Percebois
    Mar 17, 2022 at 9:43

1 Answer 1

Reset to default
0
$\begingroup$

If I understand correctly, you are looking for the image-to-image translation method. For example take a look at pix2pix GAN (pub) - very cool idea of cGAN application. You can also look for U-NET type networks (encoder-decoder). In my opinion autoencoder will not work for this application.

Improve this answer
$\endgroup$
3
  • $\begingroup$ Thank you for your answer. Indeed the pix2pix GAN would be useful for my project and is actually my current project. I've never heard about IMO autoencoder, what is it ? Are you also aware explainable machine learning methods for this kind of neural network? It would be very useful for my project to see the working procedure of my neural network. $\endgroup$
    – Gaetan Percebois
    Mar 17, 2022 at 9:14
  • $\begingroup$ Sorry, IMO = in my opinion :) Just edited the answer. Take a look at this tutorial for tensorflow. $\endgroup$
    – Slawomir Orlowski
    Mar 17, 2022 at 10:19
  • $\begingroup$ Thank you for the ref :) $\endgroup$
    – Gaetan Percebois
    Mar 17, 2022 at 13:03

You must log in to answer this question.

Not the answer you're looking for? Browse other questions tagged .