Multi-Layer Perceptron (MLP), Deep AutoEncoder (DAE), and Deep Belief Network (DBN) are trained differently.
However, do they follow the same process during the inference phase, i.e., do they calculate a weighted sum, then apply a non-linear activation function, for each layer until the last layer, or is there any difference? Moreover, are they only composed of fully connected layers?