8 votes
Accepted

How can the discriminator determine the sample is fake or real?

In a GAN, the discriminator starts untrained, and the generator and discriminator are trained alongside each other. The process relies on neither being too strong for the other at any one stage, so ...
Neil Slater's user avatar
  • 31.7k
2 votes
Accepted

Is "The Dimpled Manifold Hypothesis" correct to say this about autoencoders?

The quote hangs on the definitions of "space" and "manifold". An example of a space might be the familiar 3D euclidean vector space, and an example of a manifold would be the ...
Neil Slater's user avatar
  • 31.7k
1 vote

How can I train AI to learn how to recognize highly impaired speech from a dystonic person?

This is typically done by supervised learning. Which begins with finding or gathering a corpus of annotated data representative of your problem. Then training an ML algorithm to minimize its loss ...
foreverska's user avatar
1 vote

How come all the multi-headed self-attention layers don't end up learning the same aspect of a natural language?

They all have different weight initializations. I think that the chance of gradient descent discovering the same local minima in such high dimensions is low.
JobHunter69's user avatar

Only top scored, non community-wiki answers of a minimum length are eligible