Return to Question

I get the part from the paper where the image is split into P say 16x16 (smaller images) patches and then you have to Flatten the 3-D (16,16,3) patch to pass it into a Linear layer to get what they call "Liner Projection". After passing from the Linear layer, the patches will be vectors but with some "meaning" to them.

Can someone please explain how the two types of embeddings are working?

I visited this implementation on github, looked at the code too and looked like a maze to me.

If someone could just explain how these embeddings are working in laymen's terms, I'll look at the code again and understand.

I get the part from the paper where the image is split into P say 16x16 (smaller images) patches and then you have to Flatten the 3-D (16,16,3) patch to pass it into a Linear layer to get what they call "Liner Projection". After passing from the Linear layer, the patches will be vectors but with some "meaning" to them.

Can someone please explain how the two types of embeddings are working?

I visited this implementation on github, looked at the code too and looked like a maze to me.

If someone could just explain how these embeddings are working in laymen's terms, I'll look at the code again and understand.

I get the part from the paper where the image is split into P say 16x16 (smaller images) patches and then you have to Flatten the 3-D (16,16,3) patch to pass it into a Linear layer to get what they call "Liner Projection". After passing from the Linear layer, the patches will be vectors but with some "meaning" to them.

Can someone please explain how the two types of embeddings are working?

I visited this implementation on github, looked at the code too and looked like a maze to me.

If someone could just explain how these embeddings are working in laymen's terms, I'll look at the code again and understand.

I get the part from the paper where the image is split into P say 16x16 (smaller images) patches and then you have to Flatten the 3-D (16,16,3) patch to pass it into a Linear layer to get what they call "Liner Projection". After passing from the Linear layer, the patches will be vectors but with some "meaning" to them.

Can someone please explain how the two types of embeddings are working?

I visited this implementation on github, looked at the code too and looked like a maze to me.

If someone could just explain how these embeddings are working in laymen's terms, I'll look at the code again and understand.

I get the part from paper where image is split into P say 16x16 (smaller images) patches and then you have to Flatten the 3-D (16,16,3) patch to pass it into a Linear layer to get what they call Liner Projection. After passing from the Linear layer, the patches will be vectors but with some MEANING to them. Can someone please explain how the two types of embeddings are working? The visited this implementation on github, looked at the code too and looked like a maze to me. If someone could just explain how these embeddings are working in laymen's terms, I'll look at the code again and understand.

I get the part from the paper where the image is split into P say 16x16 (smaller images) patches and then you have to Flatten the 3-D (16,16,3) patch to pass it into a Linear layer to get what they call "Liner Projection". After passing from the Linear layer, the patches will be vectors but with some "meaning" to them. 

Can someone please explain how the two types of embeddings are working?

I visited this implementation on github, looked at the code too and looked like a maze to me. 

If someone could just explain how these embeddings are working in laymen's terms, I'll look at the code again and understand.