I wanted to implement a CNN but explore what happens when my first layer is Fully Connected. I still want to use convolutions of course but I wanted to apply them layer. I noticed that the input then losses its 3D structure. Does that mean I can only apply 1d convolutions after that? Is there a non-trivial way to recover the 3d structure so that 2d convolutions may be applied?

Hopefully when I reconstruct it to have 3d structure the 3d structure is somehow meaningful...

----

Cross posted:

- https://forums.fast.ai/t/how-do-i-recover-the-3d-structure-of-a-layer-after-a-fully-connected-layer-or-a-flatten-layer/52489
- https://discuss.pytorch.org/t/how-do-i-recover-the-3d-structure-of-a-layer-after-a-fully-connected-layer-or-a-flatten-layer/53313
- https://ai.stackexchange.com/questions/13950/how-do-i-recover-the-3d-structure-of-a-layer-after-a-fully-connected-layer