I'll answer in a couple of stages.
I feel somewhat lost as to what the input for the NN should look like.
Your choices boil down to two options, each with their own multitude of variants:
Vector Representation: Your input is a vector of the same size as your vocabulary where the elements represent the tokens in the input example. The most basic version of ...