You take any blog or any example and all they tell you about is the given picture below.
It has 4 different matrices and 3 of whose weights are shared. So, I'm wondering how is this achieved in practice?
Please correct me:
I think the first word "hello" goes in as a one-hot encoded form and changes the Hidden matrix. And then after it, "world" goes and gets multiplied and then changes the matrix again and so on. What people make it look like is that all of the words going are in Parallel. It can't be the case because the Hidden matrix is dependent on the previous word and without changing the matric, you can not pass the current word. Please correct if my idea is wrong but I think the execution is in sequential order.