I'm learning HMMs and decided to model a problem for learning purposes. I came to this idea of word predicting by letters. here is the model :
while typing, the word is typed letter by letter, so we can consider them as series of observations. let's say we have just 4 words in our database:
and we want to predict the word after 1,2 or 3 written letters.
we have to define states and HMM parameters (state transitions, emissions and priors).
our [hidden ?] states would be :
- [ ][ ][ ][ ][ ][ ][ ] : no observations. I chose 7 [ ] because of the longest word
- T [ ][ ][ ][ ][ ][ ]
- T A [ ][ ][ ][ ][ ]
- T R [ ][ ][ ][ ][ ]
- … .
and we have to learn the transition probabilities of each state pairs (the pairs which come after each other like T,TR and TA. but not for TA and TR).
our prior probabilities are 1/3 because we have 3 words. but we may change it by learning which word is used more frequently.
Now, I have these questions :
- is HMM suitable for this kind of problem ?
- are my assumptions (about states and prior probabilities) correct ?
- the states get out of hand when the word count increases. making the model very complex. is that deduction true?
- how the emission probabilities are defined in this model ?
- what do I miss in case of parameters or definitions ?
I'm a new contributor, be nice to me. regards :)