4
$\begingroup$

Can HMMs be used to model any time series data? Or does the data have to be that of a Markov process?

In HTK documentation, I see that the first few lines state that it can model any time series

HTK is a toolkit for building Hidden Markov Models (HMMs). HMMs can be used to model any time series and the core of HTK is similarly general-purpose.

Improve this question
$\endgroup$

2 Answers 2

Reset to default
1
$\begingroup$

Yes, you can fit any time series (with or without external variables) using HMM, but there are some constraints:

  1. It should follow the Markov property.
  2. There is some variance that other models are not able to capture (in other words, the system is partially observable).

Adding to point 1, for HMM, it should hold true, but the way Baum Welch algorithm works, indirectly it considers the values of more than the previous state for HMM (order-1). The state $t-1$ depends on $t-2$, which in turn depends on $t-3$. The calculation of parameters (transition, emission, starting probabilities) happens over multiple iterations and it finds parameters in such a way that holds Markov property true.

I think that, when they say 'any', they mean even when you don't have all variables needed to forecast future values.

Improve this answer
$\endgroup$
0
0
$\begingroup$

HMMs can be used to model sequential data, which is composed of discrete tokens, and it should generally follow the Markov property, which is the assumption that the probability of a class/label given observation depends only on the preceding class/label (rather than on some longer sequence).

Improve this answer
$\endgroup$
6
  • $\begingroup$ I'm sure this is not a valid answer. $\endgroup$
    – ABCD
    Aug 5, 2017 at 2:53
  • $\begingroup$ I think the intention of asking this question is get a conceptual definition of what kind of time series can be modeled. $\endgroup$
    – drw
    Aug 5, 2017 at 3:11
  • $\begingroup$ But time series is not Markov. Your answer doesn't answer the question wherther HMM can be used for non-Markov process. $\endgroup$
    – ABCD
    Aug 5, 2017 at 3:20
  • $\begingroup$ A process with the Markov property is a Markov process. The type of time series itself does not define whether it can be modeled with a Markov process. That is a hypothesis/assumption that is leveraged. $\endgroup$
    – drw
    Aug 5, 2017 at 3:31
  • $\begingroup$ @drwiner is right. My intention is to understand the topic at a conceptual level. So the statement I quoted is wrong? $\endgroup$
    – vinjk
    Aug 5, 2017 at 10:47

You must log in to answer this question.

Not the answer you're looking for? Browse other questions tagged .