1
$\begingroup$

Is it possible and how trivial (or not) might it be (if possible) to retrain GPT-2 on time-series data instead of text?

Improve this question
$\endgroup$

1 Answer 1

Reset to default
1
$\begingroup$

Definitely! but at that point it would be training a transformer-encoder (gpt2's architecture) and not GPT2 because GPT2 is defined by the weights / training procedure / data it was trained and not the architecture, and I don't think it would transfer properly to time series.

Improve this answer
$\endgroup$

You must log in to answer this question.

Not the answer you're looking for? Browse other questions tagged .