0
$\begingroup$

What is the difference between T5 and T0 models? I had read that T0 is T5 + LM. But as I know T5 uses encoder-decoder model like BART but BART can be used as LM so that's mean that T5 has a LM function too. So what is the difference between T5 and T0 then?

Improve this question
$\endgroup$
1
  • $\begingroup$ Can you provide more context? Where did you find these terms? Provide a link. $\endgroup$
    – nbro
    Apr 13 at 20:01

1 Answer 1

Reset to default
2
$\begingroup$

T0 starts with T5+LM as the base model but then performs multi-task finetuning on it using BIG-Bench tasks. As detailed in the Results section (Section 6) of their paper, T0 outperforms T5+LM on a number of tasks.

Improve this answer
$\endgroup$

You must log in to answer this question.

Not the answer you're looking for? Browse other questions tagged .