1
$\begingroup$

What is the difference between T5 and T0 models? I had read that T0 is T5 + LM. But as I know T5 uses encoder-decoder model like BART but BART can be used as LM so that's mean that T5 has a LM function too. So what is the difference between T5 and T0 then?

$\endgroup$
1
  • $\begingroup$ Can you provide more context? Where did you find these terms? Provide a link. $\endgroup$
    – nbro
    Apr 13, 2023 at 20:01

1 Answer 1

2
$\begingroup$

T0 starts with T5+LM as the base model but then performs multi-task finetuning on it using BIG-Bench tasks. As detailed in the Results section (Section 6) of their paper, T0 outperforms T5+LM on a number of tasks.

$\endgroup$
1
  • $\begingroup$ But didn't T5 also train on multiple tasks? $\endgroup$
    – HappyFace
    Apr 28 at 0:46

You must log in to answer this question.

Not the answer you're looking for? Browse other questions tagged .