Are you considering performing distillation experiments on the qwen70b model?
#2
by
lambda1989 - opened
Compared to the 7B and 32B distill-models, larger models generally perform better. Looking forward to the experimental results on the 72B model.