K3可作为教师模型训练更小稠密模型

You can use K3 as a teacher model (with logits!) to train up smaller dense models.

It’s actually feasible even to use it to create a trillion token full pre and post training dataset for even better models.