Abstract: In order to solve the confusion of knowledge types transferred by teacher models in the knowledge distillation process and alleviate the learning ability gap between teacher and student ...