0:57:52: Q1. Can you think of a reason why knowledge distillation is not doing as well here when there is label noise? ANS: If label is noisy to begin with, the trained model will be noisy as well. So the pseudo label generated by the teacher model will not be reliable.