The paper introduces EDGE-OPD, a novel approach to On-Policy Distillation that enhances the training of language models by effectively incorporating privileged context while minimizing adverse effects on general capabilities. This method demonstrates improved performance in learning target identities compared to existing techniques, indicating potential advancements in AI training methodologies.