{"version":2,"relationshipURLBase":"https://codingai-lec03.pages.dev/course/notebook-blocks/7044913259924763a3b29542e91fbca8.html","relationshipResolution":"Resolve relative relationship URLs against relationshipURLBase; complete records and absolute URLs are in blocks.","title":"已完成的基准运行","url":"https://codingai-lec03.pages.dev/course/notebook-blocks/7044913259924763a3b29542e91fbca8.html","markdown":"https://codingai-lec03.pages.dev/course/notebook-blocks/7044913259924763a3b29542e91fbca8.md","pages":[{"id":"reading-opening","title":"已完成的基准运行","unit":"已完成的基准运行","unitId":"notebook-blocks/7044913259924763a3b29542e91fbca8","chapter":"course","number":1}],"aliases":[{"oldId":"b-63178adbeaa633f1a226366e","targetId":"b-63178adbeaa633f1a226366e","page":"reading-opening","operation":"move","beforeSHA256":"240987f980b4a53ac418e6004e5b09a1427e175defab161f632e2874969ccbbc","afterSHA256":"240987f980b4a53ac418e6004e5b09a1427e175defab161f632e2874969ccbbc","reason":"Same source body in authored semantic page"},{"oldId":"b-b68f7cb908ec07ca0ab3bad0","targetId":"b-b68f7cb908ec07ca0ab3bad0","page":"reading-opening","operation":"move","beforeSHA256":"df59d9871785071deb873318b969cc57ce28ffe45bd54f15ad7033797e91e17f","afterSHA256":"df59d9871785071deb873318b969cc57ce28ffe45bd54f15ad7033797e91e17f","reason":"Same source body in authored semantic page"},{"oldId":"b-dbfdb1dde690c0bf51bb8dc3","targetId":"b-dbfdb1dde690c0bf51bb8dc3","page":"reading-opening","operation":"move","beforeSHA256":"e91f24e4e4ca40e2099a0d81d30db6568f4bf2074b499eeee6e3959617bd97ac","afterSHA256":"e91f24e4e4ca40e2099a0d81d30db6568f4bf2074b499eeee6e3959617bd97ac","reason":"Same source body in authored semantic page"},{"oldId":"b-650b182dc4b7fbff66247384","targetId":"b-650b182dc4b7fbff66247384","page":"reading-opening","operation":"move","beforeSHA256":"d73c8f62c157be8969593eee5f2f87679b08c3feb70e7a286a688663a6b7df5d","afterSHA256":"d73c8f62c157be8969593eee5f2f87679b08c3feb70e7a286a688663a6b7df5d","reason":"Same source body in authored semantic page"},{"oldId":"b-2adc33b1fd4f9d2eeffaa32d","targetId":"b-2adc33b1fd4f9d2eeffaa32d","page":"reading-opening","operation":"move","beforeSHA256":"70efe3096d536ddf0d6f0f7335815da85d73017a47a0e52cac5d2621805a3c53","afterSHA256":"70efe3096d536ddf0d6f0f7335815da85d73017a47a0e52cac5d2621805a3c53","reason":"Same source body in authored semantic page"},{"oldId":"b-7ba05b7ad7a62653202f377c","targetId":"b-7ba05b7ad7a62653202f377c","page":"reading-opening","operation":"move","beforeSHA256":"ff4e2caa2efcd2a7e24e155ecad4f46e58bf2f1bb641ebcf47707b657cc53d56","afterSHA256":"ff4e2caa2efcd2a7e24e155ecad4f46e58bf2f1bb641ebcf47707b657cc53d56","reason":"Same source body in authored semantic page"},{"oldId":"b-c75eb23530890f7c8a693bf2","targetId":"b-c75eb23530890f7c8a693bf2","page":"reading-opening","operation":"move","beforeSHA256":"13e29b78b8d0a1f4f050e2921be6922b57a1ce33eb2476ef38cb073de50ae730","afterSHA256":"13e29b78b8d0a1f4f050e2921be6922b57a1ce33eb2476ef38cb073de50ae730","reason":"Same source body in authored semantic page"},{"oldId":"b-977a2eda780b88cc3c0f2d4c","targetId":"b-977a2eda780b88cc3c0f2d4c","page":"reading-opening","operation":"move","beforeSHA256":"14189f16ad31f6c007e850d7f40b9ec49763f1b096690f95039e3e8cb55b7c2c","afterSHA256":"14189f16ad31f6c007e850d7f40b9ec49763f1b096690f95039e3e8cb55b7c2c","reason":"Same source body in authored semantic page"},{"oldId":"b-7efc1f009221f4380c75d8af","targetId":"b-7efc1f009221f4380c75d8af","page":"reading-opening","operation":"move","beforeSHA256":"edc6493162bad77efc1c2b2dcb5b0d275aefb6a0fd1ed97313d5e1201d128242","afterSHA256":"edc6493162bad77efc1c2b2dcb5b0d275aefb6a0fd1ed97313d5e1201d128242","reason":"Same source body in authored semantic page"},{"oldId":"block-7044913259924763a3b29542e91fbca8--已完成的基准运行","targetId":"b-2adc33b1fd4f9d2eeffaa32d","operation":"retain-source-identity"}],"blocks":[{"id":"b-63178adbeaa633f1a226366e","type":"p","scope":"document","url":"https://codingai-lec03.pages.dev/course/notebook-blocks/7044913259924763a3b29542e91fbca8.html#b-63178adbeaa633f1a226366e","content":"[LAB 17 · 软目标与坍塌：三个数值检查](/course/notebooks/268a4ab11b464c64b065f9fc12b19cc7.html)","sha256":"240987f980b4a53ac418e6004e5b09a1427e175defab161f632e2874969ccbbc","chapter":{"id":"course","title":"已完成的基准运行"},"unit":{"id":"notebook-blocks/7044913259924763a3b29542e91fbca8","title":"已完成的基准运行"},"page":{"id":"reading-opening","title":"已完成的基准运行","number":1},"sectionTitle":"已完成的基准运行","currentQuestion":"已完成的基准运行","sourceSlides":[],"knowledgeBlock":null,"formulas":[],"previousBlock":null,"nextBlock":"b-b68f7cb908ec07ca0ab3bad0","prerequisites":[],"relatedBlocks":[]},{"id":"b-b68f7cb908ec07ca0ab3bad0","type":"h1","scope":"document","url":"https://codingai-lec03.pages.dev/course/notebook-blocks/7044913259924763a3b29542e91fbca8.html#b-b68f7cb908ec07ca0ab3bad0","content":"# 已完成的基准运行","sha256":"df59d9871785071deb873318b969cc57ce28ffe45bd54f15ad7033797e91e17f","chapter":{"id":"course","title":"已完成的基准运行"},"unit":{"id":"notebook-blocks/7044913259924763a3b29542e91fbca8","title":"已完成的基准运行"},"page":{"id":"reading-opening","title":"已完成的基准运行","number":1},"sectionTitle":"已完成的基准运行","currentQuestion":"已完成的基准运行","sourceSlides":[],"knowledgeBlock":null,"formulas":[],"previousBlock":"b-63178adbeaa633f1a226366e","nextBlock":"b-dbfdb1dde690c0bf51bb8dc3","prerequisites":[{"id":"b-63178adbeaa633f1a226366e","url":"#b-63178adbeaa633f1a226366e","role":"problem-context"}],"relatedBlocks":[]},{"id":"b-dbfdb1dde690c0bf51bb8dc3","type":"p","scope":"document","url":"https://codingai-lec03.pages.dev/course/notebook-blocks/7044913259924763a3b29542e91fbca8.html#b-dbfdb1dde690c0bf51bb8dc3","content":"按问题继续","sha256":"e91f24e4e4ca40e2099a0d81d30db6568f4bf2074b499eeee6e3959617bd97ac","chapter":{"id":"course","title":"已完成的基准运行"},"unit":{"id":"notebook-blocks/7044913259924763a3b29542e91fbca8","title":"已完成的基准运行"},"page":{"id":"reading-opening","title":"已完成的基准运行","number":1},"sectionTitle":"已完成的基准运行","currentQuestion":"已完成的基准运行","sourceSlides":[],"knowledgeBlock":null,"formulas":[],"previousBlock":"b-b68f7cb908ec07ca0ab3bad0","nextBlock":"b-650b182dc4b7fbff66247384","prerequisites":[{"id":"b-b68f7cb908ec07ca0ab3bad0","url":"#b-b68f7cb908ec07ca0ab3bad0","role":"section-title"},{"id":"b-63178adbeaa633f1a226366e","url":"#b-63178adbeaa633f1a226366e","role":"problem-context"}],"relatedBlocks":[]},{"id":"b-650b182dc4b7fbff66247384","type":"p","scope":"document","url":"https://codingai-lec03.pages.dev/course/notebook-blocks/7044913259924763a3b29542e91fbca8.html#b-650b182dc4b7fbff66247384","content":"常数坍塌反例、固定教师KL学习及单独EMA计算","sha256":"d73c8f62c157be8969593eee5f2f87679b08c3feb70e7a286a688663a6b7df5d","chapter":{"id":"course","title":"已完成的基准运行"},"unit":{"id":"notebook-blocks/7044913259924763a3b29542e91fbca8","title":"已完成的基准运行"},"page":{"id":"reading-opening","title":"已完成的基准运行","number":1},"sectionTitle":"已完成的基准运行","currentQuestion":"已完成的基准运行","sourceSlides":[],"knowledgeBlock":null,"formulas":[],"previousBlock":"b-dbfdb1dde690c0bf51bb8dc3","nextBlock":"b-2adc33b1fd4f9d2eeffaa32d","prerequisites":[{"id":"b-b68f7cb908ec07ca0ab3bad0","url":"#b-b68f7cb908ec07ca0ab3bad0","role":"section-title"},{"id":"b-63178adbeaa633f1a226366e","url":"#b-63178adbeaa633f1a226366e","role":"problem-context"}],"relatedBlocks":[]},{"id":"b-2adc33b1fd4f9d2eeffaa32d","type":"h2","scope":"document","url":"https://codingai-lec03.pages.dev/course/notebook-blocks/7044913259924763a3b29542e91fbca8.html#b-2adc33b1fd4f9d2eeffaa32d","content":"## 已完成的基准运行","sha256":"70efe3096d536ddf0d6f0f7335815da85d73017a47a0e52cac5d2621805a3c53","chapter":{"id":"course","title":"已完成的基准运行"},"unit":{"id":"notebook-blocks/7044913259924763a3b29542e91fbca8","title":"已完成的基准运行"},"page":{"id":"reading-opening","title":"已完成的基准运行","number":1},"sectionTitle":"已完成的基准运行","currentQuestion":"已完成的基准运行","sourceSlides":[],"knowledgeBlock":null,"formulas":[],"previousBlock":"b-650b182dc4b7fbff66247384","nextBlock":"b-7ba05b7ad7a62653202f377c","prerequisites":[{"id":"b-b68f7cb908ec07ca0ab3bad0","url":"#b-b68f7cb908ec07ca0ab3bad0","role":"section-title"},{"id":"b-63178adbeaa633f1a226366e","url":"#b-63178adbeaa633f1a226366e","role":"problem-context"}],"relatedBlocks":[]},{"id":"b-7ba05b7ad7a62653202f377c","type":"p","scope":"document","url":"https://codingai-lec03.pages.dev/course/notebook-blocks/7044913259924763a3b29542e91fbca8.html#b-7ba05b7ad7a62653202f377c","content":"以下是本轮本地独立 Python 进程的实际标准输出，云端执行另行记录。","sha256":"ff4e2caa2efcd2a7e24e155ecad4f46e58bf2f1bb641ebcf47707b657cc53d56","chapter":{"id":"course","title":"已完成的基准运行"},"unit":{"id":"notebook-blocks/7044913259924763a3b29542e91fbca8","title":"已完成的基准运行"},"page":{"id":"reading-opening","title":"已完成的基准运行","number":1},"sectionTitle":"已完成的基准运行","currentQuestion":"已完成的基准运行","sourceSlides":[],"knowledgeBlock":null,"formulas":[],"previousBlock":"b-2adc33b1fd4f9d2eeffaa32d","nextBlock":"b-c75eb23530890f7c8a693bf2","prerequisites":[{"id":"b-2adc33b1fd4f9d2eeffaa32d","url":"#b-2adc33b1fd4f9d2eeffaa32d","role":"section-title"},{"id":"b-63178adbeaa633f1a226366e","url":"#b-63178adbeaa633f1a226366e","role":"problem-context"}],"relatedBlocks":[]},{"id":"b-c75eb23530890f7c8a693bf2","type":"pre","scope":"document","url":"https://codingai-lec03.pages.dev/course/notebook-blocks/7044913259924763a3b29542e91fbca8.html#b-c75eb23530890f7c8a693bf2","content":"```\nheldout teacher/student KL 0.24742 -> 1e-05\ncollapsed consistency loss 0.0 variance [0.0, 0.0, 0.0, 0.0]\nnoncollapsed variance [1.239, 0.712, 1.084, 1.199]\n3 EMA updates preserve factor 0.271 of fixed student parameters\ntemperature teacher probabilities [[0.6285, 0.2312, 0.1402]]\n\n```","sha256":"13e29b78b8d0a1f4f050e2921be6922b57a1ce33eb2476ef38cb073de50ae730","chapter":{"id":"course","title":"已完成的基准运行"},"unit":{"id":"notebook-blocks/7044913259924763a3b29542e91fbca8","title":"已完成的基准运行"},"page":{"id":"reading-opening","title":"已完成的基准运行","number":1},"sectionTitle":"已完成的基准运行","currentQuestion":"已完成的基准运行","sourceSlides":[],"knowledgeBlock":null,"formulas":[],"previousBlock":"b-7ba05b7ad7a62653202f377c","nextBlock":"b-977a2eda780b88cc3c0f2d4c","prerequisites":[{"id":"b-2adc33b1fd4f9d2eeffaa32d","url":"#b-2adc33b1fd4f9d2eeffaa32d","role":"section-title"},{"id":"b-63178adbeaa633f1a226366e","url":"#b-63178adbeaa633f1a226366e","role":"problem-context"}],"relatedBlocks":[]},{"id":"b-977a2eda780b88cc3c0f2d4c","type":"p","scope":"document","url":"https://codingai-lec03.pages.dev/course/notebook-blocks/7044913259924763a3b29542e91fbca8.html#b-977a2eda780b88cc3c0f2d4c","content":"保留集 KL 降低表示学生更接近这个教师的概率分布；不能据此宣称视觉迁移更好。增大温度让非最大类别得到更多质量，也会改变梯度尺度；正式蒸馏常乘 T² 补偿，本代码明确不乘，比较学习率时要一起考虑。","sha256":"14189f16ad31f6c007e850d7f40b9ec49763f1b096690f95039e3e8cb55b7c2c","chapter":{"id":"course","title":"已完成的基准运行"},"unit":{"id":"notebook-blocks/7044913259924763a3b29542e91fbca8","title":"已完成的基准运行"},"page":{"id":"reading-opening","title":"已完成的基准运行","number":1},"sectionTitle":"已完成的基准运行","currentQuestion":"已完成的基准运行","sourceSlides":[],"knowledgeBlock":null,"formulas":[],"previousBlock":"b-c75eb23530890f7c8a693bf2","nextBlock":"b-7efc1f009221f4380c75d8af","prerequisites":[{"id":"b-2adc33b1fd4f9d2eeffaa32d","url":"#b-2adc33b1fd4f9d2eeffaa32d","role":"section-title"},{"id":"b-63178adbeaa633f1a226366e","url":"#b-63178adbeaa633f1a226366e","role":"problem-context"}],"relatedBlocks":[]},{"id":"b-7efc1f009221f4380c75d8af","type":"p","scope":"document","url":"https://codingai-lec03.pages.dev/course/notebook-blocks/7044913259924763a3b29542e91fbca8.html#b-7efc1f009221f4380c75d8af","content":"EMA 平滑参数变化，stop-gradient 限制梯度路径，但“常量也能获得零一致性损失”的反例并未因此从数学上消失。MoCo 还用负例；BYOL/DINO 的训练设计和经验条件应分别解释。先到 [CLS 05](https://deepnote.com/project/38755e4e-23f6-4f5f-8c68-8a2e4114b1c1/notebook/b8320404134f4a2e858ccfe7d50a71d3) 区分训练目标与 probe，再只改变 T=1/4 比较分布与KL曲线。来源：[知识蒸馏论文](https://arxiv.org/abs/1503.02531)、[BYOL](https://arxiv.org/abs/2006.07733)。","sha256":"edc6493162bad77efc1c2b2dcb5b0d275aefb6a0fd1ed97313d5e1201d128242","chapter":{"id":"course","title":"已完成的基准运行"},"unit":{"id":"notebook-blocks/7044913259924763a3b29542e91fbca8","title":"已完成的基准运行"},"page":{"id":"reading-opening","title":"已完成的基准运行","number":1},"sectionTitle":"已完成的基准运行","currentQuestion":"已完成的基准运行","sourceSlides":[],"knowledgeBlock":null,"formulas":[],"previousBlock":"b-977a2eda780b88cc3c0f2d4c","nextBlock":null,"prerequisites":[{"id":"b-2adc33b1fd4f9d2eeffaa32d","url":"#b-2adc33b1fd4f9d2eeffaa32d","role":"section-title"},{"id":"b-63178adbeaa633f1a226366e","url":"#b-63178adbeaa633f1a226366e","role":"problem-context"}],"relatedBlocks":[]}]}