{"version":2,"relationshipURLBase":"https://codingai-lec03.pages.dev/course/blocks/teacher-target-source-and-collapse.html","relationshipResolution":"Resolve relative relationship URLs against relationshipURLBase; complete records and absolute URLs are in blocks.","title":"教师模型提供的是哪一种答案？","url":"https://codingai-lec03.pages.dev/course/blocks/teacher-target-source-and-collapse.html","markdown":"https://codingai-lec03.pages.dev/course/blocks/teacher-target-source-and-collapse.md","pages":[{"id":"reading-opening","title":"教师模型提供的是哪一种答案？","unit":"表示学习的选读问题","unitId":"i-extensions","chapter":"I","number":1}],"aliases":[{"oldId":"b-07d531035c0c84e23e815695","targetId":"b-07d531035c0c84e23e815695","page":"reading-opening","operation":"move","beforeSHA256":"face16af73572eaa6c46d2b913b46f7a81fbb7b04b2d09a751439b6276cab1c5","afterSHA256":"face16af73572eaa6c46d2b913b46f7a81fbb7b04b2d09a751439b6276cab1c5","reason":"Same source body in authored semantic page"},{"oldId":"b-2f29d625dbab73510fa322f6","targetId":"b-2f29d625dbab73510fa322f6","page":"reading-opening","operation":"move","beforeSHA256":"95d0ea9de4112353631eff4a418936851b49b5b6d1914dad3ff6c767a373014e","afterSHA256":"95d0ea9de4112353631eff4a418936851b49b5b6d1914dad3ff6c767a373014e","reason":"Same source body in authored semantic page"},{"oldId":"b-9003661ee6c1a628b4562559","targetId":"b-9003661ee6c1a628b4562559","page":"reading-opening","operation":"move","beforeSHA256":"9b40607f74227610df31c60a34afc2bb8e212dabce62a2af04fcbed1aae8c1b1","afterSHA256":"9b40607f74227610df31c60a34afc2bb8e212dabce62a2af04fcbed1aae8c1b1","reason":"Same source body in authored semantic page"},{"oldId":"b-ca55550a10b8bcd6b367882d","targetId":"b-ca55550a10b8bcd6b367882d","page":"reading-opening","operation":"move","beforeSHA256":"2144c511d94c649203a4096a60898b9104ed9600b5c126c135f958212ed1182a","afterSHA256":"2144c511d94c649203a4096a60898b9104ed9600b5c126c135f958212ed1182a","reason":"Same source body in authored semantic page"},{"oldId":"b-7e9827ed04716c2f02d3d1f3","targetId":"b-7e9827ed04716c2f02d3d1f3","page":"reading-opening","operation":"move","beforeSHA256":"2d86e6daf5520a7166809b03cc90d62ffda26ba3b362d7fbcd5e33bb0bbd9cc3","afterSHA256":"2d86e6daf5520a7166809b03cc90d62ffda26ba3b362d7fbcd5e33bb0bbd9cc3","reason":"Same source body in authored semantic page"},{"oldId":"b-019de88c5c64c8b1998506ca","targetId":"b-019de88c5c64c8b1998506ca","page":"reading-opening","operation":"move","beforeSHA256":"2b9ccef7e1220e2250cceff1abd8bdd736b42f8da5a223f26b029f44b962e807","afterSHA256":"2b9ccef7e1220e2250cceff1abd8bdd736b42f8da5a223f26b029f44b962e807","reason":"Same source body in authored semantic page"}],"blocks":[{"id":"b-07d531035c0c84e23e815695","type":"h1","scope":"teacher-target-source-and-collapse","url":"https://codingai-lec03.pages.dev/course/blocks/teacher-target-source-and-collapse.html#b-07d531035c0c84e23e815695","content":"# 教师模型提供的是哪一种答案？","sha256":"face16af73572eaa6c46d2b913b46f7a81fbb7b04b2d09a751439b6276cab1c5","chapter":{"id":"I","title":"学习信号与表示"},"unit":{"id":"i-extensions","title":"表示学习的选读问题"},"page":{"id":"reading-opening","title":"教师模型提供的是哪一种答案？","number":1},"sectionTitle":"教师模型提供的是哪一种答案？","currentQuestion":"教师模型提供的是哪一种答案？","sourceSlides":[],"knowledgeBlock":null,"formulas":[],"previousBlock":null,"nextBlock":"b-2f29d625dbab73510fa322f6","prerequisites":[{"id":"b-2f29d625dbab73510fa322f6","url":"#b-2f29d625dbab73510fa322f6","role":"problem-context"}],"relatedBlocks":[]},{"id":"b-2f29d625dbab73510fa322f6","type":"p","scope":"teacher-target-source-and-collapse","url":"https://codingai-lec03.pages.dev/course/blocks/teacher-target-source-and-collapse.html#b-2f29d625dbab73510fa322f6","content":"先代入常量函数检查目标的平凡解，说明仅有一致性不够，也为教师方法留下合理选读入口。","sha256":"95d0ea9de4112353631eff4a418936851b49b5b6d1914dad3ff6c767a373014e","chapter":{"id":"I","title":"学习信号与表示"},"unit":{"id":"i-extensions","title":"表示学习的选读问题"},"page":{"id":"reading-opening","title":"教师模型提供的是哪一种答案？","number":1},"sectionTitle":"教师模型提供的是哪一种答案？","currentQuestion":"教师模型提供的是哪一种答案？","sourceSlides":[],"knowledgeBlock":null,"formulas":[],"previousBlock":"b-07d531035c0c84e23e815695","nextBlock":"b-9003661ee6c1a628b4562559","prerequisites":[{"id":"b-07d531035c0c84e23e815695","url":"#b-07d531035c0c84e23e815695","role":"section-title"}],"relatedBlocks":[]},{"id":"b-9003661ee6c1a628b4562559","type":"p","scope":"teacher-target-source-and-collapse","url":"https://codingai-lec03.pages.dev/course/blocks/teacher-target-source-and-collapse.html#b-9003661ee6c1a628b4562559","content":"固定教师蒸馏让学生拟合一个已有模型的概率分布；EMA教师则来自学生参数的历史平均。这两种教师都不是天然正确的类别真值，也不必比学生更大。","sha256":"9b40607f74227610df31c60a34afc2bb8e212dabce62a2af04fcbed1aae8c1b1","chapter":{"id":"I","title":"学习信号与表示"},"unit":{"id":"i-extensions","title":"表示学习的选读问题"},"page":{"id":"reading-opening","title":"教师模型提供的是哪一种答案？","number":1},"sectionTitle":"教师模型提供的是哪一种答案？","currentQuestion":"教师模型提供的是哪一种答案？","sourceSlides":[],"knowledgeBlock":null,"formulas":[],"previousBlock":"b-2f29d625dbab73510fa322f6","nextBlock":"b-ca55550a10b8bcd6b367882d","prerequisites":[{"id":"b-07d531035c0c84e23e815695","url":"#b-07d531035c0c84e23e815695","role":"section-title"},{"id":"b-2f29d625dbab73510fa322f6","url":"#b-2f29d625dbab73510fa322f6","role":"problem-context"}],"relatedBlocks":[]},{"id":"b-ca55550a10b8bcd6b367882d","type":"p","scope":"teacher-target-source-and-collapse","url":"https://codingai-lec03.pages.dev/course/blocks/teacher-target-source-and-collapse.html#b-ca55550a10b8bcd6b367882d","content":"以logits(4,2,0)为例，温度1的概率约(0.8668,0.1173,0.0159)，温度2约(0.6652,0.2447,0.0900)。软目标除最大类外，还表达其他类别的相对接近。学生可以用交叉熵拟合它，但也可能继承教师的背景捷径。","sha256":"2144c511d94c649203a4096a60898b9104ed9600b5c126c135f958212ed1182a","chapter":{"id":"I","title":"学习信号与表示"},"unit":{"id":"i-extensions","title":"表示学习的选读问题"},"page":{"id":"reading-opening","title":"教师模型提供的是哪一种答案？","number":1},"sectionTitle":"教师模型提供的是哪一种答案？","currentQuestion":"教师模型提供的是哪一种答案？","sourceSlides":[],"knowledgeBlock":null,"formulas":[],"previousBlock":"b-9003661ee6c1a628b4562559","nextBlock":"b-7e9827ed04716c2f02d3d1f3","prerequisites":[{"id":"b-07d531035c0c84e23e815695","url":"#b-07d531035c0c84e23e815695","role":"section-title"},{"id":"b-2f29d625dbab73510fa322f6","url":"#b-2f29d625dbab73510fa322f6","role":"problem-context"}],"relatedBlocks":[]},{"id":"b-7e9827ed04716c2f02d3d1f3","type":"p","scope":"teacher-target-source-and-collapse","url":"https://codingai-lec03.pages.dev/course/blocks/teacher-target-source-and-collapse.html#b-7e9827ed04716c2f02d3d1f3","content":"BYOL、DINO说明不显式使用负例也能学表示；它们采用的不对称预测、停止梯度、教师更新及输出分布处理应整体理解。当前LAB 17训练的是解析输入上的固定线性教师蒸馏，再单独算EMA，不是DINO视觉复现。这里适合作为理解“目标从模型取得”的选读分支，阅读后回到P18。","sha256":"2d86e6daf5520a7166809b03cc90d62ffda26ba3b362d7fbcd5e33bb0bbd9cc3","chapter":{"id":"I","title":"学习信号与表示"},"unit":{"id":"i-extensions","title":"表示学习的选读问题"},"page":{"id":"reading-opening","title":"教师模型提供的是哪一种答案？","number":1},"sectionTitle":"教师模型提供的是哪一种答案？","currentQuestion":"教师模型提供的是哪一种答案？","sourceSlides":[],"knowledgeBlock":null,"formulas":[],"previousBlock":"b-ca55550a10b8bcd6b367882d","nextBlock":"b-019de88c5c64c8b1998506ca","prerequisites":[{"id":"b-07d531035c0c84e23e815695","url":"#b-07d531035c0c84e23e815695","role":"section-title"},{"id":"b-2f29d625dbab73510fa322f6","url":"#b-2f29d625dbab73510fa322f6","role":"problem-context"}],"relatedBlocks":[]},{"id":"b-019de88c5c64c8b1998506ca","type":"h2","scope":"teacher-target-source-and-collapse","url":"https://codingai-lec03.pages.dev/course/blocks/teacher-target-source-and-collapse.html#b-019de88c5c64c8b1998506ca","content":"## 继续阅读与实验","sha256":"2b9ccef7e1220e2250cceff1abd8bdd736b42f8da5a223f26b029f44b962e807","chapter":{"id":"I","title":"学习信号与表示"},"unit":{"id":"i-extensions","title":"表示学习的选读问题"},"page":{"id":"reading-opening","title":"教师模型提供的是哪一种答案？","number":1},"sectionTitle":"教师模型提供的是哪一种答案？","currentQuestion":"教师模型提供的是哪一种答案？","sourceSlides":[],"knowledgeBlock":null,"formulas":[],"previousBlock":"b-7e9827ed04716c2f02d3d1f3","nextBlock":null,"prerequisites":[{"id":"b-07d531035c0c84e23e815695","url":"#b-07d531035c0c84e23e815695","role":"section-title"},{"id":"b-2f29d625dbab73510fa322f6","url":"#b-2f29d625dbab73510fa322f6","role":"problem-context"}],"relatedBlocks":[]}]}