{"version":2,"relationshipURLBase":"https://codingai-lec03.pages.dev/course/blocks/architecture-objective-co-design.html","relationshipResolution":"Resolve relative relationship URLs against relationshipURLBase; complete records and absolute URLs are in blocks.","title":"选读：结构与遮挡目标为什么要共同设计","url":"https://codingai-lec03.pages.dev/course/blocks/architecture-objective-co-design.html","markdown":"https://codingai-lec03.pages.dev/course/blocks/architecture-objective-co-design.md","pages":[{"id":"reading-opening","title":"选读：结构与遮挡目标为什么要共同设计","unit":"表示学习的选读问题","unitId":"i-extensions","chapter":"I","number":1}],"aliases":[{"oldId":"b-29ddb1d50f47091924ab9a66","targetId":"b-29ddb1d50f47091924ab9a66","page":"reading-opening","operation":"move","beforeSHA256":"18ce8b987c883fc891e26e0f29a93311dbde953011212002321477c6de8cc4ae","afterSHA256":"18ce8b987c883fc891e26e0f29a93311dbde953011212002321477c6de8cc4ae","reason":"Same source body in authored semantic page"},{"oldId":"b-fbfeb4377a339b67ebf64917","targetId":"b-fbfeb4377a339b67ebf64917","page":"reading-opening","operation":"move","beforeSHA256":"0e40e6b7ddba60e80820146d718202e65b5d313465f9bd031aaff21da87e26e6","afterSHA256":"0e40e6b7ddba60e80820146d718202e65b5d313465f9bd031aaff21da87e26e6","reason":"Same source body in authored semantic page"},{"oldId":"b-b575c876c18f0fc1fac9f1e2","targetId":"b-b575c876c18f0fc1fac9f1e2","page":"reading-opening","operation":"move","beforeSHA256":"f90a46d599e1e60c5744399504a4b565df7745bd6e5f034a33ed662df7be5117","afterSHA256":"f90a46d599e1e60c5744399504a4b565df7745bd6e5f034a33ed662df7be5117","reason":"Same source body in authored semantic page"},{"oldId":"b-2af60bcda539da2f3a88cb5f","targetId":"b-2af60bcda539da2f3a88cb5f","page":"reading-opening","operation":"move","beforeSHA256":"5f412f089df24a97ca57f905320ac07758cc419ed15af144a02d763a3d5b011d","afterSHA256":"5f412f089df24a97ca57f905320ac07758cc419ed15af144a02d763a3d5b011d","reason":"Same source body in authored semantic page"},{"oldId":"b-3f4fa4d1fdd4d33f4ab6286f","targetId":"b-3f4fa4d1fdd4d33f4ab6286f","page":"reading-opening","operation":"rewrite","beforeSHA256":"337c5ccc6ecfd699559a48b9211bf03849b063a69762709a661fff267be474ab","afterSHA256":"34076280b7dc70991b3bc8eef7d2adec72f68cfb32c548503d53852f2ee695d6","reason":"Same source identity with figure semantics or reading context enriched"},{"oldId":"b-17c287cb5bacb7fd2a6fc01e","targetId":"b-17c287cb5bacb7fd2a6fc01e","page":"reading-opening","operation":"move","beforeSHA256":"bc8d8b41f24cb8500fbdfecfb6289b5ef4dc3c5bcc086c466aaaa7caad8b4b15","afterSHA256":"bc8d8b41f24cb8500fbdfecfb6289b5ef4dc3c5bcc086c466aaaa7caad8b4b15","reason":"Same source body in authored semantic page"},{"oldId":"b-b4aa4a5a1443d3b7cbf0913f","targetId":"b-b4aa4a5a1443d3b7cbf0913f","page":"reading-opening","operation":"move","beforeSHA256":"2b9ccef7e1220e2250cceff1abd8bdd736b42f8da5a223f26b029f44b962e807","afterSHA256":"2b9ccef7e1220e2250cceff1abd8bdd736b42f8da5a223f26b029f44b962e807","reason":"Same source body in authored semantic page"}],"blocks":[{"id":"b-29ddb1d50f47091924ab9a66","type":"h1","scope":"architecture-objective-co-design","url":"https://codingai-lec03.pages.dev/course/blocks/architecture-objective-co-design.html#b-29ddb1d50f47091924ab9a66","content":"# 选读：结构与遮挡目标为什么要共同设计","sha256":"18ce8b987c883fc891e26e0f29a93311dbde953011212002321477c6de8cc4ae","chapter":{"id":"I","title":"学习信号与表示"},"unit":{"id":"i-extensions","title":"表示学习的选读问题"},"page":{"id":"reading-opening","title":"选读：结构与遮挡目标为什么要共同设计","number":1},"sectionTitle":"选读：结构与遮挡目标为什么要共同设计","currentQuestion":"选读：结构与遮挡目标为什么要共同设计","sourceSlides":[],"knowledgeBlock":null,"formulas":[],"previousBlock":null,"nextBlock":"b-fbfeb4377a339b67ebf64917","prerequisites":[{"id":"b-fbfeb4377a339b67ebf64917","url":"#b-fbfeb4377a339b67ebf64917","role":"problem-context"}],"relatedBlocks":[]},{"id":"b-fbfeb4377a339b67ebf64917","type":"p","scope":"architecture-objective-co-design","url":"https://codingai-lec03.pages.dev/course/blocks/architecture-objective-co-design.html#b-fbfeb4377a339b67ebf64917","content":"重建不是简单复制；瓶颈、破坏或遮挡为学习增加约束，和视图关系形成另一类目标。","sha256":"0e40e6b7ddba60e80820146d718202e65b5d313465f9bd031aaff21da87e26e6","chapter":{"id":"I","title":"学习信号与表示"},"unit":{"id":"i-extensions","title":"表示学习的选读问题"},"page":{"id":"reading-opening","title":"选读：结构与遮挡目标为什么要共同设计","number":1},"sectionTitle":"选读：结构与遮挡目标为什么要共同设计","currentQuestion":"选读：结构与遮挡目标为什么要共同设计","sourceSlides":[],"knowledgeBlock":null,"formulas":[],"previousBlock":"b-29ddb1d50f47091924ab9a66","nextBlock":"b-b575c876c18f0fc1fac9f1e2","prerequisites":[{"id":"b-29ddb1d50f47091924ab9a66","url":"#b-29ddb1d50f47091924ab9a66","role":"section-title"}],"relatedBlocks":[]},{"id":"b-b575c876c18f0fc1fac9f1e2","type":"p","scope":"architecture-objective-co-design","url":"https://codingai-lec03.pages.dev/course/blocks/architecture-objective-co-design.html#b-b575c876c18f0fc1fac9f1e2","content":"把原MAE目标直接搬到卷积网络，并不意味着所有结构假设仍成立。ConvNeXt V2将遮挡图看成稀疏空间输入，用FCMAE组织学习，并引入GRN改善通道响应的多样性。这提供了一个正面研究例子：目标与网络结构可以一起设计。","sha256":"f90a46d599e1e60c5744399504a4b565df7745bd6e5f034a33ed662df7be5117","chapter":{"id":"I","title":"学习信号与表示"},"unit":{"id":"i-extensions","title":"表示学习的选读问题"},"page":{"id":"reading-opening","title":"选读：结构与遮挡目标为什么要共同设计","number":1},"sectionTitle":"选读：结构与遮挡目标为什么要共同设计","currentQuestion":"选读：结构与遮挡目标为什么要共同设计","sourceSlides":[],"knowledgeBlock":null,"formulas":[],"previousBlock":"b-fbfeb4377a339b67ebf64917","nextBlock":"b-2af60bcda539da2f3a88cb5f","prerequisites":[{"id":"b-29ddb1d50f47091924ab9a66","url":"#b-29ddb1d50f47091924ab9a66","role":"section-title"},{"id":"b-fbfeb4377a339b67ebf64917","url":"#b-fbfeb4377a339b67ebf64917","role":"problem-context"}],"relatedBlocks":[]},{"id":"b-2af60bcda539da2f3a88cb5f","type":"p","scope":"architecture-objective-co-design","url":"https://codingai-lec03.pages.dev/course/blocks/architecture-objective-co-design.html#b-2af60bcda539da2f3a88cb5f","content":"原论文Table 3的Base比较（ImageNet-1K top-1，%）：","sha256":"5f412f089df24a97ca57f905320ac07758cc419ed15af144a02d763a3d5b011d","chapter":{"id":"I","title":"学习信号与表示"},"unit":{"id":"i-extensions","title":"表示学习的选读问题"},"page":{"id":"reading-opening","title":"选读：结构与遮挡目标为什么要共同设计","number":1},"sectionTitle":"选读：结构与遮挡目标为什么要共同设计","currentQuestion":"选读：结构与遮挡目标为什么要共同设计","sourceSlides":[],"knowledgeBlock":null,"formulas":[],"previousBlock":"b-b575c876c18f0fc1fac9f1e2","nextBlock":"b-3f4fa4d1fdd4d33f4ab6286f","prerequisites":[{"id":"b-29ddb1d50f47091924ab9a66","url":"#b-29ddb1d50f47091924ab9a66","role":"section-title"},{"id":"b-fbfeb4377a339b67ebf64917","url":"#b-fbfeb4377a339b67ebf64917","role":"problem-context"}],"relatedBlocks":[]},{"id":"b-3f4fa4d1fdd4d33f4ab6286f","type":"table","scope":"architecture-objective-co-design","url":"https://codingai-lec03.pages.dev/course/blocks/architecture-objective-co-design.html#b-3f4fa4d1fdd4d33f4ab6286f","content":"| 架构 | 监督训练 | FCMAE预训练后微调 |\n| --- | --- | --- |\n| V1-Base | 83.8 | 83.7 |\n| V2-Base | 84.3 | 84.6 |","sha256":"34076280b7dc70991b3bc8eef7d2adec72f68cfb32c548503d53852f2ee695d6","chapter":{"id":"I","title":"学习信号与表示"},"unit":{"id":"i-extensions","title":"表示学习的选读问题"},"page":{"id":"reading-opening","title":"选读：结构与遮挡目标为什么要共同设计","number":1},"sectionTitle":"选读：结构与遮挡目标为什么要共同设计","currentQuestion":"选读：结构与遮挡目标为什么要共同设计","sourceSlides":[],"knowledgeBlock":null,"formulas":[],"table":{"headers":["架构","监督训练","FCMAE预训练后微调"],"rows":[["架构","监督训练","FCMAE预训练后微调"],["V1-Base","83.8","83.7"],["V2-Base","84.3","84.6"]]},"previousBlock":"b-2af60bcda539da2f3a88cb5f","nextBlock":"b-17c287cb5bacb7fd2a6fc01e","prerequisites":[{"id":"b-29ddb1d50f47091924ab9a66","url":"#b-29ddb1d50f47091924ab9a66","role":"section-title"},{"id":"b-fbfeb4377a339b67ebf64917","url":"#b-fbfeb4377a339b67ebf64917","role":"problem-context"}],"relatedBlocks":[]},{"id":"b-17c287cb5bacb7fd2a6fc01e","type":"p","scope":"architecture-objective-co-design","url":"https://codingai-lec03.pages.dev/course/blocks/architecture-objective-co-design.html#b-17c287cb5bacb7fd2a6fc01e","content":"FCMAE列先预训练800轮再微调，不能称等总预算。V1中换目标为−0.1，V2中为+0.3；这提示组合值得研究，却不能仅凭四个数识别一个严格因果交互。这里是论文证据，和LAB05的patch词典拟合不是同一实验。读完回到P22的用途评价，不再另开主讲章节。","sha256":"bc8d8b41f24cb8500fbdfecfb6289b5ef4dc3c5bcc086c466aaaa7caad8b4b15","chapter":{"id":"I","title":"学习信号与表示"},"unit":{"id":"i-extensions","title":"表示学习的选读问题"},"page":{"id":"reading-opening","title":"选读：结构与遮挡目标为什么要共同设计","number":1},"sectionTitle":"选读：结构与遮挡目标为什么要共同设计","currentQuestion":"选读：结构与遮挡目标为什么要共同设计","sourceSlides":[],"knowledgeBlock":null,"formulas":[],"previousBlock":"b-3f4fa4d1fdd4d33f4ab6286f","nextBlock":"b-b4aa4a5a1443d3b7cbf0913f","prerequisites":[{"id":"b-29ddb1d50f47091924ab9a66","url":"#b-29ddb1d50f47091924ab9a66","role":"section-title"},{"id":"b-fbfeb4377a339b67ebf64917","url":"#b-fbfeb4377a339b67ebf64917","role":"problem-context"}],"relatedBlocks":[]},{"id":"b-b4aa4a5a1443d3b7cbf0913f","type":"h2","scope":"architecture-objective-co-design","url":"https://codingai-lec03.pages.dev/course/blocks/architecture-objective-co-design.html#b-b4aa4a5a1443d3b7cbf0913f","content":"## 继续阅读与实验","sha256":"2b9ccef7e1220e2250cceff1abd8bdd736b42f8da5a223f26b029f44b962e807","chapter":{"id":"I","title":"学习信号与表示"},"unit":{"id":"i-extensions","title":"表示学习的选读问题"},"page":{"id":"reading-opening","title":"选读：结构与遮挡目标为什么要共同设计","number":1},"sectionTitle":"选读：结构与遮挡目标为什么要共同设计","currentQuestion":"选读：结构与遮挡目标为什么要共同设计","sourceSlides":[],"knowledgeBlock":null,"formulas":[],"previousBlock":"b-17c287cb5bacb7fd2a6fc01e","nextBlock":null,"prerequisites":[{"id":"b-29ddb1d50f47091924ab9a66","url":"#b-29ddb1d50f47091924ab9a66","role":"section-title"},{"id":"b-fbfeb4377a339b67ebf64917","url":"#b-fbfeb4377a339b67ebf64917","role":"problem-context"}],"relatedBlocks":[]}]}