{"version":2,"relationshipURLBase":"https://codingai-lec03.pages.dev/course/blocks/objective-and-compute-interface.html","relationshipResolution":"Resolve relative relationship URLs against relationshipURLBase; complete records and absolute URLs are in blocks.","title":"训练目标也在分配计算","url":"https://codingai-lec03.pages.dev/course/blocks/objective-and-compute-interface.html","markdown":"https://codingai-lec03.pages.dev/course/blocks/objective-and-compute-interface.md","pages":[{"id":"reading-opening","title":"训练目标也在分配计算","unit":"训练留下什么，训练答案又从哪里来？","unitId":"i-reuse-and-targets","chapter":"I","number":1}],"aliases":[{"oldId":"b-748fe0f948b31af6fd4d2667","targetId":"b-748fe0f948b31af6fd4d2667","page":"reading-opening","operation":"move","beforeSHA256":"aa9dc2522e7b136584921e0b664c74bededaf30e6a67e8869406643950773ef3","afterSHA256":"aa9dc2522e7b136584921e0b664c74bededaf30e6a67e8869406643950773ef3","reason":"Same source body in authored semantic page"},{"oldId":"b-0ec47a02be025e67a944b394","targetId":"b-0ec47a02be025e67a944b394","page":"reading-opening","operation":"move","beforeSHA256":"a4c7eab21c83eccbcaefe98f60454f108c008c8b3fa6594af5b233ae84b8b0f1","afterSHA256":"a4c7eab21c83eccbcaefe98f60454f108c008c8b3fa6594af5b233ae84b8b0f1","reason":"Same source body in authored semantic page"},{"oldId":"b-a90c08dce2b63bc114433966","targetId":"b-a90c08dce2b63bc114433966","page":"reading-opening","operation":"move","beforeSHA256":"41c0c8827ed3d1b42ab13467510bf5dd1ba108583478771eeb2f9851358a6055","afterSHA256":"41c0c8827ed3d1b42ab13467510bf5dd1ba108583478771eeb2f9851358a6055","reason":"Same source body in authored semantic page"},{"oldId":"b-a5c49f480acb5fd9531888c8","targetId":"b-a5c49f480acb5fd9531888c8","page":"reading-opening","operation":"move","beforeSHA256":"aa3396a1af2f8a274d0b98c3d282a23fe47342ee9bc0456df04dd8d50608f65b","afterSHA256":"aa3396a1af2f8a274d0b98c3d282a23fe47342ee9bc0456df04dd8d50608f65b","reason":"Same source body in authored semantic page"},{"oldId":"b-570c374ab34531d3119f3dd5","targetId":"b-570c374ab34531d3119f3dd5","page":"reading-opening","operation":"move","beforeSHA256":"ee7ba45d4a8a88485f4eb59743d22f646df82fe3ff7d2ac55977d48ae2b9ee94","afterSHA256":"ee7ba45d4a8a88485f4eb59743d22f646df82fe3ff7d2ac55977d48ae2b9ee94","reason":"Same source body in authored semantic page"},{"oldId":"b-19e5299bd3038d9c05dd7fa7","targetId":"b-19e5299bd3038d9c05dd7fa7","page":"reading-opening","operation":"move","beforeSHA256":"2b9ccef7e1220e2250cceff1abd8bdd736b42f8da5a223f26b029f44b962e807","afterSHA256":"2b9ccef7e1220e2250cceff1abd8bdd736b42f8da5a223f26b029f44b962e807","reason":"Same source body in authored semantic page"}],"blocks":[{"id":"b-748fe0f948b31af6fd4d2667","type":"h1","scope":"objective-and-compute-interface","url":"https://codingai-lec03.pages.dev/course/blocks/objective-and-compute-interface.html#b-748fe0f948b31af6fd4d2667","content":"# 训练目标也在分配计算","sha256":"aa9dc2522e7b136584921e0b664c74bededaf30e6a67e8869406643950773ef3","chapter":{"id":"I","title":"学习信号与表示"},"unit":{"id":"i-reuse-and-targets","title":"训练留下什么，训练答案又从哪里来？"},"page":{"id":"reading-opening","title":"训练目标也在分配计算","number":1},"sectionTitle":"训练目标也在分配计算","currentQuestion":"训练目标也在分配计算","sourceSlides":[],"knowledgeBlock":null,"formulas":[],"previousBlock":null,"nextBlock":"b-0ec47a02be025e67a944b394","prerequisites":[{"id":"b-0ec47a02be025e67a944b394","url":"#b-0ec47a02be025e67a944b394","role":"problem-context"}],"relatedBlocks":[]},{"id":"b-0ec47a02be025e67a944b394","type":"p","scope":"objective-and-compute-interface","url":"https://codingai-lec03.pages.dev/course/blocks/objective-and-compute-interface.html#b-0ec47a02be025e67a944b394","content":"资源约束在本讲是方法选择的一个条件；真正需要回访它的是批内候选、MoCo缓存与MAE可见块。","sha256":"a4c7eab21c83eccbcaefe98f60454f108c008c8b3fa6594af5b233ae84b8b0f1","chapter":{"id":"I","title":"学习信号与表示"},"unit":{"id":"i-reuse-and-targets","title":"训练留下什么，训练答案又从哪里来？"},"page":{"id":"reading-opening","title":"训练目标也在分配计算","number":1},"sectionTitle":"训练目标也在分配计算","currentQuestion":"训练目标也在分配计算","sourceSlides":[],"knowledgeBlock":null,"formulas":[],"previousBlock":"b-748fe0f948b31af6fd4d2667","nextBlock":"b-a90c08dce2b63bc114433966","prerequisites":[{"id":"b-748fe0f948b31af6fd4d2667","url":"#b-748fe0f948b31af6fd4d2667","role":"section-title"}],"relatedBlocks":[]},{"id":"b-a90c08dce2b63bc114433966","type":"p","scope":"objective-and-compute-interface","url":"https://codingai-lec03.pages.dev/course/blocks/objective-and-compute-interface.html#b-a90c08dce2b63bc114433966","content":"扩大目标供给后，还要把训练真正做出来。当前批内对比会同时保留多张图两种视图的前向和反向状态；保存历史key的MoCo用特征缓存减少重复编码，但必须处理旧特征的一致性；MAE让较重编码器只处理可见图块，把补全位置的工作放到较轻解码器。","sha256":"41c0c8827ed3d1b42ab13467510bf5dd1ba108583478771eeb2f9851358a6055","chapter":{"id":"I","title":"学习信号与表示"},"unit":{"id":"i-reuse-and-targets","title":"训练留下什么，训练答案又从哪里来？"},"page":{"id":"reading-opening","title":"训练目标也在分配计算","number":1},"sectionTitle":"训练目标也在分配计算","currentQuestion":"训练目标也在分配计算","sourceSlides":[],"knowledgeBlock":null,"formulas":[],"previousBlock":"b-0ec47a02be025e67a944b394","nextBlock":"b-a5c49f480acb5fd9531888c8","prerequisites":[{"id":"b-748fe0f948b31af6fd4d2667","url":"#b-748fe0f948b31af6fd4d2667","role":"section-title"},{"id":"b-0ec47a02be025e67a944b394","url":"#b-0ec47a02be025e67a944b394","role":"problem-context"}],"relatedBlocks":[]},{"id":"b-a5c49f480acb5fd9531888c8","type":"p","scope":"objective-and-compute-interface","url":"https://codingai-lec03.pages.dev/course/blocks/objective-and-compute-interface.html#b-a5c49f480acb5fd9531888c8","content":"所以计算条件会参与方法设计，而不只是最后购买多少设备。我们可以先画资源账：本步编码多少新图，保留多少激活，缓存多少旧向量，下步需要重复什么。这个账足以理解接下来的batch、队列与可见块取舍。","sha256":"aa3396a1af2f8a274d0b98c3d282a23fe47342ee9bc0456df04dd8d50608f65b","chapter":{"id":"I","title":"学习信号与表示"},"unit":{"id":"i-reuse-and-targets","title":"训练留下什么，训练答案又从哪里来？"},"page":{"id":"reading-opening","title":"训练目标也在分配计算","number":1},"sectionTitle":"训练目标也在分配计算","currentQuestion":"训练目标也在分配计算","sourceSlides":[],"knowledgeBlock":null,"formulas":[],"previousBlock":"b-a90c08dce2b63bc114433966","nextBlock":"b-570c374ab34531d3119f3dd5","prerequisites":[{"id":"b-748fe0f948b31af6fd4d2667","url":"#b-748fe0f948b31af6fd4d2667","role":"section-title"},{"id":"b-0ec47a02be025e67a944b394","url":"#b-0ec47a02be025e67a944b394","role":"problem-context"}],"relatedBlocks":[]},{"id":"b-570c374ab34531d3119f3dd5","type":"p","scope":"objective-and-compute-interface","url":"https://codingai-lec03.pages.dev/course/blocks/objective-and-compute-interface.html#b-570c374ab34531d3119f3dd5","content":"本讲不在此展开并行算法、显存公式或分片通信。它们保留为第六讲预备阅读；这里带走的是同一个原则：**需要更多比较对象，不一定等于同时反传更多图片；需要预测更多位置，也不一定等于让昂贵编码器看见所有位置。**","sha256":"ee7ba45d4a8a88485f4eb59743d22f646df82fe3ff7d2ac55977d48ae2b9ee94","chapter":{"id":"I","title":"学习信号与表示"},"unit":{"id":"i-reuse-and-targets","title":"训练留下什么，训练答案又从哪里来？"},"page":{"id":"reading-opening","title":"训练目标也在分配计算","number":1},"sectionTitle":"训练目标也在分配计算","currentQuestion":"训练目标也在分配计算","sourceSlides":[],"knowledgeBlock":null,"formulas":[],"previousBlock":"b-a5c49f480acb5fd9531888c8","nextBlock":"b-19e5299bd3038d9c05dd7fa7","prerequisites":[{"id":"b-748fe0f948b31af6fd4d2667","url":"#b-748fe0f948b31af6fd4d2667","role":"section-title"},{"id":"b-0ec47a02be025e67a944b394","url":"#b-0ec47a02be025e67a944b394","role":"problem-context"}],"relatedBlocks":[]},{"id":"b-19e5299bd3038d9c05dd7fa7","type":"h2","scope":"objective-and-compute-interface","url":"https://codingai-lec03.pages.dev/course/blocks/objective-and-compute-interface.html#b-19e5299bd3038d9c05dd7fa7","content":"## 继续阅读与实验","sha256":"2b9ccef7e1220e2250cceff1abd8bdd736b42f8da5a223f26b029f44b962e807","chapter":{"id":"I","title":"学习信号与表示"},"unit":{"id":"i-reuse-and-targets","title":"训练留下什么，训练答案又从哪里来？"},"page":{"id":"reading-opening","title":"训练目标也在分配计算","number":1},"sectionTitle":"训练目标也在分配计算","currentQuestion":"训练目标也在分配计算","sourceSlides":[],"knowledgeBlock":null,"formulas":[],"previousBlock":"b-570c374ab34531d3119f3dd5","nextBlock":null,"prerequisites":[{"id":"b-748fe0f948b31af6fd4d2667","url":"#b-748fe0f948b31af6fd4d2667","role":"section-title"},{"id":"b-0ec47a02be025e67a944b394","url":"#b-0ec47a02be025e67a944b394","role":"problem-context"}],"relatedBlocks":[]}]}