{"version":2,"relationshipURLBase":"https://codingai-lec03.pages.dev/course/blocks/mae-compute-not-sixteen-times.html","relationshipResolution":"Resolve relative relationship URLs against relationshipURLBase; complete records and absolute URLs are in blocks.","title":"少看图块为何省计算，又为何不是固定加速比","url":"https://codingai-lec03.pages.dev/course/blocks/mae-compute-not-sixteen-times.html","markdown":"https://codingai-lec03.pages.dev/course/blocks/mae-compute-not-sixteen-times.md","pages":[{"id":"reading-opening","title":"少看图块为何省计算，又为何不是固定加速比","unit":"限制可见信息，怎样构成可验证的重建任务？","unitId":"i-masked-prediction","chapter":"I","number":1}],"aliases":[{"oldId":"b-39d4e357164e838edd3ab531","targetId":"b-39d4e357164e838edd3ab531","page":"reading-opening","operation":"move","beforeSHA256":"0b02f7351d4c597783f4f5d2fa29e97ba943dab924e4e563dc6b49601ce46f7f","afterSHA256":"0b02f7351d4c597783f4f5d2fa29e97ba943dab924e4e563dc6b49601ce46f7f","reason":"Same source body in authored semantic page"},{"oldId":"b-e9a3e7acfc5602e3b377fb1b","targetId":"b-e9a3e7acfc5602e3b377fb1b","page":"reading-opening","operation":"move","beforeSHA256":"1f23436418bb9306bc343705135fc831445c2db90a17e4b6fef6e31a4889b2d4","afterSHA256":"1f23436418bb9306bc343705135fc831445c2db90a17e4b6fef6e31a4889b2d4","reason":"Same source body in authored semantic page"},{"oldId":"b-086ad8adb9c30f16c506b6be","targetId":"b-086ad8adb9c30f16c506b6be","page":"reading-opening","operation":"move","beforeSHA256":"cc473fa139d18e11032f1324021e26cb652f176eea094563108edb596633713f","afterSHA256":"cc473fa139d18e11032f1324021e26cb652f176eea094563108edb596633713f","reason":"Same source body in authored semantic page"},{"oldId":"b-03781796c362cf7d09caac34","targetId":"b-03781796c362cf7d09caac34","page":"reading-opening","operation":"move","beforeSHA256":"6fc2fb8abfdb5f7436d70e82bcc6a6060bf84c7c6704187c4857eee18e665fcf","afterSHA256":"6fc2fb8abfdb5f7436d70e82bcc6a6060bf84c7c6704187c4857eee18e665fcf","reason":"Same source body in authored semantic page"},{"oldId":"b-19edc0eb0e1e808e11f96a7f","targetId":"b-19edc0eb0e1e808e11f96a7f","page":"reading-opening","operation":"move","beforeSHA256":"7d544fa2fae3bc12754501c9fe5a9917304b891164941a690c8a82d8433c8680","afterSHA256":"7d544fa2fae3bc12754501c9fe5a9917304b891164941a690c8a82d8433c8680","reason":"Same source body in authored semantic page"},{"oldId":"b-8e1dfd23a54b821fe56ac4d6","targetId":"b-8e1dfd23a54b821fe56ac4d6","page":"reading-opening","operation":"move","beforeSHA256":"2b9ccef7e1220e2250cceff1abd8bdd736b42f8da5a223f26b029f44b962e807","afterSHA256":"2b9ccef7e1220e2250cceff1abd8bdd736b42f8da5a223f26b029f44b962e807","reason":"Same source body in authored semantic page"}],"blocks":[{"id":"b-39d4e357164e838edd3ab531","type":"h1","scope":"mae-compute-not-sixteen-times","url":"https://codingai-lec03.pages.dev/course/blocks/mae-compute-not-sixteen-times.html#b-39d4e357164e838edd3ab531","content":"# 少看图块为何省计算，又为何不是固定加速比","sha256":"0b02f7351d4c597783f4f5d2fa29e97ba943dab924e4e563dc6b49601ce46f7f","chapter":{"id":"I","title":"学习信号与表示"},"unit":{"id":"i-masked-prediction","title":"限制可见信息，怎样构成可验证的重建任务？"},"page":{"id":"reading-opening","title":"少看图块为何省计算，又为何不是固定加速比","number":1},"sectionTitle":"少看图块为何省计算，又为何不是固定加速比","currentQuestion":"少看图块为何省计算，又为何不是固定加速比","sourceSlides":[],"knowledgeBlock":null,"formulas":[],"previousBlock":null,"nextBlock":"b-e9a3e7acfc5602e3b377fb1b","prerequisites":[{"id":"b-e9a3e7acfc5602e3b377fb1b","url":"#b-e9a3e7acfc5602e3b377fb1b","role":"problem-context"}],"relatedBlocks":[]},{"id":"b-e9a3e7acfc5602e3b377fb1b","type":"p","scope":"mae-compute-not-sixteen-times","url":"https://codingai-lec03.pages.dev/course/blocks/mae-compute-not-sixteen-times.html#b-e9a3e7acfc5602e3b377fb1b","content":"固定16块与4个可见位置，让编码器输入可以逐项指认；计算节省与隐藏比例的关系留在本页说明。","sha256":"1f23436418bb9306bc343705135fc831445c2db90a17e4b6fef6e31a4889b2d4","chapter":{"id":"I","title":"学习信号与表示"},"unit":{"id":"i-masked-prediction","title":"限制可见信息，怎样构成可验证的重建任务？"},"page":{"id":"reading-opening","title":"少看图块为何省计算，又为何不是固定加速比","number":1},"sectionTitle":"少看图块为何省计算，又为何不是固定加速比","currentQuestion":"少看图块为何省计算，又为何不是固定加速比","sourceSlides":[],"knowledgeBlock":null,"formulas":[],"previousBlock":"b-39d4e357164e838edd3ab531","nextBlock":"b-086ad8adb9c30f16c506b6be","prerequisites":[{"id":"b-39d4e357164e838edd3ab531","url":"#b-39d4e357164e838edd3ab531","role":"section-title"}],"relatedBlocks":[]},{"id":"b-086ad8adb9c30f16c506b6be","type":"p","scope":"mae-compute-not-sixteen-times","url":"https://codingai-lec03.pages.dev/course/blocks/mae-compute-not-sixteen-times.html#b-086ad8adb9c30f16c506b6be","content":"16块只保留4块，编码器处理的项数变为四分之一。一些逐项计算随项数下降；涉及两两位置的计算从16²降为4²，是原来的1/16。这可以解释为什么高遮挡率有计算价值，但不需要在本讲展开注意力算法。","sha256":"cc473fa139d18e11032f1324021e26cb652f176eea094563108edb596633713f","chapter":{"id":"I","title":"学习信号与表示"},"unit":{"id":"i-masked-prediction","title":"限制可见信息，怎样构成可验证的重建任务？"},"page":{"id":"reading-opening","title":"少看图块为何省计算，又为何不是固定加速比","number":1},"sectionTitle":"少看图块为何省计算，又为何不是固定加速比","currentQuestion":"少看图块为何省计算，又为何不是固定加速比","sourceSlides":[],"knowledgeBlock":null,"formulas":[],"previousBlock":"b-e9a3e7acfc5602e3b377fb1b","nextBlock":"b-03781796c362cf7d09caac34","prerequisites":[{"id":"b-39d4e357164e838edd3ab531","url":"#b-39d4e357164e838edd3ab531","role":"section-title"},{"id":"b-e9a3e7acfc5602e3b377fb1b","url":"#b-e9a3e7acfc5602e3b377fb1b","role":"problem-context"}],"relatedBlocks":[]},{"id":"b-03781796c362cf7d09caac34","type":"p","scope":"mae-compute-not-sixteen-times","url":"https://codingai-lec03.pages.dev/course/blocks/mae-compute-not-sixteen-times.html#b-03781796c362cf7d09caac34","content":"整个训练还包含patch转换、其他网络层、解码器、损失和硬件调度。解码器重新处理完整位置，因此端到端耗时不等于某个二次项的比值。课堂上“16倍”只可描述这个构造的两两项数变化，不能宣称实际训练快16倍。","sha256":"6fc2fb8abfdb5f7436d70e82bcc6a6060bf84c7c6704187c4857eee18e665fcf","chapter":{"id":"I","title":"学习信号与表示"},"unit":{"id":"i-masked-prediction","title":"限制可见信息，怎样构成可验证的重建任务？"},"page":{"id":"reading-opening","title":"少看图块为何省计算，又为何不是固定加速比","number":1},"sectionTitle":"少看图块为何省计算，又为何不是固定加速比","currentQuestion":"少看图块为何省计算，又为何不是固定加速比","sourceSlides":[],"knowledgeBlock":null,"formulas":[],"previousBlock":"b-086ad8adb9c30f16c506b6be","nextBlock":"b-19edc0eb0e1e808e11f96a7f","prerequisites":[{"id":"b-39d4e357164e838edd3ab531","url":"#b-39d4e357164e838edd3ab531","role":"section-title"},{"id":"b-e9a3e7acfc5602e3b377fb1b","url":"#b-e9a3e7acfc5602e3b377fb1b","role":"problem-context"}],"relatedBlocks":[]},{"id":"b-19edc0eb0e1e808e11f96a7f","type":"p","scope":"mae-compute-not-sixteen-times","url":"https://codingai-lec03.pages.dev/course/blocks/mae-compute-not-sixteen-times.html#b-19edc0eb0e1e808e11f96a7f","content":"当前LAB 08用稠密卷积网格加mask通道，仍处理完整8×8图像；它能教遮挡目标与评价，但不能复现原MAE可见token编码器的计算节省。方法机制与教学模型的对应范围应这样逐项标清。","sha256":"7d544fa2fae3bc12754501c9fe5a9917304b891164941a690c8a82d8433c8680","chapter":{"id":"I","title":"学习信号与表示"},"unit":{"id":"i-masked-prediction","title":"限制可见信息，怎样构成可验证的重建任务？"},"page":{"id":"reading-opening","title":"少看图块为何省计算，又为何不是固定加速比","number":1},"sectionTitle":"少看图块为何省计算，又为何不是固定加速比","currentQuestion":"少看图块为何省计算，又为何不是固定加速比","sourceSlides":[],"knowledgeBlock":null,"formulas":[],"previousBlock":"b-03781796c362cf7d09caac34","nextBlock":"b-8e1dfd23a54b821fe56ac4d6","prerequisites":[{"id":"b-39d4e357164e838edd3ab531","url":"#b-39d4e357164e838edd3ab531","role":"section-title"},{"id":"b-e9a3e7acfc5602e3b377fb1b","url":"#b-e9a3e7acfc5602e3b377fb1b","role":"problem-context"}],"relatedBlocks":[]},{"id":"b-8e1dfd23a54b821fe56ac4d6","type":"h2","scope":"mae-compute-not-sixteen-times","url":"https://codingai-lec03.pages.dev/course/blocks/mae-compute-not-sixteen-times.html#b-8e1dfd23a54b821fe56ac4d6","content":"## 继续阅读与实验","sha256":"2b9ccef7e1220e2250cceff1abd8bdd736b42f8da5a223f26b029f44b962e807","chapter":{"id":"I","title":"学习信号与表示"},"unit":{"id":"i-masked-prediction","title":"限制可见信息，怎样构成可验证的重建任务？"},"page":{"id":"reading-opening","title":"少看图块为何省计算，又为何不是固定加速比","number":1},"sectionTitle":"少看图块为何省计算，又为何不是固定加速比","currentQuestion":"少看图块为何省计算，又为何不是固定加速比","sourceSlides":[],"knowledgeBlock":null,"formulas":[],"previousBlock":"b-19edc0eb0e1e808e11f96a7f","nextBlock":null,"prerequisites":[{"id":"b-39d4e357164e838edd3ab531","url":"#b-39d4e357164e838edd3ab531","role":"section-title"},{"id":"b-e9a3e7acfc5602e3b377fb1b","url":"#b-e9a3e7acfc5602e3b377fb1b","role":"problem-context"}],"relatedBlocks":[]}]}