{"version":2,"relationshipURLBase":"https://codingai-lec03.pages.dev/course/pages/l3-r2-p17.html","relationshipResolution":"Resolve relative relationship URLs against relationshipURLBase; complete records and absolute URLs are in blocks.","title":"把一次学习完整走通","url":"https://codingai-lec03.pages.dev/course/pages/l3-r2-p17.html","markdown":"https://codingai-lec03.pages.dev/course/pages/l3-r2-p17.md","pages":[{"id":"h-i-follow-one-key","title":"沿着一个 key，走完当前步与下一步","unit":"怎样增加候选，同时让历史表示仍可比较？","unitId":"i-dictionary-and-updates","chapter":"I","number":1}],"aliases":[{"oldId":"explanation","targetId":"h-i-follow-one-key","operation":"split-explanation-range"},{"oldId":"b-10e06945dfc69583f5d9f199","targetId":"b-10e06945dfc69583f5d9f199","page":"h-i-follow-one-key","operation":"move","beforeSHA256":"d71cf15e707c8a3674b4c90a599efee783cb84da5b8c8236a1d01c3add7b4958","afterSHA256":"d71cf15e707c8a3674b4c90a599efee783cb84da5b8c8236a1d01c3add7b4958","reason":"Same source body in authored semantic page"},{"oldId":"b-5e6bf3c2b5ca85f660ee8919","targetId":"b-5e6bf3c2b5ca85f660ee8919","page":"h-i-follow-one-key","operation":"move","beforeSHA256":"14aa4aad676112111771e67d4486fcc88d02367afebbe8021bd6c13c3a90d55f","afterSHA256":"14aa4aad676112111771e67d4486fcc88d02367afebbe8021bd6c13c3a90d55f","reason":"Same source body in authored semantic page"},{"oldId":"b-d6f757231a5d40953f2cd390","targetId":"b-d6f757231a5d40953f2cd390","page":"h-i-follow-one-key","operation":"move","beforeSHA256":"32e3dfb57a0c0ee8ebfaa6dba8b4550a4d63de60d198ddcb5319190026ceea8c","afterSHA256":"32e3dfb57a0c0ee8ebfaa6dba8b4550a4d63de60d198ddcb5319190026ceea8c","reason":"Same source body in authored semantic page"},{"oldId":"b-16e6e38ad53c56b94caf0b7e","targetId":"b-16e6e38ad53c56b94caf0b7e","page":"h-i-follow-one-key","operation":"rewrite","beforeSHA256":"da10d2f2898440fbac9e92a65fcd10f561f45e81cf10440b1a61c99f64de1ecc","afterSHA256":"4d92557b7862702cfa084365eb12440bd43590b8bd0b9ec447282122a4da725b","reason":"Same source identity with figure semantics or reading context enriched"},{"oldId":"b-1f647d857ec473a3c5d0a429","targetId":"b-1f647d857ec473a3c5d0a429","page":"h-i-follow-one-key","operation":"move","beforeSHA256":"786ce10a6b32a492259a3dccd0a54e61cd41d28a34382fb7b5386c5f03b7ad69","afterSHA256":"786ce10a6b32a492259a3dccd0a54e61cd41d28a34382fb7b5386c5f03b7ad69","reason":"Same source body in authored semantic page"},{"oldId":"b-dee0b934ce91a646024a978b","targetId":"b-dee0b934ce91a646024a978b","page":"h-i-follow-one-key","operation":"move","beforeSHA256":"cd6bc3ea8b3b61c39a70b613ef2230e79c64bd86e1a0b2262d6ad636853a67c7","afterSHA256":"cd6bc3ea8b3b61c39a70b613ef2230e79c64bd86e1a0b2262d6ad636853a67c7","reason":"Same source body in authored semantic page"},{"oldId":"b-a0b9c6ba48f9d3b76f56d650","targetId":"b-a0b9c6ba48f9d3b76f56d650","page":"h-i-follow-one-key","operation":"move","beforeSHA256":"179d2c298dfbcc98e8ef0eb6546b0bf14035ae440eb7c327f9982750eaf19bf2","afterSHA256":"179d2c298dfbcc98e8ef0eb6546b0bf14035ae440eb7c327f9982750eaf19bf2","reason":"Same source body in authored semantic page"},{"oldId":"b-37203fb622cdc25a4a53be97","targetId":"b-37203fb622cdc25a4a53be97","page":"h-i-follow-one-key","operation":"move","beforeSHA256":"4b3c3586979f78ca4986198828909eb0d7cfd735da40c74a52c00cfdce532130","afterSHA256":"4b3c3586979f78ca4986198828909eb0d7cfd735da40c74a52c00cfdce532130","reason":"Same source body in authored semantic page"},{"oldId":"b-df8cfd6e2ffb2a47fcbb37eb","targetId":"b-df8cfd6e2ffb2a47fcbb37eb","page":"h-i-follow-one-key","operation":"move","beforeSHA256":"8c189b3e064e75cf8a9b68c96e6804f3a774061b77b895462a26431cb0a3a9dd","afterSHA256":"8c189b3e064e75cf8a9b68c96e6804f3a774061b77b895462a26431cb0a3a9dd","reason":"Same source body in authored semantic page"},{"oldId":"b-fc49e96c0f8a0d424de0980b","targetId":"b-fc49e96c0f8a0d424de0980b","page":"h-i-follow-one-key","operation":"move","beforeSHA256":"9afe8ea0540ab018647cf0d557e40ffbe3a252b27be86ee5cf1cf36f008fcf6d","afterSHA256":"9afe8ea0540ab018647cf0d557e40ffbe3a252b27be86ee5cf1cf36f008fcf6d","reason":"Same source body in authored semantic page"},{"oldId":"b-2690bda565dec94b83927837","targetId":"b-2690bda565dec94b83927837","page":"h-i-follow-one-key","operation":"move","beforeSHA256":"93749e4c555e4f0e16461aab8a6a418c2d29e5d45305d313db7e50180e3be4da","afterSHA256":"93749e4c555e4f0e16461aab8a6a418c2d29e5d45305d313db7e50180e3be4da","reason":"Same source body in authored semantic page"},{"oldId":"b-b51947291797486d0fc4a4f2","targetId":"b-b51947291797486d0fc4a4f2","page":"h-i-follow-one-key","operation":"move","beforeSHA256":"3372b11342ebcdd9d3768ed439f5cd51b1b41364077b222a213f25f95759dd5d","afterSHA256":"3372b11342ebcdd9d3768ed439f5cd51b1b41364077b222a213f25f95759dd5d","reason":"Same source body in authored semantic page"},{"oldId":"b-ec38ce9e2de8c96199d3653f","targetId":"b-ec38ce9e2de8c96199d3653f","page":"h-i-follow-one-key","operation":"move","beforeSHA256":"e3e35f8636c3b9db838cbc333a9a8d0c36f933bffd7004f49afcb2610515061e","afterSHA256":"e3e35f8636c3b9db838cbc333a9a8d0c36f933bffd7004f49afcb2610515061e","reason":"Same source body in authored semantic page"},{"oldId":"b-c01e50ed2f492b1107a0463c","targetId":"b-c01e50ed2f492b1107a0463c","page":"h-i-follow-one-key","operation":"move","beforeSHA256":"958821f405d7e1cc1f7d17fd6eac5763b7a41dd75223b9498536cfae1b46711b","afterSHA256":"958821f405d7e1cc1f7d17fd6eac5763b7a41dd75223b9498536cfae1b46711b","reason":"Same source body in authored semantic page"},{"oldId":"b-ed8f1182edc21f5a41770581","targetId":"b-ed8f1182edc21f5a41770581","page":"h-i-follow-one-key","operation":"move","beforeSHA256":"b130cb7eb53ce9451428fb245c8e3837e10b1d85e7c7ac232b00bb72532212b0","afterSHA256":"b130cb7eb53ce9451428fb245c8e3837e10b1d85e7c7ac232b00bb72532212b0","reason":"Same source body in authored semantic page"},{"oldId":"b-5adfc962e6ed0d7b30d8fefc","targetId":"b-5adfc962e6ed0d7b30d8fefc","page":"h-i-follow-one-key","operation":"move","beforeSHA256":"10d873dba3a7aa2449a5b166cc444c9f37e8554d9cfdb7f3a19d36ca93521fe2","afterSHA256":"10d873dba3a7aa2449a5b166cc444c9f37e8554d9cfdb7f3a19d36ca93521fe2","reason":"Same source body in authored semantic page"},{"oldId":"b-306da3f9bc15e4cdd8bff691","targetId":"b-306da3f9bc15e4cdd8bff691","page":"h-i-follow-one-key","operation":"move","beforeSHA256":"d0e9e795cf11b971fb65629f1b3c0570186830e14caf096b9e067af88c120880","afterSHA256":"d0e9e795cf11b971fb65629f1b3c0570186830e14caf096b9e067af88c120880","reason":"Same source body in authored semantic page"},{"oldId":"b-0bdc14954107188fcb89b008","targetId":"b-0bdc14954107188fcb89b008","page":"h-i-follow-one-key","operation":"move","beforeSHA256":"a8d292570de077c1d170cf1e02e3f756c5e6147229fb804255ed87911e3c1daf","afterSHA256":"a8d292570de077c1d170cf1e02e3f756c5e6147229fb804255ed87911e3c1daf","reason":"Same source body in authored semantic page"},{"oldId":"b-e09e492b1b59de37e599f94e","targetId":"b-e09e492b1b59de37e599f94e","page":"h-i-follow-one-key","operation":"move","beforeSHA256":"cf44fcc62782fb4f6bdc42c16c5187d57556a03cb7ce6065e7bd9c36d8e7d733","afterSHA256":"cf44fcc62782fb4f6bdc42c16c5187d57556a03cb7ce6065e7bd9c36d8e7d733","reason":"Same source body in authored semantic page"},{"oldId":"b-6fa960ad76e6e5682c663417","targetId":"b-6fa960ad76e6e5682c663417","page":"h-i-follow-one-key","operation":"move","beforeSHA256":"54ae9dd7c05afb2f716541d7c927af09dc3dec8a3bfda59377663c7b3462eec1","afterSHA256":"54ae9dd7c05afb2f716541d7c927af09dc3dec8a3bfda59377663c7b3462eec1","reason":"Same source body in authored semantic page"},{"oldId":"b-1a8ce28506ca689b9653381f","targetId":"b-1a8ce28506ca689b9653381f","page":"h-i-follow-one-key","operation":"move","beforeSHA256":"6d2d900ba343fa6fbc12af38b554690ea112560d21a196f0a5a7fb4eda2e2fb9","afterSHA256":"6d2d900ba343fa6fbc12af38b554690ea112560d21a196f0a5a7fb4eda2e2fb9","reason":"Same source body in authored semantic page"},{"oldId":"h-i-follow-one-key-title","targetId":"b-e4a345e3a27ef706bb80b2a1","operation":"retain-source-identity"}],"blocks":[{"id":"b-e4a345e3a27ef706bb80b2a1","type":"h2","scope":"h-i-follow-one-key","url":"https://codingai-lec03.pages.dev/course/pages/l3-r2-p17.html#b-e4a345e3a27ef706bb80b2a1","content":"## 沿着一个 key，走完当前步与下一步","sha256":"2e49331f3908a534b5394d0214367b323676ebb9161891f9a929c8ed55cea492","chapter":{"id":"I","title":"学习信号与表示"},"unit":{"id":"i-dictionary-and-updates","title":"怎样增加候选，同时让历史表示仍可比较？"},"page":{"id":"h-i-follow-one-key","title":"沿着一个 key，走完当前步与下一步","number":1},"sectionTitle":"沿着一个 key，走完当前步与下一步","currentQuestion":"怎样增加候选，同时让历史表示仍可比较？","sourceSlides":["l3-r2-p17"],"knowledgeBlock":null,"formulas":[],"previousBlock":null,"nextBlock":"b-10e06945dfc69583f5d9f199","prerequisites":[{"id":"b-d6f757231a5d40953f2cd390","url":"#b-d6f757231a5d40953f2cd390","role":"problem-context"}],"relatedBlocks":[{"id":"b-16e6e38ad53c56b94caf0b7e","url":"#b-16e6e38ad53c56b94caf0b7e","relation":"figure-and-explanation"}]},{"id":"b-10e06945dfc69583f5d9f199","type":"h2","scope":"explanation","url":"https://codingai-lec03.pages.dev/course/pages/l3-r2-p17.html#b-10e06945dfc69583f5d9f199","content":"## 解释、算例与证据","sha256":"d71cf15e707c8a3674b4c90a599efee783cb84da5b8c8236a1d01c3add7b4958","chapter":{"id":"I","title":"学习信号与表示"},"unit":{"id":"i-dictionary-and-updates","title":"怎样增加候选，同时让历史表示仍可比较？"},"page":{"id":"h-i-follow-one-key","title":"沿着一个 key，走完当前步与下一步","number":1},"sectionTitle":"沿着一个 key，走完当前步与下一步","currentQuestion":"怎样增加候选，同时让历史表示仍可比较？","sourceSlides":["l3-r2-p17"],"knowledgeBlock":null,"formulas":[],"previousBlock":"b-e4a345e3a27ef706bb80b2a1","nextBlock":"b-5e6bf3c2b5ca85f660ee8919","prerequisites":[{"id":"b-e4a345e3a27ef706bb80b2a1","url":"#b-e4a345e3a27ef706bb80b2a1","role":"section-title"},{"id":"b-d6f757231a5d40953f2cd390","url":"#b-d6f757231a5d40953f2cd390","role":"problem-context"}],"relatedBlocks":[{"id":"b-16e6e38ad53c56b94caf0b7e","url":"#b-16e6e38ad53c56b94caf0b7e","relation":"figure-and-explanation"}]},{"id":"b-5e6bf3c2b5ca85f660ee8919","type":"h1","scope":"document","url":"https://codingai-lec03.pages.dev/course/pages/l3-r2-p17.html#b-5e6bf3c2b5ca85f660ee8919","content":"# P17 · 把一次学习完整走通","sha256":"14aa4aad676112111771e67d4486fcc88d02367afebbe8021bd6c13c3a90d55f","chapter":{"id":"I","title":"学习信号与表示"},"unit":{"id":"i-dictionary-and-updates","title":"怎样增加候选，同时让历史表示仍可比较？"},"page":{"id":"h-i-follow-one-key","title":"沿着一个 key，走完当前步与下一步","number":1},"sectionTitle":"沿着一个 key，走完当前步与下一步","currentQuestion":"怎样增加候选，同时让历史表示仍可比较？","sourceSlides":["l3-r2-p17"],"knowledgeBlock":null,"formulas":[],"previousBlock":"b-10e06945dfc69583f5d9f199","nextBlock":"b-d6f757231a5d40953f2cd390","prerequisites":[{"id":"b-10e06945dfc69583f5d9f199","url":"#b-10e06945dfc69583f5d9f199","role":"section-title"},{"id":"b-d6f757231a5d40953f2cd390","url":"#b-d6f757231a5d40953f2cd390","role":"problem-context"}],"relatedBlocks":[{"id":"b-16e6e38ad53c56b94caf0b7e","url":"#b-16e6e38ad53c56b94caf0b7e","relation":"figure-and-explanation"}]},{"id":"b-d6f757231a5d40953f2cd390","type":"p","scope":"document","url":"https://codingai-lec03.pages.dev/course/pages/l3-r2-p17.html#b-d6f757231a5d40953f2cd390","content":"本页把前两页对象放回一条可追踪过程。纸面步骤与Notebook时序有细微差异，说明已明确标注。","sha256":"32e3dfb57a0c0ee8ebfaa6dba8b4550a4d63de60d198ddcb5319190026ceea8c","chapter":{"id":"I","title":"学习信号与表示"},"unit":{"id":"i-dictionary-and-updates","title":"怎样增加候选，同时让历史表示仍可比较？"},"page":{"id":"h-i-follow-one-key","title":"沿着一个 key，走完当前步与下一步","number":1},"sectionTitle":"沿着一个 key，走完当前步与下一步","currentQuestion":"怎样增加候选，同时让历史表示仍可比较？","sourceSlides":["l3-r2-p17"],"knowledgeBlock":null,"formulas":[],"previousBlock":"b-5e6bf3c2b5ca85f660ee8919","nextBlock":"b-16e6e38ad53c56b94caf0b7e","prerequisites":[{"id":"b-5e6bf3c2b5ca85f660ee8919","url":"#b-5e6bf3c2b5ca85f660ee8919","role":"section-title"}],"relatedBlocks":[{"id":"b-16e6e38ad53c56b94caf0b7e","url":"#b-16e6e38ad53c56b94caf0b7e","relation":"figure-and-explanation"}]},{"id":"b-16e6e38ad53c56b94caf0b7e","type":"figure","scope":"document","url":"https://codingai-lec03.pages.dev/course/pages/l3-r2-p17.html#b-16e6e38ad53c56b94caf0b7e","content":"图内标签与数值：P17 学习表示机制图，状态 3；同一输入；视图 a；视图 b；query 编码器；key 编码器；q；k⁺ = k₅；L = −ln p⁺；比较用旧字典；k₁ … k₄；q 与所有候选比较；k⁺ 是本轮正确项；梯度 → θq；EMA；k₅ 入队；k₁ 退队；k₂ k₃ k₄ k₅；下一批的字典；按原文算法 1：更新 query，再平均 key 参数并维护下一批的字典。\n\n一对同源视图、query/key编码、正键与旧字典、损失、query梯度、key EMA和下一批字典在同图逐步接齐。\n\n- 同一输入\n- 视图 a\n- 视图 b\n- query 编码器\n- key 编码器\n- q\n- k⁺ = k₅\n- L = −ln p⁺\n- 比较用旧字典\n- k₁ … k₄\n- q 与所有候选比较\n- k⁺ 是本轮正确项\n- 梯度 → θq\n- EMA\n- k₅ 入队；k₁ 退队\n- k₂ k₃ k₄ k₅\n- 下一批的字典\n- 按原文算法 1：更新 query，再平均 key 参数并维护下一批的字典。一对同源视图、query/key编码、正键与旧字典、损失、query梯度、key EMA和下一批字典在同图逐步接齐。 [查看对应图解状态](/#/l3-r2-p17/2)[查看完整图解](/course/figures/l3-r2-p17-2.html)","sha256":"4d92557b7862702cfa084365eb12440bd43590b8bd0b9ec447282122a4da725b","chapter":{"id":"I","title":"学习信号与表示"},"unit":{"id":"i-dictionary-and-updates","title":"怎样增加候选，同时让历史表示仍可比较？"},"page":{"id":"h-i-follow-one-key","title":"沿着一个 key，走完当前步与下一步","number":1},"sectionTitle":"沿着一个 key，走完当前步与下一步","currentQuestion":"怎样增加候选，同时让历史表示仍可比较？","sourceSlides":["l3-r2-p17"],"knowledgeBlock":null,"formulas":[],"figure":{"caption":"一对同源视图、query/key编码、正键与旧字典、损失、query梯度、key EMA和下一批字典在同图逐步接齐。 查看对应图解状态","labels":["同一输入","视图 a","视图 b","query 编码器","key 编码器","q","k⁺ = k₅","L = −ln p⁺","比较用旧字典","k₁ … k₄","q 与所有候选比较","k⁺ 是本轮正确项","梯度 → θq","EMA","k₅ 入队；k₁ 退队","k₂ k₃ k₄ k₅","下一批的字典","按原文算法 1：更新 query，再平均 key 参数并维护下一批的字典。"],"description":"一对同源视图、query/key编码、正键与旧字典、损失、query梯度、key EMA和下一批字典在同图逐步接齐。同一输入视图 a视图 bquery 编码器key 编码器qk⁺ = k₅L = −ln p⁺比较用旧字典k₁ … k₄q 与所有候选比较k⁺ 是本轮正确项梯度 → θqEMAk₅ 入队；k₁ 退队k₂ k₃ k₄ k₅下一批的字典按原文算法 1：更新 query，再平均 key 参数并维护下一批的字典。","evidenceIdentity":"一对同源视图、query/key编码、正键与旧字典、损失、query梯度、key EMA和下一批字典在同图逐步接齐。 查看对应图解状态","images":[{"src":"/assets/display/9a66faeae8dd2c354bc56482.webp","alt":""}]},"previousBlock":"b-d6f757231a5d40953f2cd390","nextBlock":"b-1f647d857ec473a3c5d0a429","prerequisites":[{"id":"b-5e6bf3c2b5ca85f660ee8919","url":"#b-5e6bf3c2b5ca85f660ee8919","role":"section-title"},{"id":"b-d6f757231a5d40953f2cd390","url":"#b-d6f757231a5d40953f2cd390","role":"problem-context"}],"relatedBlocks":[]},{"id":"b-1f647d857ec473a3c5d0a429","type":"h2","scope":"narrative","url":"https://codingai-lec03.pages.dev/course/pages/l3-r2-p17.html#b-1f647d857ec473a3c5d0a429","content":"## 课堂讲述","sha256":"786ce10a6b32a492259a3dccd0a54e61cd41d28a34382fb7b5386c5f03b7ad69","chapter":{"id":"I","title":"学习信号与表示"},"unit":{"id":"i-dictionary-and-updates","title":"怎样增加候选，同时让历史表示仍可比较？"},"page":{"id":"h-i-follow-one-key","title":"沿着一个 key，走完当前步与下一步","number":1},"sectionTitle":"沿着一个 key，走完当前步与下一步","currentQuestion":"怎样增加候选，同时让历史表示仍可比较？","sourceSlides":["l3-r2-p17"],"knowledgeBlock":null,"formulas":[],"previousBlock":"b-16e6e38ad53c56b94caf0b7e","nextBlock":"b-dee0b934ce91a646024a978b","prerequisites":[{"id":"b-5e6bf3c2b5ca85f660ee8919","url":"#b-5e6bf3c2b5ca85f660ee8919","role":"section-title"},{"id":"b-d6f757231a5d40953f2cd390","url":"#b-d6f757231a5d40953f2cd390","role":"problem-context"}],"relatedBlocks":[{"id":"b-16e6e38ad53c56b94caf0b7e","url":"#b-16e6e38ad53c56b94caf0b7e","relation":"figure-and-explanation"}]},{"id":"b-dee0b934ce91a646024a978b","type":"p","scope":"narrative","url":"https://codingai-lec03.pages.dev/course/pages/l3-r2-p17.html#b-dee0b934ce91a646024a978b","content":"现在把刚才拆开的部件接起来。同一图片产生两个视图，分别形成查询和正键；再加上队列中的其他键，构成这次需要区分的候选。\n比较产生损失，损失通过查询分支改变参数。键编码器按自己的平均规则跟随，新的键进入队列，旧键离开。下一批数据到来时，网络参数和字典内容都已经不是上一批的状态。\n请沿着箭头看：视图关系提供答案，损失提供更新方向，字典组织提供更多比较对象，慢编码器支持跨步复用。我们不需要在课堂手写整个训练框架，但要能够说明每个部件解决什么问题。否则拿掉一个部件以后，连实验在检验哪项假设都说不清楚。","sha256":"cd6bc3ea8b3b61c39a70b613ef2230e79c64bd86e1a0b2262d6ad636853a67c7","chapter":{"id":"I","title":"学习信号与表示"},"unit":{"id":"i-dictionary-and-updates","title":"怎样增加候选，同时让历史表示仍可比较？"},"page":{"id":"h-i-follow-one-key","title":"沿着一个 key，走完当前步与下一步","number":1},"sectionTitle":"沿着一个 key，走完当前步与下一步","currentQuestion":"怎样增加候选，同时让历史表示仍可比较？","sourceSlides":["l3-r2-p17"],"knowledgeBlock":null,"formulas":[],"previousBlock":"b-1f647d857ec473a3c5d0a429","nextBlock":"b-a0b9c6ba48f9d3b76f56d650","prerequisites":[{"id":"b-1f647d857ec473a3c5d0a429","url":"#b-1f647d857ec473a3c5d0a429","role":"section-title"},{"id":"b-d6f757231a5d40953f2cd390","url":"#b-d6f757231a5d40953f2cd390","role":"problem-context"}],"relatedBlocks":[{"id":"b-16e6e38ad53c56b94caf0b7e","url":"#b-16e6e38ad53c56b94caf0b7e","relation":"figure-and-explanation"}]},{"id":"b-a0b9c6ba48f9d3b76f56d650","type":"h3","scope":"moco-one-step-paper-and-code","url":"https://codingai-lec03.pages.dev/course/pages/l3-r2-p17.html#b-a0b9c6ba48f9d3b76f56d650","content":"### 把一次学习走通，也读清实现顺序","sha256":"179d2c298dfbcc98e8ef0eb6546b0bf14035ae440eb7c327f9982750eaf19bf2","chapter":{"id":"I","title":"学习信号与表示"},"unit":{"id":"i-dictionary-and-updates","title":"怎样增加候选，同时让历史表示仍可比较？"},"page":{"id":"h-i-follow-one-key","title":"沿着一个 key，走完当前步与下一步","number":1},"sectionTitle":"把一次学习走通，也读清实现顺序","currentQuestion":"怎样增加候选，同时让历史表示仍可比较？","sourceSlides":["l3-r2-p17"],"knowledgeBlock":"moco-one-step-paper-and-code","formulas":[],"previousBlock":"b-dee0b934ce91a646024a978b","nextBlock":"b-37203fb622cdc25a4a53be97","prerequisites":[{"id":"b-1f647d857ec473a3c5d0a429","url":"#b-1f647d857ec473a3c5d0a429","role":"section-title"},{"id":"b-d6f757231a5d40953f2cd390","url":"#b-d6f757231a5d40953f2cd390","role":"problem-context"}],"relatedBlocks":[{"id":"b-16e6e38ad53c56b94caf0b7e","url":"#b-16e6e38ad53c56b94caf0b7e","relation":"figure-and-explanation"},{"id":"b-37203fb622cdc25a4a53be97","url":"#b-37203fb622cdc25a4a53be97","relation":"same-reasoning"},{"id":"b-df8cfd6e2ffb2a47fcbb37eb","url":"#b-df8cfd6e2ffb2a47fcbb37eb","relation":"same-reasoning"},{"id":"b-fc49e96c0f8a0d424de0980b","url":"#b-fc49e96c0f8a0d424de0980b","relation":"same-reasoning"}]},{"id":"b-37203fb622cdc25a4a53be97","type":"p","scope":"moco-one-step-paper-and-code","url":"https://codingai-lec03.pages.dev/course/pages/l3-r2-p17.html#b-37203fb622cdc25a4a53be97","content":"沿当前图逐项走：本批原图产生两视图；query/key编码器分别给出q、k⁺；q与k⁺及旧队列比较；loss更新query；key按EMA跟随；本次已经算出的k⁺入队、最老key出队。旧队列不因本步更新重算。","sha256":"4b3c3586979f78ca4986198828909eb0d7cfd735da40c74a52c00cfdce532130","chapter":{"id":"I","title":"学习信号与表示"},"unit":{"id":"i-dictionary-and-updates","title":"怎样增加候选，同时让历史表示仍可比较？"},"page":{"id":"h-i-follow-one-key","title":"沿着一个 key，走完当前步与下一步","number":1},"sectionTitle":"把一次学习走通，也读清实现顺序","currentQuestion":"怎样增加候选，同时让历史表示仍可比较？","sourceSlides":["l3-r2-p17"],"knowledgeBlock":"moco-one-step-paper-and-code","formulas":[],"previousBlock":"b-a0b9c6ba48f9d3b76f56d650","nextBlock":"b-df8cfd6e2ffb2a47fcbb37eb","prerequisites":[{"id":"b-a0b9c6ba48f9d3b76f56d650","url":"#b-a0b9c6ba48f9d3b76f56d650","role":"section-title"},{"id":"b-d6f757231a5d40953f2cd390","url":"#b-d6f757231a5d40953f2cd390","role":"problem-context"}],"relatedBlocks":[{"id":"b-16e6e38ad53c56b94caf0b7e","url":"#b-16e6e38ad53c56b94caf0b7e","relation":"figure-and-explanation"},{"id":"b-a0b9c6ba48f9d3b76f56d650","url":"#b-a0b9c6ba48f9d3b76f56d650","relation":"same-reasoning"},{"id":"b-df8cfd6e2ffb2a47fcbb37eb","url":"#b-df8cfd6e2ffb2a47fcbb37eb","relation":"same-reasoning"},{"id":"b-fc49e96c0f8a0d424de0980b","url":"#b-fc49e96c0f8a0d424de0980b","relation":"same-reasoning"}]},{"id":"b-df8cfd6e2ffb2a47fcbb37eb","type":"p","scope":"moco-one-step-paper-and-code","url":"https://codingai-lec03.pages.dev/course/pages/l3-r2-p17.html#b-df8cfd6e2ffb2a47fcbb37eb","content":"主讲画面按原论文Algorithm 1排列。当前LAB 07教学代码则在计算本批key之前执行EMA，再计算loss和query更新。这是训练步内的时序约定差异，读代码时必须跟着实际顺序，不要声称逐行相同。两者共享的关键机制是：query接受梯度、key停止梯度并平滑跟随、队列复用历史特征。","sha256":"8c189b3e064e75cf8a9b68c96e6804f3a774061b77b895462a26431cb0a3a9dd","chapter":{"id":"I","title":"学习信号与表示"},"unit":{"id":"i-dictionary-and-updates","title":"怎样增加候选，同时让历史表示仍可比较？"},"page":{"id":"h-i-follow-one-key","title":"沿着一个 key，走完当前步与下一步","number":1},"sectionTitle":"把一次学习走通，也读清实现顺序","currentQuestion":"怎样增加候选，同时让历史表示仍可比较？","sourceSlides":["l3-r2-p17"],"knowledgeBlock":"moco-one-step-paper-and-code","formulas":[],"previousBlock":"b-37203fb622cdc25a4a53be97","nextBlock":"b-fc49e96c0f8a0d424de0980b","prerequisites":[{"id":"b-a0b9c6ba48f9d3b76f56d650","url":"#b-a0b9c6ba48f9d3b76f56d650","role":"section-title"},{"id":"b-d6f757231a5d40953f2cd390","url":"#b-d6f757231a5d40953f2cd390","role":"problem-context"}],"relatedBlocks":[{"id":"b-16e6e38ad53c56b94caf0b7e","url":"#b-16e6e38ad53c56b94caf0b7e","relation":"figure-and-explanation"},{"id":"b-a0b9c6ba48f9d3b76f56d650","url":"#b-a0b9c6ba48f9d3b76f56d650","relation":"same-reasoning"},{"id":"b-37203fb622cdc25a4a53be97","url":"#b-37203fb622cdc25a4a53be97","relation":"same-reasoning"},{"id":"b-fc49e96c0f8a0d424de0980b","url":"#b-fc49e96c0f8a0d424de0980b","relation":"same-reasoning"}]},{"id":"b-fc49e96c0f8a0d424de0980b","type":"p","scope":"moco-one-step-paper-and-code","url":"https://codingai-lec03.pages.dev/course/pages/l3-r2-p17.html#b-fc49e96c0f8a0d424de0980b","content":"LAB 07另外在队列保存源图ID，屏蔽同源旧key，避免同一图片再次出现时成为自己的负例；不同源图仍可能属于同一类别。它没有论文的分布式ShuffleBN，训练15轮的效果也不用于论文排名。学生完成本节后，应能指出一条key何时生成、何时用于比较、何时离开。","sha256":"9afe8ea0540ab018647cf0d557e40ffbe3a252b27be86ee5cf1cf36f008fcf6d","chapter":{"id":"I","title":"学习信号与表示"},"unit":{"id":"i-dictionary-and-updates","title":"怎样增加候选，同时让历史表示仍可比较？"},"page":{"id":"h-i-follow-one-key","title":"沿着一个 key，走完当前步与下一步","number":1},"sectionTitle":"把一次学习走通，也读清实现顺序","currentQuestion":"怎样增加候选，同时让历史表示仍可比较？","sourceSlides":["l3-r2-p17"],"knowledgeBlock":"moco-one-step-paper-and-code","formulas":[],"previousBlock":"b-df8cfd6e2ffb2a47fcbb37eb","nextBlock":"b-2690bda565dec94b83927837","prerequisites":[{"id":"b-a0b9c6ba48f9d3b76f56d650","url":"#b-a0b9c6ba48f9d3b76f56d650","role":"section-title"},{"id":"b-d6f757231a5d40953f2cd390","url":"#b-d6f757231a5d40953f2cd390","role":"problem-context"}],"relatedBlocks":[{"id":"b-16e6e38ad53c56b94caf0b7e","url":"#b-16e6e38ad53c56b94caf0b7e","relation":"figure-and-explanation"},{"id":"b-a0b9c6ba48f9d3b76f56d650","url":"#b-a0b9c6ba48f9d3b76f56d650","relation":"same-reasoning"},{"id":"b-37203fb622cdc25a4a53be97","url":"#b-37203fb622cdc25a4a53be97","relation":"same-reasoning"},{"id":"b-df8cfd6e2ffb2a47fcbb37eb","url":"#b-df8cfd6e2ffb2a47fcbb37eb","relation":"same-reasoning"}]},{"id":"b-2690bda565dec94b83927837","type":"h3","scope":"moco-point-at-the-figure-dialogue","url":"https://codingai-lec03.pages.dev/course/pages/l3-r2-p17.html#b-2690bda565dec94b83927837","content":"### 模拟问答：旧 key 还能比较吗？","sha256":"93749e4c555e4f0e16461aab8a6a418c2d29e5d45305d313db7e50180e3be4da","chapter":{"id":"I","title":"学习信号与表示"},"unit":{"id":"i-dictionary-and-updates","title":"怎样增加候选，同时让历史表示仍可比较？"},"page":{"id":"h-i-follow-one-key","title":"沿着一个 key，走完当前步与下一步","number":1},"sectionTitle":"模拟问答：旧 key 还能比较吗？","currentQuestion":"怎样增加候选，同时让历史表示仍可比较？","sourceSlides":["l3-r2-p17"],"knowledgeBlock":"moco-point-at-the-figure-dialogue","formulas":[],"previousBlock":"b-fc49e96c0f8a0d424de0980b","nextBlock":"b-b51947291797486d0fc4a4f2","prerequisites":[{"id":"b-a0b9c6ba48f9d3b76f56d650","url":"#b-a0b9c6ba48f9d3b76f56d650","role":"section-title"},{"id":"b-d6f757231a5d40953f2cd390","url":"#b-d6f757231a5d40953f2cd390","role":"problem-context"}],"relatedBlocks":[{"id":"b-16e6e38ad53c56b94caf0b7e","url":"#b-16e6e38ad53c56b94caf0b7e","relation":"figure-and-explanation"},{"id":"b-b51947291797486d0fc4a4f2","url":"#b-b51947291797486d0fc4a4f2","relation":"same-reasoning"},{"id":"b-ec38ce9e2de8c96199d3653f","url":"#b-ec38ce9e2de8c96199d3653f","relation":"same-reasoning"},{"id":"b-c01e50ed2f492b1107a0463c","url":"#b-c01e50ed2f492b1107a0463c","relation":"same-reasoning"},{"id":"b-ed8f1182edc21f5a41770581","url":"#b-ed8f1182edc21f5a41770581","relation":"same-reasoning"},{"id":"b-5adfc962e6ed0d7b30d8fefc","url":"#b-5adfc962e6ed0d7b30d8fefc","relation":"same-reasoning"},{"id":"b-306da3f9bc15e4cdd8bff691","url":"#b-306da3f9bc15e4cdd8bff691","relation":"same-reasoning"},{"id":"b-0bdc14954107188fcb89b008","url":"#b-0bdc14954107188fcb89b008","relation":"same-reasoning"}]},{"id":"b-b51947291797486d0fc4a4f2","type":"p","scope":"moco-point-at-the-figure-dialogue","url":"https://codingai-lec03.pages.dev/course/pages/l3-r2-p17.html#b-b51947291797486d0fc4a4f2","content":"以下为备课用模拟对话，不是实际课堂记录。","sha256":"3372b11342ebcdd9d3768ed439f5cd51b1b41364077b222a213f25f95759dd5d","chapter":{"id":"I","title":"学习信号与表示"},"unit":{"id":"i-dictionary-and-updates","title":"怎样增加候选，同时让历史表示仍可比较？"},"page":{"id":"h-i-follow-one-key","title":"沿着一个 key，走完当前步与下一步","number":1},"sectionTitle":"模拟问答：旧 key 还能比较吗？","currentQuestion":"怎样增加候选，同时让历史表示仍可比较？","sourceSlides":["l3-r2-p17"],"knowledgeBlock":"moco-point-at-the-figure-dialogue","formulas":[],"previousBlock":"b-2690bda565dec94b83927837","nextBlock":"b-ec38ce9e2de8c96199d3653f","prerequisites":[{"id":"b-2690bda565dec94b83927837","url":"#b-2690bda565dec94b83927837","role":"section-title"},{"id":"b-d6f757231a5d40953f2cd390","url":"#b-d6f757231a5d40953f2cd390","role":"problem-context"}],"relatedBlocks":[{"id":"b-16e6e38ad53c56b94caf0b7e","url":"#b-16e6e38ad53c56b94caf0b7e","relation":"figure-and-explanation"},{"id":"b-2690bda565dec94b83927837","url":"#b-2690bda565dec94b83927837","relation":"same-reasoning"},{"id":"b-ec38ce9e2de8c96199d3653f","url":"#b-ec38ce9e2de8c96199d3653f","relation":"same-reasoning"},{"id":"b-c01e50ed2f492b1107a0463c","url":"#b-c01e50ed2f492b1107a0463c","relation":"same-reasoning"},{"id":"b-ed8f1182edc21f5a41770581","url":"#b-ed8f1182edc21f5a41770581","relation":"same-reasoning"},{"id":"b-5adfc962e6ed0d7b30d8fefc","url":"#b-5adfc962e6ed0d7b30d8fefc","relation":"same-reasoning"},{"id":"b-306da3f9bc15e4cdd8bff691","url":"#b-306da3f9bc15e4cdd8bff691","relation":"same-reasoning"},{"id":"b-0bdc14954107188fcb89b008","url":"#b-0bdc14954107188fcb89b008","relation":"same-reasoning"}]},{"id":"b-ec38ce9e2de8c96199d3653f","type":"p","scope":"moco-point-at-the-figure-dialogue","url":"https://codingai-lec03.pages.dev/course/pages/l3-r2-p17.html#b-ec38ce9e2de8c96199d3653f","content":"**学生：**“你说是前面算过的特征，图上到底哪几个？”","sha256":"e3e35f8636c3b9db838cbc333a9a8d0c36f933bffd7004f49afcb2610515061e","chapter":{"id":"I","title":"学习信号与表示"},"unit":{"id":"i-dictionary-and-updates","title":"怎样增加候选，同时让历史表示仍可比较？"},"page":{"id":"h-i-follow-one-key","title":"沿着一个 key，走完当前步与下一步","number":1},"sectionTitle":"模拟问答：旧 key 还能比较吗？","currentQuestion":"怎样增加候选，同时让历史表示仍可比较？","sourceSlides":["l3-r2-p17"],"knowledgeBlock":"moco-point-at-the-figure-dialogue","formulas":[],"previousBlock":"b-b51947291797486d0fc4a4f2","nextBlock":"b-c01e50ed2f492b1107a0463c","prerequisites":[{"id":"b-2690bda565dec94b83927837","url":"#b-2690bda565dec94b83927837","role":"section-title"},{"id":"b-d6f757231a5d40953f2cd390","url":"#b-d6f757231a5d40953f2cd390","role":"problem-context"}],"relatedBlocks":[{"id":"b-16e6e38ad53c56b94caf0b7e","url":"#b-16e6e38ad53c56b94caf0b7e","relation":"figure-and-explanation"},{"id":"b-2690bda565dec94b83927837","url":"#b-2690bda565dec94b83927837","relation":"same-reasoning"},{"id":"b-b51947291797486d0fc4a4f2","url":"#b-b51947291797486d0fc4a4f2","relation":"same-reasoning"},{"id":"b-c01e50ed2f492b1107a0463c","url":"#b-c01e50ed2f492b1107a0463c","relation":"same-reasoning"},{"id":"b-ed8f1182edc21f5a41770581","url":"#b-ed8f1182edc21f5a41770581","relation":"same-reasoning"},{"id":"b-5adfc962e6ed0d7b30d8fefc","url":"#b-5adfc962e6ed0d7b30d8fefc","relation":"same-reasoning"},{"id":"b-306da3f9bc15e4cdd8bff691","url":"#b-306da3f9bc15e4cdd8bff691","relation":"same-reasoning"},{"id":"b-0bdc14954107188fcb89b008","url":"#b-0bdc14954107188fcb89b008","relation":"same-reasoning"}]},{"id":"b-c01e50ed2f492b1107a0463c","type":"p","scope":"moco-point-at-the-figure-dialogue","url":"https://codingai-lec03.pages.dev/course/pages/l3-r2-p17.html#b-c01e50ed2f492b1107a0463c","content":"**教师：**“队列里的k1到k4是本步开始前就存在的。正在两视图分支里生成的k5是这次的新key。比较结束后k1离开，k5进入；你看下一批字典仍有k2、k3、k4。”","sha256":"958821f405d7e1cc1f7d17fd6eac5763b7a41dd75223b9498536cfae1b46711b","chapter":{"id":"I","title":"学习信号与表示"},"unit":{"id":"i-dictionary-and-updates","title":"怎样增加候选，同时让历史表示仍可比较？"},"page":{"id":"h-i-follow-one-key","title":"沿着一个 key，走完当前步与下一步","number":1},"sectionTitle":"模拟问答：旧 key 还能比较吗？","currentQuestion":"怎样增加候选，同时让历史表示仍可比较？","sourceSlides":["l3-r2-p17"],"knowledgeBlock":"moco-point-at-the-figure-dialogue","formulas":[],"previousBlock":"b-ec38ce9e2de8c96199d3653f","nextBlock":"b-ed8f1182edc21f5a41770581","prerequisites":[{"id":"b-2690bda565dec94b83927837","url":"#b-2690bda565dec94b83927837","role":"section-title"},{"id":"b-d6f757231a5d40953f2cd390","url":"#b-d6f757231a5d40953f2cd390","role":"problem-context"}],"relatedBlocks":[{"id":"b-16e6e38ad53c56b94caf0b7e","url":"#b-16e6e38ad53c56b94caf0b7e","relation":"figure-and-explanation"},{"id":"b-2690bda565dec94b83927837","url":"#b-2690bda565dec94b83927837","relation":"same-reasoning"},{"id":"b-b51947291797486d0fc4a4f2","url":"#b-b51947291797486d0fc4a4f2","relation":"same-reasoning"},{"id":"b-ec38ce9e2de8c96199d3653f","url":"#b-ec38ce9e2de8c96199d3653f","relation":"same-reasoning"},{"id":"b-ed8f1182edc21f5a41770581","url":"#b-ed8f1182edc21f5a41770581","relation":"same-reasoning"},{"id":"b-5adfc962e6ed0d7b30d8fefc","url":"#b-5adfc962e6ed0d7b30d8fefc","relation":"same-reasoning"},{"id":"b-306da3f9bc15e4cdd8bff691","url":"#b-306da3f9bc15e4cdd8bff691","relation":"same-reasoning"},{"id":"b-0bdc14954107188fcb89b008","url":"#b-0bdc14954107188fcb89b008","relation":"same-reasoning"}]},{"id":"b-ed8f1182edc21f5a41770581","type":"p","scope":"moco-point-at-the-figure-dialogue","url":"https://codingai-lec03.pages.dev/course/pages/l3-r2-p17.html#b-ed8f1182edc21f5a41770581","content":"**学生：**“编码器已经变了，它们为什么还能比？”","sha256":"b130cb7eb53ce9451428fb245c8e3837e10b1d85e7c7ac232b00bb72532212b0","chapter":{"id":"I","title":"学习信号与表示"},"unit":{"id":"i-dictionary-and-updates","title":"怎样增加候选，同时让历史表示仍可比较？"},"page":{"id":"h-i-follow-one-key","title":"沿着一个 key，走完当前步与下一步","number":1},"sectionTitle":"模拟问答：旧 key 还能比较吗？","currentQuestion":"怎样增加候选，同时让历史表示仍可比较？","sourceSlides":["l3-r2-p17"],"knowledgeBlock":"moco-point-at-the-figure-dialogue","formulas":[],"previousBlock":"b-c01e50ed2f492b1107a0463c","nextBlock":"b-5adfc962e6ed0d7b30d8fefc","prerequisites":[{"id":"b-2690bda565dec94b83927837","url":"#b-2690bda565dec94b83927837","role":"section-title"},{"id":"b-d6f757231a5d40953f2cd390","url":"#b-d6f757231a5d40953f2cd390","role":"problem-context"}],"relatedBlocks":[{"id":"b-16e6e38ad53c56b94caf0b7e","url":"#b-16e6e38ad53c56b94caf0b7e","relation":"figure-and-explanation"},{"id":"b-2690bda565dec94b83927837","url":"#b-2690bda565dec94b83927837","relation":"same-reasoning"},{"id":"b-b51947291797486d0fc4a4f2","url":"#b-b51947291797486d0fc4a4f2","relation":"same-reasoning"},{"id":"b-ec38ce9e2de8c96199d3653f","url":"#b-ec38ce9e2de8c96199d3653f","relation":"same-reasoning"},{"id":"b-c01e50ed2f492b1107a0463c","url":"#b-c01e50ed2f492b1107a0463c","relation":"same-reasoning"},{"id":"b-5adfc962e6ed0d7b30d8fefc","url":"#b-5adfc962e6ed0d7b30d8fefc","relation":"same-reasoning"},{"id":"b-306da3f9bc15e4cdd8bff691","url":"#b-306da3f9bc15e4cdd8bff691","relation":"same-reasoning"},{"id":"b-0bdc14954107188fcb89b008","url":"#b-0bdc14954107188fcb89b008","relation":"same-reasoning"}]},{"id":"b-5adfc962e6ed0d7b30d8fefc","type":"p","scope":"moco-point-at-the-figure-dialogue","url":"https://codingai-lec03.pages.dev/course/pages/l3-r2-p17.html#b-5adfc962e6ed0d7b30d8fefc","content":"**教师：**“这是设计需要处理的困难。query可以随梯度更新，key参数用EMA缓慢跟随，减少相邻批之间的变化。旧向量没有重算，所以只能说缓和漂移，不能说完全一致。队列越长，最旧条目越老，取舍就更明显。”","sha256":"10d873dba3a7aa2449a5b166cc444c9f37e8554d9cfdb7f3a19d36ca93521fe2","chapter":{"id":"I","title":"学习信号与表示"},"unit":{"id":"i-dictionary-and-updates","title":"怎样增加候选，同时让历史表示仍可比较？"},"page":{"id":"h-i-follow-one-key","title":"沿着一个 key，走完当前步与下一步","number":1},"sectionTitle":"模拟问答：旧 key 还能比较吗？","currentQuestion":"怎样增加候选，同时让历史表示仍可比较？","sourceSlides":["l3-r2-p17"],"knowledgeBlock":"moco-point-at-the-figure-dialogue","formulas":[],"previousBlock":"b-ed8f1182edc21f5a41770581","nextBlock":"b-306da3f9bc15e4cdd8bff691","prerequisites":[{"id":"b-2690bda565dec94b83927837","url":"#b-2690bda565dec94b83927837","role":"section-title"},{"id":"b-d6f757231a5d40953f2cd390","url":"#b-d6f757231a5d40953f2cd390","role":"problem-context"}],"relatedBlocks":[{"id":"b-16e6e38ad53c56b94caf0b7e","url":"#b-16e6e38ad53c56b94caf0b7e","relation":"figure-and-explanation"},{"id":"b-2690bda565dec94b83927837","url":"#b-2690bda565dec94b83927837","relation":"same-reasoning"},{"id":"b-b51947291797486d0fc4a4f2","url":"#b-b51947291797486d0fc4a4f2","relation":"same-reasoning"},{"id":"b-ec38ce9e2de8c96199d3653f","url":"#b-ec38ce9e2de8c96199d3653f","relation":"same-reasoning"},{"id":"b-c01e50ed2f492b1107a0463c","url":"#b-c01e50ed2f492b1107a0463c","relation":"same-reasoning"},{"id":"b-ed8f1182edc21f5a41770581","url":"#b-ed8f1182edc21f5a41770581","relation":"same-reasoning"},{"id":"b-306da3f9bc15e4cdd8bff691","url":"#b-306da3f9bc15e4cdd8bff691","relation":"same-reasoning"},{"id":"b-0bdc14954107188fcb89b008","url":"#b-0bdc14954107188fcb89b008","relation":"same-reasoning"}]},{"id":"b-306da3f9bc15e4cdd8bff691","type":"p","scope":"moco-point-at-the-figure-dialogue","url":"https://codingai-lec03.pages.dev/course/pages/l3-r2-p17.html#b-306da3f9bc15e4cdd8bff691","content":"**学生：**“那EMA是不是改了队列里面的数？”","sha256":"d0e9e795cf11b971fb65629f1b3c0570186830e14caf096b9e067af88c120880","chapter":{"id":"I","title":"学习信号与表示"},"unit":{"id":"i-dictionary-and-updates","title":"怎样增加候选，同时让历史表示仍可比较？"},"page":{"id":"h-i-follow-one-key","title":"沿着一个 key，走完当前步与下一步","number":1},"sectionTitle":"模拟问答：旧 key 还能比较吗？","currentQuestion":"怎样增加候选，同时让历史表示仍可比较？","sourceSlides":["l3-r2-p17"],"knowledgeBlock":"moco-point-at-the-figure-dialogue","formulas":[],"previousBlock":"b-5adfc962e6ed0d7b30d8fefc","nextBlock":"b-0bdc14954107188fcb89b008","prerequisites":[{"id":"b-2690bda565dec94b83927837","url":"#b-2690bda565dec94b83927837","role":"section-title"},{"id":"b-d6f757231a5d40953f2cd390","url":"#b-d6f757231a5d40953f2cd390","role":"problem-context"}],"relatedBlocks":[{"id":"b-16e6e38ad53c56b94caf0b7e","url":"#b-16e6e38ad53c56b94caf0b7e","relation":"figure-and-explanation"},{"id":"b-2690bda565dec94b83927837","url":"#b-2690bda565dec94b83927837","relation":"same-reasoning"},{"id":"b-b51947291797486d0fc4a4f2","url":"#b-b51947291797486d0fc4a4f2","relation":"same-reasoning"},{"id":"b-ec38ce9e2de8c96199d3653f","url":"#b-ec38ce9e2de8c96199d3653f","relation":"same-reasoning"},{"id":"b-c01e50ed2f492b1107a0463c","url":"#b-c01e50ed2f492b1107a0463c","relation":"same-reasoning"},{"id":"b-ed8f1182edc21f5a41770581","url":"#b-ed8f1182edc21f5a41770581","relation":"same-reasoning"},{"id":"b-5adfc962e6ed0d7b30d8fefc","url":"#b-5adfc962e6ed0d7b30d8fefc","relation":"same-reasoning"},{"id":"b-0bdc14954107188fcb89b008","url":"#b-0bdc14954107188fcb89b008","relation":"same-reasoning"}]},{"id":"b-0bdc14954107188fcb89b008","type":"p","scope":"moco-point-at-the-figure-dialogue","url":"https://codingai-lec03.pages.dev/course/pages/l3-r2-p17.html#b-0bdc14954107188fcb89b008","content":"**教师：**“没有。看箭头：EMA连的是两套网络参数，FIFO操作连的是向量槽位。把这两条箭头分开，整步就清楚了。”","sha256":"a8d292570de077c1d170cf1e02e3f756c5e6147229fb804255ed87911e3c1daf","chapter":{"id":"I","title":"学习信号与表示"},"unit":{"id":"i-dictionary-and-updates","title":"怎样增加候选，同时让历史表示仍可比较？"},"page":{"id":"h-i-follow-one-key","title":"沿着一个 key，走完当前步与下一步","number":1},"sectionTitle":"模拟问答：旧 key 还能比较吗？","currentQuestion":"怎样增加候选，同时让历史表示仍可比较？","sourceSlides":["l3-r2-p17"],"knowledgeBlock":"moco-point-at-the-figure-dialogue","formulas":[],"previousBlock":"b-306da3f9bc15e4cdd8bff691","nextBlock":"b-e09e492b1b59de37e599f94e","prerequisites":[{"id":"b-2690bda565dec94b83927837","url":"#b-2690bda565dec94b83927837","role":"section-title"},{"id":"b-d6f757231a5d40953f2cd390","url":"#b-d6f757231a5d40953f2cd390","role":"problem-context"}],"relatedBlocks":[{"id":"b-16e6e38ad53c56b94caf0b7e","url":"#b-16e6e38ad53c56b94caf0b7e","relation":"figure-and-explanation"},{"id":"b-2690bda565dec94b83927837","url":"#b-2690bda565dec94b83927837","relation":"same-reasoning"},{"id":"b-b51947291797486d0fc4a4f2","url":"#b-b51947291797486d0fc4a4f2","relation":"same-reasoning"},{"id":"b-ec38ce9e2de8c96199d3653f","url":"#b-ec38ce9e2de8c96199d3653f","relation":"same-reasoning"},{"id":"b-c01e50ed2f492b1107a0463c","url":"#b-c01e50ed2f492b1107a0463c","relation":"same-reasoning"},{"id":"b-ed8f1182edc21f5a41770581","url":"#b-ed8f1182edc21f5a41770581","relation":"same-reasoning"},{"id":"b-5adfc962e6ed0d7b30d8fefc","url":"#b-5adfc962e6ed0d7b30d8fefc","relation":"same-reasoning"},{"id":"b-306da3f9bc15e4cdd8bff691","url":"#b-306da3f9bc15e4cdd8bff691","relation":"same-reasoning"}]},{"id":"b-e09e492b1b59de37e599f94e","type":"h2","scope":"practice","url":"https://codingai-lec03.pages.dev/course/pages/l3-r2-p17.html#b-e09e492b1b59de37e599f94e","content":"## 沿这个问题继续","sha256":"cf44fcc62782fb4f6bdc42c16c5187d57556a03cb7ce6065e7bd9c36d8e7d733","chapter":{"id":"I","title":"学习信号与表示"},"unit":{"id":"i-dictionary-and-updates","title":"怎样增加候选，同时让历史表示仍可比较？"},"page":{"id":"h-i-follow-one-key","title":"沿着一个 key，走完当前步与下一步","number":1},"sectionTitle":"沿着一个 key，走完当前步与下一步","currentQuestion":"怎样增加候选，同时让历史表示仍可比较？","sourceSlides":["l3-r2-p17"],"knowledgeBlock":null,"formulas":[],"previousBlock":"b-0bdc14954107188fcb89b008","nextBlock":"b-6fa960ad76e6e5682c663417","prerequisites":[{"id":"b-2690bda565dec94b83927837","url":"#b-2690bda565dec94b83927837","role":"section-title"},{"id":"b-d6f757231a5d40953f2cd390","url":"#b-d6f757231a5d40953f2cd390","role":"problem-context"}],"relatedBlocks":[{"id":"b-16e6e38ad53c56b94caf0b7e","url":"#b-16e6e38ad53c56b94caf0b7e","relation":"figure-and-explanation"}]},{"id":"b-6fa960ad76e6e5682c663417","type":"p","scope":"practice","url":"https://codingai-lec03.pages.dev/course/pages/l3-r2-p17.html#b-6fa960ad76e6e5682c663417","content":"先读模拟对话并指着图回答，再读LAB 07真实训练函数；检查key无梯度、FIFO和源图ID屏蔽。","sha256":"54ae9dd7c05afb2f716541d7c927af09dc3dec8a3bfda59377663c7b3462eec1","chapter":{"id":"I","title":"学习信号与表示"},"unit":{"id":"i-dictionary-and-updates","title":"怎样增加候选，同时让历史表示仍可比较？"},"page":{"id":"h-i-follow-one-key","title":"沿着一个 key，走完当前步与下一步","number":1},"sectionTitle":"沿着一个 key，走完当前步与下一步","currentQuestion":"怎样增加候选，同时让历史表示仍可比较？","sourceSlides":["l3-r2-p17"],"knowledgeBlock":null,"formulas":[],"previousBlock":"b-e09e492b1b59de37e599f94e","nextBlock":"b-455101393e3a2dde09eb0e75","prerequisites":[{"id":"b-e09e492b1b59de37e599f94e","url":"#b-e09e492b1b59de37e599f94e","role":"section-title"},{"id":"b-d6f757231a5d40953f2cd390","url":"#b-d6f757231a5d40953f2cd390","role":"problem-context"}],"relatedBlocks":[{"id":"b-16e6e38ad53c56b94caf0b7e","url":"#b-16e6e38ad53c56b94caf0b7e","relation":"figure-and-explanation"}]},{"id":"b-455101393e3a2dde09eb0e75","type":"h4","scope":"h-i-follow-one-key","url":"https://codingai-lec03.pages.dev/course/pages/l3-r2-p17.html#b-455101393e3a2dde09eb0e75","content":"#### 图示条件与公式约定","sha256":"ef7f915c1ae63ed67bd23fecf050249273ba0efa8965d2c8d1c1c6b2d3178122","chapter":{"id":"I","title":"学习信号与表示"},"unit":{"id":"i-dictionary-and-updates","title":"怎样增加候选，同时让历史表示仍可比较？"},"page":{"id":"h-i-follow-one-key","title":"沿着一个 key，走完当前步与下一步","number":1},"sectionTitle":"沿着一个 key，走完当前步与下一步","currentQuestion":"怎样增加候选，同时让历史表示仍可比较？","sourceSlides":["l3-r2-p17"],"knowledgeBlock":null,"formulas":[],"previousBlock":"b-6fa960ad76e6e5682c663417","nextBlock":"b-1a8ce28506ca689b9653381f","prerequisites":[{"id":"b-e09e492b1b59de37e599f94e","url":"#b-e09e492b1b59de37e599f94e","role":"section-title"},{"id":"b-d6f757231a5d40953f2cd390","url":"#b-d6f757231a5d40953f2cd390","role":"problem-context"}],"relatedBlocks":[{"id":"b-16e6e38ad53c56b94caf0b7e","url":"#b-16e6e38ad53c56b94caf0b7e","relation":"figure-and-explanation"}]},{"id":"b-1a8ce28506ca689b9653381f","type":"p","scope":"document","url":"https://codingai-lec03.pages.dev/course/pages/l3-r2-p17.html#b-1a8ce28506ca689b9653381f","content":"本图按 MoCo 原文 Algorithm 1 理解一次循环：两分支编码并对 key 停止梯度，使用旧字典计算损失，反传更新 query，EMA 更新 key 参数，再将本批键入队并移除最旧键。本页单样本教学循环：正键k+=k5，新字典为[k2,k3,k4,k5]，只移出k1。P15另用双样本说明入队批量，二者规模明确区分。字典旧向量不被追溯重算。","sha256":"6d2d900ba343fa6fbc12af38b554690ea112560d21a196f0a5a7fb4eda2e2fb9","chapter":{"id":"I","title":"学习信号与表示"},"unit":{"id":"i-dictionary-and-updates","title":"怎样增加候选，同时让历史表示仍可比较？"},"page":{"id":"h-i-follow-one-key","title":"沿着一个 key，走完当前步与下一步","number":1},"sectionTitle":"沿着一个 key，走完当前步与下一步","currentQuestion":"怎样增加候选，同时让历史表示仍可比较？","sourceSlides":["l3-r2-p17"],"knowledgeBlock":null,"formulas":[],"previousBlock":"b-455101393e3a2dde09eb0e75","nextBlock":null,"prerequisites":[{"id":"b-455101393e3a2dde09eb0e75","url":"#b-455101393e3a2dde09eb0e75","role":"section-title"},{"id":"b-d6f757231a5d40953f2cd390","url":"#b-d6f757231a5d40953f2cd390","role":"problem-context"}],"relatedBlocks":[{"id":"b-16e6e38ad53c56b94caf0b7e","url":"#b-16e6e38ad53c56b94caf0b7e","relation":"figure-and-explanation"}]}]}