{"version":2,"relationshipURLBase":"https://codingai-lec03.pages.dev/course/notebook-blocks/66b6304ea0cf47dd9c5bb009263057ab.html","relationshipResolution":"Resolve relative relationship URLs against relationshipURLBase; complete records and absolute URLs are in blocks.","title":"活动 A：一张小矩阵，两种查找方向","url":"https://codingai-lec03.pages.dev/course/notebook-blocks/66b6304ea0cf47dd9c5bb009263057ab.html","markdown":"https://codingai-lec03.pages.dev/course/notebook-blocks/66b6304ea0cf47dd9c5bb009263057ab.md","pages":[{"id":"reading-opening","title":"活动 A：一张小矩阵，两种查找方向","unit":"活动 A：一张小矩阵，两种查找方向","unitId":"notebook-blocks/66b6304ea0cf47dd9c5bb009263057ab","chapter":"course","number":1}],"aliases":[{"oldId":"b-ec02c55b354f4006bf982600","targetId":"b-ec02c55b354f4006bf982600","page":"reading-opening","operation":"move","beforeSHA256":"343fb71807f077069b41c6495a8824ea4d353c740175b5775ccc5145b3bf19ca","afterSHA256":"343fb71807f077069b41c6495a8824ea4d353c740175b5775ccc5145b3bf19ca","reason":"Same source body in authored semantic page"},{"oldId":"b-8d8b0e0a123a45bf8438c40b","targetId":"b-8d8b0e0a123a45bf8438c40b","page":"reading-opening","operation":"move","beforeSHA256":"2ad310f9d8447162e178f095b452a34c834d7560799391ea141e58efc4e26008","afterSHA256":"2ad310f9d8447162e178f095b452a34c834d7560799391ea141e58efc4e26008","reason":"Same source body in authored semantic page"},{"oldId":"b-09ee4ac66148db7e7ed9e386","targetId":"b-09ee4ac66148db7e7ed9e386","page":"reading-opening","operation":"move","beforeSHA256":"42cba31deccba2a350b9b23bd0ca1dcaa4c4c5cb9d35c773e1fcb89124788ccd","afterSHA256":"42cba31deccba2a350b9b23bd0ca1dcaa4c4c5cb9d35c773e1fcb89124788ccd","reason":"Same source body in authored semantic page"},{"oldId":"b-99a7c7db9f55d8e3832bad09","targetId":"b-99a7c7db9f55d8e3832bad09","page":"reading-opening","operation":"move","beforeSHA256":"41c70c2c07b82678ff0a60f2d009b6afa750c5c691d109e754a69abf23868b50","afterSHA256":"41c70c2c07b82678ff0a60f2d009b6afa750c5c691d109e754a69abf23868b50","reason":"Same source body in authored semantic page"},{"oldId":"b-88b9f822073fc42e28455348","targetId":"b-88b9f822073fc42e28455348","page":"reading-opening","operation":"move","beforeSHA256":"0d2f43a64410dd0053d3e816f0394d6078bcdb5d28cd78e55c835ebf46152d25","afterSHA256":"0d2f43a64410dd0053d3e816f0394d6078bcdb5d28cd78e55c835ebf46152d25","reason":"Same source body in authored semantic page"},{"oldId":"b-53d34deb281f17df0b028235","targetId":"b-53d34deb281f17df0b028235","page":"reading-opening","operation":"move","beforeSHA256":"a8611b72f50695d3fd07e450025d70d459db5245859e2727f7acd33767f3d609","afterSHA256":"a8611b72f50695d3fd07e450025d70d459db5245859e2727f7acd33767f3d609","reason":"Same source body in authored semantic page"},{"oldId":"b-cefd779396b2e8334a933dae","targetId":"b-cefd779396b2e8334a933dae","page":"reading-opening","operation":"rewrite","beforeSHA256":"5d47f01a2a9695cebe3013eff0d6580b68981c22bb3e7be5cca0dc35a2ddb183","afterSHA256":"aead4f2d734b471023884420cc7eb3495c15da992dc2d3ac4788c141910c2a9a","reason":"Same source identity with figure semantics or reading context enriched"},{"oldId":"b-5dd9e306c24e781e36a61c88","targetId":"b-5dd9e306c24e781e36a61c88","page":"reading-opening","operation":"move","beforeSHA256":"15d0d789cdb37ba00e55be5d12ef2aef91fc80dc4a5938f9d2c13a45065d3445","afterSHA256":"15d0d789cdb37ba00e55be5d12ef2aef91fc80dc4a5938f9d2c13a45065d3445","reason":"Same source body in authored semantic page"},{"oldId":"b-d15201086a494993baaf4211","targetId":"b-d15201086a494993baaf4211","page":"reading-opening","operation":"move","beforeSHA256":"827be3cc0a439402b9a8d4facde53fe7a3e84bb93a2fe7dd31de94dd637ab16d","afterSHA256":"827be3cc0a439402b9a8d4facde53fe7a3e84bb93a2fe7dd31de94dd637ab16d","reason":"Same source body in authored semantic page"},{"oldId":"b-598b7669d4c574f20511edfc","targetId":"b-598b7669d4c574f20511edfc","page":"reading-opening","operation":"move","beforeSHA256":"7db21819736de71c652ced00174f154356926b74ee2a19cf7e3d2774b53e877d","afterSHA256":"7db21819736de71c652ced00174f154356926b74ee2a19cf7e3d2774b53e877d","reason":"Same source body in authored semantic page"},{"oldId":"block-66b6304ea0cf47dd9c5bb009263057ab--活动-a一张小矩阵两种查找方向","targetId":"b-88b9f822073fc42e28455348","operation":"retain-source-identity"}],"blocks":[{"id":"b-ec02c55b354f4006bf982600","type":"p","scope":"document","url":"https://codingai-lec03.pages.dev/course/notebook-blocks/66b6304ea0cf47dd9c5bb009263057ab.html#b-ec02c55b354f4006bf982600","content":"[CLS 03 · 视觉与语言：任务、训练与接口](/course/notebooks/680da245145447dd88983aabd136fd24.html)","sha256":"343fb71807f077069b41c6495a8824ea4d353c740175b5775ccc5145b3bf19ca","chapter":{"id":"course","title":"活动 A：一张小矩阵，两种查找方向"},"unit":{"id":"notebook-blocks/66b6304ea0cf47dd9c5bb009263057ab","title":"活动 A：一张小矩阵，两种查找方向"},"page":{"id":"reading-opening","title":"活动 A：一张小矩阵，两种查找方向","number":1},"sectionTitle":"活动 A：一张小矩阵，两种查找方向","currentQuestion":"活动 A：一张小矩阵，两种查找方向","sourceSlides":[],"knowledgeBlock":null,"formulas":[],"previousBlock":null,"nextBlock":"b-8d8b0e0a123a45bf8438c40b","prerequisites":[],"relatedBlocks":[]},{"id":"b-8d8b0e0a123a45bf8438c40b","type":"h1","scope":"document","url":"https://codingai-lec03.pages.dev/course/notebook-blocks/66b6304ea0cf47dd9c5bb009263057ab.html#b-8d8b0e0a123a45bf8438c40b","content":"# 活动 A：一张小矩阵，两种查找方向","sha256":"2ad310f9d8447162e178f095b452a34c834d7560799391ea141e58efc4e26008","chapter":{"id":"course","title":"活动 A：一张小矩阵，两种查找方向"},"unit":{"id":"notebook-blocks/66b6304ea0cf47dd9c5bb009263057ab","title":"活动 A：一张小矩阵，两种查找方向"},"page":{"id":"reading-opening","title":"活动 A：一张小矩阵，两种查找方向","number":1},"sectionTitle":"活动 A：一张小矩阵，两种查找方向","currentQuestion":"活动 A：一张小矩阵，两种查找方向","sourceSlides":[],"knowledgeBlock":null,"formulas":[],"previousBlock":"b-ec02c55b354f4006bf982600","nextBlock":"b-09ee4ac66148db7e7ed9e386","prerequisites":[{"id":"b-ec02c55b354f4006bf982600","url":"#b-ec02c55b354f4006bf982600","role":"problem-context"}],"relatedBlocks":[]},{"id":"b-09ee4ac66148db7e7ed9e386","type":"p","scope":"document","url":"https://codingai-lec03.pages.dev/course/notebook-blocks/66b6304ea0cf47dd9c5bb009263057ab.html#b-09ee4ac66148db7e7ed9e386","content":"主线阅读与优先实验","sha256":"42cba31deccba2a350b9b23bd0ca1dcaa4c4c5cb9d35c773e1fcb89124788ccd","chapter":{"id":"course","title":"活动 A：一张小矩阵，两种查找方向"},"unit":{"id":"notebook-blocks/66b6304ea0cf47dd9c5bb009263057ab","title":"活动 A：一张小矩阵，两种查找方向"},"page":{"id":"reading-opening","title":"活动 A：一张小矩阵，两种查找方向","number":1},"sectionTitle":"活动 A：一张小矩阵，两种查找方向","currentQuestion":"活动 A：一张小矩阵，两种查找方向","sourceSlides":[],"knowledgeBlock":null,"formulas":[],"previousBlock":"b-8d8b0e0a123a45bf8438c40b","nextBlock":"b-99a7c7db9f55d8e3832bad09","prerequisites":[{"id":"b-8d8b0e0a123a45bf8438c40b","url":"#b-8d8b0e0a123a45bf8438c40b","role":"section-title"},{"id":"b-ec02c55b354f4006bf982600","url":"#b-ec02c55b354f4006bf982600","role":"problem-context"}],"relatedBlocks":[]},{"id":"b-99a7c7db9f55d8e3832bad09","type":"p","scope":"document","url":"https://codingai-lec03.pages.dev/course/notebook-blocks/66b6304ea0cf47dd9c5bb009263057ab.html#b-99a7c7db9f55d8e3832bad09","content":"caption历史、VQA、CLIP候选、关系控制、GLIP/LLaVA与生成桥梁","sha256":"41c70c2c07b82678ff0a60f2d009b6afa750c5c691d109e754a69abf23868b50","chapter":{"id":"course","title":"活动 A：一张小矩阵，两种查找方向"},"unit":{"id":"notebook-blocks/66b6304ea0cf47dd9c5bb009263057ab","title":"活动 A：一张小矩阵，两种查找方向"},"page":{"id":"reading-opening","title":"活动 A：一张小矩阵，两种查找方向","number":1},"sectionTitle":"活动 A：一张小矩阵，两种查找方向","currentQuestion":"活动 A：一张小矩阵，两种查找方向","sourceSlides":[],"knowledgeBlock":null,"formulas":[],"previousBlock":"b-09ee4ac66148db7e7ed9e386","nextBlock":"b-88b9f822073fc42e28455348","prerequisites":[{"id":"b-8d8b0e0a123a45bf8438c40b","url":"#b-8d8b0e0a123a45bf8438c40b","role":"section-title"},{"id":"b-ec02c55b354f4006bf982600","url":"#b-ec02c55b354f4006bf982600","role":"problem-context"}],"relatedBlocks":[]},{"id":"b-88b9f822073fc42e28455348","type":"h3","scope":"document","url":"https://codingai-lec03.pages.dev/course/notebook-blocks/66b6304ea0cf47dd9c5bb009263057ab.html#b-88b9f822073fc42e28455348","content":"### 活动 A：一张小矩阵，两种查找方向","sha256":"0d2f43a64410dd0053d3e816f0394d6078bcdb5d28cd78e55c835ebf46152d25","chapter":{"id":"course","title":"活动 A：一张小矩阵，两种查找方向"},"unit":{"id":"notebook-blocks/66b6304ea0cf47dd9c5bb009263057ab","title":"活动 A：一张小矩阵，两种查找方向"},"page":{"id":"reading-opening","title":"活动 A：一张小矩阵，两种查找方向","number":1},"sectionTitle":"活动 A：一张小矩阵，两种查找方向","currentQuestion":"活动 A：一张小矩阵，两种查找方向","sourceSlides":[],"knowledgeBlock":null,"formulas":[],"previousBlock":"b-99a7c7db9f55d8e3832bad09","nextBlock":"b-53d34deb281f17df0b028235","prerequisites":[{"id":"b-8d8b0e0a123a45bf8438c40b","url":"#b-8d8b0e0a123a45bf8438c40b","role":"section-title"},{"id":"b-ec02c55b354f4006bf982600","url":"#b-ec02c55b354f4006bf982600","role":"problem-context"}],"relatedBlocks":[]},{"id":"b-53d34deb281f17df0b028235","type":"p","scope":"document","url":"https://codingai-lec03.pages.dev/course/notebook-blocks/66b6304ea0cf47dd9c5bb009263057ab.html#b-53d34deb281f17df0b028235","content":"行与列共同使用红杯、蓝杯、书的固定顺序。构造三维单位图像向量为三个坐标轴；对应文字向量在自身轴上取 4、另外两轴上取 1，再除以 √18 归一化。因此下表的每一项都是真正的余弦相似度：对角为 4/√18≈0.9428，非对角为 1/√18≈0.2357。这些向量是教学构造，不是 CLIP 推理输出。","sha256":"a8611b72f50695d3fd07e450025d70d459db5245859e2727f7acd33767f3d609","chapter":{"id":"course","title":"活动 A：一张小矩阵，两种查找方向"},"unit":{"id":"notebook-blocks/66b6304ea0cf47dd9c5bb009263057ab","title":"活动 A：一张小矩阵，两种查找方向"},"page":{"id":"reading-opening","title":"活动 A：一张小矩阵，两种查找方向","number":1},"sectionTitle":"活动 A：一张小矩阵，两种查找方向","currentQuestion":"活动 A：一张小矩阵，两种查找方向","sourceSlides":[],"knowledgeBlock":null,"formulas":[],"previousBlock":"b-88b9f822073fc42e28455348","nextBlock":"b-cefd779396b2e8334a933dae","prerequisites":[{"id":"b-88b9f822073fc42e28455348","url":"#b-88b9f822073fc42e28455348","role":"section-title"},{"id":"b-ec02c55b354f4006bf982600","url":"#b-ec02c55b354f4006bf982600","role":"problem-context"}],"relatedBlocks":[]},{"id":"b-cefd779396b2e8334a933dae","type":"table","scope":"document","url":"https://codingai-lec03.pages.dev/course/notebook-blocks/66b6304ea0cf47dd9c5bb009263057ab.html#b-cefd779396b2e8334a933dae","content":"|  | 红杯描述 | 蓝杯描述 | 书描述 |\n| --- | --- | --- | --- |\n| 红杯图 | 4/√18 | 1/√18 | 1/√18 |\n| 蓝杯图 | 1/√18 | 4/√18 | 1/√18 |\n| 书图 | 1/√18 | 1/√18 | 4/√18 |","sha256":"aead4f2d734b471023884420cc7eb3495c15da992dc2d3ac4788c141910c2a9a","chapter":{"id":"course","title":"活动 A：一张小矩阵，两种查找方向"},"unit":{"id":"notebook-blocks/66b6304ea0cf47dd9c5bb009263057ab","title":"活动 A：一张小矩阵，两种查找方向"},"page":{"id":"reading-opening","title":"活动 A：一张小矩阵，两种查找方向","number":1},"sectionTitle":"活动 A：一张小矩阵，两种查找方向","currentQuestion":"活动 A：一张小矩阵，两种查找方向","sourceSlides":[],"knowledgeBlock":null,"formulas":[],"table":{"headers":["","红杯描述","蓝杯描述","书描述"],"rows":[["","红杯描述","蓝杯描述","书描述"],["红杯图","4/√18","1/√18","1/√18"],["蓝杯图","1/√18","4/√18","1/√18"],["书图","1/√18","1/√18","4/√18"]]},"previousBlock":"b-53d34deb281f17df0b028235","nextBlock":"b-5dd9e306c24e781e36a61c88","prerequisites":[{"id":"b-88b9f822073fc42e28455348","url":"#b-88b9f822073fc42e28455348","role":"section-title"},{"id":"b-ec02c55b354f4006bf982600","url":"#b-ec02c55b354f4006bf982600","role":"problem-context"}],"relatedBlocks":[]},{"id":"b-5dd9e306c24e781e36a61c88","type":"p","scope":"document","url":"https://codingai-lec03.pages.dev/course/notebook-blocks/66b6304ea0cf47dd9c5bb009263057ab.html#b-5dd9e306c24e781e36a61c88","content":"先将温度设为 τ=1，令 logits=S/τ。**先预测：** 把蓝杯文字向量对红杯轴的权重从 1 改大并重新归一化，哪张图与哪段文字的正确配对可能变难？运行后分别看行与列的正确配对概率，而不是只看一个总分。","sha256":"15d0d789cdb37ba00e55be5d12ef2aef91fc80dc4a5938f9d2c13a45065d3445","chapter":{"id":"course","title":"活动 A：一张小矩阵，两种查找方向"},"unit":{"id":"notebook-blocks/66b6304ea0cf47dd9c5bb009263057ab","title":"活动 A：一张小矩阵，两种查找方向"},"page":{"id":"reading-opening","title":"活动 A：一张小矩阵，两种查找方向","number":1},"sectionTitle":"活动 A：一张小矩阵，两种查找方向","currentQuestion":"活动 A：一张小矩阵，两种查找方向","sourceSlides":[],"knowledgeBlock":null,"formulas":[],"previousBlock":"b-cefd779396b2e8334a933dae","nextBlock":"b-d15201086a494993baaf4211","prerequisites":[{"id":"b-88b9f822073fc42e28455348","url":"#b-88b9f822073fc42e28455348","role":"section-title"},{"id":"b-ec02c55b354f4006bf982600","url":"#b-ec02c55b354f4006bf982600","role":"problem-context"}],"relatedBlocks":[]},{"id":"b-d15201086a494993baaf4211","type":"p","scope":"document","url":"https://codingai-lec03.pages.dev/course/notebook-blocks/66b6304ea0cf47dd9c5bb009263057ab.html#b-d15201086a494993baaf4211","content":"批内未配对不保证语义完全无关，近重复和描述质量都会影响目标。这里先固定对角配对关系，隔离双向损失的计算。","sha256":"827be3cc0a439402b9a8d4facde53fe7a3e84bb93a2fe7dd31de94dd637ab16d","chapter":{"id":"course","title":"活动 A：一张小矩阵，两种查找方向"},"unit":{"id":"notebook-blocks/66b6304ea0cf47dd9c5bb009263057ab","title":"活动 A：一张小矩阵，两种查找方向"},"page":{"id":"reading-opening","title":"活动 A：一张小矩阵，两种查找方向","number":1},"sectionTitle":"活动 A：一张小矩阵，两种查找方向","currentQuestion":"活动 A：一张小矩阵，两种查找方向","sourceSlides":[],"knowledgeBlock":null,"formulas":[],"previousBlock":"b-5dd9e306c24e781e36a61c88","nextBlock":"b-598b7669d4c574f20511edfc","prerequisites":[{"id":"b-88b9f822073fc42e28455348","url":"#b-88b9f822073fc42e28455348","role":"section-title"},{"id":"b-ec02c55b354f4006bf982600","url":"#b-ec02c55b354f4006bf982600","role":"problem-context"}],"relatedBlocks":[]},{"id":"b-598b7669d4c574f20511edfc","type":"p","scope":"document","url":"https://codingai-lec03.pages.dev/course/notebook-blocks/66b6304ea0cf47dd9c5bb009263057ab.html#b-598b7669d4c574f20511edfc","content":"按默认构造计算，行、列方向的正确配对概率均约为 `[0.5035, 0.5035, 0.5035]`，双向平均损失约 `0.686192`。这是本页教学向量的确定性计算结果，可先阅读再改条件。","sha256":"7db21819736de71c652ced00174f154356926b74ee2a19cf7e3d2774b53e877d","chapter":{"id":"course","title":"活动 A：一张小矩阵，两种查找方向"},"unit":{"id":"notebook-blocks/66b6304ea0cf47dd9c5bb009263057ab","title":"活动 A：一张小矩阵，两种查找方向"},"page":{"id":"reading-opening","title":"活动 A：一张小矩阵，两种查找方向","number":1},"sectionTitle":"活动 A：一张小矩阵，两种查找方向","currentQuestion":"活动 A：一张小矩阵，两种查找方向","sourceSlides":[],"knowledgeBlock":null,"formulas":[],"previousBlock":"b-d15201086a494993baaf4211","nextBlock":null,"prerequisites":[{"id":"b-88b9f822073fc42e28455348","url":"#b-88b9f822073fc42e28455348","role":"section-title"},{"id":"b-ec02c55b354f4006bf982600","url":"#b-ec02c55b354f4006bf982600","role":"problem-context"}],"relatedBlocks":[]}]}