{"version":2,"relationshipURLBase":"https://codingai-lec03.pages.dev/course/notebook-blocks/05c08a06e13d4bcb9ad2855d108f9310.html","relationshipResolution":"Resolve relative relationship URLs against relationshipURLBase; complete records and absolute URLs are in blocks.","title":"先用三个量区分坍塌与无用读出","url":"https://codingai-lec03.pages.dev/course/notebook-blocks/05c08a06e13d4bcb9ad2855d108f9310.html","markdown":"https://codingai-lec03.pages.dev/course/notebook-blocks/05c08a06e13d4bcb9ad2855d108f9310.md","pages":[{"id":"reading-opening","title":"先用三个量区分坍塌与无用读出","unit":"先用三个量区分坍塌与无用读出","unitId":"notebook-blocks/05c08a06e13d4bcb9ad2855d108f9310","chapter":"course","number":1}],"aliases":[{"oldId":"b-fc0d245fec4501dca59de359","targetId":"b-fc0d245fec4501dca59de359","page":"reading-opening","operation":"move","beforeSHA256":"44a74e10a676a4279d4180fb4458aee1016d4cdeba4b41a1d9e7798e3be61ed1","afterSHA256":"44a74e10a676a4279d4180fb4458aee1016d4cdeba4b41a1d9e7798e3be61ed1","reason":"Same source body in authored semantic page"},{"oldId":"b-78e4c6a01343e07f5f2b4cb7","targetId":"b-78e4c6a01343e07f5f2b4cb7","page":"reading-opening","operation":"move","beforeSHA256":"0a635b8877202394d90c00fc48ce38a00a50d1d85ed282296b767b09f5311f34","afterSHA256":"0a635b8877202394d90c00fc48ce38a00a50d1d85ed282296b767b09f5311f34","reason":"Same source body in authored semantic page"},{"oldId":"b-ba099d2da66352ad5034d1f9","targetId":"b-ba099d2da66352ad5034d1f9","page":"reading-opening","operation":"move","beforeSHA256":"e91f24e4e4ca40e2099a0d81d30db6568f4bf2074b499eeee6e3959617bd97ac","afterSHA256":"e91f24e4e4ca40e2099a0d81d30db6568f4bf2074b499eeee6e3959617bd97ac","reason":"Same source body in authored semantic page"},{"oldId":"b-6df1f58cedd21ca973d42d87","targetId":"b-6df1f58cedd21ca973d42d87","page":"reading-opening","operation":"move","beforeSHA256":"44af65f60193d6766e8cc6019f133e85a56a9751792313a8cd2e06a0256ec27f","afterSHA256":"44af65f60193d6766e8cc6019f133e85a56a9751792313a8cd2e06a0256ec27f","reason":"Same source body in authored semantic page"},{"oldId":"b-450ad1b2952dafed120890cd","targetId":"b-450ad1b2952dafed120890cd","page":"reading-opening","operation":"move","beforeSHA256":"7b046569644a82f65ad052205227f16c1b004172e34365cbe4de73c52681b420","afterSHA256":"7b046569644a82f65ad052205227f16c1b004172e34365cbe4de73c52681b420","reason":"Same source body in authored semantic page"},{"oldId":"b-cbc4944a7398dda0a4c45dc9","targetId":"b-cbc4944a7398dda0a4c45dc9","page":"reading-opening","operation":"move","beforeSHA256":"3c4a62216e8f3c52833f83e5a8ceb945b5bdb027d0b6deabca56ad1fba8c71e9","afterSHA256":"3c4a62216e8f3c52833f83e5a8ceb945b5bdb027d0b6deabca56ad1fba8c71e9","reason":"Same source body in authored semantic page"},{"oldId":"b-dcb485fd2689c34ec2124dfb","targetId":"b-dcb485fd2689c34ec2124dfb","page":"reading-opening","operation":"move","beforeSHA256":"5cfb5233b27d8709e56ed0dc88b6b62514c0f383716469d139b170d4beb2f439","afterSHA256":"5cfb5233b27d8709e56ed0dc88b6b62514c0f383716469d139b170d4beb2f439","reason":"Same source body in authored semantic page"},{"oldId":"b-b73e1c84a3b4488331bd2871","targetId":"b-b73e1c84a3b4488331bd2871","page":"reading-opening","operation":"move","beforeSHA256":"3dea9621641a48772801e1ca7f637ce261694961d4996c34799d658eb0295c99","afterSHA256":"3dea9621641a48772801e1ca7f637ce261694961d4996c34799d658eb0295c99","reason":"Same source body in authored semantic page"},{"oldId":"b-6746313a2ed2d219b754d00f","targetId":"b-6746313a2ed2d219b754d00f","page":"reading-opening","operation":"move","beforeSHA256":"b8b70ff82c0bcd32ddaf4e44dea0f80f7c67697b267456c27d17cf9879c89401","afterSHA256":"b8b70ff82c0bcd32ddaf4e44dea0f80f7c67697b267456c27d17cf9879c89401","reason":"Same source body in authored semantic page"},{"oldId":"b-1807b7995202530d629fda89","targetId":"b-1807b7995202530d629fda89","page":"reading-opening","operation":"move","beforeSHA256":"30c4d3d14ad50393c706ffbf805526ef1d5433c63b4d438f68c0a798cc524ae6","afterSHA256":"30c4d3d14ad50393c706ffbf805526ef1d5433c63b4d438f68c0a798cc524ae6","reason":"Same source body in authored semantic page"},{"oldId":"b-017b95eae43a3f0d283f7421","targetId":"b-017b95eae43a3f0d283f7421","page":"reading-opening","operation":"move","beforeSHA256":"f297f61db6a828793849fb1c0a83af36c1b9e862d1024cebda5de5f7fcdee6ff","afterSHA256":"f297f61db6a828793849fb1c0a83af36c1b9e862d1024cebda5de5f7fcdee6ff","reason":"Same source body in authored semantic page"},{"oldId":"b-3f7aae7573a48d6e5dd23b07","targetId":"b-3f7aae7573a48d6e5dd23b07","page":"reading-opening","operation":"move","beforeSHA256":"0fcfc28644b12ce434e17f07aa61a599852cad27f630da57f20efd4c7ad4037d","afterSHA256":"0fcfc28644b12ce434e17f07aa61a599852cad27f630da57f20efd4c7ad4037d","reason":"Same source body in authored semantic page"},{"oldId":"b-73b5c52cfda39d26fd02cf53","targetId":"b-73b5c52cfda39d26fd02cf53","page":"reading-opening","operation":"move","beforeSHA256":"aa3bbe0b7cc6c328d10bb19ad23b01d3e3c11498cbcd139289bbbc11c3e6c9a1","afterSHA256":"aa3bbe0b7cc6c328d10bb19ad23b01d3e3c11498cbcd139289bbbc11c3e6c9a1","reason":"Same source body in authored semantic page"},{"oldId":"block-05c08a06e13d4bcb9ad2855d108f9310--先用三个量区分坍塌与无用读出","targetId":"b-450ad1b2952dafed120890cd","operation":"retain-source-identity"},{"oldId":"block-05c08a06e13d4bcb9ad2855d108f9310--数据处理不等式究竟限制哪一条链","targetId":"b-017b95eae43a3f0d283f7421","operation":"retain-source-identity"}],"blocks":[{"id":"b-fc0d245fec4501dca59de359","type":"p","scope":"document","url":"https://codingai-lec03.pages.dev/course/notebook-blocks/05c08a06e13d4bcb9ad2855d108f9310.html#b-fc0d245fec4501dca59de359","content":"[CLS 06 · 表示的三个检查：目标、信息与新域](/course/notebooks/c0645a4db6e04188ab5b119e87c53bed.html)","sha256":"44a74e10a676a4279d4180fb4458aee1016d4cdeba4b41a1d9e7798e3be61ed1","chapter":{"id":"course","title":"先用三个量区分坍塌与无用读出"},"unit":{"id":"notebook-blocks/05c08a06e13d4bcb9ad2855d108f9310","title":"先用三个量区分坍塌与无用读出"},"page":{"id":"reading-opening","title":"先用三个量区分坍塌与无用读出","number":1},"sectionTitle":"先用三个量区分坍塌与无用读出","currentQuestion":"先用三个量区分坍塌与无用读出","sourceSlides":[],"knowledgeBlock":null,"formulas":[],"previousBlock":null,"nextBlock":"b-78e4c6a01343e07f5f2b4cb7","prerequisites":[],"relatedBlocks":[]},{"id":"b-78e4c6a01343e07f5f2b4cb7","type":"h1","scope":"document","url":"https://codingai-lec03.pages.dev/course/notebook-blocks/05c08a06e13d4bcb9ad2855d108f9310.html#b-78e4c6a01343e07f5f2b4cb7","content":"# 先用三个量区分坍塌与无用读出","sha256":"0a635b8877202394d90c00fc48ce38a00a50d1d85ed282296b767b09f5311f34","chapter":{"id":"course","title":"先用三个量区分坍塌与无用读出"},"unit":{"id":"notebook-blocks/05c08a06e13d4bcb9ad2855d108f9310","title":"先用三个量区分坍塌与无用读出"},"page":{"id":"reading-opening","title":"先用三个量区分坍塌与无用读出","number":1},"sectionTitle":"先用三个量区分坍塌与无用读出","currentQuestion":"先用三个量区分坍塌与无用读出","sourceSlides":[],"knowledgeBlock":null,"formulas":[],"previousBlock":"b-fc0d245fec4501dca59de359","nextBlock":"b-ba099d2da66352ad5034d1f9","prerequisites":[{"id":"b-fc0d245fec4501dca59de359","url":"#b-fc0d245fec4501dca59de359","role":"problem-context"}],"relatedBlocks":[]},{"id":"b-ba099d2da66352ad5034d1f9","type":"p","scope":"document","url":"https://codingai-lec03.pages.dev/course/notebook-blocks/05c08a06e13d4bcb9ad2855d108f9310.html#b-ba099d2da66352ad5034d1f9","content":"按问题继续","sha256":"e91f24e4e4ca40e2099a0d81d30db6568f4bf2074b499eeee6e3959617bd97ac","chapter":{"id":"course","title":"先用三个量区分坍塌与无用读出"},"unit":{"id":"notebook-blocks/05c08a06e13d4bcb9ad2855d108f9310","title":"先用三个量区分坍塌与无用读出"},"page":{"id":"reading-opening","title":"先用三个量区分坍塌与无用读出","number":1},"sectionTitle":"先用三个量区分坍塌与无用读出","currentQuestion":"先用三个量区分坍塌与无用读出","sourceSlides":[],"knowledgeBlock":null,"formulas":[],"previousBlock":"b-78e4c6a01343e07f5f2b4cb7","nextBlock":"b-6df1f58cedd21ca973d42d87","prerequisites":[{"id":"b-78e4c6a01343e07f5f2b4cb7","url":"#b-78e4c6a01343e07f5f2b4cb7","role":"section-title"},{"id":"b-fc0d245fec4501dca59de359","url":"#b-fc0d245fec4501dca59de359","role":"problem-context"}],"relatedBlocks":[]},{"id":"b-6df1f58cedd21ca973d42d87","type":"p","scope":"document","url":"https://codingai-lec03.pages.dev/course/notebook-blocks/05c08a06e13d4bcb9ad2855d108f9310.html#b-6df1f58cedd21ca973d42d87","content":"教师软目标、坍塌、任务信息与域变化的三个不同问题","sha256":"44af65f60193d6766e8cc6019f133e85a56a9751792313a8cd2e06a0256ec27f","chapter":{"id":"course","title":"先用三个量区分坍塌与无用读出"},"unit":{"id":"notebook-blocks/05c08a06e13d4bcb9ad2855d108f9310","title":"先用三个量区分坍塌与无用读出"},"page":{"id":"reading-opening","title":"先用三个量区分坍塌与无用读出","number":1},"sectionTitle":"先用三个量区分坍塌与无用读出","currentQuestion":"先用三个量区分坍塌与无用读出","sourceSlides":[],"knowledgeBlock":null,"formulas":[],"previousBlock":"b-ba099d2da66352ad5034d1f9","nextBlock":"b-450ad1b2952dafed120890cd","prerequisites":[{"id":"b-78e4c6a01343e07f5f2b4cb7","url":"#b-78e4c6a01343e07f5f2b4cb7","role":"section-title"},{"id":"b-fc0d245fec4501dca59de359","url":"#b-fc0d245fec4501dca59de359","role":"problem-context"}],"relatedBlocks":[]},{"id":"b-450ad1b2952dafed120890cd","type":"h2","scope":"document","url":"https://codingai-lec03.pages.dev/course/notebook-blocks/05c08a06e13d4bcb9ad2855d108f9310.html#b-450ad1b2952dafed120890cd","content":"## 先用三个量区分坍塌与无用读出","sha256":"7b046569644a82f65ad052205227f16c1b004172e34365cbe4de73c52681b420","chapter":{"id":"course","title":"先用三个量区分坍塌与无用读出"},"unit":{"id":"notebook-blocks/05c08a06e13d4bcb9ad2855d108f9310","title":"先用三个量区分坍塌与无用读出"},"page":{"id":"reading-opening","title":"先用三个量区分坍塌与无用读出","number":1},"sectionTitle":"先用三个量区分坍塌与无用读出","currentQuestion":"先用三个量区分坍塌与无用读出","sourceSlides":[],"knowledgeBlock":null,"formulas":[],"previousBlock":"b-6df1f58cedd21ca973d42d87","nextBlock":"b-cbc4944a7398dda0a4c45dc9","prerequisites":[{"id":"b-78e4c6a01343e07f5f2b4cb7","url":"#b-78e4c6a01343e07f5f2b4cb7","role":"section-title"},{"id":"b-fc0d245fec4501dca59de359","url":"#b-fc0d245fec4501dca59de359","role":"problem-context"}],"relatedBlocks":[]},{"id":"b-cbc4944a7398dda0a4c45dc9","type":"p","scope":"document","url":"https://codingai-lec03.pages.dev/course/notebook-blocks/05c08a06e13d4bcb9ad2855d108f9310.html#b-cbc4944a7398dda0a4c45dc9","content":"若一批表示全部为 $(1,1)$，协方差是零，任意两个样本距离为零；仅凭这些表示的分类器只能按先验猜类别。若表示分布有方差，仍可能仅保存背景亮度，不能因“看起来散开了”就判断语义有用。相反，线性分类失败也不必说明标签信息消失。","sha256":"3c4a62216e8f3c52833f83e5a8ceb945b5bdb027d0b6deabca56ad1fba8c71e9","chapter":{"id":"course","title":"先用三个量区分坍塌与无用读出"},"unit":{"id":"notebook-blocks/05c08a06e13d4bcb9ad2855d108f9310","title":"先用三个量区分坍塌与无用读出"},"page":{"id":"reading-opening","title":"先用三个量区分坍塌与无用读出","number":1},"sectionTitle":"先用三个量区分坍塌与无用读出","currentQuestion":"先用三个量区分坍塌与无用读出","sourceSlides":[],"knowledgeBlock":null,"formulas":[{"latex":"(1,1)","definitionContext":"先用三个量区分坍塌与无用读出"}],"previousBlock":"b-450ad1b2952dafed120890cd","nextBlock":"b-dcb485fd2689c34ec2124dfb","prerequisites":[{"id":"b-450ad1b2952dafed120890cd","url":"#b-450ad1b2952dafed120890cd","role":"section-title"},{"id":"b-fc0d245fec4501dca59de359","url":"#b-fc0d245fec4501dca59de359","role":"problem-context"}],"relatedBlocks":[]},{"id":"b-dcb485fd2689c34ec2124dfb","type":"p","scope":"document","url":"https://codingai-lec03.pages.dev/course/notebook-blocks/05c08a06e13d4bcb9ad2855d108f9310.html#b-dcb485fd2689c34ec2124dfb","content":"用四个等概率输入 $h\\in\\{(-1,-1),(-1,1),(1,-1),(1,1)\\}$，同号标签 0，异号标签 1。这是 XOR：四点没有碰撞，每一点都唯一确定标签，但两类凸包都经过原点，不能被一条直线严格分开。加入 $z=h_1h_2$ 后，标签为 $\\mathbf1[z<0]$，一维阈值就能完全分开。非线性变换没有创造标签信息，只改变了可读出形式。","sha256":"5cfb5233b27d8709e56ed0dc88b6b62514c0f383716469d139b170d4beb2f439","chapter":{"id":"course","title":"先用三个量区分坍塌与无用读出"},"unit":{"id":"notebook-blocks/05c08a06e13d4bcb9ad2855d108f9310","title":"先用三个量区分坍塌与无用读出"},"page":{"id":"reading-opening","title":"先用三个量区分坍塌与无用读出","number":1},"sectionTitle":"先用三个量区分坍塌与无用读出","currentQuestion":"先用三个量区分坍塌与无用读出","sourceSlides":[],"knowledgeBlock":null,"formulas":[{"latex":"h\\in\\{(-1,-1),(-1,1),(1,-1),(1,1)\\}","definitionContext":"先用三个量区分坍塌与无用读出"},{"latex":"z=h_1h_2","definitionContext":"先用三个量区分坍塌与无用读出"},{"latex":"\\mathbf1[z<0]","definitionContext":"先用三个量区分坍塌与无用读出"}],"previousBlock":"b-cbc4944a7398dda0a4c45dc9","nextBlock":"b-b73e1c84a3b4488331bd2871","prerequisites":[{"id":"b-450ad1b2952dafed120890cd","url":"#b-450ad1b2952dafed120890cd","role":"section-title"},{"id":"b-fc0d245fec4501dca59de359","url":"#b-fc0d245fec4501dca59de359","role":"problem-context"}],"relatedBlocks":[]},{"id":"b-b73e1c84a3b4488331bd2871","type":"p","scope":"document","url":"https://codingai-lec03.pages.dev/course/notebook-blocks/05c08a06e13d4bcb9ad2855d108f9310.html#b-b73e1c84a3b4488331bd2871","content":"![XOR 保留信息但线性不可分，以及域变化中的两种线索](/course/repair/assets/cls07-xor-domain.svg)","sha256":"3dea9621641a48772801e1ca7f637ce261694961d4996c34799d658eb0295c99","chapter":{"id":"course","title":"先用三个量区分坍塌与无用读出"},"unit":{"id":"notebook-blocks/05c08a06e13d4bcb9ad2855d108f9310","title":"先用三个量区分坍塌与无用读出"},"page":{"id":"reading-opening","title":"先用三个量区分坍塌与无用读出","number":1},"sectionTitle":"先用三个量区分坍塌与无用读出","currentQuestion":"先用三个量区分坍塌与无用读出","sourceSlides":[],"knowledgeBlock":null,"formulas":[],"previousBlock":"b-dcb485fd2689c34ec2124dfb","nextBlock":"b-6746313a2ed2d219b754d00f","prerequisites":[{"id":"b-450ad1b2952dafed120890cd","url":"#b-450ad1b2952dafed120890cd","role":"section-title"},{"id":"b-fc0d245fec4501dca59de359","url":"#b-fc0d245fec4501dca59de359","role":"problem-context"}],"relatedBlocks":[]},{"id":"b-6746313a2ed2d219b754d00f","type":"p","scope":"document","url":"https://codingai-lec03.pages.dev/course/notebook-blocks/05c08a06e13d4bcb9ad2855d108f9310.html#b-6746313a2ed2d219b754d00f","content":"左图四点的身份与标签均完整保留，却没有线性分界；右图给出一个人为设定的环境分布：颜色线索从 90% 可靠变为 10%，形状线索保持 80%。这些是解释条件的构造数值，不是实测模型成绩。","sha256":"b8b70ff82c0bcd32ddaf4e44dea0f80f7c67697b267456c27d17cf9879c89401","chapter":{"id":"course","title":"先用三个量区分坍塌与无用读出"},"unit":{"id":"notebook-blocks/05c08a06e13d4bcb9ad2855d108f9310","title":"先用三个量区分坍塌与无用读出"},"page":{"id":"reading-opening","title":"先用三个量区分坍塌与无用读出","number":1},"sectionTitle":"先用三个量区分坍塌与无用读出","currentQuestion":"先用三个量区分坍塌与无用读出","sourceSlides":[],"knowledgeBlock":null,"formulas":[],"previousBlock":"b-b73e1c84a3b4488331bd2871","nextBlock":"b-1807b7995202530d629fda89","prerequisites":[{"id":"b-450ad1b2952dafed120890cd","url":"#b-450ad1b2952dafed120890cd","role":"section-title"},{"id":"b-fc0d245fec4501dca59de359","url":"#b-fc0d245fec4501dca59de359","role":"problem-context"}],"relatedBlocks":[]},{"id":"b-1807b7995202530d629fda89","type":"p","scope":"document","url":"https://codingai-lec03.pages.dev/course/notebook-blocks/05c08a06e13d4bcb9ad2855d108f9310.html#b-1807b7995202530d629fda89","content":"因此值得分别检查表示方差/秩、冻结读出、允许非线性适配的成绩。每一种检查排除的解释不同。[LAB 17](https://deepnote.com/project/38755e4e-23f6-4f5f-8c68-8a2e4114b1c1/notebook/268a4ab11b464c64b065f9fc12b19cc7) 对照软目标和常量表示；[LAB 18](https://deepnote.com/project/38755e4e-23f6-4f5f-8c68-8a2e4114b1c1/notebook/33066318f5884adc8417068df0f40431) 则比较信息是否保留与读出是否容易。不要把前者的一次低距离当成后者的高质量表示。","sha256":"30c4d3d14ad50393c706ffbf805526ef1d5433c63b4d438f68c0a798cc524ae6","chapter":{"id":"course","title":"先用三个量区分坍塌与无用读出"},"unit":{"id":"notebook-blocks/05c08a06e13d4bcb9ad2855d108f9310","title":"先用三个量区分坍塌与无用读出"},"page":{"id":"reading-opening","title":"先用三个量区分坍塌与无用读出","number":1},"sectionTitle":"先用三个量区分坍塌与无用读出","currentQuestion":"先用三个量区分坍塌与无用读出","sourceSlides":[],"knowledgeBlock":null,"formulas":[],"previousBlock":"b-6746313a2ed2d219b754d00f","nextBlock":"b-017b95eae43a3f0d283f7421","prerequisites":[{"id":"b-450ad1b2952dafed120890cd","url":"#b-450ad1b2952dafed120890cd","role":"section-title"},{"id":"b-fc0d245fec4501dca59de359","url":"#b-fc0d245fec4501dca59de359","role":"problem-context"}],"relatedBlocks":[]},{"id":"b-017b95eae43a3f0d283f7421","type":"h2","scope":"document","url":"https://codingai-lec03.pages.dev/course/notebook-blocks/05c08a06e13d4bcb9ad2855d108f9310.html#b-017b95eae43a3f0d283f7421","content":"## 数据处理不等式究竟限制哪一条链","sha256":"f297f61db6a828793849fb1c0a83af36c1b9e862d1024cebda5de5f7fcdee6ff","chapter":{"id":"course","title":"先用三个量区分坍塌与无用读出"},"unit":{"id":"notebook-blocks/05c08a06e13d4bcb9ad2855d108f9310","title":"先用三个量区分坍塌与无用读出"},"page":{"id":"reading-opening","title":"先用三个量区分坍塌与无用读出","number":1},"sectionTitle":"先用三个量区分坍塌与无用读出","currentQuestion":"先用三个量区分坍塌与无用读出","sourceSlides":[],"knowledgeBlock":null,"formulas":[],"previousBlock":"b-1807b7995202530d629fda89","nextBlock":"b-3f7aae7573a48d6e5dd23b07","prerequisites":[{"id":"b-450ad1b2952dafed120890cd","url":"#b-450ad1b2952dafed120890cd","role":"section-title"},{"id":"b-fc0d245fec4501dca59de359","url":"#b-fc0d245fec4501dca59de359","role":"problem-context"}],"relatedBlocks":[]},{"id":"b-3f7aae7573a48d6e5dd23b07","type":"p","scope":"document","url":"https://codingai-lec03.pages.dev/course/notebook-blocks/05c08a06e13d4bcb9ad2855d108f9310.html#b-3f7aae7573a48d6e5dd23b07","content":"设 $X=(A,B)$ 为两个独立均匀 bit，标签 $Y=A$。固定表示 $H_1=A$ 只存一个 bit，却保留全部标签信息：$I(Y;H_1)=1$ bit。另一个一 bit 表示 $H_2=A\\oplus B$ 与 $Y$ 独立，所以 $I(Y;H_2)=0$。两者维数相同、熵相同，任务信息却不同。这比“压缩越强越好”更能说明问题。","sha256":"0fcfc28644b12ce434e17f07aa61a599852cad27f630da57f20efd4c7ad4037d","chapter":{"id":"course","title":"先用三个量区分坍塌与无用读出"},"unit":{"id":"notebook-blocks/05c08a06e13d4bcb9ad2855d108f9310","title":"先用三个量区分坍塌与无用读出"},"page":{"id":"reading-opening","title":"先用三个量区分坍塌与无用读出","number":1},"sectionTitle":"先用三个量区分坍塌与无用读出","currentQuestion":"先用三个量区分坍塌与无用读出","sourceSlides":[],"knowledgeBlock":null,"formulas":[{"latex":"X=(A,B)","definitionContext":"先用三个量区分坍塌与无用读出"},{"latex":"Y=A","definitionContext":"先用三个量区分坍塌与无用读出"},{"latex":"H_1=A","definitionContext":"先用三个量区分坍塌与无用读出"},{"latex":"I(Y;H_1)=1","definitionContext":"先用三个量区分坍塌与无用读出"},{"latex":"H_2=A\\oplus B","definitionContext":"先用三个量区分坍塌与无用读出"},{"latex":"Y","definitionContext":"先用三个量区分坍塌与无用读出"},{"latex":"I(Y;H_2)=0","definitionContext":"先用三个量区分坍塌与无用读出"}],"previousBlock":"b-017b95eae43a3f0d283f7421","nextBlock":"b-73b5c52cfda39d26fd02cf53","prerequisites":[{"id":"b-017b95eae43a3f0d283f7421","url":"#b-017b95eae43a3f0d283f7421","role":"section-title"},{"id":"b-fc0d245fec4501dca59de359","url":"#b-fc0d245fec4501dca59de359","role":"problem-context"}],"relatedBlocks":[]},{"id":"b-73b5c52cfda39d26fd02cf53","type":"p","scope":"document","url":"https://codingai-lec03.pages.dev/course/notebook-blocks/05c08a06e13d4bcb9ad2855d108f9310.html#b-73b5c52cfda39d26fd02cf53","content":"在固定的 Markov 链 $Y\\to X\\to H$ 中，数据处理不等式给出 $I(Y;H)\\le I(Y;X)$：后处理不能从已经完全相同的输入状态中恢复被删除的区别。其前提是表示由给定 $X$ 产生，没有额外关于 $Y$ 的信息通道。模型训练时参数 $\\theta$ 可从外部训练集获得规律；比较训练前后的 $f_\\theta$，并不是在同一条固定前向链上凭空创造信息。连续变量的互信息还可能因确定性映射出现技术问题，不能拿离散 bit 算例的数值直接衡量一张连续特征图。课程采用这个例子是说明条件，而非用互信息替代实际迁移评价。","sha256":"aa3bbe0b7cc6c328d10bb19ad23b01d3e3c11498cbcd139289bbbc11c3e6c9a1","chapter":{"id":"course","title":"先用三个量区分坍塌与无用读出"},"unit":{"id":"notebook-blocks/05c08a06e13d4bcb9ad2855d108f9310","title":"先用三个量区分坍塌与无用读出"},"page":{"id":"reading-opening","title":"先用三个量区分坍塌与无用读出","number":1},"sectionTitle":"先用三个量区分坍塌与无用读出","currentQuestion":"先用三个量区分坍塌与无用读出","sourceSlides":[],"knowledgeBlock":null,"formulas":[{"latex":"Y\\to X\\to H","definitionContext":"先用三个量区分坍塌与无用读出"},{"latex":"I(Y;H)\\le I(Y;X)","definitionContext":"先用三个量区分坍塌与无用读出"},{"latex":"X","definitionContext":"先用三个量区分坍塌与无用读出"},{"latex":"Y","definitionContext":"先用三个量区分坍塌与无用读出"},{"latex":"\\theta","definitionContext":"先用三个量区分坍塌与无用读出"},{"latex":"f_\\theta","definitionContext":"先用三个量区分坍塌与无用读出"}],"previousBlock":"b-3f7aae7573a48d6e5dd23b07","nextBlock":null,"prerequisites":[{"id":"b-017b95eae43a3f0d283f7421","url":"#b-017b95eae43a3f0d283f7421","role":"section-title"},{"id":"b-fc0d245fec4501dca59de359","url":"#b-fc0d245fec4501dca59de359","role":"problem-context"}],"relatedBlocks":[]}]}