{"version":2,"relationshipURLBase":"https://codingai-lec03.pages.dev/course/blocks/text-target-construction.html","relationshipResolution":"Resolve relative relationship URLs against relationshipURLBase; complete records and absolute URLs are in blocks.","title":"同一句原文怎样生成两种预测题","url":"https://codingai-lec03.pages.dev/course/blocks/text-target-construction.html","markdown":"https://codingai-lec03.pages.dev/course/blocks/text-target-construction.md","pages":[{"id":"reading-opening","title":"同一句原文怎样生成两种预测题","unit":"训练留下什么，训练答案又从哪里来？","unitId":"i-reuse-and-targets","chapter":"I","number":1}],"aliases":[{"oldId":"b-237a44b835c454642abbf243","targetId":"b-237a44b835c454642abbf243","page":"reading-opening","operation":"move","beforeSHA256":"375c5b3df8e546d2240b84762f4be07ebf57ef778692ccdf3b26dacfbe51a9ac","afterSHA256":"375c5b3df8e546d2240b84762f4be07ebf57ef778692ccdf3b26dacfbe51a9ac","reason":"Same source body in authored semantic page"},{"oldId":"b-074d54c3c7549010cdc01669","targetId":"b-074d54c3c7549010cdc01669","page":"reading-opening","operation":"move","beforeSHA256":"b02b29311e0595dde017566001bc14643cc3d25430040e64b6ffe8628f5defb7","afterSHA256":"b02b29311e0595dde017566001bc14643cc3d25430040e64b6ffe8628f5defb7","reason":"Same source body in authored semantic page"},{"oldId":"b-a7edd8eba8b9ef54b1048f97","targetId":"b-a7edd8eba8b9ef54b1048f97","page":"reading-opening","operation":"move","beforeSHA256":"a10d4bf4baf037d64fab2152a1082bf1719aabeae7aef2751d09736bbd8951cf","afterSHA256":"a10d4bf4baf037d64fab2152a1082bf1719aabeae7aef2751d09736bbd8951cf","reason":"Same source body in authored semantic page"},{"oldId":"b-dbbac2c1282687c6135de7c8","targetId":"b-dbbac2c1282687c6135de7c8","page":"reading-opening","operation":"move","beforeSHA256":"28f958ad9c13ccd870e036c2a721d7b09506be2ad44dbf5d6631055578af6b71","afterSHA256":"28f958ad9c13ccd870e036c2a721d7b09506be2ad44dbf5d6631055578af6b71","reason":"Same source body in authored semantic page"},{"oldId":"b-002880d56481885c5bb7bb9e","targetId":"b-002880d56481885c5bb7bb9e","page":"reading-opening","operation":"move","beforeSHA256":"e4f07ac42931d66a97a8b8ffe42959b132d39e19187e517b09ec8c330532bb7e","afterSHA256":"e4f07ac42931d66a97a8b8ffe42959b132d39e19187e517b09ec8c330532bb7e","reason":"Same source body in authored semantic page"},{"oldId":"b-2254e397a11937704d2a37a8","targetId":"b-2254e397a11937704d2a37a8","page":"reading-opening","operation":"move","beforeSHA256":"2b9ccef7e1220e2250cceff1abd8bdd736b42f8da5a223f26b029f44b962e807","afterSHA256":"2b9ccef7e1220e2250cceff1abd8bdd736b42f8da5a223f26b029f44b962e807","reason":"Same source body in authored semantic page"}],"blocks":[{"id":"b-237a44b835c454642abbf243","type":"h1","scope":"text-target-construction","url":"https://codingai-lec03.pages.dev/course/blocks/text-target-construction.html#b-237a44b835c454642abbf243","content":"# 同一句原文怎样生成两种预测题","sha256":"375c5b3df8e546d2240b84762f4be07ebf57ef778692ccdf3b26dacfbe51a9ac","chapter":{"id":"I","title":"学习信号与表示"},"unit":{"id":"i-reuse-and-targets","title":"训练留下什么，训练答案又从哪里来？"},"page":{"id":"reading-opening","title":"同一句原文怎样生成两种预测题","number":1},"sectionTitle":"同一句原文怎样生成两种预测题","currentQuestion":"同一句原文怎样生成两种预测题","sourceSlides":[],"knowledgeBlock":null,"formulas":[],"previousBlock":null,"nextBlock":"b-074d54c3c7549010cdc01669","prerequisites":[{"id":"b-074d54c3c7549010cdc01669","url":"#b-074d54c3c7549010cdc01669","role":"problem-context"}],"relatedBlocks":[]},{"id":"b-074d54c3c7549010cdc01669","type":"p","scope":"text-target-construction","url":"https://codingai-lec03.pages.dev/course/blocks/text-target-construction.html#b-074d54c3c7549010cdc01669","content":"借同一句话构造next-token与masked-token题，核心是答案来源和可见条件，不是语言架构课。","sha256":"b02b29311e0595dde017566001bc14643cc3d25430040e64b6ffe8628f5defb7","chapter":{"id":"I","title":"学习信号与表示"},"unit":{"id":"i-reuse-and-targets","title":"训练留下什么，训练答案又从哪里来？"},"page":{"id":"reading-opening","title":"同一句原文怎样生成两种预测题","number":1},"sectionTitle":"同一句原文怎样生成两种预测题","currentQuestion":"同一句原文怎样生成两种预测题","sourceSlides":[],"knowledgeBlock":null,"formulas":[],"previousBlock":"b-237a44b835c454642abbf243","nextBlock":"b-a7edd8eba8b9ef54b1048f97","prerequisites":[{"id":"b-237a44b835c454642abbf243","url":"#b-237a44b835c454642abbf243","role":"section-title"}],"relatedBlocks":[]},{"id":"b-a7edd8eba8b9ef54b1048f97","type":"p","scope":"text-target-construction","url":"https://codingai-lec03.pages.dev/course/blocks/text-target-construction.html#b-a7edd8eba8b9ef54b1048f97","content":"用教学单位切分 `The / red / cup / is / on / the / table / .`。从左到右预测的一题是：输入 `The red cup`，正确目标是 `is`。遮词预测的一题是：输入 `The red [MASK] is on the table .`，目标是被取走的 `cup`。答案都从原文取得，但模型可见条件不同：前者不能偷看未来，后者可以使用遮词两侧。","sha256":"a10d4bf4baf037d64fab2152a1082bf1719aabeae7aef2751d09736bbd8951cf","chapter":{"id":"I","title":"学习信号与表示"},"unit":{"id":"i-reuse-and-targets","title":"训练留下什么，训练答案又从哪里来？"},"page":{"id":"reading-opening","title":"同一句原文怎样生成两种预测题","number":1},"sectionTitle":"同一句原文怎样生成两种预测题","currentQuestion":"同一句原文怎样生成两种预测题","sourceSlides":[],"knowledgeBlock":null,"formulas":[],"previousBlock":"b-074d54c3c7549010cdc01669","nextBlock":"b-dbbac2c1282687c6135de7c8","prerequisites":[{"id":"b-237a44b835c454642abbf243","url":"#b-237a44b835c454642abbf243","role":"section-title"},{"id":"b-074d54c3c7549010cdc01669","url":"#b-074d54c3c7549010cdc01669","role":"problem-context"}],"relatedBlocks":[]},{"id":"b-dbbac2c1282687c6135de7c8","type":"p","scope":"text-target-construction","url":"https://codingai-lec03.pages.dev/course/blocks/text-target-construction.html#b-dbbac2c1282687c6135de7c8","content":"训练时原文目标已知。若模型给正确词概率0.25，这一位置的负对数损失是 $-\\ln0.25\\approx1.386$；提高到0.5后是0.693。这个反馈足以更新参数，不需要先把整句话人工标成“描述桌面”。","sha256":"28f958ad9c13ccd870e036c2a721d7b09506be2ad44dbf5d6631055578af6b71","chapter":{"id":"I","title":"学习信号与表示"},"unit":{"id":"i-reuse-and-targets","title":"训练留下什么，训练答案又从哪里来？"},"page":{"id":"reading-opening","title":"同一句原文怎样生成两种预测题","number":1},"sectionTitle":"同一句原文怎样生成两种预测题","currentQuestion":"同一句原文怎样生成两种预测题","sourceSlides":[],"knowledgeBlock":null,"formulas":[{"latex":"-\\ln0.25\\approx1.386","definitionContext":"同一句原文怎样生成两种预测题"}],"previousBlock":"b-a7edd8eba8b9ef54b1048f97","nextBlock":"b-002880d56481885c5bb7bb9e","prerequisites":[{"id":"b-237a44b835c454642abbf243","url":"#b-237a44b835c454642abbf243","role":"section-title"},{"id":"b-074d54c3c7549010cdc01669","url":"#b-074d54c3c7549010cdc01669","role":"problem-context"}],"relatedBlocks":[]},{"id":"b-002880d56481885c5bb7bb9e","type":"p","scope":"text-target-construction","url":"https://codingai-lec03.pages.dev/course/blocks/text-target-construction.html#b-002880d56481885c5bb7bb9e","content":"本页只借文字说明目标来源。实际 tokenizer 可能把单词分成多个单位，预测器也有不同架构；这些细节不影响这里的闭环：**隐藏一部分信息→用可见条件预测→拿原文作答案**。架构、完整注意力和循环状态留后续课程。","sha256":"e4f07ac42931d66a97a8b8ffe42959b132d39e19187e517b09ec8c330532bb7e","chapter":{"id":"I","title":"学习信号与表示"},"unit":{"id":"i-reuse-and-targets","title":"训练留下什么，训练答案又从哪里来？"},"page":{"id":"reading-opening","title":"同一句原文怎样生成两种预测题","number":1},"sectionTitle":"同一句原文怎样生成两种预测题","currentQuestion":"同一句原文怎样生成两种预测题","sourceSlides":[],"knowledgeBlock":null,"formulas":[],"previousBlock":"b-dbbac2c1282687c6135de7c8","nextBlock":"b-2254e397a11937704d2a37a8","prerequisites":[{"id":"b-237a44b835c454642abbf243","url":"#b-237a44b835c454642abbf243","role":"section-title"},{"id":"b-074d54c3c7549010cdc01669","url":"#b-074d54c3c7549010cdc01669","role":"problem-context"}],"relatedBlocks":[]},{"id":"b-2254e397a11937704d2a37a8","type":"h2","scope":"text-target-construction","url":"https://codingai-lec03.pages.dev/course/blocks/text-target-construction.html#b-2254e397a11937704d2a37a8","content":"## 继续阅读与实验","sha256":"2b9ccef7e1220e2250cceff1abd8bdd736b42f8da5a223f26b029f44b962e807","chapter":{"id":"I","title":"学习信号与表示"},"unit":{"id":"i-reuse-and-targets","title":"训练留下什么，训练答案又从哪里来？"},"page":{"id":"reading-opening","title":"同一句原文怎样生成两种预测题","number":1},"sectionTitle":"同一句原文怎样生成两种预测题","currentQuestion":"同一句原文怎样生成两种预测题","sourceSlides":[],"knowledgeBlock":null,"formulas":[],"previousBlock":"b-002880d56481885c5bb7bb9e","nextBlock":null,"prerequisites":[{"id":"b-237a44b835c454642abbf243","url":"#b-237a44b835c454642abbf243","role":"section-title"},{"id":"b-074d54c3c7549010cdc01669","url":"#b-074d54c3c7549010cdc01669","role":"problem-context"}],"relatedBlocks":[]}]}