{"version":2,"relationshipURLBase":"https://codingai-lec03.pages.dev/course/blocks/spatial-to-language-interface.html","relationshipResolution":"Resolve relative relationship URLs against relationshipURLBase; complete records and absolute URLs are in blocks.","title":"从空间地址到语言请求，还缺哪一种对应","url":"https://codingai-lec03.pages.dev/course/blocks/spatial-to-language-interface.html","markdown":"https://codingai-lec03.pages.dev/course/blocks/spatial-to-language-interface.md","pages":[{"id":"reading-opening","title":"从空间地址到语言请求，还缺哪一种对应","unit":"带着空间接口，怎样进入实验与语言任务？","unitId":"spatial-to-language-and-practice","chapter":"II","number":1}],"aliases":[{"oldId":"b-30e4b0e5225a305a77483b4d","targetId":"b-30e4b0e5225a305a77483b4d","page":"reading-opening","operation":"move","beforeSHA256":"3c9e379047e0dc638a642be1d549c5e4f5fde07d9c05f4a6fb6a451ce07cbf2e","afterSHA256":"3c9e379047e0dc638a642be1d549c5e4f5fde07d9c05f4a6fb6a451ce07cbf2e","reason":"Same source body in authored semantic page"},{"oldId":"b-3b8e46ff4afae05db0feae21","targetId":"b-3b8e46ff4afae05db0feae21","page":"reading-opening","operation":"move","beforeSHA256":"368c88940b94b4f5e882642fb53f63da832ba5d53994109789e3824c3655f4cc","afterSHA256":"368c88940b94b4f5e882642fb53f63da832ba5d53994109789e3824c3655f4cc","reason":"Same source body in authored semantic page"},{"oldId":"b-dd93bcbc01c5eb3c9872bc10","targetId":"b-dd93bcbc01c5eb3c9872bc10","page":"reading-opening","operation":"move","beforeSHA256":"7f28a2a41e7f34beda1cb035eca2a130e4d1885b9cf9c43c6d0427241b5a52d2","afterSHA256":"7f28a2a41e7f34beda1cb035eca2a130e4d1885b9cf9c43c6d0427241b5a52d2","reason":"Same source body in authored semantic page"},{"oldId":"b-6a98133bab0a8ffde413b100","targetId":"b-6a98133bab0a8ffde413b100","page":"reading-opening","operation":"move","beforeSHA256":"7a6778b41d3714cb9175c27a97583c2c80b3d488cf2b0f0bf8cbee1067796cf9","afterSHA256":"7a6778b41d3714cb9175c27a97583c2c80b3d488cf2b0f0bf8cbee1067796cf9","reason":"Same source body in authored semantic page"},{"oldId":"b-16f53980ca336c50c93b59b7","targetId":"b-16f53980ca336c50c93b59b7","page":"reading-opening","operation":"move","beforeSHA256":"e0dd0f519c582fdbd68175269c30b45e49e7077528b3de5d3c5c132b8a40102e","afterSHA256":"e0dd0f519c582fdbd68175269c30b45e49e7077528b3de5d3c5c132b8a40102e","reason":"Same source body in authored semantic page"},{"oldId":"b-833f4e454de6b878743f83e3","targetId":"b-833f4e454de6b878743f83e3","page":"reading-opening","operation":"move","beforeSHA256":"80ced4e15aae0824db664e359cc6cc2983a9227fa5fa26bad01cff7b35733976","afterSHA256":"80ced4e15aae0824db664e359cc6cc2983a9227fa5fa26bad01cff7b35733976","reason":"Same source body in authored semantic page"},{"oldId":"b-da5177c10c3bfe57afba96ca","targetId":"b-da5177c10c3bfe57afba96ca","page":"reading-opening","operation":"rewrite","beforeSHA256":"066214ab49cdd0c1170ef733800ece7d2a1dbb7864dec3cf83f82d5c161678c7","afterSHA256":"d47659a6bd7d93322efc34fd205e37a9f2153d78a8b935fe00368b5f61d67420","reason":"Same source identity with figure semantics or reading context enriched"},{"oldId":"b-870c52cf3fc1464be3c68e9e","targetId":"b-870c52cf3fc1464be3c68e9e","page":"reading-opening","operation":"move","beforeSHA256":"2b9ccef7e1220e2250cceff1abd8bdd736b42f8da5a223f26b029f44b962e807","afterSHA256":"2b9ccef7e1220e2250cceff1abd8bdd736b42f8da5a223f26b029f44b962e807","reason":"Same source body in authored semantic page"}],"blocks":[{"id":"b-30e4b0e5225a305a77483b4d","type":"h1","scope":"spatial-to-language-interface","url":"https://codingai-lec03.pages.dev/course/blocks/spatial-to-language-interface.html#b-30e4b0e5225a305a77483b4d","content":"# 从空间地址到语言请求，还缺哪一种对应","sha256":"3c9e379047e0dc638a642be1d549c5e4f5fde07d9c05f4a6fb6a451ce07cbf2e","chapter":{"id":"II","title":"区域、像素与实例"},"unit":{"id":"spatial-to-language-and-practice","title":"带着空间接口，怎样进入实验与语言任务？"},"page":{"id":"reading-opening","title":"从空间地址到语言请求，还缺哪一种对应","number":1},"sectionTitle":"从空间地址到语言请求，还缺哪一种对应","currentQuestion":"从空间地址到语言请求，还缺哪一种对应","sourceSlides":[],"knowledgeBlock":null,"formulas":[],"previousBlock":null,"nextBlock":"b-3b8e46ff4afae05db0feae21","prerequisites":[{"id":"b-3b8e46ff4afae05db0feae21","url":"#b-3b8e46ff4afae05db0feae21","role":"problem-context"}],"relatedBlocks":[{"id":"b-da5177c10c3bfe57afba96ca","url":"#b-da5177c10c3bfe57afba96ca","relation":"figure-and-explanation"}]},{"id":"b-3b8e46ff4afae05db0feae21","type":"p","scope":"spatial-to-language-interface","url":"https://codingai-lec03.pages.dev/course/blocks/spatial-to-language-interface.html#b-3b8e46ff4afae05db0feae21","content":"区域、像素、实例与提示已经提供可组合的空间部件。自然语言还要把对象、属性、参照物和关系连接起来；下一部分研究语言怎样成为输出、学习信号和任务条件。课后从学习路径中选一个完整实验，不必机械刷所有 Notebook。","sha256":"368c88940b94b4f5e882642fb53f63da832ba5d53994109789e3824c3655f4cc","chapter":{"id":"II","title":"区域、像素与实例"},"unit":{"id":"spatial-to-language-and-practice","title":"带着空间接口，怎样进入实验与语言任务？"},"page":{"id":"reading-opening","title":"从空间地址到语言请求，还缺哪一种对应","number":1},"sectionTitle":"从空间地址到语言请求，还缺哪一种对应","currentQuestion":"从空间地址到语言请求，还缺哪一种对应","sourceSlides":[],"knowledgeBlock":null,"formulas":[],"previousBlock":"b-30e4b0e5225a305a77483b4d","nextBlock":"b-dd93bcbc01c5eb3c9872bc10","prerequisites":[{"id":"b-30e4b0e5225a305a77483b4d","url":"#b-30e4b0e5225a305a77483b4d","role":"section-title"}],"relatedBlocks":[{"id":"b-da5177c10c3bfe57afba96ca","url":"#b-da5177c10c3bfe57afba96ca","relation":"figure-and-explanation"}]},{"id":"b-dd93bcbc01c5eb3c9872bc10","type":"p","scope":"spatial-to-language-interface","url":"https://codingai-lec03.pages.dev/course/blocks/spatial-to-language-interface.html#b-dd93bcbc01c5eb3c9872bc10","content":"现在已经有了三种可复用接口：共享视觉特征能供多个区域读取；区域与像素输出能描述对象位置和轮廓；点或框能指定本次关心哪一块。每一步都改变了系统收到的条件与需要交付的答案。","sha256":"7f28a2a41e7f34beda1cb035eca2a130e4d1885b9cf9c43c6d0427241b5a52d2","chapter":{"id":"II","title":"区域、像素与实例"},"unit":{"id":"spatial-to-language-and-practice","title":"带着空间接口，怎样进入实验与语言任务？"},"page":{"id":"reading-opening","title":"从空间地址到语言请求，还缺哪一种对应","number":1},"sectionTitle":"从空间地址到语言请求，还缺哪一种对应","currentQuestion":"从空间地址到语言请求，还缺哪一种对应","sourceSlides":[],"knowledgeBlock":null,"formulas":[],"previousBlock":"b-3b8e46ff4afae05db0feae21","nextBlock":"b-6a98133bab0a8ffde413b100","prerequisites":[{"id":"b-30e4b0e5225a305a77483b4d","url":"#b-30e4b0e5225a305a77483b4d","role":"section-title"},{"id":"b-3b8e46ff4afae05db0feae21","url":"#b-3b8e46ff4afae05db0feae21","role":"problem-context"}],"relatedBlocks":[{"id":"b-da5177c10c3bfe57afba96ca","url":"#b-da5177c10c3bfe57afba96ca","relation":"figure-and-explanation"}]},{"id":"b-6a98133bab0a8ffde413b100","type":"p","scope":"spatial-to-language-interface","url":"https://codingai-lec03.pages.dev/course/blocks/spatial-to-language-interface.html#b-6a98133bab0a8ffde413b100","content":"“框住左边杯子”把位置条件直接编码成坐标；“找到书左边的红杯”则要求系统将对象、属性、参照物和空间关系一起解释。文本并不是另一种坐标格式：同一个词可以对应多个对象，一段关系还可能指向并未直接被颜色词修饰的目标。","sha256":"7a6778b41d3714cb9175c27a97583c2c80b3d488cf2b0f0bf8cbee1067796cf9","chapter":{"id":"II","title":"区域、像素与实例"},"unit":{"id":"spatial-to-language-and-practice","title":"带着空间接口，怎样进入实验与语言任务？"},"page":{"id":"reading-opening","title":"从空间地址到语言请求，还缺哪一种对应","number":1},"sectionTitle":"从空间地址到语言请求，还缺哪一种对应","currentQuestion":"从空间地址到语言请求，还缺哪一种对应","sourceSlides":[],"knowledgeBlock":null,"formulas":[],"previousBlock":"b-dd93bcbc01c5eb3c9872bc10","nextBlock":"b-16f53980ca336c50c93b59b7","prerequisites":[{"id":"b-30e4b0e5225a305a77483b4d","url":"#b-30e4b0e5225a305a77483b4d","role":"section-title"},{"id":"b-3b8e46ff4afae05db0feae21","url":"#b-3b8e46ff4afae05db0feae21","role":"problem-context"}],"relatedBlocks":[{"id":"b-da5177c10c3bfe57afba96ca","url":"#b-da5177c10c3bfe57afba96ca","relation":"figure-and-explanation"}]},{"id":"b-16f53980ca336c50c93b59b7","type":"p","scope":"spatial-to-language-interface","url":"https://codingai-lec03.pages.dev/course/blocks/spatial-to-language-interface.html#b-16f53980ca336c50c93b59b7","content":"下一部分因此不是换一个更大模型继续同一输出，而是研究语言的几种角色：作为描述输出、作为图文配对学习信号、作为当前问题或指代条件。已有区域表示、mask 与分类能力成为可组合的部件，新训练要建立它们与语言的对应。","sha256":"e0dd0f519c582fdbd68175269c30b45e49e7077528b3de5d3c5c132b8a40102e","chapter":{"id":"II","title":"区域、像素与实例"},"unit":{"id":"spatial-to-language-and-practice","title":"带着空间接口，怎样进入实验与语言任务？"},"page":{"id":"reading-opening","title":"从空间地址到语言请求，还缺哪一种对应","number":1},"sectionTitle":"从空间地址到语言请求，还缺哪一种对应","currentQuestion":"从空间地址到语言请求，还缺哪一种对应","sourceSlides":[],"knowledgeBlock":null,"formulas":[],"previousBlock":"b-6a98133bab0a8ffde413b100","nextBlock":"b-833f4e454de6b878743f83e3","prerequisites":[{"id":"b-30e4b0e5225a305a77483b4d","url":"#b-30e4b0e5225a305a77483b4d","role":"section-title"},{"id":"b-3b8e46ff4afae05db0feae21","url":"#b-3b8e46ff4afae05db0feae21","role":"problem-context"}],"relatedBlocks":[{"id":"b-da5177c10c3bfe57afba96ca","url":"#b-da5177c10c3bfe57afba96ca","relation":"figure-and-explanation"}]},{"id":"b-833f4e454de6b878743f83e3","type":"p","scope":"spatial-to-language-interface","url":"https://codingai-lec03.pages.dev/course/blocks/spatial-to-language-interface.html#b-833f4e454de6b878743f83e3","content":"课后可沿自己的科研问题选择一条具体路径：若要测面积，先完成像素输出与指标；若要逐个操作对象，加入实例身份；若要按自然语言选择对象，再追踪语言条件如何进入视觉判断。主讲三部分的连接就落在这些输入输出关系上。","sha256":"80ced4e15aae0824db664e359cc6cc2983a9227fa5fa26bad01cff7b35733976","chapter":{"id":"II","title":"区域、像素与实例"},"unit":{"id":"spatial-to-language-and-practice","title":"带着空间接口，怎样进入实验与语言任务？"},"page":{"id":"reading-opening","title":"从空间地址到语言请求，还缺哪一种对应","number":1},"sectionTitle":"从空间地址到语言请求，还缺哪一种对应","currentQuestion":"从空间地址到语言请求，还缺哪一种对应","sourceSlides":[],"knowledgeBlock":null,"formulas":[],"previousBlock":"b-16f53980ca336c50c93b59b7","nextBlock":"b-da5177c10c3bfe57afba96ca","prerequisites":[{"id":"b-30e4b0e5225a305a77483b4d","url":"#b-30e4b0e5225a305a77483b4d","role":"section-title"},{"id":"b-3b8e46ff4afae05db0feae21","url":"#b-3b8e46ff4afae05db0feae21","role":"problem-context"}],"relatedBlocks":[{"id":"b-da5177c10c3bfe57afba96ca","url":"#b-da5177c10c3bfe57afba96ca","relation":"figure-and-explanation"}]},{"id":"b-da5177c10c3bfe57afba96ca","type":"figure","scope":"spatial-to-language-interface","url":"https://codingai-lec03.pages.dev/course/blocks/spatial-to-language-interface.html#b-da5177c10c3bfe57afba96ca","content":"图内标签与数值：Lecture 03 课堂图解 P48；区域 + 轮廓 + 对象身份；“书左边的杯子”；文字条件；视觉区域 × 文字条件；需要学习两者的对应；下一步：描述、匹配、指代、问答；区域表示提供空间接口；语言再指定当前需要哪一个对象、哪一项信息。\n\n空间特征、对象身份与提示接口汇合，再引出语言指定。 查看对应图解状态\n\n- 区域 + 轮廓 + 对象身份\n- “书左边的杯子”\n- 文字条件\n- 视觉区域 × 文字条件\n- 需要学习两者的对应\n- 下一步：描述、匹配、指代、问答\n- 区域表示提供空间接口；语言再指定当前需要哪一个对象、哪一项信息。空间特征、对象身份与提示接口汇合，再引出语言指定。 [查看对应图解状态](/#/l3-r2-p48/0)[查看完整图解](/#/l3-r2-p48/0)","sha256":"d47659a6bd7d93322efc34fd205e37a9f2153d78a8b935fe00368b5f61d67420","chapter":{"id":"II","title":"区域、像素与实例"},"unit":{"id":"spatial-to-language-and-practice","title":"带着空间接口，怎样进入实验与语言任务？"},"page":{"id":"reading-opening","title":"从空间地址到语言请求，还缺哪一种对应","number":1},"sectionTitle":"从空间地址到语言请求，还缺哪一种对应","currentQuestion":"从空间地址到语言请求，还缺哪一种对应","sourceSlides":[],"knowledgeBlock":null,"formulas":[],"figure":{"caption":"空间特征、对象身份与提示接口汇合，再引出语言指定。 查看对应图解状态","labels":["区域 + 轮廓 + 对象身份","“书左边的杯子”","文字条件","视觉区域 × 文字条件","需要学习两者的对应","下一步：描述、匹配、指代、问答","区域表示提供空间接口；语言再指定当前需要哪一个对象、哪一项信息。"],"description":"空间特征、对象身份与提示接口汇合，再引出语言指定。 查看对应图解状态区域 + 轮廓 + 对象身份“书左边的杯子”文字条件视觉区域 × 文字条件需要学习两者的对应下一步：描述、匹配、指代、问答区域表示提供空间接口；语言再指定当前需要哪一个对象、哪一项信息。","evidenceIdentity":"空间特征、对象身份与提示接口汇合，再引出语言指定。 查看对应图解状态","images":[{"src":"/assets/display/8ced939a1fd55047fbf73ea5.webp","alt":""}]},"previousBlock":"b-833f4e454de6b878743f83e3","nextBlock":"b-870c52cf3fc1464be3c68e9e","prerequisites":[{"id":"b-30e4b0e5225a305a77483b4d","url":"#b-30e4b0e5225a305a77483b4d","role":"section-title"},{"id":"b-3b8e46ff4afae05db0feae21","url":"#b-3b8e46ff4afae05db0feae21","role":"problem-context"}],"relatedBlocks":[]},{"id":"b-870c52cf3fc1464be3c68e9e","type":"h2","scope":"spatial-to-language-interface","url":"https://codingai-lec03.pages.dev/course/blocks/spatial-to-language-interface.html#b-870c52cf3fc1464be3c68e9e","content":"## 继续阅读与实验","sha256":"2b9ccef7e1220e2250cceff1abd8bdd736b42f8da5a223f26b029f44b962e807","chapter":{"id":"II","title":"区域、像素与实例"},"unit":{"id":"spatial-to-language-and-practice","title":"带着空间接口，怎样进入实验与语言任务？"},"page":{"id":"reading-opening","title":"从空间地址到语言请求，还缺哪一种对应","number":1},"sectionTitle":"从空间地址到语言请求，还缺哪一种对应","currentQuestion":"从空间地址到语言请求，还缺哪一种对应","sourceSlides":[],"knowledgeBlock":null,"formulas":[],"previousBlock":"b-da5177c10c3bfe57afba96ca","nextBlock":null,"prerequisites":[{"id":"b-30e4b0e5225a305a77483b4d","url":"#b-30e4b0e5225a305a77483b4d","role":"section-title"},{"id":"b-3b8e46ff4afae05db0feae21","url":"#b-3b8e46ff4afae05db0feae21","role":"problem-context"}],"relatedBlocks":[{"id":"b-da5177c10c3bfe57afba96ca","url":"#b-da5177c10c3bfe57afba96ca","relation":"figure-and-explanation"}]}]}