{"version":2,"relationshipURLBase":"https://codingai-lec03.pages.dev/course/notebook-blocks/ce309fa079154f8092fa03084d3bcf9f.html","relationshipResolution":"Resolve relative relationship URLs against relationshipURLBase; complete records and absolute URLs are in blocks.","title":"指令答案也需要信息来源","url":"https://codingai-lec03.pages.dev/course/notebook-blocks/ce309fa079154f8092fa03084d3bcf9f.html","markdown":"https://codingai-lec03.pages.dev/course/notebook-blocks/ce309fa079154f8092fa03084d3bcf9f.md","pages":[{"id":"reading-opening","title":"指令答案也需要信息来源","unit":"指令答案也需要信息来源","unitId":"notebook-blocks/ce309fa079154f8092fa03084d3bcf9f","chapter":"course","number":1}],"aliases":[{"oldId":"b-de4e2889bae92971b5c61286","targetId":"b-de4e2889bae92971b5c61286","page":"reading-opening","operation":"move","beforeSHA256":"343fb71807f077069b41c6495a8824ea4d353c740175b5775ccc5145b3bf19ca","afterSHA256":"343fb71807f077069b41c6495a8824ea4d353c740175b5775ccc5145b3bf19ca","reason":"Same source body in authored semantic page"},{"oldId":"b-de8c4383a51e8b3a96faf549","targetId":"b-de8c4383a51e8b3a96faf549","page":"reading-opening","operation":"move","beforeSHA256":"fc1577b902d40235916c5882cfd30984fbf6fa30741427377af0eab8558f248b","afterSHA256":"fc1577b902d40235916c5882cfd30984fbf6fa30741427377af0eab8558f248b","reason":"Same source body in authored semantic page"},{"oldId":"b-7a3da403c428a5a19bfb4baa","targetId":"b-7a3da403c428a5a19bfb4baa","page":"reading-opening","operation":"move","beforeSHA256":"42cba31deccba2a350b9b23bd0ca1dcaa4c4c5cb9d35c773e1fcb89124788ccd","afterSHA256":"42cba31deccba2a350b9b23bd0ca1dcaa4c4c5cb9d35c773e1fcb89124788ccd","reason":"Same source body in authored semantic page"},{"oldId":"b-bcb5b61ce5b87af843d7499c","targetId":"b-bcb5b61ce5b87af843d7499c","page":"reading-opening","operation":"move","beforeSHA256":"41c70c2c07b82678ff0a60f2d009b6afa750c5c691d109e754a69abf23868b50","afterSHA256":"41c70c2c07b82678ff0a60f2d009b6afa750c5c691d109e754a69abf23868b50","reason":"Same source body in authored semantic page"},{"oldId":"b-5b156ae0e17a7d5f13c8cf51","targetId":"b-5b156ae0e17a7d5f13c8cf51","page":"reading-opening","operation":"move","beforeSHA256":"4f6e7a02e226941e5d682e57303f951521c7d87eba24808cf9c614d1c8ee0d18","afterSHA256":"4f6e7a02e226941e5d682e57303f951521c7d87eba24808cf9c614d1c8ee0d18","reason":"Same source body in authored semantic page"},{"oldId":"b-97865acc2352a1616277a26c","targetId":"b-97865acc2352a1616277a26c","page":"reading-opening","operation":"move","beforeSHA256":"931258abc2eb3340d6be3c688c9a5f07957a249928b7cd01ef400b2ae932f433","afterSHA256":"931258abc2eb3340d6be3c688c9a5f07957a249928b7cd01ef400b2ae932f433","reason":"Same source body in authored semantic page"},{"oldId":"b-faadb6c4f7e6f9828f2b8e26","targetId":"b-faadb6c4f7e6f9828f2b8e26","page":"reading-opening","operation":"move","beforeSHA256":"afc9d2ed59208633d8da6076b8ead853c22a8303cf016c2abf0fef4271692784","afterSHA256":"afc9d2ed59208633d8da6076b8ead853c22a8303cf016c2abf0fef4271692784","reason":"Same source body in authored semantic page"},{"oldId":"block-ce309fa079154f8092fa03084d3bcf9f--指令答案也需要信息来源","targetId":"b-5b156ae0e17a7d5f13c8cf51","operation":"retain-source-identity"}],"blocks":[{"id":"b-de4e2889bae92971b5c61286","type":"p","scope":"document","url":"https://codingai-lec03.pages.dev/course/notebook-blocks/ce309fa079154f8092fa03084d3bcf9f.html#b-de4e2889bae92971b5c61286","content":"[CLS 03 · 视觉与语言：任务、训练与接口](/course/notebooks/680da245145447dd88983aabd136fd24.html)","sha256":"343fb71807f077069b41c6495a8824ea4d353c740175b5775ccc5145b3bf19ca","chapter":{"id":"course","title":"指令答案也需要信息来源"},"unit":{"id":"notebook-blocks/ce309fa079154f8092fa03084d3bcf9f","title":"指令答案也需要信息来源"},"page":{"id":"reading-opening","title":"指令答案也需要信息来源","number":1},"sectionTitle":"指令答案也需要信息来源","currentQuestion":"指令答案也需要信息来源","sourceSlides":[],"knowledgeBlock":null,"formulas":[],"previousBlock":null,"nextBlock":"b-de8c4383a51e8b3a96faf549","prerequisites":[],"relatedBlocks":[]},{"id":"b-de8c4383a51e8b3a96faf549","type":"h1","scope":"document","url":"https://codingai-lec03.pages.dev/course/notebook-blocks/ce309fa079154f8092fa03084d3bcf9f.html#b-de8c4383a51e8b3a96faf549","content":"# 指令答案也需要信息来源","sha256":"fc1577b902d40235916c5882cfd30984fbf6fa30741427377af0eab8558f248b","chapter":{"id":"course","title":"指令答案也需要信息来源"},"unit":{"id":"notebook-blocks/ce309fa079154f8092fa03084d3bcf9f","title":"指令答案也需要信息来源"},"page":{"id":"reading-opening","title":"指令答案也需要信息来源","number":1},"sectionTitle":"指令答案也需要信息来源","currentQuestion":"指令答案也需要信息来源","sourceSlides":[],"knowledgeBlock":null,"formulas":[],"previousBlock":"b-de4e2889bae92971b5c61286","nextBlock":"b-7a3da403c428a5a19bfb4baa","prerequisites":[{"id":"b-de4e2889bae92971b5c61286","url":"#b-de4e2889bae92971b5c61286","role":"problem-context"}],"relatedBlocks":[]},{"id":"b-7a3da403c428a5a19bfb4baa","type":"p","scope":"document","url":"https://codingai-lec03.pages.dev/course/notebook-blocks/ce309fa079154f8092fa03084d3bcf9f.html#b-7a3da403c428a5a19bfb4baa","content":"主线阅读与优先实验","sha256":"42cba31deccba2a350b9b23bd0ca1dcaa4c4c5cb9d35c773e1fcb89124788ccd","chapter":{"id":"course","title":"指令答案也需要信息来源"},"unit":{"id":"notebook-blocks/ce309fa079154f8092fa03084d3bcf9f","title":"指令答案也需要信息来源"},"page":{"id":"reading-opening","title":"指令答案也需要信息来源","number":1},"sectionTitle":"指令答案也需要信息来源","currentQuestion":"指令答案也需要信息来源","sourceSlides":[],"knowledgeBlock":null,"formulas":[],"previousBlock":"b-de8c4383a51e8b3a96faf549","nextBlock":"b-bcb5b61ce5b87af843d7499c","prerequisites":[{"id":"b-de8c4383a51e8b3a96faf549","url":"#b-de8c4383a51e8b3a96faf549","role":"section-title"},{"id":"b-de4e2889bae92971b5c61286","url":"#b-de4e2889bae92971b5c61286","role":"problem-context"}],"relatedBlocks":[]},{"id":"b-bcb5b61ce5b87af843d7499c","type":"p","scope":"document","url":"https://codingai-lec03.pages.dev/course/notebook-blocks/ce309fa079154f8092fa03084d3bcf9f.html#b-bcb5b61ce5b87af843d7499c","content":"caption历史、VQA、CLIP候选、关系控制、GLIP/LLaVA与生成桥梁","sha256":"41c70c2c07b82678ff0a60f2d009b6afa750c5c691d109e754a69abf23868b50","chapter":{"id":"course","title":"指令答案也需要信息来源"},"unit":{"id":"notebook-blocks/ce309fa079154f8092fa03084d3bcf9f","title":"指令答案也需要信息来源"},"page":{"id":"reading-opening","title":"指令答案也需要信息来源","number":1},"sectionTitle":"指令答案也需要信息来源","currentQuestion":"指令答案也需要信息来源","sourceSlides":[],"knowledgeBlock":null,"formulas":[],"previousBlock":"b-7a3da403c428a5a19bfb4baa","nextBlock":"b-5b156ae0e17a7d5f13c8cf51","prerequisites":[{"id":"b-de8c4383a51e8b3a96faf549","url":"#b-de8c4383a51e8b3a96faf549","role":"section-title"},{"id":"b-de4e2889bae92971b5c61286","url":"#b-de4e2889bae92971b5c61286","role":"problem-context"}],"relatedBlocks":[]},{"id":"b-5b156ae0e17a7d5f13c8cf51","type":"h3","scope":"document","url":"https://codingai-lec03.pages.dev/course/notebook-blocks/ce309fa079154f8092fa03084d3bcf9f.html#b-5b156ae0e17a7d5f13c8cf51","content":"### 指令答案也需要信息来源","sha256":"4f6e7a02e226941e5d682e57303f951521c7d87eba24808cf9c614d1c8ee0d18","chapter":{"id":"course","title":"指令答案也需要信息来源"},"unit":{"id":"notebook-blocks/ce309fa079154f8092fa03084d3bcf9f","title":"指令答案也需要信息来源"},"page":{"id":"reading-opening","title":"指令答案也需要信息来源","number":1},"sectionTitle":"指令答案也需要信息来源","currentQuestion":"指令答案也需要信息来源","sourceSlides":[],"knowledgeBlock":null,"formulas":[],"previousBlock":"b-bcb5b61ce5b87af843d7499c","nextBlock":"b-97865acc2352a1616277a26c","prerequisites":[{"id":"b-de8c4383a51e8b3a96faf549","url":"#b-de8c4383a51e8b3a96faf549","role":"section-title"},{"id":"b-de4e2889bae92971b5c61286","url":"#b-de4e2889bae92971b5c61286","role":"problem-context"}],"relatedBlocks":[]},{"id":"b-97865acc2352a1616277a26c","type":"p","scope":"document","url":"https://codingai-lec03.pages.dev/course/notebook-blocks/ce309fa079154f8092fa03084d3bcf9f.html#b-97865acc2352a1616277a26c","content":"原始 LLaVA 的部分指令资料由文本 GPT-4 根据 caption、对象类别和框坐标制作，该步骤没有让它直接看原图。随后 LLaVA 才用原图和这些指令共同训练。若文字记录遗漏接触和遮挡关系，长回答也不能凭空补足监督。","sha256":"931258abc2eb3340d6be3c688c9a5f07957a249928b7cd01ef400b2ae932f433","chapter":{"id":"course","title":"指令答案也需要信息来源"},"unit":{"id":"notebook-blocks/ce309fa079154f8092fa03084d3bcf9f","title":"指令答案也需要信息来源"},"page":{"id":"reading-opening","title":"指令答案也需要信息来源","number":1},"sectionTitle":"指令答案也需要信息来源","currentQuestion":"指令答案也需要信息来源","sourceSlides":[],"knowledgeBlock":null,"formulas":[],"previousBlock":"b-5b156ae0e17a7d5f13c8cf51","nextBlock":"b-faadb6c4f7e6f9828f2b8e26","prerequisites":[{"id":"b-5b156ae0e17a7d5f13c8cf51","url":"#b-5b156ae0e17a7d5f13c8cf51","role":"section-title"},{"id":"b-de4e2889bae92971b5c61286","url":"#b-de4e2889bae92971b5c61286","role":"problem-context"}],"relatedBlocks":[]},{"id":"b-faadb6c4f7e6f9828f2b8e26","type":"p","scope":"document","url":"https://codingai-lec03.pages.dev/course/notebook-blocks/ce309fa079154f8092fa03084d3bcf9f.html#b-faadb6c4f7e6f9828f2b8e26","content":"这个细节把第三部分接回第一部分：目标从哪里来，决定系统练习什么。[完整说明与课堂练习](/course/blocks/llava-instruction-source.html)。","sha256":"afc9d2ed59208633d8da6076b8ead853c22a8303cf016c2abf0fef4271692784","chapter":{"id":"course","title":"指令答案也需要信息来源"},"unit":{"id":"notebook-blocks/ce309fa079154f8092fa03084d3bcf9f","title":"指令答案也需要信息来源"},"page":{"id":"reading-opening","title":"指令答案也需要信息来源","number":1},"sectionTitle":"指令答案也需要信息来源","currentQuestion":"指令答案也需要信息来源","sourceSlides":[],"knowledgeBlock":null,"formulas":[],"previousBlock":"b-97865acc2352a1616277a26c","nextBlock":null,"prerequisites":[{"id":"b-5b156ae0e17a7d5f13c8cf51","url":"#b-5b156ae0e17a7d5f13c8cf51","role":"section-title"},{"id":"b-de4e2889bae92971b5c61286","url":"#b-de4e2889bae92971b5c61286","role":"problem-context"}],"relatedBlocks":[]}]}