{"version":2,"relationshipURLBase":"https://codingai-lec03.pages.dev/course/notebooks/680da245145447dd88983aabd136fd24.html","relationshipResolution":"Resolve relative relationship URLs against relationshipURLBase; complete records and absolute URLs are in blocks.","title":"CLS 03 · 视觉与语言：任务、训练与接口","url":"https://codingai-lec03.pages.dev/course/notebooks/680da245145447dd88983aabd136fd24.html","markdown":"https://codingai-lec03.pages.dev/course/notebooks/680da245145447dd88983aabd136fd24.md","pages":[{"id":"reading-opening","title":"CLS 03 · 视觉与语言：任务、训练与接口","unit":"语言加入后，任务究竟改变了什么？","unitId":"language-task-interfaces","chapter":"III","number":1},{"id":"reading-block-c13dcb1596e44be4b9e7a5f06c6f04ef","title":"1. 语言可以在同一系统里承担三种作用","unit":"语言加入后，任务究竟改变了什么？","unitId":"language-task-interfaces","chapter":"III","number":2},{"id":"reading-block-8011bff99a6d4beb88ae230911fbb097","title":"2. 语言作为输出：看图说话怎样接上已有能力？","unit":"语言加入后，任务究竟改变了什么？","unitId":"language-task-interfaces","chapter":"III","number":3},{"id":"reading-block-7895864a9980401b8e3526beca11f36f","title":"研究背景：组件到位后，选择哪一个新问题？","unit":"语言加入后，任务究竟改变了什么？","unitId":"language-task-interfaces","chapter":"III","number":4},{"id":"reading-block-6a1571aafa7e44d8b3a0654c78166412","title":"3. 语言作为学习信号：把配对变成可比较关系","unit":"语言加入后，任务究竟改变了什么？","unitId":"language-task-interfaces","chapter":"III","number":5},{"id":"reading-block-66b6304ea0cf47dd9c5bb009263057ab","title":"活动 A：一张小矩阵，两种查找方向","unit":"语言加入后，任务究竟改变了什么？","unitId":"language-task-interfaces","chapter":"III","number":6},{"id":"reading-block-6190cca74684424598eec8bcc3f7b586","title":"从这张教学矩阵，走到真实模型","unit":"语言加入后，任务究竟改变了什么？","unitId":"language-task-interfaces","chapter":"III","number":7},{"id":"reading-block-65ae675e81234522a19a201af1e42f87","title":"4. 看衣色，还是看关系？让两种规则作出不同预测","unit":"语言加入后，任务究竟改变了什么？","unitId":"language-task-interfaces","chapter":"III","number":8},{"id":"reading-block-c64974ec883f4a6a9488baa50fe6db3c","title":"四条件的规则预期","unit":"语言加入后，任务究竟改变了什么？","unitId":"language-task-interfaces","chapter":"III","number":9},{"id":"reading-block-0aabdf483a9d4b58a0bcff200b378bc9","title":"5. 语言指定任务之一：这句话指的是哪个区域？","unit":"语言加入后，任务究竟改变了什么？","unitId":"language-task-interfaces","chapter":"III","number":10},{"id":"reading-block-4f123fd559034e98ab80a149967f6452","title":"6. 语言指定任务之二：根据画面回答这个问题","unit":"语言加入后，任务究竟改变了什么？","unitId":"language-task-interfaces","chapter":"III","number":11},{"id":"reading-block-ce309fa079154f8092fa03084d3bcf9f","title":"指令答案也需要信息来源","unit":"语言加入后，任务究竟改变了什么？","unitId":"language-task-interfaces","chapter":"III","number":12},{"id":"reading-block-fc3d98abedce4cfe9f92457dd3572549","title":"7. 哪些能力可以继承，哪些环节还要重新学习？","unit":"语言加入后，任务究竟改变了什么？","unitId":"language-task-interfaces","chapter":"III","number":13},{"id":"reading-block-b76c720aae524c5faef18b343a6374aa","title":"8A. 只给一句描述，怎样产生一幅新图像？","unit":"语言加入后，任务究竟改变了什么？","unitId":"language-task-interfaces","chapter":"III","number":14},{"id":"reading-block-63a505de22ae4389bfa3360aab9f5b84","title":"8B. 同一句话，为什么有多种合理图像？","unit":"语言加入后，任务究竟改变了什么？","unitId":"language-task-interfaces","chapter":"III","number":15},{"id":"reading-block-aead117ad6f542828f635a98ebe8a29a","title":"8C. 从任务接口走向生成机制","unit":"语言加入后，任务究竟改变了什么？","unitId":"language-task-interfaces","chapter":"III","number":16},{"id":"reading-block-f9a09c497c544a4ba4af64ab27b80fa5","title":"8D. 带着三项判断结束本讲","unit":"语言加入后，任务究竟改变了什么？","unitId":"language-task-interfaces","chapter":"III","number":17}],"aliases":[{"oldId":"b-6293e12c6ccb0216241fec48","targetId":"b-6293e12c6ccb0216241fec48","page":"reading-opening","operation":"move","beforeSHA256":"a6b2c548a0a325bab1464ec88d074342246fbd71d255cf4a7dc465a013406f44","afterSHA256":"a6b2c548a0a325bab1464ec88d074342246fbd71d255cf4a7dc465a013406f44","reason":"Same source body in authored semantic page"},{"oldId":"b-12384c711c1eb652e7880c16","targetId":"b-12384c711c1eb652e7880c16","page":"reading-opening","operation":"move","beforeSHA256":"42cba31deccba2a350b9b23bd0ca1dcaa4c4c5cb9d35c773e1fcb89124788ccd","afterSHA256":"42cba31deccba2a350b9b23bd0ca1dcaa4c4c5cb9d35c773e1fcb89124788ccd","reason":"Same source body in authored semantic page"},{"oldId":"b-5fd5f62e15e98785286ec4dc","targetId":"b-5fd5f62e15e98785286ec4dc","page":"reading-opening","operation":"move","beforeSHA256":"41c70c2c07b82678ff0a60f2d009b6afa750c5c691d109e754a69abf23868b50","afterSHA256":"41c70c2c07b82678ff0a60f2d009b6afa750c5c691d109e754a69abf23868b50","reason":"Same source body in authored semantic page"},{"oldId":"b-39c7d157e577ecb4b4b03925","targetId":"b-39c7d157e577ecb4b4b03925","page":"reading-opening","operation":"move","beforeSHA256":"f22152fd55dcdb0090b5653d37145694fd19388d31e10226549464fe8b483578","afterSHA256":"f22152fd55dcdb0090b5653d37145694fd19388d31e10226549464fe8b483578","reason":"Same source body in authored semantic page"},{"oldId":"b-dbd17e74958dcfd9fc5cfad3","targetId":"b-dbd17e74958dcfd9fc5cfad3","page":"reading-opening","operation":"move","beforeSHA256":"bab4bd804571aa5afbaf197e9c1539510fc766578c9825aa46cadbb18444cc32","afterSHA256":"bab4bd804571aa5afbaf197e9c1539510fc766578c9825aa46cadbb18444cc32","reason":"Same source body in authored semantic page"},{"oldId":"b-93693d0de1519fe268d1461d","targetId":"b-93693d0de1519fe268d1461d","page":"reading-opening","operation":"move","beforeSHA256":"f727b99f9d6274f0111bb10a0383f86a10271b27674851de4ca88872fc35141a","afterSHA256":"f727b99f9d6274f0111bb10a0383f86a10271b27674851de4ca88872fc35141a","reason":"Same source body in authored semantic page"},{"oldId":"b-2b4d2cd788634ac0cd473150","targetId":"b-2b4d2cd788634ac0cd473150","page":"reading-opening","operation":"rewrite","beforeSHA256":"68534496237ab167741e9fd0e94e2d15f431f288da2adff9cc1c9716ff8ef303","afterSHA256":"1d235867f8149bef480564be89cbe45135e146a1a5ca2cd3ac79ed658b91718b","reason":"Same source identity with figure semantics or reading context enriched"},{"oldId":"b-663e8f8b7395ae02b990fe63","targetId":"b-663e8f8b7395ae02b990fe63","page":"reading-opening","operation":"move","beforeSHA256":"7cab542474232d191a291fd42ab397e8a90cb7de1f204d1cbdcbb02807a5457f","afterSHA256":"7cab542474232d191a291fd42ab397e8a90cb7de1f204d1cbdcbb02807a5457f","reason":"Same source body in authored semantic page"},{"oldId":"b-960a2ee063bdce14080d62c9","targetId":"b-960a2ee063bdce14080d62c9","page":"reading-block-c13dcb1596e44be4b9e7a5f06c6f04ef","operation":"move","beforeSHA256":"d7be4c6e6a52627a6e950b2ea2d07b7e4b6a9b011316f48d54d6427622484c10","afterSHA256":"d7be4c6e6a52627a6e950b2ea2d07b7e4b6a9b011316f48d54d6427622484c10","reason":"Same source body in authored semantic page"},{"oldId":"b-098f2cab24ceaabe889ab2ac","targetId":"b-098f2cab24ceaabe889ab2ac","page":"reading-block-c13dcb1596e44be4b9e7a5f06c6f04ef","operation":"move","beforeSHA256":"6ad34e4ada835ae6143061c572cc8edb19103f364741d4cf627501c9ba2aa759","afterSHA256":"6ad34e4ada835ae6143061c572cc8edb19103f364741d4cf627501c9ba2aa759","reason":"Same source body in authored semantic page"},{"oldId":"b-5db0332dece9ff2983c72c42","targetId":"b-5db0332dece9ff2983c72c42","page":"reading-block-c13dcb1596e44be4b9e7a5f06c6f04ef","operation":"rewrite","beforeSHA256":"fc65d4e0d64271d306a1dcd0daafa1a8009c0e1ba58b2e34d56608e5e7f18cc4","afterSHA256":"7568784e0cb35e602743541c7257dcc26131f360b079886e0148b7b750e1d9b8","reason":"Same source identity with figure semantics or reading context enriched"},{"oldId":"b-6c398d1e870bbc7b47418b99","targetId":"b-6c398d1e870bbc7b47418b99","page":"reading-block-c13dcb1596e44be4b9e7a5f06c6f04ef","operation":"move","beforeSHA256":"c5a151ba290050d898b8b7b1ee06d5e932083a9a348688238f6e032b81d679f2","afterSHA256":"c5a151ba290050d898b8b7b1ee06d5e932083a9a348688238f6e032b81d679f2","reason":"Same source body in authored semantic page"},{"oldId":"b-310c58b9918a06c94af4ada3","targetId":"b-310c58b9918a06c94af4ada3","page":"reading-block-8011bff99a6d4beb88ae230911fbb097","operation":"move","beforeSHA256":"f18263031c97893ae92a034e60fc60f4b4242cecc141cb54848ca0940cd975ab","afterSHA256":"f18263031c97893ae92a034e60fc60f4b4242cecc141cb54848ca0940cd975ab","reason":"Same source body in authored semantic page"},{"oldId":"b-4c5eddec8cfb45bd16c551a2","targetId":"b-4c5eddec8cfb45bd16c551a2","page":"reading-block-8011bff99a6d4beb88ae230911fbb097","operation":"move","beforeSHA256":"7aca821f1c7bffbb560cbea620602884dbd6c22947e99b30387a9ae006a78714","afterSHA256":"7aca821f1c7bffbb560cbea620602884dbd6c22947e99b30387a9ae006a78714","reason":"Same source body in authored semantic page"},{"oldId":"b-d09c6ce890a33e9b21f28a76","targetId":"b-d09c6ce890a33e9b21f28a76","page":"reading-block-8011bff99a6d4beb88ae230911fbb097","operation":"move","beforeSHA256":"2fe5de42360d0416004495225148d4789a58190d6d5d6f8ccf8d6f676cc7db8f","afterSHA256":"2fe5de42360d0416004495225148d4789a58190d6d5d6f8ccf8d6f676cc7db8f","reason":"Same source body in authored semantic page"},{"oldId":"b-8101017d0d34dc8c1b8fbb21","targetId":"b-8101017d0d34dc8c1b8fbb21","page":"reading-block-8011bff99a6d4beb88ae230911fbb097","operation":"move","beforeSHA256":"a4199dc2105b7fcf2d31b7486c23469b3c2adfd5e951d87c8810ebe4fe3e0734","afterSHA256":"a4199dc2105b7fcf2d31b7486c23469b3c2adfd5e951d87c8810ebe4fe3e0734","reason":"Same source body in authored semantic page"},{"oldId":"b-2337659b8416b8f4d0e3a562","targetId":"b-2337659b8416b8f4d0e3a562","page":"reading-block-7895864a9980401b8e3526beca11f36f","operation":"move","beforeSHA256":"ef54cf9e1e190890a585eee086cb53436d99085fc293b4e6e3c919ca09d1a0cb","afterSHA256":"ef54cf9e1e190890a585eee086cb53436d99085fc293b4e6e3c919ca09d1a0cb","reason":"Same source body in authored semantic page"},{"oldId":"b-e192e3caa9a23e9b1be3ff45","targetId":"b-e192e3caa9a23e9b1be3ff45","page":"reading-block-7895864a9980401b8e3526beca11f36f","operation":"move","beforeSHA256":"6540e5779e1c360eb7aa418f46d443a164608b1194c149fd60832c8c4e1d37da","afterSHA256":"6540e5779e1c360eb7aa418f46d443a164608b1194c149fd60832c8c4e1d37da","reason":"Same source body in authored semantic page"},{"oldId":"b-d7cec921fcafff81c72399da","targetId":"b-d7cec921fcafff81c72399da","page":"reading-block-7895864a9980401b8e3526beca11f36f","operation":"move","beforeSHA256":"26ec077cbd6252e4bc71322380612569328787416226eee320a977c24a89589a","afterSHA256":"26ec077cbd6252e4bc71322380612569328787416226eee320a977c24a89589a","reason":"Same source body in authored semantic page"},{"oldId":"b-e4f2abddd4d33f411da8807d","targetId":"b-e4f2abddd4d33f411da8807d","page":"reading-block-6a1571aafa7e44d8b3a0654c78166412","operation":"move","beforeSHA256":"75581af4311579d0f0aa8b3e31fa3041835f11a6eff2ca81d661bda081bd4195","afterSHA256":"75581af4311579d0f0aa8b3e31fa3041835f11a6eff2ca81d661bda081bd4195","reason":"Same source body in authored semantic page"},{"oldId":"b-766056ae03a6fd785b9d2567","targetId":"b-766056ae03a6fd785b9d2567","page":"reading-block-6a1571aafa7e44d8b3a0654c78166412","operation":"move","beforeSHA256":"7ca98a60191efe95460cc789edd63b4dcd46b8e818d377021613b48bd73a2582","afterSHA256":"7ca98a60191efe95460cc789edd63b4dcd46b8e818d377021613b48bd73a2582","reason":"Same source body in authored semantic page"},{"oldId":"b-09c13cfbafc9a73ffbc9f4f5","targetId":"b-09c13cfbafc9a73ffbc9f4f5","page":"reading-block-6a1571aafa7e44d8b3a0654c78166412","operation":"move","beforeSHA256":"8cbcdacec033c71a8883d97e2d9160a22887dde95646104c6a75b045185b1614","afterSHA256":"8cbcdacec033c71a8883d97e2d9160a22887dde95646104c6a75b045185b1614","reason":"Same source body in authored semantic page"},{"oldId":"b-8a71f757c4142586a9bb9afc","targetId":"b-8a71f757c4142586a9bb9afc","page":"reading-block-6a1571aafa7e44d8b3a0654c78166412","operation":"move","beforeSHA256":"a22143a5d7eb7b02fb2f6b604dc5b90425bbfb2492a3e768276483cb768bb024","afterSHA256":"a22143a5d7eb7b02fb2f6b604dc5b90425bbfb2492a3e768276483cb768bb024","reason":"Same source body in authored semantic page"},{"oldId":"b-1368f444fc995b73e0b330f1","targetId":"b-1368f444fc995b73e0b330f1","page":"reading-block-66b6304ea0cf47dd9c5bb009263057ab","operation":"move","beforeSHA256":"0d2f43a64410dd0053d3e816f0394d6078bcdb5d28cd78e55c835ebf46152d25","afterSHA256":"0d2f43a64410dd0053d3e816f0394d6078bcdb5d28cd78e55c835ebf46152d25","reason":"Same source body in authored semantic page"},{"oldId":"b-ae7b61d81f4e61c789fdf5be","targetId":"b-ae7b61d81f4e61c789fdf5be","page":"reading-block-66b6304ea0cf47dd9c5bb009263057ab","operation":"move","beforeSHA256":"a8611b72f50695d3fd07e450025d70d459db5245859e2727f7acd33767f3d609","afterSHA256":"a8611b72f50695d3fd07e450025d70d459db5245859e2727f7acd33767f3d609","reason":"Same source body in authored semantic page"},{"oldId":"b-2cf5e20dadd0f2ba891521c1","targetId":"b-2cf5e20dadd0f2ba891521c1","page":"reading-block-66b6304ea0cf47dd9c5bb009263057ab","operation":"rewrite","beforeSHA256":"5d47f01a2a9695cebe3013eff0d6580b68981c22bb3e7be5cca0dc35a2ddb183","afterSHA256":"aead4f2d734b471023884420cc7eb3495c15da992dc2d3ac4788c141910c2a9a","reason":"Same source identity with figure semantics or reading context enriched"},{"oldId":"b-f7e360bb5beef266e9b63f2f","targetId":"b-f7e360bb5beef266e9b63f2f","page":"reading-block-66b6304ea0cf47dd9c5bb009263057ab","operation":"move","beforeSHA256":"15d0d789cdb37ba00e55be5d12ef2aef91fc80dc4a5938f9d2c13a45065d3445","afterSHA256":"15d0d789cdb37ba00e55be5d12ef2aef91fc80dc4a5938f9d2c13a45065d3445","reason":"Same source body in authored semantic page"},{"oldId":"b-e4660cc3e2b46562906ca426","targetId":"b-e4660cc3e2b46562906ca426","page":"reading-block-66b6304ea0cf47dd9c5bb009263057ab","operation":"move","beforeSHA256":"827be3cc0a439402b9a8d4facde53fe7a3e84bb93a2fe7dd31de94dd637ab16d","afterSHA256":"827be3cc0a439402b9a8d4facde53fe7a3e84bb93a2fe7dd31de94dd637ab16d","reason":"Same source body in authored semantic page"},{"oldId":"b-85588e4c11506b828c390f3c","targetId":"b-85588e4c11506b828c390f3c","page":"reading-block-66b6304ea0cf47dd9c5bb009263057ab","operation":"move","beforeSHA256":"7db21819736de71c652ced00174f154356926b74ee2a19cf7e3d2774b53e877d","afterSHA256":"7db21819736de71c652ced00174f154356926b74ee2a19cf7e3d2774b53e877d","reason":"Same source body in authored semantic page"},{"oldId":"b-39df99ccc85503528ff6bd2d","targetId":"b-39df99ccc85503528ff6bd2d","page":"reading-block-66b6304ea0cf47dd9c5bb009263057ab","operation":"move","beforeSHA256":"7462623f6862fb9ca9e60dff3dddc5d87cc3d61b00f48431e6c4da48f60fc1b1","afterSHA256":"7462623f6862fb9ca9e60dff3dddc5d87cc3d61b00f48431e6c4da48f60fc1b1","reason":"Same source body in authored semantic page"},{"oldId":"b-1b6f65ac397a7a706f2c33e7","targetId":"b-1b6f65ac397a7a706f2c33e7","page":"reading-block-6190cca74684424598eec8bcc3f7b586","operation":"move","beforeSHA256":"0b107bdae592f78e39efffc6bd9c577608dc6857569f7394cbbe587754ee0fbe","afterSHA256":"0b107bdae592f78e39efffc6bd9c577608dc6857569f7394cbbe587754ee0fbe","reason":"Same source body in authored semantic page"},{"oldId":"b-e57c9b39e3449e4e11ca8062","targetId":"b-e57c9b39e3449e4e11ca8062","page":"reading-block-6190cca74684424598eec8bcc3f7b586","operation":"move","beforeSHA256":"f16725c3f4b99db85728a8c0ad5468e176f12e070a8e0ef4c396639ead55b32f","afterSHA256":"f16725c3f4b99db85728a8c0ad5468e176f12e070a8e0ef4c396639ead55b32f","reason":"Same source body in authored semantic page"},{"oldId":"b-4fb35df1268e1477ff0ba860","targetId":"b-4fb35df1268e1477ff0ba860","page":"reading-block-6190cca74684424598eec8bcc3f7b586","operation":"move","beforeSHA256":"ad34b5f0089cfb6cb77961b0aa49093d4e43fbc5d8788f09d588270e1c227693","afterSHA256":"ad34b5f0089cfb6cb77961b0aa49093d4e43fbc5d8788f09d588270e1c227693","reason":"Same source body in authored semantic page"},{"oldId":"b-e809b56e7ad21137669bf4e5","targetId":"b-e809b56e7ad21137669bf4e5","page":"reading-block-65ae675e81234522a19a201af1e42f87","operation":"move","beforeSHA256":"d6d7f687bcedba0dcfe9455635b91fa547436d30cdd7198d319d848e7f7bdac9","afterSHA256":"d6d7f687bcedba0dcfe9455635b91fa547436d30cdd7198d319d848e7f7bdac9","reason":"Same source body in authored semantic page"},{"oldId":"b-1a860aa60e11f9894233ab42","targetId":"b-1a860aa60e11f9894233ab42","page":"reading-block-65ae675e81234522a19a201af1e42f87","operation":"move","beforeSHA256":"1e7c02057395dde2ac8ca8b8cdfdf6e4e8cce3442906d0ec870a82c93536b0da","afterSHA256":"1e7c02057395dde2ac8ca8b8cdfdf6e4e8cce3442906d0ec870a82c93536b0da","reason":"Same source body in authored semantic page"},{"oldId":"b-58f7c561d2061a5adb4db73f","targetId":"b-58f7c561d2061a5adb4db73f","page":"reading-block-65ae675e81234522a19a201af1e42f87","operation":"move","beforeSHA256":"029f2ef9a409227d34191533326a7c683f8de701b3bd7cb9250da730a734db5a","afterSHA256":"029f2ef9a409227d34191533326a7c683f8de701b3bd7cb9250da730a734db5a","reason":"Same source body in authored semantic page"},{"oldId":"b-31395ae667223cfe68eedcf6","targetId":"b-31395ae667223cfe68eedcf6","page":"reading-block-65ae675e81234522a19a201af1e42f87","operation":"move","beforeSHA256":"f87e8116e3b3421c94ff6df6c88c80edbb76ab16ad88ecef445a1094faa116e7","afterSHA256":"f87e8116e3b3421c94ff6df6c88c80edbb76ab16ad88ecef445a1094faa116e7","reason":"Same source body in authored semantic page"},{"oldId":"b-d59eadfd2994ff39c052aab9","targetId":"b-d59eadfd2994ff39c052aab9","page":"reading-block-65ae675e81234522a19a201af1e42f87","operation":"move","beforeSHA256":"61f2eac3fa189777b58f278954c103ea5a0d4a0ea7c11ddc56d5f88df56a5a95","afterSHA256":"61f2eac3fa189777b58f278954c103ea5a0d4a0ea7c11ddc56d5f88df56a5a95","reason":"Same source body in authored semantic page"},{"oldId":"b-5345b2caf55fa30c23e0c472","targetId":"b-5345b2caf55fa30c23e0c472","page":"reading-block-65ae675e81234522a19a201af1e42f87","operation":"move","beforeSHA256":"cd95176ac6950004a2ac89b291a5c2456210da6829ac70a68abe8d14c2595de7","afterSHA256":"cd95176ac6950004a2ac89b291a5c2456210da6829ac70a68abe8d14c2595de7","reason":"Same source body in authored semantic page"},{"oldId":"b-af0c588b4cd885d2359fe446","targetId":"b-af0c588b4cd885d2359fe446","page":"reading-block-65ae675e81234522a19a201af1e42f87","operation":"move","beforeSHA256":"c49232d6357522fd9a2ce0c7f9605542ba840d616e261e709a3b167378ab8391","afterSHA256":"c49232d6357522fd9a2ce0c7f9605542ba840d616e261e709a3b167378ab8391","reason":"Same source body in authored semantic page"},{"oldId":"b-d3e569e523f6fe21e4c42bca","targetId":"b-d3e569e523f6fe21e4c42bca","page":"reading-block-65ae675e81234522a19a201af1e42f87","operation":"move","beforeSHA256":"378a6ccfb10340771d62b5fef8fbfe2539f83070b2d2989f2c35ed91cc438be8","afterSHA256":"378a6ccfb10340771d62b5fef8fbfe2539f83070b2d2989f2c35ed91cc438be8","reason":"Same source body in authored semantic page"},{"oldId":"b-42ac8fac11da15dd5cf45190","targetId":"b-42ac8fac11da15dd5cf45190","page":"reading-block-65ae675e81234522a19a201af1e42f87","operation":"move","beforeSHA256":"f0f0573c44743250e28b31cf5696ecbfdd69eeeffd89c838fd710d5e52e7ae96","afterSHA256":"f0f0573c44743250e28b31cf5696ecbfdd69eeeffd89c838fd710d5e52e7ae96","reason":"Same source body in authored semantic page"},{"oldId":"b-8740dbd5b30d137bd548b4d6","targetId":"b-8740dbd5b30d137bd548b4d6","page":"reading-block-65ae675e81234522a19a201af1e42f87","operation":"move","beforeSHA256":"b769c9351f34ebc68ed7c27472d6037a868463332f4cd2baaf7d642d10f8f860","afterSHA256":"b769c9351f34ebc68ed7c27472d6037a868463332f4cd2baaf7d642d10f8f860","reason":"Same source body in authored semantic page"},{"oldId":"b-b1a858697a28bbea9135e9fe","targetId":"b-b1a858697a28bbea9135e9fe","page":"reading-block-65ae675e81234522a19a201af1e42f87","operation":"move","beforeSHA256":"9620dc81c8a3d7c3440efbdddc20207cb5571f9100e8f7b9b9f9f6ded164bdab","afterSHA256":"9620dc81c8a3d7c3440efbdddc20207cb5571f9100e8f7b9b9f9f6ded164bdab","reason":"Same source body in authored semantic page"},{"oldId":"b-ac74a24d1ae064245623f389","targetId":"b-ac74a24d1ae064245623f389","page":"reading-block-65ae675e81234522a19a201af1e42f87","operation":"move","beforeSHA256":"737afe1e44c836f3341701c4103d3dffc6e5200fc78e2829b40ba2ca7a72c64f","afterSHA256":"737afe1e44c836f3341701c4103d3dffc6e5200fc78e2829b40ba2ca7a72c64f","reason":"Same source body in authored semantic page"},{"oldId":"b-bfd45867284c70a73d0f0513","targetId":"b-bfd45867284c70a73d0f0513","page":"reading-block-65ae675e81234522a19a201af1e42f87","operation":"move","beforeSHA256":"188973b8e72f76f1befd0676e79b5aefc45bf4b2416491ef83be18d6cb131014","afterSHA256":"188973b8e72f76f1befd0676e79b5aefc45bf4b2416491ef83be18d6cb131014","reason":"Same source body in authored semantic page"},{"oldId":"b-a3a2e01c1047082e0782e519","targetId":"b-a3a2e01c1047082e0782e519","page":"reading-block-65ae675e81234522a19a201af1e42f87","operation":"move","beforeSHA256":"0d010adebcae62e3cb7b10a98c86ba63d0b61cdec8735a3397880d3ae2f50db1","afterSHA256":"0d010adebcae62e3cb7b10a98c86ba63d0b61cdec8735a3397880d3ae2f50db1","reason":"Same source body in authored semantic page"},{"oldId":"b-2b83cd04ebdfa269ac03a978","targetId":"b-2b83cd04ebdfa269ac03a978","page":"reading-block-65ae675e81234522a19a201af1e42f87","operation":"move","beforeSHA256":"e092e4e96514f964fb2620a149576bb5565f3718a9638a34ea1f49e3a5c12847","afterSHA256":"e092e4e96514f964fb2620a149576bb5565f3718a9638a34ea1f49e3a5c12847","reason":"Same source body in authored semantic page"},{"oldId":"b-b8948d817728bcba7d039188","targetId":"b-b8948d817728bcba7d039188","page":"reading-block-65ae675e81234522a19a201af1e42f87","operation":"move","beforeSHA256":"02bd2d981f917d5ad9574401f79a2c0465c3377e12c6c03c474cf4452e1f7193","afterSHA256":"02bd2d981f917d5ad9574401f79a2c0465c3377e12c6c03c474cf4452e1f7193","reason":"Same source body in authored semantic page"},{"oldId":"b-6eee098c82786402cf13ff32","targetId":"b-6eee098c82786402cf13ff32","page":"reading-block-c64974ec883f4a6a9488baa50fe6db3c","operation":"move","beforeSHA256":"c836ecfcd84baf84a70fee3b5093340e6e5b4fc2ea2a38da878f82a41045e1f0","afterSHA256":"c836ecfcd84baf84a70fee3b5093340e6e5b4fc2ea2a38da878f82a41045e1f0","reason":"Same source body in authored semantic page"},{"oldId":"b-dcab827d9763a960d18e20c8","targetId":"b-dcab827d9763a960d18e20c8","page":"reading-block-c64974ec883f4a6a9488baa50fe6db3c","operation":"rewrite","beforeSHA256":"1bbbed7013211e9a4464269280e5dcee0ebd4e04ffbb8fd41351f5114bc51fce","afterSHA256":"51e5cb3b305ffb050b59d2fb17530f18f29faee14aa25b863449ecfb1169d60a","reason":"Same source identity with figure semantics or reading context enriched"},{"oldId":"b-6ce2d79787560bd4f40745f2","targetId":"b-6ce2d79787560bd4f40745f2","page":"reading-block-c64974ec883f4a6a9488baa50fe6db3c","operation":"move","beforeSHA256":"0ebe5564b653d73e64093c3de11d71962ff8d88d08cbb28f7def0426ffae10de","afterSHA256":"0ebe5564b653d73e64093c3de11d71962ff8d88d08cbb28f7def0426ffae10de","reason":"Same source body in authored semantic page"},{"oldId":"b-786d78044821377d7e339e53","targetId":"b-786d78044821377d7e339e53","page":"reading-block-c64974ec883f4a6a9488baa50fe6db3c","operation":"move","beforeSHA256":"df529a3ca5d78966b839f5382d36379ea7fe532a3edb06f4508b1bd843e8bcd7","afterSHA256":"df529a3ca5d78966b839f5382d36379ea7fe532a3edb06f4508b1bd843e8bcd7","reason":"Same source body in authored semantic page"},{"oldId":"b-8fc77dbf7f76f34a286bee45","targetId":"b-8fc77dbf7f76f34a286bee45","page":"reading-block-c64974ec883f4a6a9488baa50fe6db3c","operation":"move","beforeSHA256":"55e0f4486b82871bc213cb33f13c8240e5363b41f60c0673e24c6c61c5841c3a","afterSHA256":"55e0f4486b82871bc213cb33f13c8240e5363b41f60c0673e24c6c61c5841c3a","reason":"Same source body in authored semantic page"},{"oldId":"b-7e065df99d4fd0a5d5ffd945","targetId":"b-7e065df99d4fd0a5d5ffd945","page":"reading-block-0aabdf483a9d4b58a0bcff200b378bc9","operation":"move","beforeSHA256":"448987d94222e9dc12f2fdc642840249b41cfdb297f44ff9fa034faf912b2c1f","afterSHA256":"448987d94222e9dc12f2fdc642840249b41cfdb297f44ff9fa034faf912b2c1f","reason":"Same source body in authored semantic page"},{"oldId":"b-2c3937d0ccb88027e9e3386c","targetId":"b-2c3937d0ccb88027e9e3386c","page":"reading-block-0aabdf483a9d4b58a0bcff200b378bc9","operation":"move","beforeSHA256":"826c37982b1fccb48a900e7b147f828e26b6399914cb55a9725a7e159f48cebb","afterSHA256":"826c37982b1fccb48a900e7b147f828e26b6399914cb55a9725a7e159f48cebb","reason":"Same source body in authored semantic page"},{"oldId":"b-b3e4ce7107f0f045ff26ece2","targetId":"b-b3e4ce7107f0f045ff26ece2","page":"reading-block-0aabdf483a9d4b58a0bcff200b378bc9","operation":"move","beforeSHA256":"3d5c7bd3c37b0b27a8ff2291c779f7cb4f476415ede88c31e8859e72e9e04035","afterSHA256":"3d5c7bd3c37b0b27a8ff2291c779f7cb4f476415ede88c31e8859e72e9e04035","reason":"Same source body in authored semantic page"},{"oldId":"b-dd0d2dbd8a00573b7d3c7065","targetId":"b-dd0d2dbd8a00573b7d3c7065","page":"reading-block-0aabdf483a9d4b58a0bcff200b378bc9","operation":"move","beforeSHA256":"c08ee8b374daa51edb2a12d7498572a81bca062005f11e4fa535ab6c6cdec853","afterSHA256":"c08ee8b374daa51edb2a12d7498572a81bca062005f11e4fa535ab6c6cdec853","reason":"Same source body in authored semantic page"},{"oldId":"b-0e7921da9f49da534ad883f5","targetId":"b-0e7921da9f49da534ad883f5","page":"reading-block-4f123fd559034e98ab80a149967f6452","operation":"move","beforeSHA256":"4c12f8caf1008b197e82c6f59b2dfe2b20ec1686fb0d9d62fd0dd05ca25af4ca","afterSHA256":"4c12f8caf1008b197e82c6f59b2dfe2b20ec1686fb0d9d62fd0dd05ca25af4ca","reason":"Same source body in authored semantic page"},{"oldId":"b-dbbaab4836e2a23b9743ca9f","targetId":"b-dbbaab4836e2a23b9743ca9f","page":"reading-block-4f123fd559034e98ab80a149967f6452","operation":"move","beforeSHA256":"617e419c317d8efed8d341ce4af6ad4d1caf49a51c7bae9d4d1605603b749536","afterSHA256":"617e419c317d8efed8d341ce4af6ad4d1caf49a51c7bae9d4d1605603b749536","reason":"Same source body in authored semantic page"},{"oldId":"b-681911ad48e0a1dedced0284","targetId":"b-681911ad48e0a1dedced0284","page":"reading-block-4f123fd559034e98ab80a149967f6452","operation":"move","beforeSHA256":"05a43b7dca3fcbe6656e1d5fe6c72c489f7746be571acf25013a8234f62cc4ca","afterSHA256":"05a43b7dca3fcbe6656e1d5fe6c72c489f7746be571acf25013a8234f62cc4ca","reason":"Same source body in authored semantic page"},{"oldId":"b-5f91f3a7b4c296b874462626","targetId":"b-5f91f3a7b4c296b874462626","page":"reading-block-4f123fd559034e98ab80a149967f6452","operation":"move","beforeSHA256":"53284538628970eb67c2983de4a891ba92836b5ea5f1c443f8064a010523ac09","afterSHA256":"53284538628970eb67c2983de4a891ba92836b5ea5f1c443f8064a010523ac09","reason":"Same source body in authored semantic page"},{"oldId":"b-0ff6110c8c0a03378614134a","targetId":"b-0ff6110c8c0a03378614134a","page":"reading-block-ce309fa079154f8092fa03084d3bcf9f","operation":"move","beforeSHA256":"4f6e7a02e226941e5d682e57303f951521c7d87eba24808cf9c614d1c8ee0d18","afterSHA256":"4f6e7a02e226941e5d682e57303f951521c7d87eba24808cf9c614d1c8ee0d18","reason":"Same source body in authored semantic page"},{"oldId":"b-e8535c6afb078e3ec792e2ba","targetId":"b-e8535c6afb078e3ec792e2ba","page":"reading-block-ce309fa079154f8092fa03084d3bcf9f","operation":"move","beforeSHA256":"931258abc2eb3340d6be3c688c9a5f07957a249928b7cd01ef400b2ae932f433","afterSHA256":"931258abc2eb3340d6be3c688c9a5f07957a249928b7cd01ef400b2ae932f433","reason":"Same source body in authored semantic page"},{"oldId":"b-b5622f16e75c00c66cff88ff","targetId":"b-b5622f16e75c00c66cff88ff","page":"reading-block-ce309fa079154f8092fa03084d3bcf9f","operation":"move","beforeSHA256":"afc9d2ed59208633d8da6076b8ead853c22a8303cf016c2abf0fef4271692784","afterSHA256":"afc9d2ed59208633d8da6076b8ead853c22a8303cf016c2abf0fef4271692784","reason":"Same source body in authored semantic page"},{"oldId":"b-e44bdd5e38dee1516fe0949c","targetId":"b-e44bdd5e38dee1516fe0949c","page":"reading-block-fc3d98abedce4cfe9f92457dd3572549","operation":"move","beforeSHA256":"b422e5c41fb46da51102e6139beea88f8386b5054ac4b3ad85ac9244c32f8e1f","afterSHA256":"b422e5c41fb46da51102e6139beea88f8386b5054ac4b3ad85ac9244c32f8e1f","reason":"Same source body in authored semantic page"},{"oldId":"b-958355d1b57c6d98b3b110cd","targetId":"b-958355d1b57c6d98b3b110cd","page":"reading-block-fc3d98abedce4cfe9f92457dd3572549","operation":"rewrite","beforeSHA256":"d2b2884666f6364e5da1213a28d5ce1b87f7a7d0210f5e88b518983b5746fa58","afterSHA256":"2d581f2b1c5fd2dd3063e1c1569b70b145e9da82322aadec1a3dfac8bca097fe","reason":"Same source identity with figure semantics or reading context enriched"},{"oldId":"b-30efda84670311e1f880b14c","targetId":"b-30efda84670311e1f880b14c","page":"reading-block-fc3d98abedce4cfe9f92457dd3572549","operation":"move","beforeSHA256":"5dc7ba2b1f6c6316e7308c7da92b581aeb6feee3f11c1f88621e07593710394d","afterSHA256":"5dc7ba2b1f6c6316e7308c7da92b581aeb6feee3f11c1f88621e07593710394d","reason":"Same source body in authored semantic page"},{"oldId":"b-70656ed72da276e84cad486b","targetId":"b-70656ed72da276e84cad486b","page":"reading-block-fc3d98abedce4cfe9f92457dd3572549","operation":"move","beforeSHA256":"9b59abe0072b6b80a90d34b288a06475c6850e52668587e545dd8760d6fcddfe","afterSHA256":"9b59abe0072b6b80a90d34b288a06475c6850e52668587e545dd8760d6fcddfe","reason":"Same source body in authored semantic page"},{"oldId":"b-5c0ac2edb692192ddaa28d8b","targetId":"b-5c0ac2edb692192ddaa28d8b","page":"reading-block-b76c720aae524c5faef18b343a6374aa","operation":"move","beforeSHA256":"eaeeed1ae0427188eac58d53ec3f43bb2e102dce0e1d5e8c4d02912018d55f95","afterSHA256":"eaeeed1ae0427188eac58d53ec3f43bb2e102dce0e1d5e8c4d02912018d55f95","reason":"Same source body in authored semantic page"},{"oldId":"b-3e0a9efbb87cb4cfdcbdd8d7","targetId":"b-3e0a9efbb87cb4cfdcbdd8d7","page":"reading-block-b76c720aae524c5faef18b343a6374aa","operation":"move","beforeSHA256":"45ba6b3d2c09727e6a1c315bca9819ed3dc9a528bcd3967fd024e4e5c6a5647f","afterSHA256":"45ba6b3d2c09727e6a1c315bca9819ed3dc9a528bcd3967fd024e4e5c6a5647f","reason":"Same source body in authored semantic page"},{"oldId":"b-4e53637c91dd438e0e9ee1db","targetId":"b-4e53637c91dd438e0e9ee1db","page":"reading-block-b76c720aae524c5faef18b343a6374aa","operation":"move","beforeSHA256":"c6febdec2ae248a7832a8dd6f8171f5558f284b515bf60f2b725a94807eec1e8","afterSHA256":"c6febdec2ae248a7832a8dd6f8171f5558f284b515bf60f2b725a94807eec1e8","reason":"Same source body in authored semantic page"},{"oldId":"b-dfd590e2fc78d0f9b9394b61","targetId":"b-dfd590e2fc78d0f9b9394b61","page":"reading-block-b76c720aae524c5faef18b343a6374aa","operation":"move","beforeSHA256":"c6febdec2ae248a7832a8dd6f8171f5558f284b515bf60f2b725a94807eec1e8","afterSHA256":"c6febdec2ae248a7832a8dd6f8171f5558f284b515bf60f2b725a94807eec1e8","reason":"Same source body in authored semantic page"},{"oldId":"b-358279c23ed751146dd3b0fb","targetId":"b-358279c23ed751146dd3b0fb","page":"reading-block-b76c720aae524c5faef18b343a6374aa","operation":"move","beforeSHA256":"a5f88743244fce1f0c7154025389a242e51ec43f3098e14c0e1d51ad7930b72d","afterSHA256":"a5f88743244fce1f0c7154025389a242e51ec43f3098e14c0e1d51ad7930b72d","reason":"Same source body in authored semantic page"},{"oldId":"b-272b6434b35b01027ab89107","targetId":"b-272b6434b35b01027ab89107","page":"reading-block-b76c720aae524c5faef18b343a6374aa","operation":"move","beforeSHA256":"2074f6f25833791334e2622f481240a866c683e7f8b3b0ad0536db73dd43fd64","afterSHA256":"2074f6f25833791334e2622f481240a866c683e7f8b3b0ad0536db73dd43fd64","reason":"Same source body in authored semantic page"},{"oldId":"b-443088c88a906b3e9d16a150","targetId":"b-443088c88a906b3e9d16a150","page":"reading-block-63a505de22ae4389bfa3360aab9f5b84","operation":"move","beforeSHA256":"dfa0892457d88def26b39b90aa5fc829695d80c9bbb0dbfbb0d27aaaba50246d","afterSHA256":"dfa0892457d88def26b39b90aa5fc829695d80c9bbb0dbfbb0d27aaaba50246d","reason":"Same source body in authored semantic page"},{"oldId":"b-9a1d6ae92b103507c8bec492","targetId":"b-9a1d6ae92b103507c8bec492","page":"reading-block-63a505de22ae4389bfa3360aab9f5b84","operation":"move","beforeSHA256":"cf7fd8ff4bae4380c923987a7e392cad55130841222aa1a9b4016eb1d6f2a957","afterSHA256":"cf7fd8ff4bae4380c923987a7e392cad55130841222aa1a9b4016eb1d6f2a957","reason":"Same source body in authored semantic page"},{"oldId":"b-2547ccf7f2d0f3f34ad1bdc8","targetId":"b-2547ccf7f2d0f3f34ad1bdc8","page":"reading-block-63a505de22ae4389bfa3360aab9f5b84","operation":"move","beforeSHA256":"e19f2082b0f95c084a830b2ddaa0e17aadc33a539dda973c55f262f41f7912c5","afterSHA256":"e19f2082b0f95c084a830b2ddaa0e17aadc33a539dda973c55f262f41f7912c5","reason":"Same source body in authored semantic page"},{"oldId":"b-5ab743e2316c44ce6acbc40f","targetId":"b-5ab743e2316c44ce6acbc40f","page":"reading-block-63a505de22ae4389bfa3360aab9f5b84","operation":"move","beforeSHA256":"1f6e31e2b2dbc9a62e0dd4e9a066eafb2be5a050149f230ddb54cedec729524d","afterSHA256":"1f6e31e2b2dbc9a62e0dd4e9a066eafb2be5a050149f230ddb54cedec729524d","reason":"Same source body in authored semantic page"},{"oldId":"b-2a802495339dbee301b79ecf","targetId":"b-2a802495339dbee301b79ecf","page":"reading-block-63a505de22ae4389bfa3360aab9f5b84","operation":"move","beforeSHA256":"35a83f4615e816d6e2089e4cc62c05fdb9d244c10b1fd5844f30bb0013b29e3b","afterSHA256":"35a83f4615e816d6e2089e4cc62c05fdb9d244c10b1fd5844f30bb0013b29e3b","reason":"Same source body in authored semantic page"},{"oldId":"b-080a311e4d6c8feb63cc1440","targetId":"b-080a311e4d6c8feb63cc1440","page":"reading-block-63a505de22ae4389bfa3360aab9f5b84","operation":"move","beforeSHA256":"ba3d2aca4094187642fdd70cf1ec1985ebad6809f16b721f44e92851a90d945e","afterSHA256":"ba3d2aca4094187642fdd70cf1ec1985ebad6809f16b721f44e92851a90d945e","reason":"Same source body in authored semantic page"},{"oldId":"b-c55833cd8474b608c1d354ac","targetId":"b-c55833cd8474b608c1d354ac","page":"reading-block-63a505de22ae4389bfa3360aab9f5b84","operation":"move","beforeSHA256":"18502752c7150235b0383c6453be3b72e10a15f596da43a2692724c617dad06e","afterSHA256":"18502752c7150235b0383c6453be3b72e10a15f596da43a2692724c617dad06e","reason":"Same source body in authored semantic page"},{"oldId":"b-ddae8c50cddd1aafc238218a","targetId":"b-ddae8c50cddd1aafc238218a","page":"reading-block-63a505de22ae4389bfa3360aab9f5b84","operation":"move","beforeSHA256":"46ccad82420657a0419905e10975bcaa713b5009a3ea1b14300dd3552bbb4ee0","afterSHA256":"46ccad82420657a0419905e10975bcaa713b5009a3ea1b14300dd3552bbb4ee0","reason":"Same source body in authored semantic page"},{"oldId":"b-87fcbbd4da31ec7901dc4f47","targetId":"b-87fcbbd4da31ec7901dc4f47","page":"reading-block-63a505de22ae4389bfa3360aab9f5b84","operation":"move","beforeSHA256":"c9a1149641761796275222b4791eedd41d5cbd674182c4bef7ddbefdfc2351b5","afterSHA256":"c9a1149641761796275222b4791eedd41d5cbd674182c4bef7ddbefdfc2351b5","reason":"Same source body in authored semantic page"},{"oldId":"b-da802720bcd07414a86b7178","targetId":"b-da802720bcd07414a86b7178","page":"reading-block-63a505de22ae4389bfa3360aab9f5b84","operation":"move","beforeSHA256":"b788699bd059bf4fe754b7fb902ea4c258639e62e09bad0cd62e9fae1bb2a821","afterSHA256":"b788699bd059bf4fe754b7fb902ea4c258639e62e09bad0cd62e9fae1bb2a821","reason":"Same source body in authored semantic page"},{"oldId":"b-77cc73428d47e01ef1d8f4de","targetId":"b-77cc73428d47e01ef1d8f4de","page":"reading-block-63a505de22ae4389bfa3360aab9f5b84","operation":"move","beforeSHA256":"3ae0dad0a0a4f849682fc00cb590bf19b6754cf535a6a9b5ed68d989ce809079","afterSHA256":"3ae0dad0a0a4f849682fc00cb590bf19b6754cf535a6a9b5ed68d989ce809079","reason":"Same source body in authored semantic page"},{"oldId":"b-d5ef6f2137d7803b53e232b3","targetId":"b-d5ef6f2137d7803b53e232b3","page":"reading-block-63a505de22ae4389bfa3360aab9f5b84","operation":"move","beforeSHA256":"3c1b064ae1227aa2cc16fadcf715afe99cbac1c93fdc8b4e282eba90aee2b7f3","afterSHA256":"3c1b064ae1227aa2cc16fadcf715afe99cbac1c93fdc8b4e282eba90aee2b7f3","reason":"Same source body in authored semantic page"},{"oldId":"b-ec6696a19a62de9d59ec0870","targetId":"b-ec6696a19a62de9d59ec0870","page":"reading-block-63a505de22ae4389bfa3360aab9f5b84","operation":"move","beforeSHA256":"4483c65121d2fda48387c2d19b1b50e8f103d71ff64ed8875d4b85bf62dd709b","afterSHA256":"4483c65121d2fda48387c2d19b1b50e8f103d71ff64ed8875d4b85bf62dd709b","reason":"Same source body in authored semantic page"},{"oldId":"b-4e69b8dbb59e8c8f7a2d17c3","targetId":"b-4e69b8dbb59e8c8f7a2d17c3","page":"reading-block-aead117ad6f542828f635a98ebe8a29a","operation":"move","beforeSHA256":"ca2d786f5df1b68f7324a11164f448d6599e7c4d91acdecf5da2b4ebee747121","afterSHA256":"ca2d786f5df1b68f7324a11164f448d6599e7c4d91acdecf5da2b4ebee747121","reason":"Same source body in authored semantic page"},{"oldId":"b-26d00ae93eb5ae863d03c589","targetId":"b-26d00ae93eb5ae863d03c589","page":"reading-block-aead117ad6f542828f635a98ebe8a29a","operation":"move","beforeSHA256":"a74e7494da4f27597b87a787edfb6666ddbb5fe9cb8acff82ae11ff528697bcc","afterSHA256":"a74e7494da4f27597b87a787edfb6666ddbb5fe9cb8acff82ae11ff528697bcc","reason":"Same source body in authored semantic page"},{"oldId":"b-c8a1b60cf9405923db5ec8c7","targetId":"b-c8a1b60cf9405923db5ec8c7","page":"reading-block-aead117ad6f542828f635a98ebe8a29a","operation":"move","beforeSHA256":"b57464e1073c44ff4e797006cdae033c6ce6c10edc4ac7d4d01b97c0bca39c4d","afterSHA256":"b57464e1073c44ff4e797006cdae033c6ce6c10edc4ac7d4d01b97c0bca39c4d","reason":"Same source body in authored semantic page"},{"oldId":"b-c9a1b4db168029b424cebb39","targetId":"b-c9a1b4db168029b424cebb39","page":"reading-block-f9a09c497c544a4ba4af64ab27b80fa5","operation":"move","beforeSHA256":"86b47fdf22b5f59fcb52f39908699d3afa539bfc3ac039b38ca831c41799f903","afterSHA256":"86b47fdf22b5f59fcb52f39908699d3afa539bfc3ac039b38ca831c41799f903","reason":"Same source body in authored semantic page"},{"oldId":"b-b6d14c0a7ba95d11906d6775","targetId":"b-b6d14c0a7ba95d11906d6775","page":"reading-block-f9a09c497c544a4ba4af64ab27b80fa5","operation":"move","beforeSHA256":"cb5c5f6c89b690472f6152911a67770fa42e8b09dd72e92057611aac7fd5ea43","afterSHA256":"cb5c5f6c89b690472f6152911a67770fa42e8b09dd72e92057611aac7fd5ea43","reason":"Same source body in authored semantic page"},{"oldId":"b-742302425326661395a8bab1","targetId":"b-742302425326661395a8bab1","page":"reading-block-f9a09c497c544a4ba4af64ab27b80fa5","operation":"move","beforeSHA256":"36bfd8f5cd6db82d0034a944908e56f553c295a0f5c79a2fe695711943f94a8e","afterSHA256":"36bfd8f5cd6db82d0034a944908e56f553c295a0f5c79a2fe695711943f94a8e","reason":"Same source body in authored semantic page"},{"oldId":"block-7895864a9980401b8e3526beca11f36f--研究背景组件到位后选择哪一个新问题","targetId":"b-2337659b8416b8f4d0e3a562","operation":"retain-source-identity"},{"oldId":"block-66b6304ea0cf47dd9c5bb009263057ab--活动-a一张小矩阵两种查找方向","targetId":"b-1368f444fc995b73e0b330f1","operation":"retain-source-identity"},{"oldId":"block-6190cca74684424598eec8bcc3f7b586--从这张教学矩阵走到真实模型","targetId":"b-1b6f65ac397a7a706f2c33e7","operation":"retain-source-identity"},{"oldId":"block-c64974ec883f4a6a9488baa50fe6db3c--四条件的规则预期","targetId":"b-6eee098c82786402cf13ff32","operation":"retain-source-identity"},{"oldId":"block-ce309fa079154f8092fa03084d3bcf9f--指令答案也需要信息来源","targetId":"b-0ff6110c8c0a03378614134a","operation":"retain-source-identity"}],"blocks":[{"id":"b-6293e12c6ccb0216241fec48","type":"h1","scope":"document","url":"https://codingai-lec03.pages.dev/course/notebooks/680da245145447dd88983aabd136fd24.html#b-6293e12c6ccb0216241fec48","content":"# CLS 03 · 视觉与语言：任务、训练与接口","sha256":"a6b2c548a0a325bab1464ec88d074342246fbd71d255cf4a7dc465a013406f44","chapter":{"id":"III","title":"视觉与语言"},"unit":{"id":"language-task-interfaces","title":"语言加入后，任务究竟改变了什么？"},"page":{"id":"reading-opening","title":"CLS 03 · 视觉与语言：任务、训练与接口","number":1},"sectionTitle":"CLS 03 · 视觉与语言：任务、训练与接口","currentQuestion":"CLS 03 · 视觉与语言：任务、训练与接口","sourceSlides":[],"knowledgeBlock":null,"formulas":[],"previousBlock":null,"nextBlock":"b-12384c711c1eb652e7880c16","prerequisites":[{"id":"b-12384c711c1eb652e7880c16","url":"#b-12384c711c1eb652e7880c16","role":"problem-context"}],"relatedBlocks":[]},{"id":"b-12384c711c1eb652e7880c16","type":"p","scope":"document","url":"https://codingai-lec03.pages.dev/course/notebooks/680da245145447dd88983aabd136fd24.html#b-12384c711c1eb652e7880c16","content":"主线阅读与优先实验","sha256":"42cba31deccba2a350b9b23bd0ca1dcaa4c4c5cb9d35c773e1fcb89124788ccd","chapter":{"id":"III","title":"视觉与语言"},"unit":{"id":"language-task-interfaces","title":"语言加入后，任务究竟改变了什么？"},"page":{"id":"reading-opening","title":"CLS 03 · 视觉与语言：任务、训练与接口","number":1},"sectionTitle":"CLS 03 · 视觉与语言：任务、训练与接口","currentQuestion":"CLS 03 · 视觉与语言：任务、训练与接口","sourceSlides":[],"knowledgeBlock":null,"formulas":[],"previousBlock":"b-6293e12c6ccb0216241fec48","nextBlock":"b-5fd5f62e15e98785286ec4dc","prerequisites":[{"id":"b-6293e12c6ccb0216241fec48","url":"#b-6293e12c6ccb0216241fec48","role":"section-title"}],"relatedBlocks":[]},{"id":"b-5fd5f62e15e98785286ec4dc","type":"p","scope":"document","url":"https://codingai-lec03.pages.dev/course/notebooks/680da245145447dd88983aabd136fd24.html#b-5fd5f62e15e98785286ec4dc","content":"caption历史、VQA、CLIP候选、关系控制、GLIP/LLaVA与生成桥梁","sha256":"41c70c2c07b82678ff0a60f2d009b6afa750c5c691d109e754a69abf23868b50","chapter":{"id":"III","title":"视觉与语言"},"unit":{"id":"language-task-interfaces","title":"语言加入后，任务究竟改变了什么？"},"page":{"id":"reading-opening","title":"CLS 03 · 视觉与语言：任务、训练与接口","number":1},"sectionTitle":"CLS 03 · 视觉与语言：任务、训练与接口","currentQuestion":"CLS 03 · 视觉与语言：任务、训练与接口","sourceSlides":[],"knowledgeBlock":null,"formulas":[],"previousBlock":"b-12384c711c1eb652e7880c16","nextBlock":"b-39c7d157e577ecb4b4b03925","prerequisites":[{"id":"b-6293e12c6ccb0216241fec48","url":"#b-6293e12c6ccb0216241fec48","role":"section-title"},{"id":"b-12384c711c1eb652e7880c16","url":"#b-12384c711c1eb652e7880c16","role":"problem-context"}],"relatedBlocks":[]},{"id":"b-39c7d157e577ecb4b4b03925","type":"p","scope":"document","url":"https://codingai-lec03.pages.dev/course/notebooks/680da245145447dd88983aabd136fd24.html#b-39c7d157e577ecb4b4b03925","content":"可先阅读已有结果，再决定是否运行。重算时请核对各节记录的数据、参数、环境与日期。","sha256":"f22152fd55dcdb0090b5653d37145694fd19388d31e10226549464fe8b483578","chapter":{"id":"III","title":"视觉与语言"},"unit":{"id":"language-task-interfaces","title":"语言加入后，任务究竟改变了什么？"},"page":{"id":"reading-opening","title":"CLS 03 · 视觉与语言：任务、训练与接口","number":1},"sectionTitle":"CLS 03 · 视觉与语言：任务、训练与接口","currentQuestion":"CLS 03 · 视觉与语言：任务、训练与接口","sourceSlides":[],"knowledgeBlock":null,"formulas":[],"previousBlock":"b-5fd5f62e15e98785286ec4dc","nextBlock":"b-dbd17e74958dcfd9fc5cfad3","prerequisites":[{"id":"b-6293e12c6ccb0216241fec48","url":"#b-6293e12c6ccb0216241fec48","role":"section-title"},{"id":"b-12384c711c1eb652e7880c16","url":"#b-12384c711c1eb652e7880c16","role":"problem-context"}],"relatedBlocks":[]},{"id":"b-dbd17e74958dcfd9fc5cfad3","type":"p","scope":"block-009d0db9c9574995bdb7be7a82e66c8d","url":"https://codingai-lec03.pages.dev/course/notebooks/680da245145447dd88983aabd136fd24.html#b-dbd17e74958dcfd9fc5cfad3","content":"**学习路径：** [文字候选与图文检索](/course/study/clip-retrieval.html)","sha256":"bab4bd804571aa5afbaf197e9c1539510fc766578c9825aa46cadbb18444cc32","chapter":{"id":"III","title":"视觉与语言"},"unit":{"id":"language-task-interfaces","title":"语言加入后，任务究竟改变了什么？"},"page":{"id":"reading-opening","title":"CLS 03 · 视觉与语言：任务、训练与接口","number":1},"sectionTitle":"CLS 03 · 视觉与语言：任务、训练与接口","currentQuestion":"CLS 03 · 视觉与语言：任务、训练与接口","sourceSlides":[],"knowledgeBlock":null,"formulas":[],"previousBlock":"b-39c7d157e577ecb4b4b03925","nextBlock":"b-93693d0de1519fe268d1461d","prerequisites":[{"id":"b-6293e12c6ccb0216241fec48","url":"#b-6293e12c6ccb0216241fec48","role":"section-title"},{"id":"b-12384c711c1eb652e7880c16","url":"#b-12384c711c1eb652e7880c16","role":"problem-context"}],"relatedBlocks":[]},{"id":"b-93693d0de1519fe268d1461d","type":"p","scope":"block-009d0db9c9574995bdb7be7a82e66c8d","url":"https://codingai-lec03.pages.dev/course/notebooks/680da245145447dd88983aabd136fd24.html#b-93693d0de1519fe268d1461d","content":"同一张图可以配文字、生成描述、回答问题，也可以按短语返回区域。本册把这四种输出放到同一条线上：语言此刻是答案、学习信号，还是任务条件？","sha256":"f727b99f9d6274f0111bb10a0383f86a10271b27674851de4ca88872fc35141a","chapter":{"id":"III","title":"视觉与语言"},"unit":{"id":"language-task-interfaces","title":"语言加入后，任务究竟改变了什么？"},"page":{"id":"reading-opening","title":"CLS 03 · 视觉与语言：任务、训练与接口","number":1},"sectionTitle":"CLS 03 · 视觉与语言：任务、训练与接口","currentQuestion":"CLS 03 · 视觉与语言：任务、训练与接口","sourceSlides":[],"knowledgeBlock":null,"formulas":[],"previousBlock":"b-dbd17e74958dcfd9fc5cfad3","nextBlock":"b-2b4d2cd788634ac0cd473150","prerequisites":[{"id":"b-6293e12c6ccb0216241fec48","url":"#b-6293e12c6ccb0216241fec48","role":"section-title"},{"id":"b-12384c711c1eb652e7880c16","url":"#b-12384c711c1eb652e7880c16","role":"problem-context"}],"relatedBlocks":[]},{"id":"b-2b4d2cd788634ac0cd473150","type":"table","scope":"block-009d0db9c9574995bdb7be7a82e66c8d","url":"https://codingai-lec03.pages.dev/course/notebooks/680da245145447dd88983aabd136fd24.html#b-2b4d2cd788634ac0cd473150","content":"| 你想解决的问题 | 先读 | 再做或深读 |\n| --- | --- | --- |\n| 图像怎样改变一句话或一个答案 | [P51 描述](/course/pages/l3-r2-p51.html)、[P54 问答](/course/pages/l3-r2-p54.html) | [CLS 09](https://deepnote.com/project/38755e4e-23f6-4f5f-8c68-8a2e4114b1c1/notebook/c9f328a00ef44ecc90804e47276a7811)，按兴趣选 LAB13 或 LAB14 |\n| 图文配对怎样得到可复用表示 | [P57 矩阵](/course/pages/l3-r2-p57.html)、[P58 候选](/course/pages/l3-r2-p58.html) | 优先 [LAB 04](https://deepnote.com/project/38755e4e-23f6-4f5f-8c68-8a2e4114b1c1/notebook/0ba963931ddf4866b507b210d93a43bf)；需要图库缓存时再进 LAB12 |\n| 一句话指哪个对象，视觉如何接入语言模型 | [P63 定位](/course/pages/l3-r2-p63.html)、[P64 接口](/course/pages/l3-r2-p64.html) | [CLS 11](https://deepnote.com/project/38755e4e-23f6-4f5f-8c68-8a2e4114b1c1/notebook/95169c3e298c4c819373bb4534f3dff9)，其中 LAB15 是可复算的关系规则练习 |","sha256":"1d235867f8149bef480564be89cbe45135e146a1a5ca2cd3ac79ed658b91718b","chapter":{"id":"III","title":"视觉与语言"},"unit":{"id":"language-task-interfaces","title":"语言加入后，任务究竟改变了什么？"},"page":{"id":"reading-opening","title":"CLS 03 · 视觉与语言：任务、训练与接口","number":1},"sectionTitle":"CLS 03 · 视觉与语言：任务、训练与接口","currentQuestion":"CLS 03 · 视觉与语言：任务、训练与接口","sourceSlides":[],"knowledgeBlock":null,"formulas":[],"table":{"headers":["你想解决的问题","先读","再做或深读"],"rows":[["你想解决的问题","先读","再做或深读"],["图像怎样改变一句话或一个答案","P51 描述、P54 问答","CLS 09，按兴趣选 LAB13 或 LAB14"],["图文配对怎样得到可复用表示","P57 矩阵、P58 候选","优先 LAB 04；需要图库缓存时再进 LAB12"],["一句话指哪个对象，视觉如何接入语言模型","P63 定位、P64 接口","CLS 11，其中 LAB15 是可复算的关系规则练习"]]},"previousBlock":"b-93693d0de1519fe268d1461d","nextBlock":"b-663e8f8b7395ae02b990fe63","prerequisites":[{"id":"b-6293e12c6ccb0216241fec48","url":"#b-6293e12c6ccb0216241fec48","role":"section-title"},{"id":"b-12384c711c1eb652e7880c16","url":"#b-12384c711c1eb652e7880c16","role":"problem-context"}],"relatedBlocks":[]},{"id":"b-663e8f8b7395ae02b990fe63","type":"p","scope":"block-009d0db9c9574995bdb7be7a82e66c8d","url":"https://codingai-lec03.pages.dev/course/notebooks/680da245145447dd88983aabd136fd24.html#b-663e8f8b7395ae02b990fe63","content":"读完应能为一个任务说清输入、训练目标、输出和适合的检验；不要求把所有分支顺序运行。本册的矩阵与规则代码是小算例，真实CLIP模型证据在LAB04。最后用[条件多解](/course/blocks/generation-one-condition-many-results.html)连接第四讲；用[研究划分小例](/course/blocks/research-question-split-evidence.html)检验自己的评价是否对应未来场景。","sha256":"7cab542474232d191a291fd42ab397e8a90cb7de1f204d1cbdcbb02807a5457f","chapter":{"id":"III","title":"视觉与语言"},"unit":{"id":"language-task-interfaces","title":"语言加入后，任务究竟改变了什么？"},"page":{"id":"reading-opening","title":"CLS 03 · 视觉与语言：任务、训练与接口","number":1},"sectionTitle":"CLS 03 · 视觉与语言：任务、训练与接口","currentQuestion":"CLS 03 · 视觉与语言：任务、训练与接口","sourceSlides":[],"knowledgeBlock":null,"formulas":[],"previousBlock":"b-2b4d2cd788634ac0cd473150","nextBlock":null,"prerequisites":[{"id":"b-6293e12c6ccb0216241fec48","url":"#b-6293e12c6ccb0216241fec48","role":"section-title"},{"id":"b-12384c711c1eb652e7880c16","url":"#b-12384c711c1eb652e7880c16","role":"problem-context"}],"relatedBlocks":[]},{"id":"b-960a2ee063bdce14080d62c9","type":"h3","scope":"block-c13dcb1596e44be4b9e7a5f06c6f04ef","url":"https://codingai-lec03.pages.dev/course/notebooks/680da245145447dd88983aabd136fd24.html#b-960a2ee063bdce14080d62c9","content":"### 1. 语言可以在同一系统里承担三种作用","sha256":"d7be4c6e6a52627a6e950b2ea2d07b7e4b6a9b011316f48d54d6427622484c10","chapter":{"id":"III","title":"视觉与语言"},"unit":{"id":"language-task-interfaces","title":"语言加入后，任务究竟改变了什么？"},"page":{"id":"reading-block-c13dcb1596e44be4b9e7a5f06c6f04ef","title":"1. 语言可以在同一系统里承担三种作用","number":2},"sectionTitle":"1. 语言可以在同一系统里承担三种作用","currentQuestion":"1. 语言可以在同一系统里承担三种作用","sourceSlides":[],"knowledgeBlock":null,"formulas":[],"previousBlock":null,"nextBlock":"b-098f2cab24ceaabe889ab2ac","prerequisites":[{"id":"b-098f2cab24ceaabe889ab2ac","url":"#b-098f2cab24ceaabe889ab2ac","role":"problem-context"}],"relatedBlocks":[]},{"id":"b-098f2cab24ceaabe889ab2ac","type":"p","scope":"block-7ae8158cd82e44c29bd3cc05ccee7103","url":"https://codingai-lec03.pages.dev/course/notebooks/680da245145447dd88983aabd136fd24.html#b-098f2cab24ceaabe889ab2ac","content":"前一部分用框和点指定对象。现在把任务说出来：“描述这张桌面图”“找到红杯”“谁拿着球”。这些句子对系统提出的输出要求不同。","sha256":"6ad34e4ada835ae6143061c572cc8edb19103f364741d4cf627501c9ba2aa759","chapter":{"id":"III","title":"视觉与语言"},"unit":{"id":"language-task-interfaces","title":"语言加入后，任务究竟改变了什么？"},"page":{"id":"reading-block-c13dcb1596e44be4b9e7a5f06c6f04ef","title":"1. 语言可以在同一系统里承担三种作用","number":2},"sectionTitle":"1. 语言可以在同一系统里承担三种作用","currentQuestion":"1. 语言可以在同一系统里承担三种作用","sourceSlides":[],"knowledgeBlock":null,"formulas":[],"previousBlock":"b-960a2ee063bdce14080d62c9","nextBlock":"b-5db0332dece9ff2983c72c42","prerequisites":[{"id":"b-960a2ee063bdce14080d62c9","url":"#b-960a2ee063bdce14080d62c9","role":"section-title"}],"relatedBlocks":[]},{"id":"b-5db0332dece9ff2983c72c42","type":"table","scope":"block-7ae8158cd82e44c29bd3cc05ccee7103","url":"https://codingai-lec03.pages.dev/course/notebooks/680da245145447dd88983aabd136fd24.html#b-5db0332dece9ff2983c72c42","content":"| 语言的作用 | 本部分追问 | 需要建立的接口 |\n| --- | --- | --- |\n| 作为输出 | 如何利用图像和已生成词，描述所见？ | 视觉表示连接词序列预测 |\n| 作为学习信号 | 图文配对怎样教会匹配与检索？ | 图像与文本进入可比较空间 |\n| 作为任务条件 | 这句话指哪个区域，或要求回答什么？ | 区域—词语对应，或视觉条件下的指令作答 |","sha256":"7568784e0cb35e602743541c7257dcc26131f360b079886e0148b7b750e1d9b8","chapter":{"id":"III","title":"视觉与语言"},"unit":{"id":"language-task-interfaces","title":"语言加入后，任务究竟改变了什么？"},"page":{"id":"reading-block-c13dcb1596e44be4b9e7a5f06c6f04ef","title":"1. 语言可以在同一系统里承担三种作用","number":2},"sectionTitle":"1. 语言可以在同一系统里承担三种作用","currentQuestion":"1. 语言可以在同一系统里承担三种作用","sourceSlides":[],"knowledgeBlock":null,"formulas":[],"table":{"headers":["语言的作用","本部分追问","需要建立的接口"],"rows":[["语言的作用","本部分追问","需要建立的接口"],["作为输出","如何利用图像和已生成词，描述所见？","视觉表示连接词序列预测"],["作为学习信号","图文配对怎样教会匹配与检索？","图像与文本进入可比较空间"],["作为任务条件","这句话指哪个区域，或要求回答什么？","区域—词语对应，或视觉条件下的指令作答"]]},"previousBlock":"b-098f2cab24ceaabe889ab2ac","nextBlock":"b-6c398d1e870bbc7b47418b99","prerequisites":[{"id":"b-960a2ee063bdce14080d62c9","url":"#b-960a2ee063bdce14080d62c9","role":"section-title"},{"id":"b-098f2cab24ceaabe889ab2ac","url":"#b-098f2cab24ceaabe889ab2ac","role":"problem-context"}],"relatedBlocks":[]},{"id":"b-6c398d1e870bbc7b47418b99","type":"p","scope":"block-7ae8158cd82e44c29bd3cc05ccee7103","url":"https://codingai-lec03.pages.dev/course/notebooks/680da245145447dd88983aabd136fd24.html#b-6c398d1e870bbc7b47418b99","content":"这不是互斥的三类系统，也不是后一阶段淘汰前一阶段。一个视觉助手可以使用图文配对学习，用问题指定任务，再生成文字回答。先明确语言此刻的作用，再讨论需要的训练与接口。","sha256":"c5a151ba290050d898b8b7b1ee06d5e932083a9a348688238f6e032b81d679f2","chapter":{"id":"III","title":"视觉与语言"},"unit":{"id":"language-task-interfaces","title":"语言加入后，任务究竟改变了什么？"},"page":{"id":"reading-block-c13dcb1596e44be4b9e7a5f06c6f04ef","title":"1. 语言可以在同一系统里承担三种作用","number":2},"sectionTitle":"1. 语言可以在同一系统里承担三种作用","currentQuestion":"1. 语言可以在同一系统里承担三种作用","sourceSlides":[],"knowledgeBlock":null,"formulas":[],"previousBlock":"b-5db0332dece9ff2983c72c42","nextBlock":null,"prerequisites":[{"id":"b-960a2ee063bdce14080d62c9","url":"#b-960a2ee063bdce14080d62c9","role":"section-title"},{"id":"b-098f2cab24ceaabe889ab2ac","url":"#b-098f2cab24ceaabe889ab2ac","role":"problem-context"}],"relatedBlocks":[]},{"id":"b-310c58b9918a06c94af4ada3","type":"h3","scope":"block-8011bff99a6d4beb88ae230911fbb097","url":"https://codingai-lec03.pages.dev/course/notebooks/680da245145447dd88983aabd136fd24.html#b-310c58b9918a06c94af4ada3","content":"### 2. 语言作为输出：看图说话怎样接上已有能力？","sha256":"f18263031c97893ae92a034e60fc60f4b4242cecc141cb54848ca0940cd975ab","chapter":{"id":"III","title":"视觉与语言"},"unit":{"id":"language-task-interfaces","title":"语言加入后，任务究竟改变了什么？"},"page":{"id":"reading-block-8011bff99a6d4beb88ae230911fbb097","title":"2. 语言作为输出：看图说话怎样接上已有能力？","number":3},"sectionTitle":"2. 语言作为输出：看图说话怎样接上已有能力？","currentQuestion":"2. 语言作为输出：看图说话怎样接上已有能力？","sourceSlides":[],"knowledgeBlock":null,"formulas":[],"previousBlock":null,"nextBlock":"b-4c5eddec8cfb45bd16c551a2","prerequisites":[{"id":"b-4c5eddec8cfb45bd16c551a2","url":"#b-4c5eddec8cfb45bd16c551a2","role":"problem-context"}],"relatedBlocks":[]},{"id":"b-4c5eddec8cfb45bd16c551a2","type":"p","scope":"block-9af985696da54136a73aa78d650b93c5","url":"https://codingai-lec03.pages.dev/course/notebooks/680da245145447dd88983aabd136fd24.html#b-4c5eddec8cfb45bd16c551a2","content":"图像描述学习 $p(y_t\\mid I,y_{<t})$：视觉特征与已有文字一起决定下一词。训练时配对描述给出目标；推理时从开始符号出发，只能接续自己的输出，直到结束符号。今天先把这条接口看清，循环网络内部留第五讲。","sha256":"7aca821f1c7bffbb560cbea620602884dbd6c22947e99b30387a9ae006a78714","chapter":{"id":"III","title":"视觉与语言"},"unit":{"id":"language-task-interfaces","title":"语言加入后，任务究竟改变了什么？"},"page":{"id":"reading-block-8011bff99a6d4beb88ae230911fbb097","title":"2. 语言作为输出：看图说话怎样接上已有能力？","number":3},"sectionTitle":"2. 语言作为输出：看图说话怎样接上已有能力？","currentQuestion":"2. 语言作为输出：看图说话怎样接上已有能力？","sourceSlides":[],"knowledgeBlock":null,"formulas":[{"latex":"p(y_t\\mid I,y_{<t})","definitionContext":"2. 语言作为输出：看图说话怎样接上已有能力？"}],"previousBlock":"b-310c58b9918a06c94af4ada3","nextBlock":"b-d09c6ce890a33e9b21f28a76","prerequisites":[{"id":"b-310c58b9918a06c94af4ada3","url":"#b-310c58b9918a06c94af4ada3","role":"section-title"}],"relatedBlocks":[]},{"id":"b-d09c6ce890a33e9b21f28a76","type":"p","scope":"block-9af985696da54136a73aa78d650b93c5","url":"https://codingai-lec03.pages.dev/course/notebooks/680da245145447dd88983aabd136fd24.html#b-d09c6ce890a33e9b21f28a76","content":"[返回图像条件的课堂图](/course/pages/l3-r2-p51.html)。完整的 shifted target、EOS/PAD 和保留集生成对照归并到 [CLS 09 · 图像条件输出：描述与问答](https://deepnote.com/workspace/ise3309jingao-5ba66b0a-4283-4f5a-ae06-3f68d3201e99/project/38755e4e-23f6-4f5f-8c68-8a2e4114b1c1/notebook/c9f328a00ef44ecc90804e47276a7811?utm_source=openai&utm_medium=mcp&utm_campaign=openaimcp&utm_content=c9f328a00ef44ecc90804e47276a7811&utm_term=get_notebook) 与 [LAB 13 · 看图生成一句话：训练、解码与消融](https://deepnote.com/workspace/ise3309jingao-5ba66b0a-4283-4f5a-ae06-3f68d3201e99/project/38755e4e-23f6-4f5f-8c68-8a2e4114b1c1/notebook/3da47f3ee3554ee0a36e0bb6a2fdc61f?utm_source=openai&utm_medium=mcp&utm_campaign=openaimcp&utm_content=3da47f3ee3554ee0a36e0bb6a2fdc61f&utm_term=get_notebook)；本册不复制两份训练说明。","sha256":"2fe5de42360d0416004495225148d4789a58190d6d5d6f8ccf8d6f676cc7db8f","chapter":{"id":"III","title":"视觉与语言"},"unit":{"id":"language-task-interfaces","title":"语言加入后，任务究竟改变了什么？"},"page":{"id":"reading-block-8011bff99a6d4beb88ae230911fbb097","title":"2. 语言作为输出：看图说话怎样接上已有能力？","number":3},"sectionTitle":"2. 语言作为输出：看图说话怎样接上已有能力？","currentQuestion":"2. 语言作为输出：看图说话怎样接上已有能力？","sourceSlides":[],"knowledgeBlock":null,"formulas":[],"previousBlock":"b-4c5eddec8cfb45bd16c551a2","nextBlock":"b-8101017d0d34dc8c1b8fbb21","prerequisites":[{"id":"b-310c58b9918a06c94af4ada3","url":"#b-310c58b9918a06c94af4ada3","role":"section-title"},{"id":"b-4c5eddec8cfb45bd16c551a2","url":"#b-4c5eddec8cfb45bd16c551a2","role":"problem-context"}],"relatedBlocks":[]},{"id":"b-8101017d0d34dc8c1b8fbb21","type":"p","scope":"block-9af985696da54136a73aa78d650b93c5","url":"https://codingai-lec03.pages.dev/course/notebooks/680da245145447dd88983aabd136fd24.html#b-8101017d0d34dc8c1b8fbb21","content":"一张图可有多种真实描述。“桌上有杯子”与“左侧红杯靠近书”聚焦信息不同。先说明任务要求概括还是详细描述，再判断遗漏是否构成错误。[图像条件怎样进入一个可变长度答案](/course/blocks/caption-conditioned-token.html) · [已保存的条件生成实验：视觉输入确实改变了句子](/course/blocks/caption-visual-controls.html)。","sha256":"a4199dc2105b7fcf2d31b7486c23469b3c2adfd5e951d87c8810ebe4fe3e0734","chapter":{"id":"III","title":"视觉与语言"},"unit":{"id":"language-task-interfaces","title":"语言加入后，任务究竟改变了什么？"},"page":{"id":"reading-block-8011bff99a6d4beb88ae230911fbb097","title":"2. 语言作为输出：看图说话怎样接上已有能力？","number":3},"sectionTitle":"2. 语言作为输出：看图说话怎样接上已有能力？","currentQuestion":"2. 语言作为输出：看图说话怎样接上已有能力？","sourceSlides":[],"knowledgeBlock":null,"formulas":[],"previousBlock":"b-d09c6ce890a33e9b21f28a76","nextBlock":null,"prerequisites":[{"id":"b-310c58b9918a06c94af4ada3","url":"#b-310c58b9918a06c94af4ada3","role":"section-title"},{"id":"b-4c5eddec8cfb45bd16c551a2","url":"#b-4c5eddec8cfb45bd16c551a2","role":"problem-context"}],"relatedBlocks":[]},{"id":"b-2337659b8416b8f4d0e3a562","type":"h3","scope":"block-7895864a9980401b8e3526beca11f36f","url":"https://codingai-lec03.pages.dev/course/notebooks/680da245145447dd88983aabd136fd24.html#b-2337659b8416b8f4d0e3a562","content":"### 研究背景：组件到位后，选择哪一个新问题？","sha256":"ef54cf9e1e190890a585eee086cb53436d99085fc293b4e6e3c919ca09d1a0cb","chapter":{"id":"III","title":"视觉与语言"},"unit":{"id":"language-task-interfaces","title":"语言加入后，任务究竟改变了什么？"},"page":{"id":"reading-block-7895864a9980401b8e3526beca11f36f","title":"研究背景：组件到位后，选择哪一个新问题？","number":4},"sectionTitle":"研究背景：组件到位后，选择哪一个新问题？","currentQuestion":"研究背景：组件到位后，选择哪一个新问题？","sourceSlides":[],"knowledgeBlock":null,"formulas":[],"previousBlock":null,"nextBlock":"b-e192e3caa9a23e9b1be3ff45","prerequisites":[{"id":"b-e192e3caa9a23e9b1be3ff45","url":"#b-e192e3caa9a23e9b1be3ff45","role":"problem-context"}],"relatedBlocks":[]},{"id":"b-e192e3caa9a23e9b1be3ff45","type":"p","scope":"block-7895864a9980401b8e3526beca11f36f","url":"https://codingai-lec03.pages.dev/course/notebooks/680da245145447dd88983aabd136fd24.html#b-e192e3caa9a23e9b1be3ff45","content":"2014–2016 年，视觉预训练、文字预测与图文数据汇合，出现描述、区域对齐和视觉问答等不同研究入口。Trevor Darrell 是 LRCN 的共同作者之一；这里使用公开研究背景，不推断个人动机或讲者私下经历。","sha256":"6540e5779e1c360eb7aa418f46d443a164608b1194c149fd60832c8c4e1d37da","chapter":{"id":"III","title":"视觉与语言"},"unit":{"id":"language-task-interfaces","title":"语言加入后，任务究竟改变了什么？"},"page":{"id":"reading-block-7895864a9980401b8e3526beca11f36f","title":"研究背景：组件到位后，选择哪一个新问题？","number":4},"sectionTitle":"研究背景：组件到位后，选择哪一个新问题？","currentQuestion":"研究背景：组件到位后，选择哪一个新问题？","sourceSlides":[],"knowledgeBlock":null,"formulas":[],"previousBlock":"b-2337659b8416b8f4d0e3a562","nextBlock":"b-d7cec921fcafff81c72399da","prerequisites":[{"id":"b-2337659b8416b8f4d0e3a562","url":"#b-2337659b8416b8f4d0e3a562","role":"section-title"}],"relatedBlocks":[]},{"id":"b-d7cec921fcafff81c72399da","type":"p","scope":"block-7895864a9980401b8e3526beca11f36f","url":"https://codingai-lec03.pages.dev/course/notebooks/680da245145447dd88983aabd136fd24.html#b-d7cec921fcafff81c72399da","content":"这段历史的重点是正面进展：已有表示确实开始支持可训练、可比较的新任务。再问组合缺口和局部关系，才知道后续工作为何需要新机制。[课堂历史图](/course/pages/l3-r2-p50.html) · [历史事实、评价结果与来源](/course/blocks/vl-history-convergence.html) · [DCC 的配对缺口](/course/blocks/caption-compositional-gap.html)。","sha256":"26ec077cbd6252e4bc71322380612569328787416226eee320a977c24a89589a","chapter":{"id":"III","title":"视觉与语言"},"unit":{"id":"language-task-interfaces","title":"语言加入后，任务究竟改变了什么？"},"page":{"id":"reading-block-7895864a9980401b8e3526beca11f36f","title":"研究背景：组件到位后，选择哪一个新问题？","number":4},"sectionTitle":"研究背景：组件到位后，选择哪一个新问题？","currentQuestion":"研究背景：组件到位后，选择哪一个新问题？","sourceSlides":[],"knowledgeBlock":null,"formulas":[],"previousBlock":"b-e192e3caa9a23e9b1be3ff45","nextBlock":null,"prerequisites":[{"id":"b-2337659b8416b8f4d0e3a562","url":"#b-2337659b8416b8f4d0e3a562","role":"section-title"},{"id":"b-e192e3caa9a23e9b1be3ff45","url":"#b-e192e3caa9a23e9b1be3ff45","role":"problem-context"}],"relatedBlocks":[]},{"id":"b-e4f2abddd4d33f411da8807d","type":"h3","scope":"block-6a1571aafa7e44d8b3a0654c78166412","url":"https://codingai-lec03.pages.dev/course/notebooks/680da245145447dd88983aabd136fd24.html#b-e4f2abddd4d33f411da8807d","content":"### 3. 语言作为学习信号：把配对变成可比较关系","sha256":"75581af4311579d0f0aa8b3e31fa3041835f11a6eff2ca81d661bda081bd4195","chapter":{"id":"III","title":"视觉与语言"},"unit":{"id":"language-task-interfaces","title":"语言加入后，任务究竟改变了什么？"},"page":{"id":"reading-block-6a1571aafa7e44d8b3a0654c78166412","title":"3. 语言作为学习信号：把配对变成可比较关系","number":5},"sectionTitle":"3. 语言作为学习信号：把配对变成可比较关系","currentQuestion":"3. 语言作为学习信号：把配对变成可比较关系","sourceSlides":[],"knowledgeBlock":null,"formulas":[],"previousBlock":null,"nextBlock":"b-766056ae03a6fd785b9d2567","prerequisites":[{"id":"b-766056ae03a6fd785b9d2567","url":"#b-766056ae03a6fd785b9d2567","role":"problem-context"}],"relatedBlocks":[]},{"id":"b-766056ae03a6fd785b9d2567","type":"p","scope":"block-f0aeadb1c331456f96ceb967cfb16a4c","url":"https://codingai-lec03.pages.dev/course/notebooks/680da245145447dd88983aabd136fd24.html#b-766056ae03a6fd785b9d2567","content":"CLIP 使用已配对的图像与文字，同时训练两种编码器。训练后，可以把“a photo of a cup”等候选描述编码成文字向量，与图像向量比较，做分类或在已有集合中检索。[CLIP](https://proceedings.mlr.press/v139/radford21a.html)","sha256":"7ca98a60191efe95460cc789edd63b4dcd46b8e818d377021613b48bd73a2582","chapter":{"id":"III","title":"视觉与语言"},"unit":{"id":"language-task-interfaces","title":"语言加入后，任务究竟改变了什么？"},"page":{"id":"reading-block-6a1571aafa7e44d8b3a0654c78166412","title":"3. 语言作为学习信号：把配对变成可比较关系","number":5},"sectionTitle":"3. 语言作为学习信号：把配对变成可比较关系","currentQuestion":"3. 语言作为学习信号：把配对变成可比较关系","sourceSlides":[],"knowledgeBlock":null,"formulas":[],"previousBlock":"b-e4f2abddd4d33f411da8807d","nextBlock":"b-09c13cfbafc9a73ffbc9f4f5","prerequisites":[{"id":"b-e4f2abddd4d33f411da8807d","url":"#b-e4f2abddd4d33f411da8807d","role":"section-title"}],"relatedBlocks":[]},{"id":"b-09c13cfbafc9a73ffbc9f4f5","type":"p","scope":"block-f0aeadb1c331456f96ceb967cfb16a4c","url":"https://codingai-lec03.pages.dev/course/notebooks/680da245145447dd88983aabd136fd24.html#b-09c13cfbafc9a73ffbc9f4f5","content":"这项能力来自配对学习：图像向量与文字向量本来并不天然处在可比较的坐标系。图文配对包含人的文字和数据选择，是外部学习信号；不使用固定类别标签不等于完全没有监督。","sha256":"8cbcdacec033c71a8883d97e2d9160a22887dde95646104c6a75b045185b1614","chapter":{"id":"III","title":"视觉与语言"},"unit":{"id":"language-task-interfaces","title":"语言加入后，任务究竟改变了什么？"},"page":{"id":"reading-block-6a1571aafa7e44d8b3a0654c78166412","title":"3. 语言作为学习信号：把配对变成可比较关系","number":5},"sectionTitle":"3. 语言作为学习信号：把配对变成可比较关系","currentQuestion":"3. 语言作为学习信号：把配对变成可比较关系","sourceSlides":[],"knowledgeBlock":null,"formulas":[],"previousBlock":"b-766056ae03a6fd785b9d2567","nextBlock":"b-8a71f757c4142586a9bb9afc","prerequisites":[{"id":"b-e4f2abddd4d33f411da8807d","url":"#b-e4f2abddd4d33f411da8807d","role":"section-title"},{"id":"b-766056ae03a6fd785b9d2567","url":"#b-766056ae03a6fd785b9d2567","role":"problem-context"}],"relatedBlocks":[]},{"id":"b-8a71f757c4142586a9bb9afc","type":"p","scope":"block-f0aeadb1c331456f96ceb967cfb16a4c","url":"https://codingai-lec03.pages.dev/course/notebooks/680da245145447dd88983aabd136fd24.html#b-8a71f757c4142586a9bb9afc","content":"设红杯、蓝杯、书三张图分别与三段描述配对。把归一化表示记为 uᵢ 和 vⱼ，组成 `Sᵢⱼ=uᵢᵀvⱼ`。每一行回答“这张图配哪段文字”；每一列回答“这段文字配哪张图”。正确配对位于对角线，两种方向的分类损失一起参与训练。","sha256":"a22143a5d7eb7b02fb2f6b604dc5b90425bbfb2492a3e768276483cb768bb024","chapter":{"id":"III","title":"视觉与语言"},"unit":{"id":"language-task-interfaces","title":"语言加入后，任务究竟改变了什么？"},"page":{"id":"reading-block-6a1571aafa7e44d8b3a0654c78166412","title":"3. 语言作为学习信号：把配对变成可比较关系","number":5},"sectionTitle":"3. 语言作为学习信号：把配对变成可比较关系","currentQuestion":"3. 语言作为学习信号：把配对变成可比较关系","sourceSlides":[],"knowledgeBlock":null,"formulas":[],"previousBlock":"b-09c13cfbafc9a73ffbc9f4f5","nextBlock":null,"prerequisites":[{"id":"b-e4f2abddd4d33f411da8807d","url":"#b-e4f2abddd4d33f411da8807d","role":"section-title"},{"id":"b-766056ae03a6fd785b9d2567","url":"#b-766056ae03a6fd785b9d2567","role":"problem-context"}],"relatedBlocks":[]},{"id":"b-1368f444fc995b73e0b330f1","type":"h3","scope":"block-66b6304ea0cf47dd9c5bb009263057ab","url":"https://codingai-lec03.pages.dev/course/notebooks/680da245145447dd88983aabd136fd24.html#b-1368f444fc995b73e0b330f1","content":"### 活动 A：一张小矩阵，两种查找方向","sha256":"0d2f43a64410dd0053d3e816f0394d6078bcdb5d28cd78e55c835ebf46152d25","chapter":{"id":"III","title":"视觉与语言"},"unit":{"id":"language-task-interfaces","title":"语言加入后，任务究竟改变了什么？"},"page":{"id":"reading-block-66b6304ea0cf47dd9c5bb009263057ab","title":"活动 A：一张小矩阵，两种查找方向","number":6},"sectionTitle":"活动 A：一张小矩阵，两种查找方向","currentQuestion":"活动 A：一张小矩阵，两种查找方向","sourceSlides":[],"knowledgeBlock":null,"formulas":[],"previousBlock":null,"nextBlock":"b-ae7b61d81f4e61c789fdf5be","prerequisites":[{"id":"b-ae7b61d81f4e61c789fdf5be","url":"#b-ae7b61d81f4e61c789fdf5be","role":"problem-context"}],"relatedBlocks":[]},{"id":"b-ae7b61d81f4e61c789fdf5be","type":"p","scope":"block-66b6304ea0cf47dd9c5bb009263057ab","url":"https://codingai-lec03.pages.dev/course/notebooks/680da245145447dd88983aabd136fd24.html#b-ae7b61d81f4e61c789fdf5be","content":"行与列共同使用红杯、蓝杯、书的固定顺序。构造三维单位图像向量为三个坐标轴；对应文字向量在自身轴上取 4、另外两轴上取 1，再除以 √18 归一化。因此下表的每一项都是真正的余弦相似度：对角为 4/√18≈0.9428，非对角为 1/√18≈0.2357。这些向量是教学构造，不是 CLIP 推理输出。","sha256":"a8611b72f50695d3fd07e450025d70d459db5245859e2727f7acd33767f3d609","chapter":{"id":"III","title":"视觉与语言"},"unit":{"id":"language-task-interfaces","title":"语言加入后，任务究竟改变了什么？"},"page":{"id":"reading-block-66b6304ea0cf47dd9c5bb009263057ab","title":"活动 A：一张小矩阵，两种查找方向","number":6},"sectionTitle":"活动 A：一张小矩阵，两种查找方向","currentQuestion":"活动 A：一张小矩阵，两种查找方向","sourceSlides":[],"knowledgeBlock":null,"formulas":[],"previousBlock":"b-1368f444fc995b73e0b330f1","nextBlock":"b-2cf5e20dadd0f2ba891521c1","prerequisites":[{"id":"b-1368f444fc995b73e0b330f1","url":"#b-1368f444fc995b73e0b330f1","role":"section-title"}],"relatedBlocks":[]},{"id":"b-2cf5e20dadd0f2ba891521c1","type":"table","scope":"block-66b6304ea0cf47dd9c5bb009263057ab","url":"https://codingai-lec03.pages.dev/course/notebooks/680da245145447dd88983aabd136fd24.html#b-2cf5e20dadd0f2ba891521c1","content":"|  | 红杯描述 | 蓝杯描述 | 书描述 |\n| --- | --- | --- | --- |\n| 红杯图 | 4/√18 | 1/√18 | 1/√18 |\n| 蓝杯图 | 1/√18 | 4/√18 | 1/√18 |\n| 书图 | 1/√18 | 1/√18 | 4/√18 |","sha256":"aead4f2d734b471023884420cc7eb3495c15da992dc2d3ac4788c141910c2a9a","chapter":{"id":"III","title":"视觉与语言"},"unit":{"id":"language-task-interfaces","title":"语言加入后，任务究竟改变了什么？"},"page":{"id":"reading-block-66b6304ea0cf47dd9c5bb009263057ab","title":"活动 A：一张小矩阵，两种查找方向","number":6},"sectionTitle":"活动 A：一张小矩阵，两种查找方向","currentQuestion":"活动 A：一张小矩阵，两种查找方向","sourceSlides":[],"knowledgeBlock":null,"formulas":[],"table":{"headers":["","红杯描述","蓝杯描述","书描述"],"rows":[["","红杯描述","蓝杯描述","书描述"],["红杯图","4/√18","1/√18","1/√18"],["蓝杯图","1/√18","4/√18","1/√18"],["书图","1/√18","1/√18","4/√18"]]},"previousBlock":"b-ae7b61d81f4e61c789fdf5be","nextBlock":"b-f7e360bb5beef266e9b63f2f","prerequisites":[{"id":"b-1368f444fc995b73e0b330f1","url":"#b-1368f444fc995b73e0b330f1","role":"section-title"},{"id":"b-ae7b61d81f4e61c789fdf5be","url":"#b-ae7b61d81f4e61c789fdf5be","role":"problem-context"}],"relatedBlocks":[]},{"id":"b-f7e360bb5beef266e9b63f2f","type":"p","scope":"block-66b6304ea0cf47dd9c5bb009263057ab","url":"https://codingai-lec03.pages.dev/course/notebooks/680da245145447dd88983aabd136fd24.html#b-f7e360bb5beef266e9b63f2f","content":"先将温度设为 τ=1，令 logits=S/τ。**先预测：** 把蓝杯文字向量对红杯轴的权重从 1 改大并重新归一化，哪张图与哪段文字的正确配对可能变难？运行后分别看行与列的正确配对概率，而不是只看一个总分。","sha256":"15d0d789cdb37ba00e55be5d12ef2aef91fc80dc4a5938f9d2c13a45065d3445","chapter":{"id":"III","title":"视觉与语言"},"unit":{"id":"language-task-interfaces","title":"语言加入后，任务究竟改变了什么？"},"page":{"id":"reading-block-66b6304ea0cf47dd9c5bb009263057ab","title":"活动 A：一张小矩阵，两种查找方向","number":6},"sectionTitle":"活动 A：一张小矩阵，两种查找方向","currentQuestion":"活动 A：一张小矩阵，两种查找方向","sourceSlides":[],"knowledgeBlock":null,"formulas":[],"previousBlock":"b-2cf5e20dadd0f2ba891521c1","nextBlock":"b-e4660cc3e2b46562906ca426","prerequisites":[{"id":"b-1368f444fc995b73e0b330f1","url":"#b-1368f444fc995b73e0b330f1","role":"section-title"},{"id":"b-ae7b61d81f4e61c789fdf5be","url":"#b-ae7b61d81f4e61c789fdf5be","role":"problem-context"}],"relatedBlocks":[]},{"id":"b-e4660cc3e2b46562906ca426","type":"p","scope":"block-66b6304ea0cf47dd9c5bb009263057ab","url":"https://codingai-lec03.pages.dev/course/notebooks/680da245145447dd88983aabd136fd24.html#b-e4660cc3e2b46562906ca426","content":"批内未配对不保证语义完全无关，近重复和描述质量都会影响目标。这里先固定对角配对关系，隔离双向损失的计算。","sha256":"827be3cc0a439402b9a8d4facde53fe7a3e84bb93a2fe7dd31de94dd637ab16d","chapter":{"id":"III","title":"视觉与语言"},"unit":{"id":"language-task-interfaces","title":"语言加入后，任务究竟改变了什么？"},"page":{"id":"reading-block-66b6304ea0cf47dd9c5bb009263057ab","title":"活动 A：一张小矩阵，两种查找方向","number":6},"sectionTitle":"活动 A：一张小矩阵，两种查找方向","currentQuestion":"活动 A：一张小矩阵，两种查找方向","sourceSlides":[],"knowledgeBlock":null,"formulas":[],"previousBlock":"b-f7e360bb5beef266e9b63f2f","nextBlock":"b-85588e4c11506b828c390f3c","prerequisites":[{"id":"b-1368f444fc995b73e0b330f1","url":"#b-1368f444fc995b73e0b330f1","role":"section-title"},{"id":"b-ae7b61d81f4e61c789fdf5be","url":"#b-ae7b61d81f4e61c789fdf5be","role":"problem-context"}],"relatedBlocks":[]},{"id":"b-85588e4c11506b828c390f3c","type":"p","scope":"block-66b6304ea0cf47dd9c5bb009263057ab","url":"https://codingai-lec03.pages.dev/course/notebooks/680da245145447dd88983aabd136fd24.html#b-85588e4c11506b828c390f3c","content":"按默认构造计算，行、列方向的正确配对概率均约为 `[0.5035, 0.5035, 0.5035]`，双向平均损失约 `0.686192`。这是本页教学向量的确定性计算结果，可先阅读再改条件。","sha256":"7db21819736de71c652ced00174f154356926b74ee2a19cf7e3d2774b53e877d","chapter":{"id":"III","title":"视觉与语言"},"unit":{"id":"language-task-interfaces","title":"语言加入后，任务究竟改变了什么？"},"page":{"id":"reading-block-66b6304ea0cf47dd9c5bb009263057ab","title":"活动 A：一张小矩阵，两种查找方向","number":6},"sectionTitle":"活动 A：一张小矩阵，两种查找方向","currentQuestion":"活动 A：一张小矩阵，两种查找方向","sourceSlides":[],"knowledgeBlock":null,"formulas":[],"previousBlock":"b-e4660cc3e2b46562906ca426","nextBlock":"b-39df99ccc85503528ff6bd2d","prerequisites":[{"id":"b-1368f444fc995b73e0b330f1","url":"#b-1368f444fc995b73e0b330f1","role":"section-title"},{"id":"b-ae7b61d81f4e61c789fdf5be","url":"#b-ae7b61d81f4e61c789fdf5be","role":"problem-context"}],"relatedBlocks":[]},{"id":"b-39df99ccc85503528ff6bd2d","type":"pre","scope":"block-fdd18e776fb949909b1d5e2233b7d639","url":"https://codingai-lec03.pages.dev/course/notebooks/680da245145447dd88983aabd136fd24.html#b-39df99ccc85503528ff6bd2d","content":"```\n# 独立 CPU 的双向配对目标；余弦来自归一化教学向量。\nimport math\nobjects = ['redcup', 'bluecup', 'book']\nimage_vectors = [[1.0,0.0,0.0],[0.0,1.0,0.0],[0.0,0.0,1.0]]\ntext_weights = [[4.0,1.0,1.0],[1.0,4.0,1.0],[1.0,1.0,4.0]]\ndef normalize(vector):\n    norm=math.sqrt(sum(x*x for x in vector))\n    return [x/norm for x in vector]\ntext_vectors=[normalize(vector) for vector in text_weights]\nS=[[sum(a*b for a,b in zip(u,v)) for v in text_vectors] for u in image_vectors]\ntemperature=1.0\nlogits=[[s/temperature for s in row] for row in S]\ndef softmax(row):\n    exps=[math.exp(x-max(row)) for x in row]\n    return [x/sum(exps) for x in exps]\nrow_prob=[softmax(row) for row in logits]\ncol_prob=[softmax(list(col)) for col in zip(*logits)]\nrow_loss=-sum(math.log(row_prob[i][i]) for i in range(3))/3\ncol_loss=-sum(math.log(col_prob[i][i]) for i in range(3))/3\nprint('对象顺序:',objects,'温度:',temperature)\nprint('余弦矩阵:',[[round(s,6) for s in row] for row in S])\nprint('每张图找正确文字:',[round(row_prob[i][i],4) for i in range(3)])\nprint('每段文字找正确图:',[round(col_prob[i][i],4) for i in range(3)])\nprint('双向平均损失:',round((row_loss+col_loss)/2,6))\nassert all(abs(sum(p)-1)<1e-12 for p in row_prob+col_prob)\nassert all(abs(sum(x*x for x in vector)-1)<1e-12 for vector in image_vectors+text_vectors)\nif text_weights==[[4.0,1.0,1.0],[1.0,4.0,1.0],[1.0,1.0,4.0]] and temperature==1.0:\n    assert all(math.isclose(S[i][j],(4 if i==j else 1)/math.sqrt(18)) for i in range(3) for j in range(3))\n    assert math.isclose((row_loss+col_loss)/2,0.6861917388550698)\n\n```","sha256":"7462623f6862fb9ca9e60dff3dddc5d87cc3d61b00f48431e6c4da48f60fc1b1","chapter":{"id":"III","title":"视觉与语言"},"unit":{"id":"language-task-interfaces","title":"语言加入后，任务究竟改变了什么？"},"page":{"id":"reading-block-66b6304ea0cf47dd9c5bb009263057ab","title":"活动 A：一张小矩阵，两种查找方向","number":6},"sectionTitle":"活动 A：一张小矩阵，两种查找方向","currentQuestion":"活动 A：一张小矩阵，两种查找方向","sourceSlides":[],"knowledgeBlock":null,"formulas":[],"previousBlock":"b-85588e4c11506b828c390f3c","nextBlock":null,"prerequisites":[{"id":"b-1368f444fc995b73e0b330f1","url":"#b-1368f444fc995b73e0b330f1","role":"section-title"},{"id":"b-ae7b61d81f4e61c789fdf5be","url":"#b-ae7b61d81f4e61c789fdf5be","role":"problem-context"}],"relatedBlocks":[]},{"id":"b-1b6f65ac397a7a706f2c33e7","type":"h3","scope":"block-6190cca74684424598eec8bcc3f7b586","url":"https://codingai-lec03.pages.dev/course/notebooks/680da245145447dd88983aabd136fd24.html#b-1b6f65ac397a7a706f2c33e7","content":"### 从这张教学矩阵，走到真实模型","sha256":"0b107bdae592f78e39efffc6bd9c577608dc6857569f7394cbbe587754ee0fbe","chapter":{"id":"III","title":"视觉与语言"},"unit":{"id":"language-task-interfaces","title":"语言加入后，任务究竟改变了什么？"},"page":{"id":"reading-block-6190cca74684424598eec8bcc3f7b586","title":"从这张教学矩阵，走到真实模型","number":7},"sectionTitle":"从这张教学矩阵，走到真实模型","currentQuestion":"从这张教学矩阵，走到真实模型","sourceSlides":[],"knowledgeBlock":null,"formulas":[],"previousBlock":null,"nextBlock":"b-e57c9b39e3449e4e11ca8062","prerequisites":[{"id":"b-e57c9b39e3449e4e11ca8062","url":"#b-e57c9b39e3449e4e11ca8062","role":"problem-context"}],"relatedBlocks":[]},{"id":"b-e57c9b39e3449e4e11ca8062","type":"p","scope":"block-6190cca74684424598eec8bcc3f7b586","url":"https://codingai-lec03.pages.dev/course/notebooks/680da245145447dd88983aabd136fd24.html#b-e57c9b39e3449e4e11ca8062","content":"上面代码使用三维单位向量和 τ=1，正确概率约 0.5035、平均损失约 0.686192。课堂 [P57](/course/pages/l3-r2-p57.html) 使用另一组四维单位向量和 τ=.2，正确概率约 0.90876、损失约 0.09567。两套都是自洽的教学构造；不要把一套的温度、矩阵和另一套的结果拼在一起。","sha256":"f16725c3f4b99db85728a8c0ad5468e176f12e070a8e0ef4c396639ead55b32f","chapter":{"id":"III","title":"视觉与语言"},"unit":{"id":"language-task-interfaces","title":"语言加入后，任务究竟改变了什么？"},"page":{"id":"reading-block-6190cca74684424598eec8bcc3f7b586","title":"从这张教学矩阵，走到真实模型","number":7},"sectionTitle":"从这张教学矩阵，走到真实模型","currentQuestion":"从这张教学矩阵，走到真实模型","sourceSlides":[],"knowledgeBlock":null,"formulas":[],"previousBlock":"b-1b6f65ac397a7a706f2c33e7","nextBlock":"b-4fb35df1268e1477ff0ba860","prerequisites":[{"id":"b-1b6f65ac397a7a706f2c33e7","url":"#b-1b6f65ac397a7a706f2c33e7","role":"section-title"}],"relatedBlocks":[]},{"id":"b-4fb35df1268e1477ff0ba860","type":"p","scope":"block-6190cca74684424598eec8bcc3f7b586","url":"https://codingai-lec03.pages.dev/course/notebooks/680da245145447dd88983aabd136fd24.html#b-4fb35df1268e1477ff0ba860","content":"[LAB 04 · CLIP：候选、提示与关系检验](https://deepnote.com/workspace/ise3309jingao-5ba66b0a-4283-4f5a-ae06-3f68d3201e99/project/38755e4e-23f6-4f5f-8c68-8a2e4114b1c1/notebook/0ba963931ddf4866b507b210d93a43bf?utm_source=openai&utm_medium=mcp&utm_campaign=openaimcp&utm_content=0ba963931ddf4866b507b210d93a43bf&utm_term=get_notebook) 固定真实猫图与 CLIP checkpoint，分别扩大候选、改模板和删除正确类别；这是模型证据。[LAB 12 · CLIP延伸：缓存与检索（近似索引选读）](https://deepnote.com/workspace/ise3309jingao-5ba66b0a-4283-4f5a-ae06-3f68d3201e99/project/38755e4e-23f6-4f5f-8c68-8a2e4114b1c1/notebook/921eeaf784284ce19568c6ca7619b55a?utm_source=openai&utm_medium=mcp&utm_campaign=openaimcp&utm_content=921eeaf784284ce19568c6ca7619b55a&utm_term=get_notebook) 使用同一编码器得到的完整向量，继续看缓存与检索。先完成前者再选后者，避免重复做两份“图文匹配”。[为什么候选 softmax 会变](/course/blocks/clip-candidate-probability.html)。","sha256":"ad34b5f0089cfb6cb77961b0aa49093d4e43fbc5d8788f09d588270e1c227693","chapter":{"id":"III","title":"视觉与语言"},"unit":{"id":"language-task-interfaces","title":"语言加入后，任务究竟改变了什么？"},"page":{"id":"reading-block-6190cca74684424598eec8bcc3f7b586","title":"从这张教学矩阵，走到真实模型","number":7},"sectionTitle":"从这张教学矩阵，走到真实模型","currentQuestion":"从这张教学矩阵，走到真实模型","sourceSlides":[],"knowledgeBlock":null,"formulas":[],"previousBlock":"b-e57c9b39e3449e4e11ca8062","nextBlock":null,"prerequisites":[{"id":"b-1b6f65ac397a7a706f2c33e7","url":"#b-1b6f65ac397a7a706f2c33e7","role":"section-title"},{"id":"b-e57c9b39e3449e4e11ca8062","url":"#b-e57c9b39e3449e4e11ca8062","role":"problem-context"}],"relatedBlocks":[]},{"id":"b-e809b56e7ad21137669bf4e5","type":"h3","scope":"block-65ae675e81234522a19a201af1e42f87","url":"https://codingai-lec03.pages.dev/course/notebooks/680da245145447dd88983aabd136fd24.html#b-e809b56e7ad21137669bf4e5","content":"### 4. 看衣色，还是看关系？让两种规则作出不同预测","sha256":"d6d7f687bcedba0dcfe9455635b91fa547436d30cdd7198d319d848e7f7bdac9","chapter":{"id":"III","title":"视觉与语言"},"unit":{"id":"language-task-interfaces","title":"语言加入后，任务究竟改变了什么？"},"page":{"id":"reading-block-65ae675e81234522a19a201af1e42f87","title":"4. 看衣色，还是看关系？让两种规则作出不同预测","number":8},"sectionTitle":"4. 看衣色，还是看关系？让两种规则作出不同预测","currentQuestion":"4. 看衣色，还是看关系？让两种规则作出不同预测","sourceSlides":[],"knowledgeBlock":null,"formulas":[],"previousBlock":null,"nextBlock":"b-1a860aa60e11f9894233ab42","prerequisites":[{"id":"b-1a860aa60e11f9894233ab42","url":"#b-1a860aa60e11f9894233ab42","role":"problem-context"}],"relatedBlocks":[]},{"id":"b-1a860aa60e11f9894233ab42","type":"p","scope":"block-1a0beae32caa4112a3e73f1a4249a6a9","url":"https://codingai-lec03.pages.dev/course/notebooks/680da245145447dd88983aabd136fd24.html#b-1a860aa60e11f9894233ab42","content":"正式问题保留两句候选：","sha256":"1e7c02057395dde2ac8ca8b8cdfdf6e4e8cce3442906d0ec870a82c93536b0da","chapter":{"id":"III","title":"视觉与语言"},"unit":{"id":"language-task-interfaces","title":"语言加入后，任务究竟改变了什么？"},"page":{"id":"reading-block-65ae675e81234522a19a201af1e42f87","title":"4. 看衣色，还是看关系？让两种规则作出不同预测","number":8},"sectionTitle":"4. 看衣色，还是看关系？让两种规则作出不同预测","currentQuestion":"4. 看衣色，还是看关系？让两种规则作出不同预测","sourceSlides":[],"knowledgeBlock":null,"formulas":[],"previousBlock":"b-e809b56e7ad21137669bf4e5","nextBlock":"b-58f7c561d2061a5adb4db73f","prerequisites":[{"id":"b-e809b56e7ad21137669bf4e5","url":"#b-e809b56e7ad21137669bf4e5","role":"section-title"}],"relatedBlocks":[]},{"id":"b-58f7c561d2061a5adb4db73f","type":"ul","scope":"block-1a0beae32caa4112a3e73f1a4249a6a9","url":"https://codingai-lec03.pages.dev/course/notebooks/680da245145447dd88983aabd136fd24.html#b-58f7c561d2061a5adb4db73f","content":"- A. `A person in red holds a ball beside a person in blue.`\n\n- B. `A person in blue holds a ball beside a person in red.`","sha256":"029f2ef9a409227d34191533326a7c683f8de701b3bd7cb9250da730a734db5a","chapter":{"id":"III","title":"视觉与语言"},"unit":{"id":"language-task-interfaces","title":"语言加入后，任务究竟改变了什么？"},"page":{"id":"reading-block-65ae675e81234522a19a201af1e42f87","title":"4. 看衣色，还是看关系？让两种规则作出不同预测","number":8},"sectionTitle":"4. 看衣色，还是看关系？让两种规则作出不同预测","currentQuestion":"4. 看衣色，还是看关系？让两种规则作出不同预测","sourceSlides":[],"knowledgeBlock":null,"formulas":[],"previousBlock":"b-1a860aa60e11f9894233ab42","nextBlock":"b-31395ae667223cfe68eedcf6","prerequisites":[{"id":"b-e809b56e7ad21137669bf4e5","url":"#b-e809b56e7ad21137669bf4e5","role":"section-title"},{"id":"b-1a860aa60e11f9894233ab42","url":"#b-1a860aa60e11f9894233ab42","role":"problem-context"}],"relatedBlocks":[]},{"id":"b-31395ae667223cfe68eedcf6","type":"li","scope":"block-1a0beae32caa4112a3e73f1a4249a6a9","url":"https://codingai-lec03.pages.dev/course/notebooks/680da245145447dd88983aabd136fd24.html#b-31395ae667223cfe68eedcf6","content":"- A. `A person in red holds a ball beside a person in blue.`","sha256":"f87e8116e3b3421c94ff6df6c88c80edbb76ab16ad88ecef445a1094faa116e7","chapter":{"id":"III","title":"视觉与语言"},"unit":{"id":"language-task-interfaces","title":"语言加入后，任务究竟改变了什么？"},"page":{"id":"reading-block-65ae675e81234522a19a201af1e42f87","title":"4. 看衣色，还是看关系？让两种规则作出不同预测","number":8},"sectionTitle":"4. 看衣色，还是看关系？让两种规则作出不同预测","currentQuestion":"4. 看衣色，还是看关系？让两种规则作出不同预测","sourceSlides":[],"knowledgeBlock":null,"formulas":[],"previousBlock":"b-58f7c561d2061a5adb4db73f","nextBlock":"b-d59eadfd2994ff39c052aab9","prerequisites":[{"id":"b-e809b56e7ad21137669bf4e5","url":"#b-e809b56e7ad21137669bf4e5","role":"section-title"},{"id":"b-1a860aa60e11f9894233ab42","url":"#b-1a860aa60e11f9894233ab42","role":"problem-context"}],"relatedBlocks":[]},{"id":"b-d59eadfd2994ff39c052aab9","type":"li","scope":"block-1a0beae32caa4112a3e73f1a4249a6a9","url":"https://codingai-lec03.pages.dev/course/notebooks/680da245145447dd88983aabd136fd24.html#b-d59eadfd2994ff39c052aab9","content":"- B. `A person in blue holds a ball beside a person in red.`","sha256":"61f2eac3fa189777b58f278954c103ea5a0d4a0ea7c11ddc56d5f88df56a5a95","chapter":{"id":"III","title":"视觉与语言"},"unit":{"id":"language-task-interfaces","title":"语言加入后，任务究竟改变了什么？"},"page":{"id":"reading-block-65ae675e81234522a19a201af1e42f87","title":"4. 看衣色，还是看关系？让两种规则作出不同预测","number":8},"sectionTitle":"4. 看衣色，还是看关系？让两种规则作出不同预测","currentQuestion":"4. 看衣色，还是看关系？让两种规则作出不同预测","sourceSlides":[],"knowledgeBlock":null,"formulas":[],"previousBlock":"b-31395ae667223cfe68eedcf6","nextBlock":"b-5345b2caf55fa30c23e0c472","prerequisites":[{"id":"b-e809b56e7ad21137669bf4e5","url":"#b-e809b56e7ad21137669bf4e5","role":"section-title"},{"id":"b-1a860aa60e11f9894233ab42","url":"#b-1a860aa60e11f9894233ab42","role":"problem-context"}],"relatedBlocks":[]},{"id":"b-5345b2caf55fa30c23e0c472","type":"p","scope":"block-1a0beae32caa4112a3e73f1a4249a6a9","url":"https://codingai-lec03.pages.dev/course/notebooks/680da245145447dd88983aabd136fd24.html#b-5345b2caf55fa30c23e0c472","content":"**条件1：左红持球**","sha256":"cd95176ac6950004a2ac89b291a5c2456210da6829ac70a68abe8d14c2595de7","chapter":{"id":"III","title":"视觉与语言"},"unit":{"id":"language-task-interfaces","title":"语言加入后，任务究竟改变了什么？"},"page":{"id":"reading-block-65ae675e81234522a19a201af1e42f87","title":"4. 看衣色，还是看关系？让两种规则作出不同预测","number":8},"sectionTitle":"4. 看衣色，还是看关系？让两种规则作出不同预测","currentQuestion":"4. 看衣色，还是看关系？让两种规则作出不同预测","sourceSlides":[],"knowledgeBlock":null,"formulas":[],"previousBlock":"b-d59eadfd2994ff39c052aab9","nextBlock":"b-af0c588b4cd885d2359fe446","prerequisites":[{"id":"b-e809b56e7ad21137669bf4e5","url":"#b-e809b56e7ad21137669bf4e5","role":"section-title"},{"id":"b-1a860aa60e11f9894233ab42","url":"#b-1a860aa60e11f9894233ab42","role":"problem-context"}],"relatedBlocks":[]},{"id":"b-af0c588b4cd885d2359fe446","type":"p","scope":"block-1a0beae32caa4112a3e73f1a4249a6a9","url":"https://codingai-lec03.pages.dev/course/notebooks/680da245145447dd88983aabd136fd24.html#b-af0c588b4cd885d2359fe446","content":"![条件1：左红持球](/course/knowledge-assets/b44ae6205135966005a376cd.jpg)","sha256":"c49232d6357522fd9a2ce0c7f9605542ba840d616e261e709a3b167378ab8391","chapter":{"id":"III","title":"视觉与语言"},"unit":{"id":"language-task-interfaces","title":"语言加入后，任务究竟改变了什么？"},"page":{"id":"reading-block-65ae675e81234522a19a201af1e42f87","title":"4. 看衣色，还是看关系？让两种规则作出不同预测","number":8},"sectionTitle":"4. 看衣色，还是看关系？让两种规则作出不同预测","currentQuestion":"4. 看衣色，还是看关系？让两种规则作出不同预测","sourceSlides":[],"knowledgeBlock":null,"formulas":[],"previousBlock":"b-5345b2caf55fa30c23e0c472","nextBlock":"b-d3e569e523f6fe21e4c42bca","prerequisites":[{"id":"b-e809b56e7ad21137669bf4e5","url":"#b-e809b56e7ad21137669bf4e5","role":"section-title"},{"id":"b-1a860aa60e11f9894233ab42","url":"#b-1a860aa60e11f9894233ab42","role":"problem-context"}],"relatedBlocks":[]},{"id":"b-d3e569e523f6fe21e4c42bca","type":"p","scope":"block-1a0beae32caa4112a3e73f1a4249a6a9","url":"https://codingai-lec03.pages.dev/course/notebooks/680da245145447dd88983aabd136fd24.html#b-d3e569e523f6fe21e4c42bca","content":"**条件2：左蓝持球**","sha256":"378a6ccfb10340771d62b5fef8fbfe2539f83070b2d2989f2c35ed91cc438be8","chapter":{"id":"III","title":"视觉与语言"},"unit":{"id":"language-task-interfaces","title":"语言加入后，任务究竟改变了什么？"},"page":{"id":"reading-block-65ae675e81234522a19a201af1e42f87","title":"4. 看衣色，还是看关系？让两种规则作出不同预测","number":8},"sectionTitle":"4. 看衣色，还是看关系？让两种规则作出不同预测","currentQuestion":"4. 看衣色，还是看关系？让两种规则作出不同预测","sourceSlides":[],"knowledgeBlock":null,"formulas":[],"previousBlock":"b-af0c588b4cd885d2359fe446","nextBlock":"b-42ac8fac11da15dd5cf45190","prerequisites":[{"id":"b-e809b56e7ad21137669bf4e5","url":"#b-e809b56e7ad21137669bf4e5","role":"section-title"},{"id":"b-1a860aa60e11f9894233ab42","url":"#b-1a860aa60e11f9894233ab42","role":"problem-context"}],"relatedBlocks":[]},{"id":"b-42ac8fac11da15dd5cf45190","type":"p","scope":"block-1a0beae32caa4112a3e73f1a4249a6a9","url":"https://codingai-lec03.pages.dev/course/notebooks/680da245145447dd88983aabd136fd24.html#b-42ac8fac11da15dd5cf45190","content":"![条件2：左蓝持球](/course/knowledge-assets/a2fad6392231baa79e7361b8.jpg)","sha256":"f0f0573c44743250e28b31cf5696ecbfdd69eeeffd89c838fd710d5e52e7ae96","chapter":{"id":"III","title":"视觉与语言"},"unit":{"id":"language-task-interfaces","title":"语言加入后，任务究竟改变了什么？"},"page":{"id":"reading-block-65ae675e81234522a19a201af1e42f87","title":"4. 看衣色，还是看关系？让两种规则作出不同预测","number":8},"sectionTitle":"4. 看衣色，还是看关系？让两种规则作出不同预测","currentQuestion":"4. 看衣色，还是看关系？让两种规则作出不同预测","sourceSlides":[],"knowledgeBlock":null,"formulas":[],"previousBlock":"b-d3e569e523f6fe21e4c42bca","nextBlock":"b-8740dbd5b30d137bd548b4d6","prerequisites":[{"id":"b-e809b56e7ad21137669bf4e5","url":"#b-e809b56e7ad21137669bf4e5","role":"section-title"},{"id":"b-1a860aa60e11f9894233ab42","url":"#b-1a860aa60e11f9894233ab42","role":"problem-context"}],"relatedBlocks":[]},{"id":"b-8740dbd5b30d137bd548b4d6","type":"p","scope":"block-1a0beae32caa4112a3e73f1a4249a6a9","url":"https://codingai-lec03.pages.dev/course/notebooks/680da245145447dd88983aabd136fd24.html#b-8740dbd5b30d137bd548b4d6","content":"**条件3：右蓝持球**","sha256":"b769c9351f34ebc68ed7c27472d6037a868463332f4cd2baaf7d642d10f8f860","chapter":{"id":"III","title":"视觉与语言"},"unit":{"id":"language-task-interfaces","title":"语言加入后，任务究竟改变了什么？"},"page":{"id":"reading-block-65ae675e81234522a19a201af1e42f87","title":"4. 看衣色，还是看关系？让两种规则作出不同预测","number":8},"sectionTitle":"4. 看衣色，还是看关系？让两种规则作出不同预测","currentQuestion":"4. 看衣色，还是看关系？让两种规则作出不同预测","sourceSlides":[],"knowledgeBlock":null,"formulas":[],"previousBlock":"b-42ac8fac11da15dd5cf45190","nextBlock":"b-b1a858697a28bbea9135e9fe","prerequisites":[{"id":"b-e809b56e7ad21137669bf4e5","url":"#b-e809b56e7ad21137669bf4e5","role":"section-title"},{"id":"b-1a860aa60e11f9894233ab42","url":"#b-1a860aa60e11f9894233ab42","role":"problem-context"}],"relatedBlocks":[]},{"id":"b-b1a858697a28bbea9135e9fe","type":"p","scope":"block-1a0beae32caa4112a3e73f1a4249a6a9","url":"https://codingai-lec03.pages.dev/course/notebooks/680da245145447dd88983aabd136fd24.html#b-b1a858697a28bbea9135e9fe","content":"![条件3：右蓝持球](/course/knowledge-assets/429e669b3080a200d8e3b65c.jpg)","sha256":"9620dc81c8a3d7c3440efbdddc20207cb5571f9100e8f7b9b9f9f6ded164bdab","chapter":{"id":"III","title":"视觉与语言"},"unit":{"id":"language-task-interfaces","title":"语言加入后，任务究竟改变了什么？"},"page":{"id":"reading-block-65ae675e81234522a19a201af1e42f87","title":"4. 看衣色，还是看关系？让两种规则作出不同预测","number":8},"sectionTitle":"4. 看衣色，还是看关系？让两种规则作出不同预测","currentQuestion":"4. 看衣色，还是看关系？让两种规则作出不同预测","sourceSlides":[],"knowledgeBlock":null,"formulas":[],"previousBlock":"b-8740dbd5b30d137bd548b4d6","nextBlock":"b-ac74a24d1ae064245623f389","prerequisites":[{"id":"b-e809b56e7ad21137669bf4e5","url":"#b-e809b56e7ad21137669bf4e5","role":"section-title"},{"id":"b-1a860aa60e11f9894233ab42","url":"#b-1a860aa60e11f9894233ab42","role":"problem-context"}],"relatedBlocks":[]},{"id":"b-ac74a24d1ae064245623f389","type":"p","scope":"block-1a0beae32caa4112a3e73f1a4249a6a9","url":"https://codingai-lec03.pages.dev/course/notebooks/680da245145447dd88983aabd136fd24.html#b-ac74a24d1ae064245623f389","content":"**条件4：右红持球**","sha256":"737afe1e44c836f3341701c4103d3dffc6e5200fc78e2829b40ba2ca7a72c64f","chapter":{"id":"III","title":"视觉与语言"},"unit":{"id":"language-task-interfaces","title":"语言加入后，任务究竟改变了什么？"},"page":{"id":"reading-block-65ae675e81234522a19a201af1e42f87","title":"4. 看衣色，还是看关系？让两种规则作出不同预测","number":8},"sectionTitle":"4. 看衣色，还是看关系？让两种规则作出不同预测","currentQuestion":"4. 看衣色，还是看关系？让两种规则作出不同预测","sourceSlides":[],"knowledgeBlock":null,"formulas":[],"previousBlock":"b-b1a858697a28bbea9135e9fe","nextBlock":"b-bfd45867284c70a73d0f0513","prerequisites":[{"id":"b-e809b56e7ad21137669bf4e5","url":"#b-e809b56e7ad21137669bf4e5","role":"section-title"},{"id":"b-1a860aa60e11f9894233ab42","url":"#b-1a860aa60e11f9894233ab42","role":"problem-context"}],"relatedBlocks":[]},{"id":"b-bfd45867284c70a73d0f0513","type":"p","scope":"block-1a0beae32caa4112a3e73f1a4249a6a9","url":"https://codingai-lec03.pages.dev/course/notebooks/680da245145447dd88983aabd136fd24.html#b-bfd45867284c70a73d0f0513","content":"![条件4：右红持球](/course/knowledge-assets/62eb7ad7573b1dc20562ec8a.jpg)","sha256":"188973b8e72f76f1befd0676e79b5aefc45bf4b2416491ef83be18d6cb131014","chapter":{"id":"III","title":"视觉与语言"},"unit":{"id":"language-task-interfaces","title":"语言加入后，任务究竟改变了什么？"},"page":{"id":"reading-block-65ae675e81234522a19a201af1e42f87","title":"4. 看衣色，还是看关系？让两种规则作出不同预测","number":8},"sectionTitle":"4. 看衣色，还是看关系？让两种规则作出不同预测","currentQuestion":"4. 看衣色，还是看关系？让两种规则作出不同预测","sourceSlides":[],"knowledgeBlock":null,"formulas":[],"previousBlock":"b-ac74a24d1ae064245623f389","nextBlock":"b-a3a2e01c1047082e0782e519","prerequisites":[{"id":"b-e809b56e7ad21137669bf4e5","url":"#b-e809b56e7ad21137669bf4e5","role":"section-title"},{"id":"b-1a860aa60e11f9894233ab42","url":"#b-1a860aa60e11f9894233ab42","role":"problem-context"}],"relatedBlocks":[]},{"id":"b-a3a2e01c1047082e0782e519","type":"p","scope":"block-1a0beae32caa4112a3e73f1a4249a6a9","url":"https://codingai-lec03.pages.dev/course/notebooks/680da245145447dd88983aabd136fd24.html#b-a3a2e01c1047082e0782e519","content":"两个人、一个球；左右均按观看者位置。每个条件的持球人及另一人是否接触球应从图中确认。","sha256":"0d010adebcae62e3cb7b10a98c86ba63d0b61cdec8735a3397880d3ae2f50db1","chapter":{"id":"III","title":"视觉与语言"},"unit":{"id":"language-task-interfaces","title":"语言加入后，任务究竟改变了什么？"},"page":{"id":"reading-block-65ae675e81234522a19a201af1e42f87","title":"4. 看衣色，还是看关系？让两种规则作出不同预测","number":8},"sectionTitle":"4. 看衣色，还是看关系？让两种规则作出不同预测","currentQuestion":"4. 看衣色，还是看关系？让两种规则作出不同预测","sourceSlides":[],"knowledgeBlock":null,"formulas":[],"previousBlock":"b-bfd45867284c70a73d0f0513","nextBlock":"b-2b83cd04ebdfa269ac03a978","prerequisites":[{"id":"b-e809b56e7ad21137669bf4e5","url":"#b-e809b56e7ad21137669bf4e5","role":"section-title"},{"id":"b-1a860aa60e11f9894233ab42","url":"#b-1a860aa60e11f9894233ab42","role":"problem-context"}],"relatedBlocks":[]},{"id":"b-2b83cd04ebdfa269ac03a978","type":"p","scope":"block-1a0beae32caa4112a3e73f1a4249a6a9","url":"https://codingai-lec03.pages.dev/course/notebooks/680da245145447dd88983aabd136fd24.html#b-2b83cd04ebdfa269ac03a978","content":"原来两幅图的持球人都站在左侧：左红持球时 A 合适，左蓝持球时 B 合适。两个观察同时符合两条规则：**读取持球者衣色**，或者仅仅**读取左侧人物衣色**。因此原两图不足以区分两种解释。","sha256":"e092e4e96514f964fb2620a149576bb5565f3718a9638a34ea1f49e3a5c12847","chapter":{"id":"III","title":"视觉与语言"},"unit":{"id":"language-task-interfaces","title":"语言加入后，任务究竟改变了什么？"},"page":{"id":"reading-block-65ae675e81234522a19a201af1e42f87","title":"4. 看衣色，还是看关系？让两种规则作出不同预测","number":8},"sectionTitle":"4. 看衣色，还是看关系？让两种规则作出不同预测","currentQuestion":"4. 看衣色，还是看关系？让两种规则作出不同预测","sourceSlides":[],"knowledgeBlock":null,"formulas":[],"previousBlock":"b-a3a2e01c1047082e0782e519","nextBlock":"b-b8948d817728bcba7d039188","prerequisites":[{"id":"b-e809b56e7ad21137669bf4e5","url":"#b-e809b56e7ad21137669bf4e5","role":"section-title"},{"id":"b-1a860aa60e11f9894233ab42","url":"#b-1a860aa60e11f9894233ab42","role":"problem-context"}],"relatedBlocks":[]},{"id":"b-b8948d817728bcba7d039188","type":"p","scope":"block-1a0beae32caa4112a3e73f1a4249a6a9","url":"https://codingai-lec03.pages.dev/course/notebooks/680da245145447dd88983aabd136fd24.html#b-b8948d817728bcba7d039188","content":"新增右侧人物持球的两种条件，保持 A/B 候选不变。现在两条规则会给出不同预测，实验才有机会区分它们。图中独立生成的姿态、背景、光照也可能变化，所以它是针对竞争解释的条件设计，不声称所有图像只变了一个像素因素。","sha256":"02bd2d981f917d5ad9574401f79a2c0465c3377e12c6c03c474cf4452e1f7193","chapter":{"id":"III","title":"视觉与语言"},"unit":{"id":"language-task-interfaces","title":"语言加入后，任务究竟改变了什么？"},"page":{"id":"reading-block-65ae675e81234522a19a201af1e42f87","title":"4. 看衣色，还是看关系？让两种规则作出不同预测","number":8},"sectionTitle":"4. 看衣色，还是看关系？让两种规则作出不同预测","currentQuestion":"4. 看衣色，还是看关系？让两种规则作出不同预测","sourceSlides":[],"knowledgeBlock":null,"formulas":[],"previousBlock":"b-2b83cd04ebdfa269ac03a978","nextBlock":null,"prerequisites":[{"id":"b-e809b56e7ad21137669bf4e5","url":"#b-e809b56e7ad21137669bf4e5","role":"section-title"},{"id":"b-1a860aa60e11f9894233ab42","url":"#b-1a860aa60e11f9894233ab42","role":"problem-context"}],"relatedBlocks":[]},{"id":"b-6eee098c82786402cf13ff32","type":"h3","scope":"block-c64974ec883f4a6a9488baa50fe6db3c","url":"https://codingai-lec03.pages.dev/course/notebooks/680da245145447dd88983aabd136fd24.html#b-6eee098c82786402cf13ff32","content":"### 四条件的规则预期","sha256":"c836ecfcd84baf84a70fee3b5093340e6e5b4fc2ea2a38da878f82a41045e1f0","chapter":{"id":"III","title":"视觉与语言"},"unit":{"id":"language-task-interfaces","title":"语言加入后，任务究竟改变了什么？"},"page":{"id":"reading-block-c64974ec883f4a6a9488baa50fe6db3c","title":"四条件的规则预期","number":9},"sectionTitle":"四条件的规则预期","currentQuestion":"四条件的规则预期","sourceSlides":[],"knowledgeBlock":null,"formulas":[],"previousBlock":null,"nextBlock":"b-dcab827d9763a960d18e20c8","prerequisites":[{"id":"b-6ce2d79787560bd4f40745f2","url":"#b-6ce2d79787560bd4f40745f2","role":"problem-context"}],"relatedBlocks":[]},{"id":"b-dcab827d9763a960d18e20c8","type":"table","scope":"block-c64974ec883f4a6a9488baa50fe6db3c","url":"https://codingai-lec03.pages.dev/course/notebooks/680da245145447dd88983aabd136fd24.html#b-dcab827d9763a960d18e20c8","content":"| 条件 | 左侧 | 右侧 | 持球位置 | 持球者衣色规则 | 左侧衣色规则 |\n| --- | --- | --- | --- | --- | --- |\n| 1 | 红 | 蓝 | 左 | A | A |\n| 2 | 蓝 | 红 | 左 | B | B |\n| 3 | 红 | 蓝 | 右 | B | A |\n| 4 | 蓝 | 红 | 右 | A | B |","sha256":"51e5cb3b305ffb050b59d2fb17530f18f29faee14aa25b863449ecfb1169d60a","chapter":{"id":"III","title":"视觉与语言"},"unit":{"id":"language-task-interfaces","title":"语言加入后，任务究竟改变了什么？"},"page":{"id":"reading-block-c64974ec883f4a6a9488baa50fe6db3c","title":"四条件的规则预期","number":9},"sectionTitle":"四条件的规则预期","currentQuestion":"四条件的规则预期","sourceSlides":[],"knowledgeBlock":null,"formulas":[],"table":{"headers":["条件","左侧","右侧","持球位置","持球者衣色规则","左侧衣色规则"],"rows":[["条件","左侧","右侧","持球位置","持球者衣色规则","左侧衣色规则"],["1","红","蓝","左","A","A"],["2","蓝","红","左","B","B"],["3","红","蓝","右","B","A"],["4","蓝","红","右","A","B"]]},"previousBlock":"b-6eee098c82786402cf13ff32","nextBlock":"b-6ce2d79787560bd4f40745f2","prerequisites":[{"id":"b-6eee098c82786402cf13ff32","url":"#b-6eee098c82786402cf13ff32","role":"section-title"},{"id":"b-6ce2d79787560bd4f40745f2","url":"#b-6ce2d79787560bd4f40745f2","role":"problem-context"}],"relatedBlocks":[]},{"id":"b-6ce2d79787560bd4f40745f2","type":"p","scope":"block-c64974ec883f4a6a9488baa50fe6db3c","url":"https://codingai-lec03.pages.dev/course/notebooks/680da245145447dd88983aabd136fd24.html#b-6ce2d79787560bd4f40745f2","content":"前两行两规则相同，后两行不同。**先预测：** 假如模型在第 3、4 行也跟随持球者，能否据此证明它理解所有关系？这会支持当前检验中的关系解释，但更广结论还需不同人物、位置、动作和候选表达。","sha256":"0ebe5564b653d73e64093c3de11d71962ff8d88d08cbb28f7def0426ffae10de","chapter":{"id":"III","title":"视觉与语言"},"unit":{"id":"language-task-interfaces","title":"语言加入后，任务究竟改变了什么？"},"page":{"id":"reading-block-c64974ec883f4a6a9488baa50fe6db3c","title":"四条件的规则预期","number":9},"sectionTitle":"四条件的规则预期","currentQuestion":"四条件的规则预期","sourceSlides":[],"knowledgeBlock":null,"formulas":[],"previousBlock":"b-dcab827d9763a960d18e20c8","nextBlock":"b-786d78044821377d7e339e53","prerequisites":[{"id":"b-6eee098c82786402cf13ff32","url":"#b-6eee098c82786402cf13ff32","role":"section-title"}],"relatedBlocks":[]},{"id":"b-786d78044821377d7e339e53","type":"p","scope":"block-c64974ec883f4a6a9488baa50fe6db3c","url":"https://codingai-lec03.pages.dev/course/notebooks/680da245145447dd88983aabd136fd24.html#b-786d78044821377d7e339e53","content":"下格只计算这张规则预期表。真实 CLIP 分数需固定模型、预处理、四幅输入与候选后实际推理，再与表中规则比较。","sha256":"df529a3ca5d78966b839f5382d36379ea7fe532a3edb06f4508b1bd843e8bcd7","chapter":{"id":"III","title":"视觉与语言"},"unit":{"id":"language-task-interfaces","title":"语言加入后，任务究竟改变了什么？"},"page":{"id":"reading-block-c64974ec883f4a6a9488baa50fe6db3c","title":"四条件的规则预期","number":9},"sectionTitle":"四条件的规则预期","currentQuestion":"四条件的规则预期","sourceSlides":[],"knowledgeBlock":null,"formulas":[],"previousBlock":"b-6ce2d79787560bd4f40745f2","nextBlock":"b-8fc77dbf7f76f34a286bee45","prerequisites":[{"id":"b-6eee098c82786402cf13ff32","url":"#b-6eee098c82786402cf13ff32","role":"section-title"},{"id":"b-6ce2d79787560bd4f40745f2","url":"#b-6ce2d79787560bd4f40745f2","role":"problem-context"}],"relatedBlocks":[]},{"id":"b-8fc77dbf7f76f34a286bee45","type":"pre","scope":"block-88deeaae5acf42cc94771c90b0e19b8a","url":"https://codingai-lec03.pages.dev/course/notebooks/680da245145447dd88983aabd136fd24.html#b-8fc77dbf7f76f34a286bee45","content":"```\n# 独立 CPU 规则对照；输出 A/B 来自明确规则，不是 CLIP。\nconditions=[('1','red','blue','left'),('2','blue','red','left'),\n            ('3','red','blue','right'),('4','blue','red','right')]\nanswer_of={'red':'A','blue':'B'}\nrows=[]\nfor cid,left,right,holder_side in conditions:\n    holder_color=left if holder_side=='left' else right\n    relation=answer_of[holder_color]\n    shortcut=answer_of[left]\n    rows.append((cid,relation,shortcut))\n    print('条件',cid,'持球者规则',relation,'左侧规则',shortcut,'一致?',relation==shortcut)\nassert rows==[('1','A','A'),('2','B','B'),('3','B','A'),('4','A','B')]\n```","sha256":"55e0f4486b82871bc213cb33f13c8240e5363b41f60c0673e24c6c61c5841c3a","chapter":{"id":"III","title":"视觉与语言"},"unit":{"id":"language-task-interfaces","title":"语言加入后，任务究竟改变了什么？"},"page":{"id":"reading-block-c64974ec883f4a6a9488baa50fe6db3c","title":"四条件的规则预期","number":9},"sectionTitle":"四条件的规则预期","currentQuestion":"四条件的规则预期","sourceSlides":[],"knowledgeBlock":null,"formulas":[],"previousBlock":"b-786d78044821377d7e339e53","nextBlock":null,"prerequisites":[{"id":"b-6eee098c82786402cf13ff32","url":"#b-6eee098c82786402cf13ff32","role":"section-title"},{"id":"b-6ce2d79787560bd4f40745f2","url":"#b-6ce2d79787560bd4f40745f2","role":"problem-context"}],"relatedBlocks":[]},{"id":"b-7e065df99d4fd0a5d5ffd945","type":"h3","scope":"block-0aabdf483a9d4b58a0bcff200b378bc9","url":"https://codingai-lec03.pages.dev/course/notebooks/680da245145447dd88983aabd136fd24.html#b-7e065df99d4fd0a5d5ffd945","content":"### 5. 语言指定任务之一：这句话指的是哪个区域？","sha256":"448987d94222e9dc12f2fdc642840249b41cfdb297f44ff9fa034faf912b2c1f","chapter":{"id":"III","title":"视觉与语言"},"unit":{"id":"language-task-interfaces","title":"语言加入后，任务究竟改变了什么？"},"page":{"id":"reading-block-0aabdf483a9d4b58a0bcff200b378bc9","title":"5. 语言指定任务之一：这句话指的是哪个区域？","number":10},"sectionTitle":"5. 语言指定任务之一：这句话指的是哪个区域？","currentQuestion":"5. 语言指定任务之一：这句话指的是哪个区域？","sourceSlides":[],"knowledgeBlock":null,"formulas":[],"previousBlock":null,"nextBlock":"b-2c3937d0ccb88027e9e3386c","prerequisites":[{"id":"b-2c3937d0ccb88027e9e3386c","url":"#b-2c3937d0ccb88027e9e3386c","role":"problem-context"}],"relatedBlocks":[]},{"id":"b-2c3937d0ccb88027e9e3386c","type":"p","scope":"block-443e8c7bfc094e03bed653667baf21a7","url":"https://codingai-lec03.pages.dev/course/notebooks/680da245145447dd88983aabd136fd24.html#b-2c3937d0ccb88027e9e3386c","content":"CLIP 整图相似度给配对程度；“蓝杯左边的杯子”还要求输出目标区域。这里需要分开目标、参照物与关系，不能看到 blue 就返回蓝杯。","sha256":"826c37982b1fccb48a900e7b147f828e26b6399914cb55a9725a7e159f48cebb","chapter":{"id":"III","title":"视觉与语言"},"unit":{"id":"language-task-interfaces","title":"语言加入后，任务究竟改变了什么？"},"page":{"id":"reading-block-0aabdf483a9d4b58a0bcff200b378bc9","title":"5. 语言指定任务之一：这句话指的是哪个区域？","number":10},"sectionTitle":"5. 语言指定任务之一：这句话指的是哪个区域？","currentQuestion":"5. 语言指定任务之一：这句话指的是哪个区域？","sourceSlides":[],"knowledgeBlock":null,"formulas":[],"previousBlock":"b-7e065df99d4fd0a5d5ffd945","nextBlock":"b-b3e4ce7107f0f045ff26ece2","prerequisites":[{"id":"b-7e065df99d4fd0a5d5ffd945","url":"#b-7e065df99d4fd0a5d5ffd945","role":"section-title"}],"relatedBlocks":[]},{"id":"b-b3e4ce7107f0f045ff26ece2","type":"p","scope":"block-443e8c7bfc094e03bed653667baf21a7","url":"https://codingai-lec03.pages.dev/course/notebooks/680da245145447dd88983aabd136fd24.html#b-b3e4ce7107f0f045ff26ece2","content":"[P63](/course/pages/l3-r2-p63.html) 的 GLIP 说明对象级语言定位的学习路线；[CLS 11 · 语言定位与视觉模型接口](https://deepnote.com/workspace/ise3309jingao-5ba66b0a-4283-4f5a-ae06-3f68d3201e99/project/38755e4e-23f6-4f5f-8c68-8a2e4114b1c1/notebook/95169c3e298c4c819373bb4534f3dff9?utm_source=openai&utm_medium=mcp&utm_campaign=openaimcp&utm_content=95169c3e298c4c819373bb4534f3dff9&utm_term=get_notebook) 展开监督、空间输出和模型接口；[LAB 15 · 语言指代小练习：目标、参照与关系](https://deepnote.com/workspace/ise3309jingao-5ba66b0a-4283-4f5a-ae06-3f68d3201e99/project/38755e4e-23f6-4f5f-8c68-8a2e4114b1c1/notebook/7dc83786d067465aa76264475db2c62d?utm_source=openai&utm_medium=mcp&utm_campaign=openaimcp&utm_content=7dc83786d067465aa76264475db2c62d&utm_term=get_notebook) 用像素提框与关系规则做完整对照。后者不是 GLIP 推理，但能准确解释为什么旧关键词规则选错。","sha256":"3d5c7bd3c37b0b27a8ff2291c779f7cb4f476415ede88c31e8859e72e9e04035","chapter":{"id":"III","title":"视觉与语言"},"unit":{"id":"language-task-interfaces","title":"语言加入后，任务究竟改变了什么？"},"page":{"id":"reading-block-0aabdf483a9d4b58a0bcff200b378bc9","title":"5. 语言指定任务之一：这句话指的是哪个区域？","number":10},"sectionTitle":"5. 语言指定任务之一：这句话指的是哪个区域？","currentQuestion":"5. 语言指定任务之一：这句话指的是哪个区域？","sourceSlides":[],"knowledgeBlock":null,"formulas":[],"previousBlock":"b-2c3937d0ccb88027e9e3386c","nextBlock":"b-dd0d2dbd8a00573b7d3c7065","prerequisites":[{"id":"b-7e065df99d4fd0a5d5ffd945","url":"#b-7e065df99d4fd0a5d5ffd945","role":"section-title"},{"id":"b-2c3937d0ccb88027e9e3386c","url":"#b-2c3937d0ccb88027e9e3386c","role":"problem-context"}],"relatedBlocks":[]},{"id":"b-dd0d2dbd8a00573b7d3c7065","type":"p","scope":"block-443e8c7bfc094e03bed653667baf21a7","url":"https://codingai-lec03.pages.dev/course/notebooks/680da245145447dd88983aabd136fd24.html#b-dd0d2dbd8a00573b7d3c7065","content":"[带坐标的完整算例](/course/blocks/grounding-target-reference-relation.html) · [GLIP 的方法和正面迁移证据](/course/blocks/glip-language-objective.html)。","sha256":"c08ee8b374daa51edb2a12d7498572a81bca062005f11e4fa535ab6c6cdec853","chapter":{"id":"III","title":"视觉与语言"},"unit":{"id":"language-task-interfaces","title":"语言加入后，任务究竟改变了什么？"},"page":{"id":"reading-block-0aabdf483a9d4b58a0bcff200b378bc9","title":"5. 语言指定任务之一：这句话指的是哪个区域？","number":10},"sectionTitle":"5. 语言指定任务之一：这句话指的是哪个区域？","currentQuestion":"5. 语言指定任务之一：这句话指的是哪个区域？","sourceSlides":[],"knowledgeBlock":null,"formulas":[],"previousBlock":"b-b3e4ce7107f0f045ff26ece2","nextBlock":null,"prerequisites":[{"id":"b-7e065df99d4fd0a5d5ffd945","url":"#b-7e065df99d4fd0a5d5ffd945","role":"section-title"},{"id":"b-2c3937d0ccb88027e9e3386c","url":"#b-2c3937d0ccb88027e9e3386c","role":"problem-context"}],"relatedBlocks":[]},{"id":"b-0e7921da9f49da534ad883f5","type":"h3","scope":"block-4f123fd559034e98ab80a149967f6452","url":"https://codingai-lec03.pages.dev/course/notebooks/680da245145447dd88983aabd136fd24.html#b-0e7921da9f49da534ad883f5","content":"### 6. 语言指定任务之二：根据画面回答这个问题","sha256":"4c12f8caf1008b197e82c6f59b2dfe2b20ec1686fb0d9d62fd0dd05ca25af4ca","chapter":{"id":"III","title":"视觉与语言"},"unit":{"id":"language-task-interfaces","title":"语言加入后，任务究竟改变了什么？"},"page":{"id":"reading-block-4f123fd559034e98ab80a149967f6452","title":"6. 语言指定任务之二：根据画面回答这个问题","number":11},"sectionTitle":"6. 语言指定任务之二：根据画面回答这个问题","currentQuestion":"6. 语言指定任务之二：根据画面回答这个问题","sourceSlides":[],"knowledgeBlock":null,"formulas":[],"previousBlock":null,"nextBlock":"b-dbbaab4836e2a23b9743ca9f","prerequisites":[{"id":"b-dbbaab4836e2a23b9743ca9f","url":"#b-dbbaab4836e2a23b9743ca9f","role":"problem-context"}],"relatedBlocks":[]},{"id":"b-dbbaab4836e2a23b9743ca9f","type":"p","scope":"block-ddbfd4bf2bf747b0ae9f1cba853e8b68","url":"https://codingai-lec03.pages.dev/course/notebooks/680da245145447dd88983aabd136fd24.html#b-dbbaab4836e2a23b9743ca9f","content":"原始 LLaVA 的接口是视觉编码器 → 线性投影 → 语言模型。送入的是视觉网格向量，不是一个类别标签。阶段一冻结视觉与语言模型，只训练投影；阶段二仍冻结视觉，更新投影与语言模型。","sha256":"617e419c317d8efed8d341ce4af6ad4d1caf49a51c7bae9d4d1605603b749536","chapter":{"id":"III","title":"视觉与语言"},"unit":{"id":"language-task-interfaces","title":"语言加入后，任务究竟改变了什么？"},"page":{"id":"reading-block-4f123fd559034e98ab80a149967f6452","title":"6. 语言指定任务之二：根据画面回答这个问题","number":11},"sectionTitle":"6. 语言指定任务之二：根据画面回答这个问题","currentQuestion":"6. 语言指定任务之二：根据画面回答这个问题","sourceSlides":[],"knowledgeBlock":null,"formulas":[],"previousBlock":"b-0e7921da9f49da534ad883f5","nextBlock":"b-681911ad48e0a1dedced0284","prerequisites":[{"id":"b-0e7921da9f49da534ad883f5","url":"#b-0e7921da9f49da534ad883f5","role":"section-title"}],"relatedBlocks":[]},{"id":"b-681911ad48e0a1dedced0284","type":"p","scope":"block-ddbfd4bf2bf747b0ae9f1cba853e8b68","url":"https://codingai-lec03.pages.dev/course/notebooks/680da245145447dd88983aabd136fd24.html#b-681911ad48e0a1dedced0284","content":"[P64](/course/pages/l3-r2-p64.html) 与 [P65](/course/pages/l3-r2-p65.html) 对照这两个阶段。完整解释集中于 [CLS 11 · 语言定位与视觉模型接口](https://deepnote.com/workspace/ise3309jingao-5ba66b0a-4283-4f5a-ae06-3f68d3201e99/project/38755e4e-23f6-4f5f-8c68-8a2e4114b1c1/notebook/95169c3e298c4c819373bb4534f3dff9?utm_source=openai&utm_medium=mcp&utm_campaign=openaimcp&utm_content=95169c3e298c4c819373bb4534f3dff9&utm_term=get_notebook)；注意后续版本的连接器不倒写为原始配置，RNN/attention 的内部结构留第五讲。","sha256":"05a43b7dca3fcbe6656e1d5fe6c72c489f7746be571acf25013a8234f62cc4ca","chapter":{"id":"III","title":"视觉与语言"},"unit":{"id":"language-task-interfaces","title":"语言加入后，任务究竟改变了什么？"},"page":{"id":"reading-block-4f123fd559034e98ab80a149967f6452","title":"6. 语言指定任务之二：根据画面回答这个问题","number":11},"sectionTitle":"6. 语言指定任务之二：根据画面回答这个问题","currentQuestion":"6. 语言指定任务之二：根据画面回答这个问题","sourceSlides":[],"knowledgeBlock":null,"formulas":[],"previousBlock":"b-dbbaab4836e2a23b9743ca9f","nextBlock":"b-5f91f3a7b4c296b874462626","prerequisites":[{"id":"b-0e7921da9f49da534ad883f5","url":"#b-0e7921da9f49da534ad883f5","role":"section-title"},{"id":"b-dbbaab4836e2a23b9743ca9f","url":"#b-dbbaab4836e2a23b9743ca9f","role":"problem-context"}],"relatedBlocks":[]},{"id":"b-5f91f3a7b4c296b874462626","type":"p","scope":"block-ddbfd4bf2bf747b0ae9f1cba853e8b68","url":"https://codingai-lec03.pages.dev/course/notebooks/680da245145447dd88983aabd136fd24.html#b-5f91f3a7b4c296b874462626","content":"[为何 CLIP 对齐后仍需要连接层](/course/blocks/llava-visual-vector-interface.html) · [逐模块核对冻结范围](/course/blocks/llava-two-stage-freezing.html)。","sha256":"53284538628970eb67c2983de4a891ba92836b5ea5f1c443f8064a010523ac09","chapter":{"id":"III","title":"视觉与语言"},"unit":{"id":"language-task-interfaces","title":"语言加入后，任务究竟改变了什么？"},"page":{"id":"reading-block-4f123fd559034e98ab80a149967f6452","title":"6. 语言指定任务之二：根据画面回答这个问题","number":11},"sectionTitle":"6. 语言指定任务之二：根据画面回答这个问题","currentQuestion":"6. 语言指定任务之二：根据画面回答这个问题","sourceSlides":[],"knowledgeBlock":null,"formulas":[],"previousBlock":"b-681911ad48e0a1dedced0284","nextBlock":null,"prerequisites":[{"id":"b-0e7921da9f49da534ad883f5","url":"#b-0e7921da9f49da534ad883f5","role":"section-title"},{"id":"b-dbbaab4836e2a23b9743ca9f","url":"#b-dbbaab4836e2a23b9743ca9f","role":"problem-context"}],"relatedBlocks":[]},{"id":"b-0ff6110c8c0a03378614134a","type":"h3","scope":"block-ce309fa079154f8092fa03084d3bcf9f","url":"https://codingai-lec03.pages.dev/course/notebooks/680da245145447dd88983aabd136fd24.html#b-0ff6110c8c0a03378614134a","content":"### 指令答案也需要信息来源","sha256":"4f6e7a02e226941e5d682e57303f951521c7d87eba24808cf9c614d1c8ee0d18","chapter":{"id":"III","title":"视觉与语言"},"unit":{"id":"language-task-interfaces","title":"语言加入后，任务究竟改变了什么？"},"page":{"id":"reading-block-ce309fa079154f8092fa03084d3bcf9f","title":"指令答案也需要信息来源","number":12},"sectionTitle":"指令答案也需要信息来源","currentQuestion":"指令答案也需要信息来源","sourceSlides":[],"knowledgeBlock":null,"formulas":[],"previousBlock":null,"nextBlock":"b-e8535c6afb078e3ec792e2ba","prerequisites":[{"id":"b-e8535c6afb078e3ec792e2ba","url":"#b-e8535c6afb078e3ec792e2ba","role":"problem-context"}],"relatedBlocks":[]},{"id":"b-e8535c6afb078e3ec792e2ba","type":"p","scope":"block-ce309fa079154f8092fa03084d3bcf9f","url":"https://codingai-lec03.pages.dev/course/notebooks/680da245145447dd88983aabd136fd24.html#b-e8535c6afb078e3ec792e2ba","content":"原始 LLaVA 的部分指令资料由文本 GPT-4 根据 caption、对象类别和框坐标制作，该步骤没有让它直接看原图。随后 LLaVA 才用原图和这些指令共同训练。若文字记录遗漏接触和遮挡关系，长回答也不能凭空补足监督。","sha256":"931258abc2eb3340d6be3c688c9a5f07957a249928b7cd01ef400b2ae932f433","chapter":{"id":"III","title":"视觉与语言"},"unit":{"id":"language-task-interfaces","title":"语言加入后，任务究竟改变了什么？"},"page":{"id":"reading-block-ce309fa079154f8092fa03084d3bcf9f","title":"指令答案也需要信息来源","number":12},"sectionTitle":"指令答案也需要信息来源","currentQuestion":"指令答案也需要信息来源","sourceSlides":[],"knowledgeBlock":null,"formulas":[],"previousBlock":"b-0ff6110c8c0a03378614134a","nextBlock":"b-b5622f16e75c00c66cff88ff","prerequisites":[{"id":"b-0ff6110c8c0a03378614134a","url":"#b-0ff6110c8c0a03378614134a","role":"section-title"}],"relatedBlocks":[]},{"id":"b-b5622f16e75c00c66cff88ff","type":"p","scope":"block-ce309fa079154f8092fa03084d3bcf9f","url":"https://codingai-lec03.pages.dev/course/notebooks/680da245145447dd88983aabd136fd24.html#b-b5622f16e75c00c66cff88ff","content":"这个细节把第三部分接回第一部分：目标从哪里来，决定系统练习什么。[完整说明与课堂练习](/course/blocks/llava-instruction-source.html)。","sha256":"afc9d2ed59208633d8da6076b8ead853c22a8303cf016c2abf0fef4271692784","chapter":{"id":"III","title":"视觉与语言"},"unit":{"id":"language-task-interfaces","title":"语言加入后，任务究竟改变了什么？"},"page":{"id":"reading-block-ce309fa079154f8092fa03084d3bcf9f","title":"指令答案也需要信息来源","number":12},"sectionTitle":"指令答案也需要信息来源","currentQuestion":"指令答案也需要信息来源","sourceSlides":[],"knowledgeBlock":null,"formulas":[],"previousBlock":"b-e8535c6afb078e3ec792e2ba","nextBlock":null,"prerequisites":[{"id":"b-0ff6110c8c0a03378614134a","url":"#b-0ff6110c8c0a03378614134a","role":"section-title"},{"id":"b-e8535c6afb078e3ec792e2ba","url":"#b-e8535c6afb078e3ec792e2ba","role":"problem-context"}],"relatedBlocks":[]},{"id":"b-e44bdd5e38dee1516fe0949c","type":"h3","scope":"block-fc3d98abedce4cfe9f92457dd3572549","url":"https://codingai-lec03.pages.dev/course/notebooks/680da245145447dd88983aabd136fd24.html#b-e44bdd5e38dee1516fe0949c","content":"### 7. 哪些能力可以继承，哪些环节还要重新学习？","sha256":"b422e5c41fb46da51102e6139beea88f8386b5054ac4b3ad85ac9244c32f8e1f","chapter":{"id":"III","title":"视觉与语言"},"unit":{"id":"language-task-interfaces","title":"语言加入后，任务究竟改变了什么？"},"page":{"id":"reading-block-fc3d98abedce4cfe9f92457dd3572549","title":"7. 哪些能力可以继承，哪些环节还要重新学习？","number":13},"sectionTitle":"7. 哪些能力可以继承，哪些环节还要重新学习？","currentQuestion":"7. 哪些能力可以继承，哪些环节还要重新学习？","sourceSlides":[],"knowledgeBlock":null,"formulas":[],"previousBlock":null,"nextBlock":"b-958355d1b57c6d98b3b110cd","prerequisites":[{"id":"b-30efda84670311e1f880b14c","url":"#b-30efda84670311e1f880b14c","role":"problem-context"}],"relatedBlocks":[]},{"id":"b-958355d1b57c6d98b3b110cd","type":"table","scope":"block-9f722432814341c394a2b6c32e03fbef","url":"https://codingai-lec03.pages.dev/course/notebooks/680da245145447dd88983aabd136fd24.html#b-958355d1b57c6d98b3b110cd","content":"| 新任务 | 可以复用的部件 | 仍要建立的环节 |\n| --- | --- | --- |\n| 固定表示分类 | 视觉编码器 | 目标标签与读出 |\n| 检测与实例分割 | 视觉主干 | 区域组织、空间读取、框/掩码监督 |\n| 图文匹配 | 合适的视觉与语言编码器 | 共同空间、配对学习与候选定义 |\n| 文字定位 | 视觉空间特征与文字表示 | 区域—词语交互与定位训练 |\n| 视觉问答 | 视觉编码器与语言模型 | 连接层、视觉指令与回答评价 |","sha256":"2d581f2b1c5fd2dd3063e1c1569b70b145e9da82322aadec1a3dfac8bca097fe","chapter":{"id":"III","title":"视觉与语言"},"unit":{"id":"language-task-interfaces","title":"语言加入后，任务究竟改变了什么？"},"page":{"id":"reading-block-fc3d98abedce4cfe9f92457dd3572549","title":"7. 哪些能力可以继承，哪些环节还要重新学习？","number":13},"sectionTitle":"7. 哪些能力可以继承，哪些环节还要重新学习？","currentQuestion":"7. 哪些能力可以继承，哪些环节还要重新学习？","sourceSlides":[],"knowledgeBlock":null,"formulas":[],"table":{"headers":["新任务","可以复用的部件","仍要建立的环节"],"rows":[["新任务","可以复用的部件","仍要建立的环节"],["固定表示分类","视觉编码器","目标标签与读出"],["检测与实例分割","视觉主干","区域组织、空间读取、框/掩码监督"],["图文匹配","合适的视觉与语言编码器","共同空间、配对学习与候选定义"],["文字定位","视觉空间特征与文字表示","区域—词语交互与定位训练"],["视觉问答","视觉编码器与语言模型","连接层、视觉指令与回答评价"]]},"previousBlock":"b-e44bdd5e38dee1516fe0949c","nextBlock":"b-30efda84670311e1f880b14c","prerequisites":[{"id":"b-e44bdd5e38dee1516fe0949c","url":"#b-e44bdd5e38dee1516fe0949c","role":"section-title"},{"id":"b-30efda84670311e1f880b14c","url":"#b-30efda84670311e1f880b14c","role":"problem-context"}],"relatedBlocks":[]},{"id":"b-30efda84670311e1f880b14c","type":"p","scope":"block-9f722432814341c394a2b6c32e03fbef","url":"https://codingai-lec03.pages.dev/course/notebooks/680da245145447dd88983aabd136fd24.html#b-30efda84670311e1f880b14c","content":"这张表不要求每个系统都从上一行起步。它提醒我们：复用已有能力之后，仍要说明新任务的学习信号、输出与接口。","sha256":"5dc7ba2b1f6c6316e7308c7da92b581aeb6feee3f11c1f88621e07593710394d","chapter":{"id":"III","title":"视觉与语言"},"unit":{"id":"language-task-interfaces","title":"语言加入后，任务究竟改变了什么？"},"page":{"id":"reading-block-fc3d98abedce4cfe9f92457dd3572549","title":"7. 哪些能力可以继承，哪些环节还要重新学习？","number":13},"sectionTitle":"7. 哪些能力可以继承，哪些环节还要重新学习？","currentQuestion":"7. 哪些能力可以继承，哪些环节还要重新学习？","sourceSlides":[],"knowledgeBlock":null,"formulas":[],"previousBlock":"b-958355d1b57c6d98b3b110cd","nextBlock":"b-70656ed72da276e84cad486b","prerequisites":[{"id":"b-e44bdd5e38dee1516fe0949c","url":"#b-e44bdd5e38dee1516fe0949c","role":"section-title"}],"relatedBlocks":[]},{"id":"b-70656ed72da276e84cad486b","type":"p","scope":"block-9f722432814341c394a2b6c32e03fbef","url":"https://codingai-lec03.pages.dev/course/notebooks/680da245145447dd88983aabd136fd24.html#b-70656ed72da276e84cad486b","content":"回到全讲中心问题：**网络学到的视觉表示，怎样变成可复用、可指定、可检验的能力？** 现在再改变一次任务：把输入图像拿走，只保留描述，要求系统创造一幅新图。","sha256":"9b59abe0072b6b80a90d34b288a06475c6850e52668587e545dd8760d6fcddfe","chapter":{"id":"III","title":"视觉与语言"},"unit":{"id":"language-task-interfaces","title":"语言加入后，任务究竟改变了什么？"},"page":{"id":"reading-block-fc3d98abedce4cfe9f92457dd3572549","title":"7. 哪些能力可以继承，哪些环节还要重新学习？","number":13},"sectionTitle":"7. 哪些能力可以继承，哪些环节还要重新学习？","currentQuestion":"7. 哪些能力可以继承，哪些环节还要重新学习？","sourceSlides":[],"knowledgeBlock":null,"formulas":[],"previousBlock":"b-30efda84670311e1f880b14c","nextBlock":null,"prerequisites":[{"id":"b-e44bdd5e38dee1516fe0949c","url":"#b-e44bdd5e38dee1516fe0949c","role":"section-title"},{"id":"b-30efda84670311e1f880b14c","url":"#b-30efda84670311e1f880b14c","role":"problem-context"}],"relatedBlocks":[]},{"id":"b-5c0ac2edb692192ddaa28d8b","type":"h3","scope":"block-b76c720aae524c5faef18b343a6374aa","url":"https://codingai-lec03.pages.dev/course/notebooks/680da245145447dd88983aabd136fd24.html#b-5c0ac2edb692192ddaa28d8b","content":"### 8A. 只给一句描述，怎样产生一幅新图像？","sha256":"eaeeed1ae0427188eac58d53ec3f43bb2e102dce0e1d5e8c4d02912018d55f95","chapter":{"id":"III","title":"视觉与语言"},"unit":{"id":"language-task-interfaces","title":"语言加入后，任务究竟改变了什么？"},"page":{"id":"reading-block-b76c720aae524c5faef18b343a6374aa","title":"8A. 只给一句描述，怎样产生一幅新图像？","number":14},"sectionTitle":"8A. 只给一句描述，怎样产生一幅新图像？","currentQuestion":"8A. 只给一句描述，怎样产生一幅新图像？","sourceSlides":[],"knowledgeBlock":null,"formulas":[],"previousBlock":null,"nextBlock":"b-3e0a9efbb87cb4cfdcbdd8d7","prerequisites":[{"id":"b-3e0a9efbb87cb4cfdcbdd8d7","url":"#b-3e0a9efbb87cb4cfdcbdd8d7","role":"problem-context"}],"relatedBlocks":[]},{"id":"b-3e0a9efbb87cb4cfdcbdd8d7","type":"p","scope":"block-045f75954e664345ab8c0a5c766a2f16","url":"https://codingai-lec03.pages.dev/course/notebooks/680da245145447dd88983aabd136fd24.html#b-3e0a9efbb87cb4cfdcbdd8d7","content":"我们已经用图像与句子做匹配，用词语指定区域，也能根据图像回答问题。现在拿走图像，只留下：","sha256":"45ba6b3d2c09727e6a1c315bca9819ed3dc9a528bcd3967fd024e4e5c6a5647f","chapter":{"id":"III","title":"视觉与语言"},"unit":{"id":"language-task-interfaces","title":"语言加入后，任务究竟改变了什么？"},"page":{"id":"reading-block-b76c720aae524c5faef18b343a6374aa","title":"8A. 只给一句描述，怎样产生一幅新图像？","number":14},"sectionTitle":"8A. 只给一句描述，怎样产生一幅新图像？","currentQuestion":"8A. 只给一句描述，怎样产生一幅新图像？","sourceSlides":[],"knowledgeBlock":null,"formulas":[],"previousBlock":"b-5c0ac2edb692192ddaa28d8b","nextBlock":"b-4e53637c91dd438e0e9ee1db","prerequisites":[{"id":"b-5c0ac2edb692192ddaa28d8b","url":"#b-5c0ac2edb692192ddaa28d8b","role":"section-title"}],"relatedBlocks":[]},{"id":"b-4e53637c91dd438e0e9ee1db","type":"blockquote","scope":"block-045f75954e664345ab8c0a5c766a2f16","url":"https://codingai-lec03.pages.dev/course/notebooks/680da245145447dd88983aabd136fd24.html#b-4e53637c91dd438e0e9ee1db","content":"红色杯子放在木桌上。","sha256":"c6febdec2ae248a7832a8dd6f8171f5558f284b515bf60f2b725a94807eec1e8","chapter":{"id":"III","title":"视觉与语言"},"unit":{"id":"language-task-interfaces","title":"语言加入后，任务究竟改变了什么？"},"page":{"id":"reading-block-b76c720aae524c5faef18b343a6374aa","title":"8A. 只给一句描述，怎样产生一幅新图像？","number":14},"sectionTitle":"8A. 只给一句描述，怎样产生一幅新图像？","currentQuestion":"8A. 只给一句描述，怎样产生一幅新图像？","sourceSlides":[],"knowledgeBlock":null,"formulas":[],"previousBlock":"b-3e0a9efbb87cb4cfdcbdd8d7","nextBlock":"b-dfd590e2fc78d0f9b9394b61","prerequisites":[{"id":"b-5c0ac2edb692192ddaa28d8b","url":"#b-5c0ac2edb692192ddaa28d8b","role":"section-title"},{"id":"b-3e0a9efbb87cb4cfdcbdd8d7","url":"#b-3e0a9efbb87cb4cfdcbdd8d7","role":"problem-context"}],"relatedBlocks":[]},{"id":"b-dfd590e2fc78d0f9b9394b61","type":"p","scope":"block-045f75954e664345ab8c0a5c766a2f16","url":"https://codingai-lec03.pages.dev/course/notebooks/680da245145447dd88983aabd136fd24.html#b-dfd590e2fc78d0f9b9394b61","content":"红色杯子放在木桌上。","sha256":"c6febdec2ae248a7832a8dd6f8171f5558f284b515bf60f2b725a94807eec1e8","chapter":{"id":"III","title":"视觉与语言"},"unit":{"id":"language-task-interfaces","title":"语言加入后，任务究竟改变了什么？"},"page":{"id":"reading-block-b76c720aae524c5faef18b343a6374aa","title":"8A. 只给一句描述，怎样产生一幅新图像？","number":14},"sectionTitle":"8A. 只给一句描述，怎样产生一幅新图像？","currentQuestion":"8A. 只给一句描述，怎样产生一幅新图像？","sourceSlides":[],"knowledgeBlock":null,"formulas":[],"previousBlock":"b-4e53637c91dd438e0e9ee1db","nextBlock":"b-358279c23ed751146dd3b0fb","prerequisites":[{"id":"b-5c0ac2edb692192ddaa28d8b","url":"#b-5c0ac2edb692192ddaa28d8b","role":"section-title"},{"id":"b-3e0a9efbb87cb4cfdcbdd8d7","url":"#b-3e0a9efbb87cb4cfdcbdd8d7","role":"problem-context"}],"relatedBlocks":[]},{"id":"b-358279c23ed751146dd3b0fb","type":"p","scope":"block-045f75954e664345ab8c0a5c766a2f16","url":"https://codingai-lec03.pages.dev/course/notebooks/680da245145447dd88983aabd136fd24.html#b-358279c23ed751146dd3b0fb","content":"使用者不再递交一张图供分析，而是要求系统产生新的视觉内容。**给候选打分，还没有给出生成这些像素的方法。** 我们需要说明输出的表示、学习目标，以及从条件到一个具体结果的生成过程。","sha256":"a5f88743244fce1f0c7154025389a242e51ec43f3098e14c0e1d51ad7930b72d","chapter":{"id":"III","title":"视觉与语言"},"unit":{"id":"language-task-interfaces","title":"语言加入后，任务究竟改变了什么？"},"page":{"id":"reading-block-b76c720aae524c5faef18b343a6374aa","title":"8A. 只给一句描述，怎样产生一幅新图像？","number":14},"sectionTitle":"8A. 只给一句描述，怎样产生一幅新图像？","currentQuestion":"8A. 只给一句描述，怎样产生一幅新图像？","sourceSlides":[],"knowledgeBlock":null,"formulas":[],"previousBlock":"b-dfd590e2fc78d0f9b9394b61","nextBlock":"b-272b6434b35b01027ab89107","prerequisites":[{"id":"b-5c0ac2edb692192ddaa28d8b","url":"#b-5c0ac2edb692192ddaa28d8b","role":"section-title"},{"id":"b-3e0a9efbb87cb4cfdcbdd8d7","url":"#b-3e0a9efbb87cb4cfdcbdd8d7","role":"problem-context"}],"relatedBlocks":[]},{"id":"b-272b6434b35b01027ab89107","type":"p","scope":"block-045f75954e664345ab8c0a5c766a2f16","url":"https://codingai-lec03.pages.dev/course/notebooks/680da245145447dd88983aabd136fd24.html#b-272b6434b35b01027ab89107","content":"第三讲的 captioning 与看图回答已经可能通过生成文本实现，MAE 也涉及重构。本讲的焦点是表示与任务接口；第四讲将把**生成分布、训练和采样本身**作为研究对象。","sha256":"2074f6f25833791334e2622f481240a866c683e7f8b3b0ad0536db73dd43fd64","chapter":{"id":"III","title":"视觉与语言"},"unit":{"id":"language-task-interfaces","title":"语言加入后，任务究竟改变了什么？"},"page":{"id":"reading-block-b76c720aae524c5faef18b343a6374aa","title":"8A. 只给一句描述，怎样产生一幅新图像？","number":14},"sectionTitle":"8A. 只给一句描述，怎样产生一幅新图像？","currentQuestion":"8A. 只给一句描述，怎样产生一幅新图像？","sourceSlides":[],"knowledgeBlock":null,"formulas":[],"previousBlock":"b-358279c23ed751146dd3b0fb","nextBlock":null,"prerequisites":[{"id":"b-5c0ac2edb692192ddaa28d8b","url":"#b-5c0ac2edb692192ddaa28d8b","role":"section-title"},{"id":"b-3e0a9efbb87cb4cfdcbdd8d7","url":"#b-3e0a9efbb87cb4cfdcbdd8d7","role":"problem-context"}],"relatedBlocks":[]},{"id":"b-443088c88a906b3e9d16a150","type":"h3","scope":"block-63a505de22ae4389bfa3360aab9f5b84","url":"https://codingai-lec03.pages.dev/course/notebooks/680da245145447dd88983aabd136fd24.html#b-443088c88a906b3e9d16a150","content":"### 8B. 同一句话，为什么有多种合理图像？","sha256":"dfa0892457d88def26b39b90aa5fc829695d80c9bbb0dbfbb0d27aaaba50246d","chapter":{"id":"III","title":"视觉与语言"},"unit":{"id":"language-task-interfaces","title":"语言加入后，任务究竟改变了什么？"},"page":{"id":"reading-block-63a505de22ae4389bfa3360aab9f5b84","title":"8B. 同一句话，为什么有多种合理图像？","number":15},"sectionTitle":"8B. 同一句话，为什么有多种合理图像？","currentQuestion":"8B. 同一句话，为什么有多种合理图像？","sourceSlides":[],"knowledgeBlock":null,"formulas":[],"previousBlock":null,"nextBlock":"b-9a1d6ae92b103507c8bec492","prerequisites":[{"id":"b-9a1d6ae92b103507c8bec492","url":"#b-9a1d6ae92b103507c8bec492","role":"problem-context"}],"relatedBlocks":[]},{"id":"b-9a1d6ae92b103507c8bec492","type":"p","scope":"block-50fdfc97f7844d30b241c1f48b61bf47","url":"https://codingai-lec03.pages.dev/course/notebooks/680da245145447dd88983aabd136fd24.html#b-9a1d6ae92b103507c8bec492","content":"**满足条件 A**","sha256":"cf7fd8ff4bae4380c923987a7e392cad55130841222aa1a9b4016eb1d6f2a957","chapter":{"id":"III","title":"视觉与语言"},"unit":{"id":"language-task-interfaces","title":"语言加入后，任务究竟改变了什么？"},"page":{"id":"reading-block-63a505de22ae4389bfa3360aab9f5b84","title":"8B. 同一句话，为什么有多种合理图像？","number":15},"sectionTitle":"8B. 同一句话，为什么有多种合理图像？","currentQuestion":"8B. 同一句话，为什么有多种合理图像？","sourceSlides":[],"knowledgeBlock":null,"formulas":[],"previousBlock":"b-443088c88a906b3e9d16a150","nextBlock":"b-2547ccf7f2d0f3f34ad1bdc8","prerequisites":[{"id":"b-443088c88a906b3e9d16a150","url":"#b-443088c88a906b3e9d16a150","role":"section-title"}],"relatedBlocks":[]},{"id":"b-2547ccf7f2d0f3f34ad1bdc8","type":"p","scope":"block-50fdfc97f7844d30b241c1f48b61bf47","url":"https://codingai-lec03.pages.dev/course/notebooks/680da245145447dd88983aabd136fd24.html#b-2547ccf7f2d0f3f34ad1bdc8","content":"![满足条件 A](/course/knowledge-assets/ec560facd73498443d236728.jpg)","sha256":"e19f2082b0f95c084a830b2ddaa0e17aadc33a539dda973c55f262f41f7912c5","chapter":{"id":"III","title":"视觉与语言"},"unit":{"id":"language-task-interfaces","title":"语言加入后，任务究竟改变了什么？"},"page":{"id":"reading-block-63a505de22ae4389bfa3360aab9f5b84","title":"8B. 同一句话，为什么有多种合理图像？","number":15},"sectionTitle":"8B. 同一句话，为什么有多种合理图像？","currentQuestion":"8B. 同一句话，为什么有多种合理图像？","sourceSlides":[],"knowledgeBlock":null,"formulas":[],"previousBlock":"b-9a1d6ae92b103507c8bec492","nextBlock":"b-5ab743e2316c44ce6acbc40f","prerequisites":[{"id":"b-443088c88a906b3e9d16a150","url":"#b-443088c88a906b3e9d16a150","role":"section-title"},{"id":"b-9a1d6ae92b103507c8bec492","url":"#b-9a1d6ae92b103507c8bec492","role":"problem-context"}],"relatedBlocks":[]},{"id":"b-5ab743e2316c44ce6acbc40f","type":"p","scope":"block-50fdfc97f7844d30b241c1f48b61bf47","url":"https://codingai-lec03.pages.dev/course/notebooks/680da245145447dd88983aabd136fd24.html#b-5ab743e2316c44ce6acbc40f","content":"**满足条件 B**","sha256":"1f6e31e2b2dbc9a62e0dd4e9a066eafb2be5a050149f230ddb54cedec729524d","chapter":{"id":"III","title":"视觉与语言"},"unit":{"id":"language-task-interfaces","title":"语言加入后，任务究竟改变了什么？"},"page":{"id":"reading-block-63a505de22ae4389bfa3360aab9f5b84","title":"8B. 同一句话，为什么有多种合理图像？","number":15},"sectionTitle":"8B. 同一句话，为什么有多种合理图像？","currentQuestion":"8B. 同一句话，为什么有多种合理图像？","sourceSlides":[],"knowledgeBlock":null,"formulas":[],"previousBlock":"b-2547ccf7f2d0f3f34ad1bdc8","nextBlock":"b-2a802495339dbee301b79ecf","prerequisites":[{"id":"b-443088c88a906b3e9d16a150","url":"#b-443088c88a906b3e9d16a150","role":"section-title"},{"id":"b-9a1d6ae92b103507c8bec492","url":"#b-9a1d6ae92b103507c8bec492","role":"problem-context"}],"relatedBlocks":[]},{"id":"b-2a802495339dbee301b79ecf","type":"p","scope":"block-50fdfc97f7844d30b241c1f48b61bf47","url":"https://codingai-lec03.pages.dev/course/notebooks/680da245145447dd88983aabd136fd24.html#b-2a802495339dbee301b79ecf","content":"![满足条件 B](/course/knowledge-assets/dc1cd1908690ea385130c51d.jpg)","sha256":"35a83f4615e816d6e2089e4cc62c05fdb9d244c10b1fd5844f30bb0013b29e3b","chapter":{"id":"III","title":"视觉与语言"},"unit":{"id":"language-task-interfaces","title":"语言加入后，任务究竟改变了什么？"},"page":{"id":"reading-block-63a505de22ae4389bfa3360aab9f5b84","title":"8B. 同一句话，为什么有多种合理图像？","number":15},"sectionTitle":"8B. 同一句话，为什么有多种合理图像？","currentQuestion":"8B. 同一句话，为什么有多种合理图像？","sourceSlides":[],"knowledgeBlock":null,"formulas":[],"previousBlock":"b-5ab743e2316c44ce6acbc40f","nextBlock":"b-080a311e4d6c8feb63cc1440","prerequisites":[{"id":"b-443088c88a906b3e9d16a150","url":"#b-443088c88a906b3e9d16a150","role":"section-title"},{"id":"b-9a1d6ae92b103507c8bec492","url":"#b-9a1d6ae92b103507c8bec492","role":"problem-context"}],"relatedBlocks":[]},{"id":"b-080a311e4d6c8feb63cc1440","type":"p","scope":"block-50fdfc97f7844d30b241c1f48b61bf47","url":"https://codingai-lec03.pages.dev/course/notebooks/680da245145447dd88983aabd136fd24.html#b-080a311e4d6c8feb63cc1440","content":"**满足条件 C**","sha256":"ba3d2aca4094187642fdd70cf1ec1985ebad6809f16b721f44e92851a90d945e","chapter":{"id":"III","title":"视觉与语言"},"unit":{"id":"language-task-interfaces","title":"语言加入后，任务究竟改变了什么？"},"page":{"id":"reading-block-63a505de22ae4389bfa3360aab9f5b84","title":"8B. 同一句话，为什么有多种合理图像？","number":15},"sectionTitle":"8B. 同一句话，为什么有多种合理图像？","currentQuestion":"8B. 同一句话，为什么有多种合理图像？","sourceSlides":[],"knowledgeBlock":null,"formulas":[],"previousBlock":"b-2a802495339dbee301b79ecf","nextBlock":"b-c55833cd8474b608c1d354ac","prerequisites":[{"id":"b-443088c88a906b3e9d16a150","url":"#b-443088c88a906b3e9d16a150","role":"section-title"},{"id":"b-9a1d6ae92b103507c8bec492","url":"#b-9a1d6ae92b103507c8bec492","role":"problem-context"}],"relatedBlocks":[]},{"id":"b-c55833cd8474b608c1d354ac","type":"p","scope":"block-50fdfc97f7844d30b241c1f48b61bf47","url":"https://codingai-lec03.pages.dev/course/notebooks/680da245145447dd88983aabd136fd24.html#b-c55833cd8474b608c1d354ac","content":"![满足条件 C](/course/knowledge-assets/8d1f81eafbc5ed484eaec555.jpg)","sha256":"18502752c7150235b0383c6453be3b72e10a15f596da43a2692724c617dad06e","chapter":{"id":"III","title":"视觉与语言"},"unit":{"id":"language-task-interfaces","title":"语言加入后，任务究竟改变了什么？"},"page":{"id":"reading-block-63a505de22ae4389bfa3360aab9f5b84","title":"8B. 同一句话，为什么有多种合理图像？","number":15},"sectionTitle":"8B. 同一句话，为什么有多种合理图像？","currentQuestion":"8B. 同一句话，为什么有多种合理图像？","sourceSlides":[],"knowledgeBlock":null,"formulas":[],"previousBlock":"b-080a311e4d6c8feb63cc1440","nextBlock":"b-ddae8c50cddd1aafc238218a","prerequisites":[{"id":"b-443088c88a906b3e9d16a150","url":"#b-443088c88a906b3e9d16a150","role":"section-title"},{"id":"b-9a1d6ae92b103507c8bec492","url":"#b-9a1d6ae92b103507c8bec492","role":"problem-context"}],"relatedBlocks":[]},{"id":"b-ddae8c50cddd1aafc238218a","type":"p","scope":"block-50fdfc97f7844d30b241c1f48b61bf47","url":"https://codingai-lec03.pages.dev/course/notebooks/680da245145447dd88983aabd136fd24.html#b-ddae8c50cddd1aafc238218a","content":"**违反红杯条件：蓝杯**","sha256":"46ccad82420657a0419905e10975bcaa713b5009a3ea1b14300dd3552bbb4ee0","chapter":{"id":"III","title":"视觉与语言"},"unit":{"id":"language-task-interfaces","title":"语言加入后，任务究竟改变了什么？"},"page":{"id":"reading-block-63a505de22ae4389bfa3360aab9f5b84","title":"8B. 同一句话，为什么有多种合理图像？","number":15},"sectionTitle":"8B. 同一句话，为什么有多种合理图像？","currentQuestion":"8B. 同一句话，为什么有多种合理图像？","sourceSlides":[],"knowledgeBlock":null,"formulas":[],"previousBlock":"b-c55833cd8474b608c1d354ac","nextBlock":"b-87fcbbd4da31ec7901dc4f47","prerequisites":[{"id":"b-443088c88a906b3e9d16a150","url":"#b-443088c88a906b3e9d16a150","role":"section-title"},{"id":"b-9a1d6ae92b103507c8bec492","url":"#b-9a1d6ae92b103507c8bec492","role":"problem-context"}],"relatedBlocks":[]},{"id":"b-87fcbbd4da31ec7901dc4f47","type":"p","scope":"block-50fdfc97f7844d30b241c1f48b61bf47","url":"https://codingai-lec03.pages.dev/course/notebooks/680da245145447dd88983aabd136fd24.html#b-87fcbbd4da31ec7901dc4f47","content":"![违反红杯条件：蓝杯](/course/knowledge-assets/249a1599e2eb22de518cbc2d.jpg)","sha256":"c9a1149641761796275222b4791eedd41d5cbd674182c4bef7ddbefdfc2351b5","chapter":{"id":"III","title":"视觉与语言"},"unit":{"id":"language-task-interfaces","title":"语言加入后，任务究竟改变了什么？"},"page":{"id":"reading-block-63a505de22ae4389bfa3360aab9f5b84","title":"8B. 同一句话，为什么有多种合理图像？","number":15},"sectionTitle":"8B. 同一句话，为什么有多种合理图像？","currentQuestion":"8B. 同一句话，为什么有多种合理图像？","sourceSlides":[],"knowledgeBlock":null,"formulas":[],"previousBlock":"b-ddae8c50cddd1aafc238218a","nextBlock":"b-da802720bcd07414a86b7178","prerequisites":[{"id":"b-443088c88a906b3e9d16a150","url":"#b-443088c88a906b3e9d16a150","role":"section-title"},{"id":"b-9a1d6ae92b103507c8bec492","url":"#b-9a1d6ae92b103507c8bec492","role":"problem-context"}],"relatedBlocks":[]},{"id":"b-da802720bcd07414a86b7178","type":"p","scope":"block-50fdfc97f7844d30b241c1f48b61bf47","url":"https://codingai-lec03.pages.dev/course/notebooks/680da245145447dd88983aabd136fd24.html#b-da802720bcd07414a86b7178","content":"同一“红杯＋木桌”条件下的三种合理样本，以及一张违反指定条件的对照。它们是条件与多样性的情境示例，不是生成方法质量对比。","sha256":"b788699bd059bf4fe754b7fb902ea4c258639e62e09bad0cd62e9fae1bb2a821","chapter":{"id":"III","title":"视觉与语言"},"unit":{"id":"language-task-interfaces","title":"语言加入后，任务究竟改变了什么？"},"page":{"id":"reading-block-63a505de22ae4389bfa3360aab9f5b84","title":"8B. 同一句话，为什么有多种合理图像？","number":15},"sectionTitle":"8B. 同一句话，为什么有多种合理图像？","currentQuestion":"8B. 同一句话，为什么有多种合理图像？","sourceSlides":[],"knowledgeBlock":null,"formulas":[],"previousBlock":"b-87fcbbd4da31ec7901dc4f47","nextBlock":"b-77cc73428d47e01ef1d8f4de","prerequisites":[{"id":"b-443088c88a906b3e9d16a150","url":"#b-443088c88a906b3e9d16a150","role":"section-title"},{"id":"b-9a1d6ae92b103507c8bec492","url":"#b-9a1d6ae92b103507c8bec492","role":"problem-context"}],"relatedBlocks":[]},{"id":"b-77cc73428d47e01ef1d8f4de","type":"p","scope":"block-50fdfc97f7844d30b241c1f48b61bf47","url":"https://codingai-lec03.pages.dev/course/notebooks/680da245145447dd88983aabd136fd24.html#b-77cc73428d47e01ef1d8f4de","content":"**先看图再判断：** 哪些细节必须满足？哪些是描述没有指定的？红杯与木桌是条件；杯型、视角、光照、摆放位置仍有自由度。不同合理图像不必是同一幅图的微小扰动。","sha256":"3ae0dad0a0a4f849682fc00cb590bf19b6754cf535a6a9b5ed68d989ce809079","chapter":{"id":"III","title":"视觉与语言"},"unit":{"id":"language-task-interfaces","title":"语言加入后，任务究竟改变了什么？"},"page":{"id":"reading-block-63a505de22ae4389bfa3360aab9f5b84","title":"8B. 同一句话，为什么有多种合理图像？","number":15},"sectionTitle":"8B. 同一句话，为什么有多种合理图像？","currentQuestion":"8B. 同一句话，为什么有多种合理图像？","sourceSlides":[],"knowledgeBlock":null,"formulas":[],"previousBlock":"b-da802720bcd07414a86b7178","nextBlock":"b-d5ef6f2137d7803b53e232b3","prerequisites":[{"id":"b-443088c88a906b3e9d16a150","url":"#b-443088c88a906b3e9d16a150","role":"section-title"},{"id":"b-9a1d6ae92b103507c8bec492","url":"#b-9a1d6ae92b103507c8bec492","role":"problem-context"}],"relatedBlocks":[]},{"id":"b-d5ef6f2137d7803b53e232b3","type":"p","scope":"block-50fdfc97f7844d30b241c1f48b61bf47","url":"https://codingai-lec03.pages.dev/course/notebooks/680da245145447dd88983aabd136fd24.html#b-d5ef6f2137d7803b53e232b3","content":"因此，训练不只是寻找唯一正确像素答案，而是学习符合条件的多种可能；采样再从这些可能性中得到具体结果。用记号写就是 `x ~ pθ(x | c)`：c 是条件，模型参数 θ 规定条件分布，x 是一次产生的结果。","sha256":"3c1b064ae1227aa2cc16fadcf715afe99cbac1c93fdc8b4e282eba90aee2b7f3","chapter":{"id":"III","title":"视觉与语言"},"unit":{"id":"language-task-interfaces","title":"语言加入后，任务究竟改变了什么？"},"page":{"id":"reading-block-63a505de22ae4389bfa3360aab9f5b84","title":"8B. 同一句话，为什么有多种合理图像？","number":15},"sectionTitle":"8B. 同一句话，为什么有多种合理图像？","currentQuestion":"8B. 同一句话，为什么有多种合理图像？","sourceSlides":[],"knowledgeBlock":null,"formulas":[],"previousBlock":"b-77cc73428d47e01ef1d8f4de","nextBlock":"b-ec6696a19a62de9d59ec0870","prerequisites":[{"id":"b-443088c88a906b3e9d16a150","url":"#b-443088c88a906b3e9d16a150","role":"section-title"},{"id":"b-9a1d6ae92b103507c8bec492","url":"#b-9a1d6ae92b103507c8bec492","role":"problem-context"}],"relatedBlocks":[]},{"id":"b-ec6696a19a62de9d59ec0870","type":"p","scope":"block-50fdfc97f7844d30b241c1f48b61bf47","url":"https://codingai-lec03.pages.dev/course/notebooks/680da245145447dd88983aabd136fd24.html#b-ec6696a19a62de9d59ec0870","content":"图文相似度可以为某些生成系统提供信号，但相似度函数本身不是完整采样器。MAE 的既有遮挡训练配方，也不会自动给出任意文生图能力。","sha256":"4483c65121d2fda48387c2d19b1b50e8f103d71ff64ed8875d4b85bf62dd709b","chapter":{"id":"III","title":"视觉与语言"},"unit":{"id":"language-task-interfaces","title":"语言加入后，任务究竟改变了什么？"},"page":{"id":"reading-block-63a505de22ae4389bfa3360aab9f5b84","title":"8B. 同一句话，为什么有多种合理图像？","number":15},"sectionTitle":"8B. 同一句话，为什么有多种合理图像？","currentQuestion":"8B. 同一句话，为什么有多种合理图像？","sourceSlides":[],"knowledgeBlock":null,"formulas":[],"previousBlock":"b-d5ef6f2137d7803b53e232b3","nextBlock":null,"prerequisites":[{"id":"b-443088c88a906b3e9d16a150","url":"#b-443088c88a906b3e9d16a150","role":"section-title"},{"id":"b-9a1d6ae92b103507c8bec492","url":"#b-9a1d6ae92b103507c8bec492","role":"problem-context"}],"relatedBlocks":[]},{"id":"b-4e69b8dbb59e8c8f7a2d17c3","type":"h3","scope":"block-aead117ad6f542828f635a98ebe8a29a","url":"https://codingai-lec03.pages.dev/course/notebooks/680da245145447dd88983aabd136fd24.html#b-4e69b8dbb59e8c8f7a2d17c3","content":"### 8C. 从任务接口走向生成机制","sha256":"ca2d786f5df1b68f7324a11164f448d6599e7c4d91acdecf5da2b4ebee747121","chapter":{"id":"III","title":"视觉与语言"},"unit":{"id":"language-task-interfaces","title":"语言加入后，任务究竟改变了什么？"},"page":{"id":"reading-block-aead117ad6f542828f635a98ebe8a29a","title":"8C. 从任务接口走向生成机制","number":16},"sectionTitle":"8C. 从任务接口走向生成机制","currentQuestion":"8C. 从任务接口走向生成机制","sourceSlides":[],"knowledgeBlock":null,"formulas":[],"previousBlock":null,"nextBlock":"b-26d00ae93eb5ae863d03c589","prerequisites":[{"id":"b-26d00ae93eb5ae863d03c589","url":"#b-26d00ae93eb5ae863d03c589","role":"problem-context"}],"relatedBlocks":[]},{"id":"b-26d00ae93eb5ae863d03c589","type":"p","scope":"block-ac3a381fdb1c4469a490d0fa0071d035","url":"https://codingai-lec03.pages.dev/course/notebooks/680da245145447dd88983aabd136fd24.html#b-26d00ae93eb5ae863d03c589","content":"图像描述已经在生成文字；前面的条件多解图又说明，同一句描述不必对应唯一像素答案。第四讲会进一步问：训练反馈怎样支持这些可能，采样又怎样得到一个结果？","sha256":"a74e7494da4f27597b87a787edfb6666ddbb5fe9cb8acff82ae11ff528697bcc","chapter":{"id":"III","title":"视觉与语言"},"unit":{"id":"language-task-interfaces","title":"语言加入后，任务究竟改变了什么？"},"page":{"id":"reading-block-aead117ad6f542828f635a98ebe8a29a","title":"8C. 从任务接口走向生成机制","number":16},"sectionTitle":"8C. 从任务接口走向生成机制","currentQuestion":"8C. 从任务接口走向生成机制","sourceSlides":[],"knowledgeBlock":null,"formulas":[],"previousBlock":"b-4e69b8dbb59e8c8f7a2d17c3","nextBlock":"b-c8a1b60cf9405923db5ec8c7","prerequisites":[{"id":"b-4e69b8dbb59e8c8f7a2d17c3","url":"#b-4e69b8dbb59e8c8f7a2d17c3","role":"section-title"}],"relatedBlocks":[]},{"id":"b-c8a1b60cf9405923db5ec8c7","type":"p","scope":"block-ac3a381fdb1c4469a490d0fa0071d035","url":"https://codingai-lec03.pages.dev/course/notebooks/680da245145447dd88983aabd136fd24.html#b-c8a1b60cf9405923db5ec8c7","content":"GAN、VAE、Diffusion 的路线比较与原始来源，已移到[第四讲：从条件多解走向生成模型](https://deepnote.com/project/6f83a923-d155-47be-be58-680db701ff7f/notebook/694b7a43ea4948f5a197c014c2fbad3b?utm_source=openai&utm_medium=mcp&utm_campaign=openaimcp&utm_content=694b7a43ea4948f5a197c014c2fbad3b&utm_term=get_notebook)。","sha256":"b57464e1073c44ff4e797006cdae033c6ce6c10edc4ac7d4d01b97c0bca39c4d","chapter":{"id":"III","title":"视觉与语言"},"unit":{"id":"language-task-interfaces","title":"语言加入后，任务究竟改变了什么？"},"page":{"id":"reading-block-aead117ad6f542828f635a98ebe8a29a","title":"8C. 从任务接口走向生成机制","number":16},"sectionTitle":"8C. 从任务接口走向生成机制","currentQuestion":"8C. 从任务接口走向生成机制","sourceSlides":[],"knowledgeBlock":null,"formulas":[],"previousBlock":"b-26d00ae93eb5ae863d03c589","nextBlock":null,"prerequisites":[{"id":"b-4e69b8dbb59e8c8f7a2d17c3","url":"#b-4e69b8dbb59e8c8f7a2d17c3","role":"section-title"},{"id":"b-26d00ae93eb5ae863d03c589","url":"#b-26d00ae93eb5ae863d03c589","role":"problem-context"}],"relatedBlocks":[]},{"id":"b-c9a1b4db168029b424cebb39","type":"h3","scope":"block-f9a09c497c544a4ba4af64ab27b80fa5","url":"https://codingai-lec03.pages.dev/course/notebooks/680da245145447dd88983aabd136fd24.html#b-c9a1b4db168029b424cebb39","content":"### 8D. 带着三项判断结束本讲","sha256":"86b47fdf22b5f59fcb52f39908699d3afa539bfc3ac039b38ca831c41799f903","chapter":{"id":"III","title":"视觉与语言"},"unit":{"id":"language-task-interfaces","title":"语言加入后，任务究竟改变了什么？"},"page":{"id":"reading-block-f9a09c497c544a4ba4af64ab27b80fa5","title":"8D. 带着三项判断结束本讲","number":17},"sectionTitle":"8D. 带着三项判断结束本讲","currentQuestion":"8D. 带着三项判断结束本讲","sourceSlides":[],"knowledgeBlock":null,"formulas":[],"previousBlock":null,"nextBlock":"b-b6d14c0a7ba95d11906d6775","prerequisites":[{"id":"b-b6d14c0a7ba95d11906d6775","url":"#b-b6d14c0a7ba95d11906d6775","role":"problem-context"}],"relatedBlocks":[]},{"id":"b-b6d14c0a7ba95d11906d6775","type":"p","scope":"block-384f15c57d2c4dbeb72443ff9b5e6de3","url":"https://codingai-lec03.pages.dev/course/notebooks/680da245145447dd88983aabd136fd24.html#b-b6d14c0a7ba95d11906d6775","content":"选择本讲的一个系统，依次说清三件事：训练答案从哪里来；表示怎样被读成区域、像素或文字；哪项干预或保留评价支持它学到了所需能力。","sha256":"cb5c5f6c89b690472f6152911a67770fa42e8b09dd72e92057611aac7fd5ea43","chapter":{"id":"III","title":"视觉与语言"},"unit":{"id":"language-task-interfaces","title":"语言加入后，任务究竟改变了什么？"},"page":{"id":"reading-block-f9a09c497c544a4ba4af64ab27b80fa5","title":"8D. 带着三项判断结束本讲","number":17},"sectionTitle":"8D. 带着三项判断结束本讲","currentQuestion":"8D. 带着三项判断结束本讲","sourceSlides":[],"knowledgeBlock":null,"formulas":[],"previousBlock":"b-c9a1b4db168029b424cebb39","nextBlock":"b-742302425326661395a8bab1","prerequisites":[{"id":"b-c9a1b4db168029b424cebb39","url":"#b-c9a1b4db168029b424cebb39","role":"section-title"}],"relatedBlocks":[]},{"id":"b-742302425326661395a8bab1","type":"p","scope":"block-384f15c57d2c4dbeb72443ff9b5e6de3","url":"https://codingai-lec03.pages.dev/course/notebooks/680da245145447dd88983aabd136fd24.html#b-742302425326661395a8bab1","content":"这三项判断可以串起表示、空间输出与视觉语言，也会成为下一讲研究生成机制的起点。需要回查具体例子时，从[第三讲导读的八条问题路径](/course/guide.html)进入，不必重新顺读全部实验。","sha256":"36bfd8f5cd6db82d0034a944908e56f553c295a0f5c79a2fe695711943f94a8e","chapter":{"id":"III","title":"视觉与语言"},"unit":{"id":"language-task-interfaces","title":"语言加入后，任务究竟改变了什么？"},"page":{"id":"reading-block-f9a09c497c544a4ba4af64ab27b80fa5","title":"8D. 带着三项判断结束本讲","number":17},"sectionTitle":"8D. 带着三项判断结束本讲","currentQuestion":"8D. 带着三项判断结束本讲","sourceSlides":[],"knowledgeBlock":null,"formulas":[],"previousBlock":"b-b6d14c0a7ba95d11906d6775","nextBlock":null,"prerequisites":[{"id":"b-c9a1b4db168029b424cebb39","url":"#b-c9a1b4db168029b424cebb39","role":"section-title"},{"id":"b-b6d14c0a7ba95d11906d6775","url":"#b-b6d14c0a7ba95d11906d6775","role":"problem-context"}],"relatedBlocks":[]}]}