{"version":2,"relationshipURLBase":"https://codingai-lec03.pages.dev/course/blocks/readout-versus-finetuning-protocol.html","relationshipResolution":"Resolve relative relationship URLs against relationshipURLBase; complete records and absolute URLs are in blocks.","title":"冻结读出与微调分别在问什么？","url":"https://codingai-lec03.pages.dev/course/blocks/readout-versus-finetuning-protocol.html","markdown":"https://codingai-lec03.pages.dev/course/blocks/readout-versus-finetuning-protocol.md","pages":[{"id":"reading-opening","title":"冻结读出与微调分别在问什么？","unit":"怎样判断表示支持了哪种使用方式？","unitId":"i-use-and-evaluate","chapter":"I","number":1}],"aliases":[{"oldId":"b-b911634e31d02ccd9de8f9cf","targetId":"b-b911634e31d02ccd9de8f9cf","page":"reading-opening","operation":"move","beforeSHA256":"88235ada8811769c7b803b1f4c14eefdfd7f7c736905bfb1d94d71734cd7051f","afterSHA256":"88235ada8811769c7b803b1f4c14eefdfd7f7c736905bfb1d94d71734cd7051f","reason":"Same source body in authored semantic page"},{"oldId":"b-ba00c93153e1ec6be500f4ba","targetId":"b-ba00c93153e1ec6be500f4ba","page":"reading-opening","operation":"move","beforeSHA256":"54cbe5d9c97cc6c6bacf77ce81460d0720d81671f6d484205fd796b01b0b0bbd","afterSHA256":"54cbe5d9c97cc6c6bacf77ce81460d0720d81671f6d484205fd796b01b0b0bbd","reason":"Same source body in authored semantic page"},{"oldId":"b-74c8d7ad7004331295395ce9","targetId":"b-74c8d7ad7004331295395ce9","page":"reading-opening","operation":"move","beforeSHA256":"4acaebce971b6ea0d4b4101354b8427376bb30d9ed88c0ef19d5ab243972411d","afterSHA256":"4acaebce971b6ea0d4b4101354b8427376bb30d9ed88c0ef19d5ab243972411d","reason":"Same source body in authored semantic page"},{"oldId":"b-2678e0e861845ad66bd39b1b","targetId":"b-2678e0e861845ad66bd39b1b","page":"reading-opening","operation":"move","beforeSHA256":"ad68639e870f873dabd5bb51b94caf66ea41705a05f7587ef204fe83a589e25e","afterSHA256":"ad68639e870f873dabd5bb51b94caf66ea41705a05f7587ef204fe83a589e25e","reason":"Same source body in authored semantic page"},{"oldId":"b-d6b5a54f906e0be13bf7fff8","targetId":"b-d6b5a54f906e0be13bf7fff8","page":"reading-opening","operation":"move","beforeSHA256":"865d09ceca4372f3726a049746e16f3e02eaa37161581388c6ad30162ecbd365","afterSHA256":"865d09ceca4372f3726a049746e16f3e02eaa37161581388c6ad30162ecbd365","reason":"Same source body in authored semantic page"},{"oldId":"b-6e99979996b16040b9eb1b49","targetId":"b-6e99979996b16040b9eb1b49","page":"reading-opening","operation":"move","beforeSHA256":"2b9ccef7e1220e2250cceff1abd8bdd736b42f8da5a223f26b029f44b962e807","afterSHA256":"2b9ccef7e1220e2250cceff1abd8bdd736b42f8da5a223f26b029f44b962e807","reason":"Same source body in authored semantic page"}],"blocks":[{"id":"b-b911634e31d02ccd9de8f9cf","type":"h1","scope":"readout-versus-finetuning-protocol","url":"https://codingai-lec03.pages.dev/course/blocks/readout-versus-finetuning-protocol.html#b-b911634e31d02ccd9de8f9cf","content":"# 冻结读出与微调分别在问什么？","sha256":"88235ada8811769c7b803b1f4c14eefdfd7f7c736905bfb1d94d71734cd7051f","chapter":{"id":"I","title":"学习信号与表示"},"unit":{"id":"i-use-and-evaluate","title":"怎样判断表示支持了哪种使用方式？"},"page":{"id":"reading-opening","title":"冻结读出与微调分别在问什么？","number":1},"sectionTitle":"冻结读出与微调分别在问什么？","currentQuestion":"冻结读出与微调分别在问什么？","sourceSlides":[],"knowledgeBlock":null,"formulas":[],"previousBlock":null,"nextBlock":"b-ba00c93153e1ec6be500f4ba","prerequisites":[{"id":"b-ba00c93153e1ec6be500f4ba","url":"#b-ba00c93153e1ec6be500f4ba","role":"problem-context"}],"relatedBlocks":[]},{"id":"b-ba00c93153e1ec6be500f4ba","type":"p","scope":"readout-versus-finetuning-protocol","url":"https://codingai-lec03.pages.dev/course/blocks/readout-versus-finetuning-protocol.html#b-ba00c93153e1ec6be500f4ba","content":"把第一部分的方法转为使用与评价：冻结读出问现成表示，微调问适配起点，二者应各有协议。","sha256":"54cbe5d9c97cc6c6bacf77ce81460d0720d81671f6d484205fd796b01b0b0bbd","chapter":{"id":"I","title":"学习信号与表示"},"unit":{"id":"i-use-and-evaluate","title":"怎样判断表示支持了哪种使用方式？"},"page":{"id":"reading-opening","title":"冻结读出与微调分别在问什么？","number":1},"sectionTitle":"冻结读出与微调分别在问什么？","currentQuestion":"冻结读出与微调分别在问什么？","sourceSlides":[],"knowledgeBlock":null,"formulas":[],"previousBlock":"b-b911634e31d02ccd9de8f9cf","nextBlock":"b-74c8d7ad7004331295395ce9","prerequisites":[{"id":"b-b911634e31d02ccd9de8f9cf","url":"#b-b911634e31d02ccd9de8f9cf","role":"section-title"}],"relatedBlocks":[]},{"id":"b-74c8d7ad7004331295395ce9","type":"p","scope":"readout-versus-finetuning-protocol","url":"https://codingai-lec03.pages.dev/course/blocks/readout-versus-finetuning-protocol.html#b-74c8d7ad7004331295395ce9","content":"冻结读出把 $f_\\theta$ 固定，只学习新头 $Wh+b$。它问“当前表示中，答案能否被这个受限读出取出？”kNN甚至不拟合新网络，但仍用训练标签建参考库，并依赖距离、归一化和k。微调允许编码器改变，问“这个起点经过给定适配后能做到什么？”","sha256":"4acaebce971b6ea0d4b4101354b8427376bb30d9ed88c0ef19d5ab243972411d","chapter":{"id":"I","title":"学习信号与表示"},"unit":{"id":"i-use-and-evaluate","title":"怎样判断表示支持了哪种使用方式？"},"page":{"id":"reading-opening","title":"冻结读出与微调分别在问什么？","number":1},"sectionTitle":"冻结读出与微调分别在问什么？","currentQuestion":"冻结读出与微调分别在问什么？","sourceSlides":[],"knowledgeBlock":null,"formulas":[{"latex":"f_\\theta","definitionContext":"冻结读出与微调分别在问什么？"},{"latex":"Wh+b","definitionContext":"冻结读出与微调分别在问什么？"}],"previousBlock":"b-ba00c93153e1ec6be500f4ba","nextBlock":"b-2678e0e861845ad66bd39b1b","prerequisites":[{"id":"b-b911634e31d02ccd9de8f9cf","url":"#b-b911634e31d02ccd9de8f9cf","role":"section-title"},{"id":"b-ba00c93153e1ec6be500f4ba","url":"#b-ba00c93153e1ec6be500f4ba","role":"problem-context"}],"relatedBlocks":[]},{"id":"b-2678e0e861845ad66bd39b1b","type":"p","scope":"readout-versus-finetuning-protocol","url":"https://codingai-lec03.pages.dev/course/blocks/readout-versus-finetuning-protocol.html#b-2678e0e861845ad66bd39b1b","content":"公平比较首先固定目标任务、原图划分、标签预算和评价规则。按原图先划分再生成视图，避免同一原图的两个裁剪分别进入训练和测试。超参数和停点用验证集选择，测试集用于最终报告。已经看过的保留结果可供探索，却不再是未知验收题。","sha256":"ad68639e870f873dabd5bb51b94caf66ea41705a05f7587ef204fe83a589e25e","chapter":{"id":"I","title":"学习信号与表示"},"unit":{"id":"i-use-and-evaluate","title":"怎样判断表示支持了哪种使用方式？"},"page":{"id":"reading-opening","title":"冻结读出与微调分别在问什么？","number":1},"sectionTitle":"冻结读出与微调分别在问什么？","currentQuestion":"冻结读出与微调分别在问什么？","sourceSlides":[],"knowledgeBlock":null,"formulas":[],"previousBlock":"b-74c8d7ad7004331295395ce9","nextBlock":"b-d6b5a54f906e0be13bf7fff8","prerequisites":[{"id":"b-b911634e31d02ccd9de8f9cf","url":"#b-b911634e31d02ccd9de8f9cf","role":"section-title"},{"id":"b-ba00c93153e1ec6be500f4ba","url":"#b-ba00c93153e1ec6be500f4ba","role":"problem-context"}],"relatedBlocks":[]},{"id":"b-d6b5a54f906e0be13bf7fff8","type":"p","scope":"readout-versus-finetuning-protocol","url":"https://codingai-lec03.pages.dev/course/blocks/readout-versus-finetuning-protocol.html#b-d6b5a54f906e0be13bf7fff8","content":"冻结参数还不自动冻结所有状态。含BatchNorm时，运行统计可能在train模式改变；`eval()`、`no_grad()`与`requires_grad_(False)`控制不同对象。LAB 02保留这项实现选读，主讲先抓住“哪些参数可动，答案用在哪里”。","sha256":"865d09ceca4372f3726a049746e16f3e02eaa37161581388c6ad30162ecbd365","chapter":{"id":"I","title":"学习信号与表示"},"unit":{"id":"i-use-and-evaluate","title":"怎样判断表示支持了哪种使用方式？"},"page":{"id":"reading-opening","title":"冻结读出与微调分别在问什么？","number":1},"sectionTitle":"冻结读出与微调分别在问什么？","currentQuestion":"冻结读出与微调分别在问什么？","sourceSlides":[],"knowledgeBlock":null,"formulas":[],"previousBlock":"b-2678e0e861845ad66bd39b1b","nextBlock":"b-6e99979996b16040b9eb1b49","prerequisites":[{"id":"b-b911634e31d02ccd9de8f9cf","url":"#b-b911634e31d02ccd9de8f9cf","role":"section-title"},{"id":"b-ba00c93153e1ec6be500f4ba","url":"#b-ba00c93153e1ec6be500f4ba","role":"problem-context"}],"relatedBlocks":[]},{"id":"b-6e99979996b16040b9eb1b49","type":"h2","scope":"readout-versus-finetuning-protocol","url":"https://codingai-lec03.pages.dev/course/blocks/readout-versus-finetuning-protocol.html#b-6e99979996b16040b9eb1b49","content":"## 继续阅读与实验","sha256":"2b9ccef7e1220e2250cceff1abd8bdd736b42f8da5a223f26b029f44b962e807","chapter":{"id":"I","title":"学习信号与表示"},"unit":{"id":"i-use-and-evaluate","title":"怎样判断表示支持了哪种使用方式？"},"page":{"id":"reading-opening","title":"冻结读出与微调分别在问什么？","number":1},"sectionTitle":"冻结读出与微调分别在问什么？","currentQuestion":"冻结读出与微调分别在问什么？","sourceSlides":[],"knowledgeBlock":null,"formulas":[],"previousBlock":"b-d6b5a54f906e0be13bf7fff8","nextBlock":null,"prerequisites":[{"id":"b-b911634e31d02ccd9de8f9cf","url":"#b-b911634e31d02ccd9de8f9cf","role":"section-title"},{"id":"b-ba00c93153e1ec6be500f4ba","url":"#b-ba00c93153e1ec6be500f4ba","role":"problem-context"}],"relatedBlocks":[]}]}