{"version":2,"relationshipURLBase":"https://codingai-lec03.pages.dev/course/blocks/adaptation-scope-and-negative-result.html","relationshipResolution":"Resolve relative relationship URLs against relationshipURLBase; complete records and absolute URLs are in blocks.","title":"解冻更多参数，不保证更好","url":"https://codingai-lec03.pages.dev/course/blocks/adaptation-scope-and-negative-result.html","markdown":"https://codingai-lec03.pages.dev/course/blocks/adaptation-scope-and-negative-result.md","pages":[{"id":"reading-opening","title":"解冻更多参数，不保证更好","unit":"怎样判断表示支持了哪种使用方式？","unitId":"i-use-and-evaluate","chapter":"I","number":1}],"aliases":[{"oldId":"b-dfeb13640544ab3a1b8aec4a","targetId":"b-dfeb13640544ab3a1b8aec4a","page":"reading-opening","operation":"move","beforeSHA256":"f5cb3c3ffdd626d235c5a5f2d1ef03774650a41389b412904be5ed91f8c70231","afterSHA256":"f5cb3c3ffdd626d235c5a5f2d1ef03774650a41389b412904be5ed91f8c70231","reason":"Same source body in authored semantic page"},{"oldId":"b-aa5d2a4af04b04271754f344","targetId":"b-aa5d2a4af04b04271754f344","page":"reading-opening","operation":"move","beforeSHA256":"54cbe5d9c97cc6c6bacf77ce81460d0720d81671f6d484205fd796b01b0b0bbd","afterSHA256":"54cbe5d9c97cc6c6bacf77ce81460d0720d81671f6d484205fd796b01b0b0bbd","reason":"Same source body in authored semantic page"},{"oldId":"b-26b260acd33205901a4a1459","targetId":"b-26b260acd33205901a4a1459","page":"reading-opening","operation":"move","beforeSHA256":"1e251273badfddc47ff49a7a7de205d5a67f0ac0a8a7f192997585fd22737dc4","afterSHA256":"1e251273badfddc47ff49a7a7de205d5a67f0ac0a8a7f192997585fd22737dc4","reason":"Same source body in authored semantic page"},{"oldId":"b-0fd4be96f39505c8b9d99495","targetId":"b-0fd4be96f39505c8b9d99495","page":"reading-opening","operation":"move","beforeSHA256":"a5879223894e532f5d6752f8496bc1e65b69436ef72aa56362e3642249ec484b","afterSHA256":"a5879223894e532f5d6752f8496bc1e65b69436ef72aa56362e3642249ec484b","reason":"Same source body in authored semantic page"},{"oldId":"b-e99b9fbfc6fea1d51cb53f29","targetId":"b-e99b9fbfc6fea1d51cb53f29","page":"reading-opening","operation":"move","beforeSHA256":"393e153deb58af24c40e05420246665f58a55a9640a04cc5792c49c49ada9f90","afterSHA256":"393e153deb58af24c40e05420246665f58a55a9640a04cc5792c49c49ada9f90","reason":"Same source body in authored semantic page"},{"oldId":"b-78e9eb40c40bd81860bebb6b","targetId":"b-78e9eb40c40bd81860bebb6b","page":"reading-opening","operation":"move","beforeSHA256":"2b9ccef7e1220e2250cceff1abd8bdd736b42f8da5a223f26b029f44b962e807","afterSHA256":"2b9ccef7e1220e2250cceff1abd8bdd736b42f8da5a223f26b029f44b962e807","reason":"Same source body in authored semantic page"}],"blocks":[{"id":"b-dfeb13640544ab3a1b8aec4a","type":"h1","scope":"adaptation-scope-and-negative-result","url":"https://codingai-lec03.pages.dev/course/blocks/adaptation-scope-and-negative-result.html#b-dfeb13640544ab3a1b8aec4a","content":"# 解冻更多参数，不保证更好","sha256":"f5cb3c3ffdd626d235c5a5f2d1ef03774650a41389b412904be5ed91f8c70231","chapter":{"id":"I","title":"学习信号与表示"},"unit":{"id":"i-use-and-evaluate","title":"怎样判断表示支持了哪种使用方式？"},"page":{"id":"reading-opening","title":"解冻更多参数，不保证更好","number":1},"sectionTitle":"解冻更多参数，不保证更好","currentQuestion":"解冻更多参数，不保证更好","sourceSlides":[],"knowledgeBlock":null,"formulas":[],"previousBlock":null,"nextBlock":"b-aa5d2a4af04b04271754f344","prerequisites":[{"id":"b-aa5d2a4af04b04271754f344","url":"#b-aa5d2a4af04b04271754f344","role":"problem-context"}],"relatedBlocks":[]},{"id":"b-aa5d2a4af04b04271754f344","type":"p","scope":"adaptation-scope-and-negative-result","url":"https://codingai-lec03.pages.dev/course/blocks/adaptation-scope-and-negative-result.html#b-aa5d2a4af04b04271754f344","content":"把第一部分的方法转为使用与评价：冻结读出问现成表示，微调问适配起点，二者应各有协议。","sha256":"54cbe5d9c97cc6c6bacf77ce81460d0720d81671f6d484205fd796b01b0b0bbd","chapter":{"id":"I","title":"学习信号与表示"},"unit":{"id":"i-use-and-evaluate","title":"怎样判断表示支持了哪种使用方式？"},"page":{"id":"reading-opening","title":"解冻更多参数，不保证更好","number":1},"sectionTitle":"解冻更多参数，不保证更好","currentQuestion":"解冻更多参数，不保证更好","sourceSlides":[],"knowledgeBlock":null,"formulas":[],"previousBlock":"b-dfeb13640544ab3a1b8aec4a","nextBlock":"b-26b260acd33205901a4a1459","prerequisites":[{"id":"b-dfeb13640544ab3a1b8aec4a","url":"#b-dfeb13640544ab3a1b8aec4a","role":"section-title"}],"relatedBlocks":[]},{"id":"b-26b260acd33205901a4a1459","type":"p","scope":"adaptation-scope-and-negative-result","url":"https://codingai-lec03.pages.dev/course/blocks/adaptation-scope-and-negative-result.html#b-26b260acd33205901a4a1459","content":"LAB 02从同一十分类CNN出发比较head、late、all，并加入随机起点scratch。新任务仍是数字是否≥5；head只更新新头，late更新后部，all更新全网。三种迁移共享源checkpoint、新头初始化、数据顺序和训练轮数。","sha256":"1e251273badfddc47ff49a7a7de205d5a67f0ac0a8a7f192997585fd22737dc4","chapter":{"id":"I","title":"学习信号与表示"},"unit":{"id":"i-use-and-evaluate","title":"怎样判断表示支持了哪种使用方式？"},"page":{"id":"reading-opening","title":"解冻更多参数，不保证更好","number":1},"sectionTitle":"解冻更多参数，不保证更好","currentQuestion":"解冻更多参数，不保证更好","sourceSlides":[],"knowledgeBlock":null,"formulas":[],"previousBlock":"b-aa5d2a4af04b04271754f344","nextBlock":"b-0fd4be96f39505c8b9d99495","prerequisites":[{"id":"b-dfeb13640544ab3a1b8aec4a","url":"#b-dfeb13640544ab3a1b8aec4a","role":"section-title"},{"id":"b-aa5d2a4af04b04271754f344","url":"#b-aa5d2a4af04b04271754f344","role":"problem-context"}],"relatedBlocks":[]},{"id":"b-0fd4be96f39505c8b9d99495","type":"p","scope":"adaptation-scope-and-negative-result","url":"https://codingai-lec03.pages.dev/course/blocks/adaptation-scope-and-negative-result.html#b-0fd4be96f39505c8b9d99495","content":"已有默认协议是256训练、128验证、4轮、Adam学习率0.002。保存的最低验证交叉熵为head 1.906、late 0.877、all 0.849、scratch 0.611。按预先确定的“最低验证CE”规则，这一次应选择scratch，而不是因为课程在讲迁移就偏爱迁移模型。","sha256":"a5879223894e532f5d6752f8496bc1e65b69436ef72aa56362e3642249ec484b","chapter":{"id":"I","title":"学习信号与表示"},"unit":{"id":"i-use-and-evaluate","title":"怎样判断表示支持了哪种使用方式？"},"page":{"id":"reading-opening","title":"解冻更多参数，不保证更好","number":1},"sectionTitle":"解冻更多参数，不保证更好","currentQuestion":"解冻更多参数，不保证更好","sourceSlides":[],"knowledgeBlock":null,"formulas":[],"previousBlock":"b-26b260acd33205901a4a1459","nextBlock":"b-e99b9fbfc6fea1d51cb53f29","prerequisites":[{"id":"b-dfeb13640544ab3a1b8aec4a","url":"#b-dfeb13640544ab3a1b8aec4a","role":"section-title"},{"id":"b-aa5d2a4af04b04271754f344","url":"#b-aa5d2a4af04b04271754f344","role":"problem-context"}],"relatedBlocks":[]},{"id":"b-e99b9fbfc6fea1d51cb53f29","type":"p","scope":"adaptation-scope-and-negative-result","url":"https://codingai-lec03.pages.dev/course/blocks/adaptation-scope-and-negative-result.html#b-e99b9fbfc6fea1d51cb53f29","content":"这个负结果有教学价值：迁移是一种可检验起点优势，不是身份保证。相同轮数并不等算力，相同学习率也未必给每种范围公平的调优机会。可进一步只改标签预算或位移，再事先确定新的验证协议；不能反复看同一测试集直到挑出喜欢的结果。","sha256":"393e153deb58af24c40e05420246665f58a55a9640a04cc5792c49c49ada9f90","chapter":{"id":"I","title":"学习信号与表示"},"unit":{"id":"i-use-and-evaluate","title":"怎样判断表示支持了哪种使用方式？"},"page":{"id":"reading-opening","title":"解冻更多参数，不保证更好","number":1},"sectionTitle":"解冻更多参数，不保证更好","currentQuestion":"解冻更多参数，不保证更好","sourceSlides":[],"knowledgeBlock":null,"formulas":[],"previousBlock":"b-0fd4be96f39505c8b9d99495","nextBlock":"b-78e9eb40c40bd81860bebb6b","prerequisites":[{"id":"b-dfeb13640544ab3a1b8aec4a","url":"#b-dfeb13640544ab3a1b8aec4a","role":"section-title"},{"id":"b-aa5d2a4af04b04271754f344","url":"#b-aa5d2a4af04b04271754f344","role":"problem-context"}],"relatedBlocks":[]},{"id":"b-78e9eb40c40bd81860bebb6b","type":"h2","scope":"adaptation-scope-and-negative-result","url":"https://codingai-lec03.pages.dev/course/blocks/adaptation-scope-and-negative-result.html#b-78e9eb40c40bd81860bebb6b","content":"## 继续阅读与实验","sha256":"2b9ccef7e1220e2250cceff1abd8bdd736b42f8da5a223f26b029f44b962e807","chapter":{"id":"I","title":"学习信号与表示"},"unit":{"id":"i-use-and-evaluate","title":"怎样判断表示支持了哪种使用方式？"},"page":{"id":"reading-opening","title":"解冻更多参数，不保证更好","number":1},"sectionTitle":"解冻更多参数，不保证更好","currentQuestion":"解冻更多参数，不保证更好","sourceSlides":[],"knowledgeBlock":null,"formulas":[],"previousBlock":"b-e99b9fbfc6fea1d51cb53f29","nextBlock":null,"prerequisites":[{"id":"b-dfeb13640544ab3a1b8aec4a","url":"#b-dfeb13640544ab3a1b8aec4a","role":"section-title"},{"id":"b-aa5d2a4af04b04271754f344","url":"#b-aa5d2a4af04b04271754f344","role":"problem-context"}],"relatedBlocks":[]}]}
