{"version":2,"relationshipURLBase":"https://codingai-lec03.pages.dev/course/blocks/temperature-ranking-probability-gradient.html","relationshipResolution":"Resolve relative relationship URLs against relationshipURLBase; complete records and absolute URLs are in blocks.","title":"温度改变什么，不改变什么？","url":"https://codingai-lec03.pages.dev/course/blocks/temperature-ranking-probability-gradient.html","markdown":"https://codingai-lec03.pages.dev/course/blocks/temperature-ranking-probability-gradient.md","pages":[{"id":"reading-opening","title":"温度改变什么，不改变什么？","unit":"视图关系怎样成为学习目标，又会牺牲什么？","unitId":"i-view-objective","chapter":"I","number":1}],"aliases":[{"oldId":"b-c01ed39ec974b5b36523f750","targetId":"b-c01ed39ec974b5b36523f750","page":"reading-opening","operation":"move","beforeSHA256":"07011a9eeebb09250b9337dc3250dda04d360e7403d9c76f5b618bd747c86a35","afterSHA256":"07011a9eeebb09250b9337dc3250dda04d360e7403d9c76f5b618bd747c86a35","reason":"Same source body in authored semantic page"},{"oldId":"b-3031c63dc63474e784d929a3","targetId":"b-3031c63dc63474e784d929a3","page":"reading-opening","operation":"move","beforeSHA256":"617994cb9e9eba93f0bf3265ec9ed81f11bc03c1613f1ad98c4222386b3673c8","afterSHA256":"617994cb9e9eba93f0bf3265ec9ed81f11bc03c1613f1ad98c4222386b3673c8","reason":"Same source body in authored semantic page"},{"oldId":"b-420668d2056d591d017e979b","targetId":"b-420668d2056d591d017e979b","page":"reading-opening","operation":"move","beforeSHA256":"30cc57f9cef9b262d68ee394cdfb0ddd4e5ef757bdb425bcbc1fc4968ba016bb","afterSHA256":"30cc57f9cef9b262d68ee394cdfb0ddd4e5ef757bdb425bcbc1fc4968ba016bb","reason":"Same source body in authored semantic page"},{"oldId":"b-58c7f830053c45a46f75f5e8","targetId":"b-58c7f830053c45a46f75f5e8","page":"reading-opening","operation":"move","beforeSHA256":"1e9027019191bb4ba57e8f3c872d28a368d09fd70037e9c0adb6ef60534b3811","afterSHA256":"1e9027019191bb4ba57e8f3c872d28a368d09fd70037e9c0adb6ef60534b3811","reason":"Same source body in authored semantic page"},{"oldId":"b-f0b6090a9c35d962f4d76413","targetId":"b-f0b6090a9c35d962f4d76413","page":"reading-opening","operation":"move","beforeSHA256":"9b9e97f7402a68932626b81e3fa3ebc2d15b582b7062edb8dabee3c6e5b37f87","afterSHA256":"9b9e97f7402a68932626b81e3fa3ebc2d15b582b7062edb8dabee3c6e5b37f87","reason":"Same source body in authored semantic page"},{"oldId":"b-fa8b69d119a33babc3721c1d","targetId":"b-fa8b69d119a33babc3721c1d","page":"reading-opening","operation":"move","beforeSHA256":"2b9ccef7e1220e2250cceff1abd8bdd736b42f8da5a223f26b029f44b962e807","afterSHA256":"2b9ccef7e1220e2250cceff1abd8bdd736b42f8da5a223f26b029f44b962e807","reason":"Same source body in authored semantic page"}],"blocks":[{"id":"b-c01ed39ec974b5b36523f750","type":"h1","scope":"temperature-ranking-probability-gradient","url":"https://codingai-lec03.pages.dev/course/blocks/temperature-ranking-probability-gradient.html#b-c01ed39ec974b5b36523f750","content":"# 温度改变什么，不改变什么？","sha256":"07011a9eeebb09250b9337dc3250dda04d360e7403d9c76f5b618bd747c86a35","chapter":{"id":"I","title":"学习信号与表示"},"unit":{"id":"i-view-objective","title":"视图关系怎样成为学习目标，又会牺牲什么？"},"page":{"id":"reading-opening","title":"温度改变什么，不改变什么？","number":1},"sectionTitle":"温度改变什么，不改变什么？","currentQuestion":"温度改变什么，不改变什么？","sourceSlides":[],"knowledgeBlock":null,"formulas":[],"previousBlock":null,"nextBlock":"b-3031c63dc63474e784d929a3","prerequisites":[{"id":"b-3031c63dc63474e784d929a3","url":"#b-3031c63dc63474e784d929a3","role":"problem-context"}],"relatedBlocks":[]},{"id":"b-3031c63dc63474e784d929a3","type":"p","scope":"temperature-ranking-probability-gradient","url":"https://codingai-lec03.pages.dev/course/blocks/temperature-ranking-probability-gradient.html#b-3031c63dc63474e784d929a3","content":"这一页把相似关系变成可优化的概率与损失。分数、温度、softmax和负对数必须能对上同一组数。","sha256":"617994cb9e9eba93f0bf3265ec9ed81f11bc03c1613f1ad98c4222386b3673c8","chapter":{"id":"I","title":"学习信号与表示"},"unit":{"id":"i-view-objective","title":"视图关系怎样成为学习目标，又会牺牲什么？"},"page":{"id":"reading-opening","title":"温度改变什么，不改变什么？","number":1},"sectionTitle":"温度改变什么，不改变什么？","currentQuestion":"温度改变什么，不改变什么？","sourceSlides":[],"knowledgeBlock":null,"formulas":[],"previousBlock":"b-c01ed39ec974b5b36523f750","nextBlock":"b-420668d2056d591d017e979b","prerequisites":[{"id":"b-c01ed39ec974b5b36523f750","url":"#b-c01ed39ec974b5b36523f750","role":"section-title"}],"relatedBlocks":[]},{"id":"b-420668d2056d591d017e979b","type":"p","scope":"temperature-ranking-probability-gradient","url":"https://codingai-lec03.pages.dev/course/blocks/temperature-ranking-probability-gradient.html#b-420668d2056d591d017e979b","content":"固定相似度为 $(0.8,0.4,0.2)$，第一项是正例。温度1、0.5、0.1时，正例概率分别约0.4506、0.5713、0.9796。排序完全不变，但概率越来越集中。若正例分数低于最强负例，低温度也会更尖锐地放大错误选择。","sha256":"30cc57f9cef9b262d68ee394cdfb0ddd4e5ef757bdb425bcbc1fc4968ba016bb","chapter":{"id":"I","title":"学习信号与表示"},"unit":{"id":"i-view-objective","title":"视图关系怎样成为学习目标，又会牺牲什么？"},"page":{"id":"reading-opening","title":"温度改变什么，不改变什么？","number":1},"sectionTitle":"温度改变什么，不改变什么？","currentQuestion":"温度改变什么，不改变什么？","sourceSlides":[],"knowledgeBlock":null,"formulas":[{"latex":"(0.8,0.4,0.2)","definitionContext":"温度改变什么，不改变什么？"}],"previousBlock":"b-3031c63dc63474e784d929a3","nextBlock":"b-58c7f830053c45a46f75f5e8","prerequisites":[{"id":"b-c01ed39ec974b5b36523f750","url":"#b-c01ed39ec974b5b36523f750","role":"section-title"},{"id":"b-3031c63dc63474e784d929a3","url":"#b-3031c63dc63474e784d929a3","role":"problem-context"}],"relatedBlocks":[]},{"id":"b-58c7f830053c45a46f75f5e8","type":"p","scope":"temperature-ranking-probability-gradient","url":"https://codingai-lec03.pages.dev/course/blocks/temperature-ranking-probability-gradient.html#b-58c7f830053c45a46f75f5e8","content":"梯度能解释其作用：$\\partial L/\\partial s_+=(p_+-1)/\\tau$，负例为 $p_j/\\tau$。温度既改变分母中的尺度，也改变概率。因此“温度越低，梯度越大”并不总成立：正例已经几乎确定时，$1-p_+$也会接近零。","sha256":"1e9027019191bb4ba57e8f3c872d28a368d09fd70037e9c0adb6ef60534b3811","chapter":{"id":"I","title":"学习信号与表示"},"unit":{"id":"i-view-objective","title":"视图关系怎样成为学习目标，又会牺牲什么？"},"page":{"id":"reading-opening","title":"温度改变什么，不改变什么？","number":1},"sectionTitle":"温度改变什么，不改变什么？","currentQuestion":"温度改变什么，不改变什么？","sourceSlides":[],"knowledgeBlock":null,"formulas":[{"latex":"\\partial L/\\partial s_+=(p_+-1)/\\tau","definitionContext":"温度改变什么，不改变什么？"},{"latex":"p_j/\\tau","definitionContext":"温度改变什么，不改变什么？"},{"latex":"1-p_+","definitionContext":"温度改变什么，不改变什么？"}],"previousBlock":"b-420668d2056d591d017e979b","nextBlock":"b-f0b6090a9c35d962f4d76413","prerequisites":[{"id":"b-c01ed39ec974b5b36523f750","url":"#b-c01ed39ec974b5b36523f750","role":"section-title"},{"id":"b-3031c63dc63474e784d929a3","url":"#b-3031c63dc63474e784d929a3","role":"problem-context"}],"relatedBlocks":[]},{"id":"b-f0b6090a9c35d962f4d76413","type":"p","scope":"temperature-ranking-probability-gradient","url":"https://codingai-lec03.pages.dev/course/blocks/temperature-ranking-probability-gradient.html#b-f0b6090a9c35d962f4d76413","content":"把温度调低造成的loss下降，不能当作表示已经改善。温度是训练条件，最终仍用固定读出协议评价。课堂上可以让学生先预测哪一项概率增加，再计算；避免同时改相似度、候选数和温度，使原因无法辨认。","sha256":"9b9e97f7402a68932626b81e3fa3ebc2d15b582b7062edb8dabee3c6e5b37f87","chapter":{"id":"I","title":"学习信号与表示"},"unit":{"id":"i-view-objective","title":"视图关系怎样成为学习目标，又会牺牲什么？"},"page":{"id":"reading-opening","title":"温度改变什么，不改变什么？","number":1},"sectionTitle":"温度改变什么，不改变什么？","currentQuestion":"温度改变什么，不改变什么？","sourceSlides":[],"knowledgeBlock":null,"formulas":[],"previousBlock":"b-58c7f830053c45a46f75f5e8","nextBlock":"b-fa8b69d119a33babc3721c1d","prerequisites":[{"id":"b-c01ed39ec974b5b36523f750","url":"#b-c01ed39ec974b5b36523f750","role":"section-title"},{"id":"b-3031c63dc63474e784d929a3","url":"#b-3031c63dc63474e784d929a3","role":"problem-context"}],"relatedBlocks":[]},{"id":"b-fa8b69d119a33babc3721c1d","type":"h2","scope":"temperature-ranking-probability-gradient","url":"https://codingai-lec03.pages.dev/course/blocks/temperature-ranking-probability-gradient.html#b-fa8b69d119a33babc3721c1d","content":"## 继续阅读与实验","sha256":"2b9ccef7e1220e2250cceff1abd8bdd736b42f8da5a223f26b029f44b962e807","chapter":{"id":"I","title":"学习信号与表示"},"unit":{"id":"i-view-objective","title":"视图关系怎样成为学习目标，又会牺牲什么？"},"page":{"id":"reading-opening","title":"温度改变什么，不改变什么？","number":1},"sectionTitle":"温度改变什么，不改变什么？","currentQuestion":"温度改变什么，不改变什么？","sourceSlides":[],"knowledgeBlock":null,"formulas":[],"previousBlock":"b-f0b6090a9c35d962f4d76413","nextBlock":null,"prerequisites":[{"id":"b-c01ed39ec974b5b36523f750","url":"#b-c01ed39ec974b5b36523f750","role":"section-title"},{"id":"b-3031c63dc63474e784d929a3","url":"#b-3031c63dc63474e784d929a3","role":"problem-context"}],"relatedBlocks":[]}]}