<rss xmlns:atom="http://www.w3.org/2005/Atom" version="2.0">
    <channel>
        <title>Reading-Note/LLM - 标签 - vllbc02&#39;s blogs</title>
        <link>https://blog.vllbc.top/tags/reading-note/llm/</link>
        <description>Reading-Note/LLM - 标签 - vllbc02&#39;s blogs</description>
        <generator>Hugo -- gohugo.io</generator><language>zh-CN</language><copyright>This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.</copyright><lastBuildDate>Mon, 17 Aug 2026 00:00:00 &#43;0000</lastBuildDate><atom:link href="https://blog.vllbc.top/tags/reading-note/llm/" rel="self" type="application/rss+xml" /><item>
    <title>GLM-5.3 阅读笔记 — 后训练 scaling、SAO 算法与 Slime 框架</title>
    <link>https://blog.vllbc.top/glm-5.3-%E5%90%8E%E8%AE%AD%E7%BB%83scaling%E4%B8%8Esao%E7%AE%97%E6%B3%95/</link>
    <pubDate>Mon, 17 Aug 2026 00:00:00 &#43;0000</pubDate>
    <author>知乎专栏《deep research》</author>
    <guid>https://blog.vllbc.top/glm-5.3-%E5%90%8E%E8%AE%AD%E7%BB%83scaling%E4%B8%8Esao%E7%AE%97%E6%B3%95/</guid>
    <description><![CDATA[<h1 id="glm-53--后训练-scaling-与-sao-算法">GLM-5.3 — 后训练 scaling 与 SAO 算法</h1>
<blockquote>
<p>[!info] TL;DR
<strong>核心思想</strong>：复用基座，把资源堆到<strong>后训练</strong>上。GLM-5.3 的全部提升（自研 Z.ai Code Bench +50%）来自后训练 pipeline 的三处扩展——<strong>算法</strong>（SAO 单轨迹异步 RL 替代 GRPO）、<strong>框架</strong>（Slime 异步训练框架）、<strong>环境</strong>（百万级可执行 sandbox）。</p>]]></description>
</item>
<item>
    <title>SFT、RL 与 OPD：从分布视角理解后训练</title>
    <link>https://blog.vllbc.top/sftrl-%E4%B8%8E-opd%E5%88%86%E5%B8%83%E8%A7%86%E8%A7%92/</link>
    <pubDate>Mon, 03 Aug 2026 00:00:00 &#43;0000</pubDate>
    <author>wh.</author>
    <guid>https://blog.vllbc.top/sftrl-%E4%B8%8E-opd%E5%88%86%E5%B8%83%E8%A7%86%E8%A7%92/</guid>
    <description><![CDATA[<h1 id="sftrl-与-opd从分布视角理解后训练">SFT、RL 与 OPD：从分布视角理解后训练</h1>
<blockquote>
<p>[!info] TL;DR
<strong>核心思想</strong>：把语言模型看成序列分布，post-training 就是在重塑这个分布。SFT 追随固定的外部数据分布，RL 从当前策略采样并用奖励筛选，OPD 在学生自己的状态上匹配 teacher 分布。</p>]]></description>
</item>
</channel>
</rss>
