<?xml version="1.0" encoding="utf-8" standalone="yes"?><rss version="2.0" xmlns:atom="http://www.w3.org/2005/Atom"><channel><title>RL on Matt Suiche</title><link>https://www.msuiche.com/tags/rl/</link><description>Recent content in RL on Matt Suiche</description><generator>Hugo</generator><language>en-us</language><lastBuildDate>Fri, 06 Nov 2026 12:00:00 +0100</lastBuildDate><atom:link href="https://www.msuiche.com/tags/rl/index.xml" rel="self" type="application/rss+xml"/><item><title>RLVR on Inkling 2 Small: Beating GLM-5.3-Flash in 60 Steps for $22</title><link>https://www.msuiche.com/posts/rlvr-on-inkling-2-small-beating-glm-5.3-flash-in-60-steps-for-22/</link><pubDate>Fri, 06 Nov 2026 12:00:00 +0100</pubDate><guid>https://www.msuiche.com/posts/rlvr-on-inkling-2-small-beating-glm-5.3-flash-in-60-steps-for-22/</guid><description>&lt;div class="rlvr-article"&gt;
&lt;p class="rlvr-kicker"&gt;RLVR field notes · Security work · November 2026&lt;/p&gt;
&lt;section class="rlvr-result" aria-label="Headline result"&gt;
 &lt;div class="rlvr-result-main"&gt;
 &lt;strong class="rlvr-result-value"&gt;0.708&lt;/strong&gt;
 &lt;span class="rlvr-result-label"&gt;pass@1 · 12-task exploit suite&lt;/span&gt;
 &lt;dl class="rlvr-result-facts"&gt;
 &lt;div&gt;&lt;dt&gt;vs best GLM arm&lt;/dt&gt;&lt;dd&gt;+27 pp&lt;/dd&gt;&lt;/div&gt;
 &lt;div&gt;&lt;dt&gt;Training&lt;/dt&gt;&lt;dd&gt;60 GRPO steps&lt;/dd&gt;&lt;/div&gt;
 &lt;div&gt;&lt;dt&gt;Training cost&lt;/dt&gt;&lt;dd&gt;$22&lt;/dd&gt;&lt;/div&gt;
 &lt;div&gt;&lt;dt&gt;Campaign&lt;/dt&gt;&lt;dd&gt;under $100&lt;/dd&gt;&lt;/div&gt;
 &lt;/dl&gt;
&lt;/section&gt;
&lt;p class="rlvr-deck"&gt;The same security-task RL experiment, run two ways: rented 8×H200 nodes versus a serverless training API. The benchmark, the cost ledger, and the case for open weights.&lt;/p&gt;
&lt;p&gt;Two months ago I built the only vLLM lane for &lt;a href="https://www.msuiche.com/posts/inkling-on-two-dgx-sparks-the-only-vllm-lane-and-the-two-walls-behind-it/" target="_blank" rel="noopener"&gt;Inkling-Small on two DGX
Sparks&lt;/a&gt;
and released the &lt;a href="https://huggingface.co/msuiche/Inkling-Small-abliterated-cyber-GLP-41" target="_blank" rel="noopener"&gt;GLP-41 steering
vectors&lt;/a&gt;.
The point of the two-node recipe was a &lt;strong&gt;local, open-weight US model&lt;/strong&gt; I
could inspect and steer myself, not another API dependency. Yesterday
Thinking Machines shipped
&lt;a href="https://thinkingmachines.ai/news/inkling-2-small/" target="_blank" rel="noopener"&gt;Inkling 2 Small&lt;/a&gt; - 594B
total parameters, 17B active, hybrid MoE - and per their
&lt;a href="https://thinkingmachines.ai/news/inkling-2-small/" target="_blank" rel="noopener"&gt;stated approach&lt;/a&gt; the
weights land under Apache 2.0 after external red-teaming completes, following
the path they outlined for a safe transition to open weights. Between those
two dates, my RL pipeline for security tasks went through a full generation
cycle: five GPU-rental training campaigns on GLM-5.3-Flash that cost roughly
$12,000 of metered GPU time, a sixth on DeepSeek-V4.1-Flash-1017 that burned
about $4,600 and never trained a single step, and then - this week - a
complete 60-step run on Inkling 2 Small that cost about $35.&lt;/p&gt;</description></item></channel></rss>