E39: with FPO++'s full square fine-tuning, FPO lifts the clone on every seed - short of the bar at 4.8M steps - #95

Merged

tactino merged 4 commits into

mainfrom

exp/e39-square-fpo-plus-plus

Sep 28, 2026

Commits on Sep 28, 2026

FPO++'s optimizer, gradient clipping, advantage normalisation and Huber CFM loss, as options
tactino
committed
bce0625
exp: E39 scripts - fpo-policy on square under FPO++'s full square fine-tuning (before the pilot)
tactino
committed
c6cb817
exp: pre-register E39 - fpo-policy on square under FPO++'s square fine-tuning in full
tactino
committed
5c6ccd7
exp: E39 results - FPO with FPO++'s full square fine-tuning lifts the clone on every seed, 1 of 3 past +0.2 at 4.8M steps
tactino
committed
26b7e4d