Coverage figure: sixteen cells, all learn - Gaussian square (E40), fpo-policy · FPO · square (E41), square plots success - #97
Merged
Conversation
…n declared as decided after E39
…o figure/square-gaussian-pi0
…square-gaussian-pi0
…plots the whole run
…M steps by E41, two of three seeds past the bar
… into figure/square-gaussian-pi0
…he bar, two of three seeds past it, all three down from their best
…d below the untrained 31, not 'barely moved'
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Stacked on #96 (E41): merge that first, and this diff shrinks to the figure files and the READMEs.
The coverage figure is now sixteen cells, and all sixteen learn.
gaussian-ppo-squareis new: DPPO's Gaussian MLP fine-tuned from its released checkpoint with DPPO's PPO settings (E40).fpo-fpo-squarelearns: E39 resumed to FPO++'s 8M steps by E41, two of three seeds past the bar. Its curve is E39's 100 iterations followed by E41's 67 (newresumed_fromincells.json), and its clip is E41's seed 1.rollout/success.pi0-policy · DPPO's note now says 20 of 50 is below the untrained 31 ("barely moved it" was wrong).The site PR that publishes this follows.