diff --git a/.gitignore b/.gitignore index 98dbeb4..8cc775b 100644 --- a/.gitignore +++ b/.gitignore @@ -1,3 +1,15 @@ +# Byte-compiled / optimized / test / notebook artifacts __pycache__/ *.py[cod] +*.pyc +.pytest_cache/ +.ipynb_checkpoints/ + +# Virtual environments & packaging .venv/ +build/ +dist/ +*.egg-info/ + +# Build targets +target/ diff --git a/README.md b/README.md index 9b017ba..a58216e 100644 --- a/README.md +++ b/README.md @@ -1,15 +1,18 @@ -
- Controlled infrastructure for studying iterative, model-guided candidate - generation, evaluation, and selection — with deterministic accounting. -
+# RSI Experimental Framework - +A controlled experimental testbed for AI researchers and engineers studying iterative candidate generation, evaluation, and selection with deterministic accounting. + +[](https://github.com/rustfuture/rsi-experimental-framework/actions/workflows/ci.yml) +[](LICENSE) +[](https://colab.research.google.com/github/rustfuture/rsi-experimental-framework/blob/main/notebooks/rsi_open_weight_colab.ipynb) + +**Status**: Research prototype / experimental harness (deterministic baseline validated; candidate lineage and held-out isolation verified; local LLM provider interface implemented; real-model self-improvement evidence not yet recorded). + +- **Iterative candidate search**: Generates, evaluates, and selects keyword-policy mutations over a fixed 32-sentence synthetic classification pool. +- **Strict validation gate**: Validates proposals via `validate_proposal` (single-token mutation, allowed vocabulary, disjoint polarities, bounded bias) before scoring. +- **Lineage tracking and regression rejection**: Records candidate parentage with immutable event IDs and rejects candidate mutations that cause dev-set accuracy regressions. +- **Held-out isolation**: Evaluates the held-out split strictly once post-selection, preventing test data leakage into candidate generation or selection. +- **Reproducible empirical accounting**: Produces byte-identical canonical artifacts (`first_run.json`, `history.jsonl`, `metrics.csv`, `progress.svg`) and numerically verified reports (`report.md`).At a Glance · @@ -20,8 +23,6 @@ Limitations
-Open-weight experiment notebook (optional GPU path)
- This repository tests one narrow question: > Can a fixed base model improve held-out task performance through iterative @@ -31,6 +32,7 @@ The framework provides a deterministic baseline, validated provider inputs, candidate lineage, held-out isolation, and reproducible artifacts. It makes no claim that this produces intelligence. + ## At a Glance | | |