Skip to content

docs: attribute the vendored chat templates and container profiles - #644

Merged
ion-alpha-dev merged 2 commits into
mainfrom
docs/notice-third-party-files
Nov 1, 2026
Merged

ion-alpha-dev merged 2 commits into
mainfrom
docs/notice-third-party-files

Conversation

@ion-alpha-dev

Copy link
Copy Markdown
Collaborator

What

NOTICE now attributes the third-party files Flynn ships: the gpt-oss and Gemma 4 chat templates, and the seccomp and AppArmor profiles derived from moby/profiles. The template variables record the upstream revision each was taken from, and a new test pins each template to its publisher's SHA-256. The watch package comment now describes the ai! / ai? marker syntax directly.

Why

All four files are Apache-2.0, which asks redistributors to keep the attribution with the work. Until now NOTICE listed only the Chroma lexers. The digest test keeps the statement "copied unchanged" true: an in-place edit to a template fails CI instead of quietly serving a prompt format that differs from the one the model was trained on.

How to verify

  • go test ./internal/inference/launch -run TestEmbeddedTemplatesAreThePublishersOwn
  • Append a byte to either .jinja file and the test fails.
  • The digests match the current chat_template.jinja in openai/gpt-oss-20b (revision 6cee5e8) and google/gemma-4-12B-it (revision 43c9d01). Both repos are tagged apache-2.0 on Hugging Face.

Notes for reviewers

  • Template behaviour is unchanged; only comments, NOTICE and a test change.
  • The moby/profiles commit stays pinned in dev/container-profiles. NOTICE points there instead of repeating it.

@codecov

codecov Bot commented Oct 31, 2026

Copy link
Copy Markdown

Codecov Report

✅ All modified and coverable lines are covered by tests.

📢 Thoughts on this report? Let us know!

@ion-alpha-dev

Copy link
Copy Markdown
Collaborator Author

Review: the paths are correct, and so is the moby/profiles Apache-2.0 attribution with its upstream pin. Three things before merge:

  1. The Gemma 4 licence line has to be checked against Google's own model card or licence page, not a secondary source. One source mentions supplemental terms. Link the primary source in the NOTICE entry or the PR body.
  2. The gemma4 template comment gives gemma-4-12B-it for the revision and the -qat-q4_0-gguf repo for the embedded copy. Name one source, or say why there are two.
  3. Lines are too long at internal/inference/launch/template.go around line 37 and watch/marker.go around line 3.

go test -race ./internal/inference/launch/ ./watch/ passes locally.

NOTICE now names the third-party files Flynn ships beside the Chroma
lexers: the gpt-oss and Gemma 4 chat templates, copied unchanged from
the files OpenAI and Google publish on Hugging Face, and the seccomp
profile and AppArmor template derived from moby/profiles. All are
Apache-2.0.

The template variables record the upstream revision each file was
taken from, and a test holds each template to the SHA-256 of that
upstream file, so the "copied unchanged" statement fails CI rather
than going stale if a template is edited in place.

The watch package comment describes the ai! and ai? marker syntax
directly.

Signed-off-by: Ion Alpha <[email protected]>
The Gemma 4 model card (google/gemma-4-12B-it) declares apache-2.0 and
links the Gemma 4 licence page, which is the unmodified Apache 2.0
text. The Gemma Terms of Use scope lists only earlier models. NOTICE
now says so, so the template and the weights are under the same terms.

The gemma4 template comment named the -qat-q4_0-gguf repository as
well as the 12B-it repository. The file is byte for byte the
chat_template.jinja at the recorded 12B-it revision (sha256 verified),
so the comment names that one source.

Also wrap two over-long comment lines.

Signed-off-by: Ion Alpha <[email protected]>
@ion-alpha-dev
ion-alpha-dev force-pushed the docs/notice-third-party-files branch from 0585e65 to fd11f39 Compare November 1, 2026 09:01
@ion-alpha-dev
ion-alpha-dev merged commit bb4ff6f into main Nov 1, 2026
32 checks passed
@ion-alpha-dev
ion-alpha-dev deleted the docs/notice-third-party-files branch November 1, 2026 09:21
@github-actions github-actions Bot locked and limited conversation to collaborators Nov 1, 2026
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant