Repository navigation
Conversation
For native .litertlm, getMetadata() and chatTemplate() show the file-name family template that drives Dart-side parsing; the runtime renders it only for text-only Qwen3 requests and uses the bundle's embedded template otherwise. Refs #1836
This was referenced Nov 9, 2026
Merged
Owner
Author
|
Landed via batch integration PR #1843 (rebase merge), one commit per constituent. |
Contributor
|
Chat app preview removed for |
leehack
added a commit
that referenced
this pull request
Nov 9, 2026
* Raise the Apple companions' Flutter floor to 3.38.6 (#1834) (#1841) Squash of #1841 at 345ada9 against merge-base ec4bf4f. * Explain which chat template LiteRT-LM bundles render (#1836) (#1842) Squash of #1842 at 278b8db against merge-base ec4bf4f. * Record LiteRT-LM thinking as N/A for bundle templates that cannot think (#1833) Squash of #1833 at eda933e against merge-base ec4bf4f. * Pin Windows pending-delete removal for remove and prune (#1837) (#1839) Squash of #1839 at 403835b against merge-base b78008c. * Pin Chrome supervisor exit precedence and post-done wait (#1837 a-d) (#1840) Squash of #1840 at 73c66a0 against merge-base ec4bf4f. * Refuse LiteRT-LM GPU on Linux when every Vulkan device is software (#1831) Squash of #1831 at e51e76c against merge-base ec4bf4f. * Require the in-process LiteRT marker for Linux and Windows LiteRT-LM embeddings (#1830) Squash of #1830 at 0296fd5 against merge-base b78008c. Conflict resolutions: - website/docs/platforms/known-platform-issues.md, "## Linux and Windows", custom-runtime bullet tail and the Linux x64 GPU bullet (vs #1831): #1830's embeddings-marker paragraph replaces the legacy `v0.18.x` refusal paragraph, followed by #1831's rewritten Linux x64 software-Vulkan GPU bullet (replacing the old llvmpipe-crash bullet). * Prepare 0.19.1 release * State the desktop LiteRT-LM embeddings runtime floor for 0.19.1
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
.litertlm,getMetadata()andengine.chatTemplate(...)show the file-name family template that drives Dart-side format detection and parsing. The runtime renders that template only for text-only Qwen3 requests. Qwen3.5, Gemma and every request with media render the bundle's embedded template, so the native prompt can differ.website/docs/getting-started/model-families.md(the.litertlmbullet and the "To see what a model will receive" note) andskills/llamadart-tool-calling/SKILL.md.Production-readiness scope
chatTemplate()/metadata show for native LiteRT-LM bundles.Completeness checklist
PR type guidance
litert_lm_service.dart(useTextTemplate/promptTemplate) and theModelParams.chatTemplateDartdoc, and verified it on real bundles (Review Notes). The docs build and link check pass.Test Plan
dart run tool/prepare_workspace.dartdart format --output=none --set-exit-if-changed .(0 changed)dart analyze: N/A, Markdown-only diff (CI runs it)dart test -p vm -j 1 --exclude-tags local-only: N/A, ran the Markdown-selected suites instead (below)dart test -p chrome --exclude-tags local-only: N/A, docs-onlycoverage-libmatrix row whenlib/behavior changes: N/A, nolib/changedart test -p vm -j 1 $(cat tool/ci/markdown_test_suites.txt)(728 passed, includingpackage_skills_test.dart);./tool/docs/build_site.sh --port 18736(exit 0, link check passed)Matrix Evidence
docs-site./tool/docs/build_site.sh --port 18736exit 0 (the default port 8080 was taken locally)Review Notes
Qwen3.5-0.8B_int8.litertlm: metadata reports the Qwen3 template (hermes).chatTemplate([user 'hi'], enableThinking: true)ends in<|im_start|>assistant\n. The embedded template, which the runtime renders, always ends in<think>\n\n</think>\n\n.gemma-4-E2B-it.litertlm: the embedded template (11995 chars) differs from llamadart'sgemma4template (16430 chars).278b8dba7(32 pass, 9 skipped, 0 failed).High-risk regression review