Repository navigation
docs(d3): FastFlowLM 1.0.11 -- images, 32,768 tokens, smoke test with an image - #833
Merged
Merged
Conversation
- models/d3.md: a four-command smoke test with the outputs a healthy install prints (taken from a run of this build). - instructions/server: `decision` is a model type; a "Decision Model (System One)" section with the launch commands, the models endpoint, and the NPU sharing caveat. - instructions/cli: `--decision`, server mode only. - models catalog page: Decision 3.0 (System One). Co-Authored-By: Claude <[email protected]>
… an image - Catalog: d3:lite needs FastFlowLM 1.0.11 (images, 32,768-token input, the NPU attention kernel and the vision bitstreams ship with it). - models/d3.md: 'FastFlowLM 1.0.11 or later'; the smoke test shows this release's outputs (ready line with 32768, /v1/systemone/models with modalities and image_max_pixels) and adds an image request (panda.png from this repo; shell and PowerShell). Outputs from a run of main's CI build b263087: panda 0.999, 404 input tokens, 0.42 s. - benchmarks/d3_results.md: 1.0.11; image accuracy on the Decision Index public vision suite (600 questions, 10 benchmarks: NPU 61.7% vs upstream BF16 60.2%, +1.50 pt, 95% CI -0.92 ... +3.92) and latency with and without an image from 512 to 32,000 input tokens. - instructions/server, cli: images, the input limit, the NPU hardware contexts the decision model takes. Co-Authored-By: Claude <[email protected]>
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Docs and catalog for d3:lite in FastFlowLM 1.0.11 (images, 32,768-token input; merged in #815, #816, #829).
src/model_list.json: d3:liteflm_min_version1.0.10 → 1.0.11.docs/docs/models/d3.md: "FastFlowLM 1.0.11 or later"; a smoke test with this release's outputs, now including animage request (
src/tb_files/panda.png; shell and PowerShell).docs/docs/benchmarks/d3_results.md: 1.0.11; image accuracy on the Decision Index public vision suite and latencywith and without an image up to 32,000 tokens.
docs/docs/instructions/server/index.md,cli.md: the--decisionlaunch method, images, the input limit and theNPU hardware contexts the decision model takes;
docs/models.md: catalog entry.Every output in the smoke test was taken from main's CI portable build (b263087):
flm pull d3:lite(10 files,0.78 GB, verified), the ready line,
/v1/systemone/models, the text request (returns 0.98, 112 ms) and the image request(panda 0.999, 404 input tokens, 0.42 s). The PowerShell variant was not run.
🤖 Generated with Claude Code