Customed version of Google's tflite-micro
-
Updated
Jun 2, 2026 - C++
#
inference-embedded-engine
Here are 4 public repositories matching this topic...
Edge AI with cube:evk
machine-learning ai tensorflow inference cube v2x cits tflite npu edgeai inference-embedded-engine vxdelegate
-
Updated
Apr 27, 2026 - Python
Hardware probe and best-of-N sampling harness in C. Ranks GGUF quantisations against measured VRAM and RAM, drives Ollama or llama.cpp over OpenAI-format HTTP on localhost, and gates every candidate behind a static check and a test run.
ai inference inference-server ai-agents inference-engine inference-optimization inference-acceleration inference-api ai-model ai-tools ai-agent inference-embedded-engine inference-embedded-engine-models ai-coding inference-gateway inference-providers
-
Updated
Sep 15, 2026 - C
High-performance LLM inference platform with vLLM continuous batching achieving 12.3K+ req/sec, 42ms P50/178ms P99 latency, INT8/INT4 quantization (70% memory savings), tensor parallelism across 4 GPUs, and comprehensive monitoring serving 1500+ concurrent users.
-
Updated
May 17, 2026 - Python
Add this topic to your repo
To associate your repository with the inference-embedded-engine topic, visit your repo's landing page and select "manage topics."