Edge AI & Inference Economics · Creator of AnyLabeling (3.4k⭐)
I build AI that runs on real hardware, for real people, at low cost.
8+ years shipping production ML. First ML Lead at Scopic Software (USA, remote) since 2025. Previously: autonomous driving at VinAI, AI Core Platform at Samsung SDS (10-engineer team, 4 markets, 3 enterprise customers).
Open-source creator. 6,000+ GitHub stars across 25+ projects. Founder of Neural Research Lab.
Edge AI specialist. C++, NCNN, TensorRT, ONNX Runtime, llama.cpp. On-device deployment from Jetson Nano to RTX GPUs.
- Bulwark — Linux security scanner in Rust that also audits your AI coding assistants: API keys leaked into Claude Code / Cursor / Copilot transcripts, and agent config a prompt injection could turn into code execution. Plain-language findings, reversible one-click fixes, no telemetry. CLI + desktop app, scans a fleet over SSH.
- EdgeVox — Offline voice-agent framework for robots. ROS2-native STT/LLM/TTS pipeline, safety-first agent architecture. Shipping since early 2026.
- Nôm — Vietnamese-first AI toolkit (named after chữ Nôm). RAG over docs, diacritic restoration, OCR, segmentation, document parsing. Local-first, multi-backend (Ollama / llama.cpp / HF / OpenAI / Anthropic). Apache-2.0.
| Project | What | Signal |
|---|---|---|
| AnyLabeling | AI-assisted data labeling with SAM + YOLO | 3.4k⭐ · 340k+ downloads |
| Bulwark | Linux security + antivirus that audits AI coding assistants | 65 rules · Rust · Ubuntu PPA · Apache-2.0 |
| EdgeVox | Offline voice agents for robots | 11 releases · PyPI · ROS2 |
| Nôm | Vietnamese-first AI toolkit: RAG, diacritics, OCR, parsing | v0.2.37 on PyPI · Apache-2.0 · local-first |
| LlamaAssistant | Local LLM desktop assistant | 529⭐ · llama.cpp + RAG |
| DaisyKit | Cross-platform AI SDK | 324k+ PyPI downloads · starred by NCNN's author |
| OpenADAS | Driver-assistance on Jetson Nano | 494⭐ · NVIDIA Jetson Project of the Month |
| samexporter | SAM model → ONNX exporter | 419⭐ |
More projects: vietanh.dev/projects
- AWS Certified Machine Learning — Specialty (2025)
- NVIDIA Jetson Project of the Month — OpenADAS (2021)
- IEEE BigData 2023 publication — Active learning for object detection
- Samsung SDS Employee of the Year — AI Research Lab (2022)
- Blog: vietanh.dev — writing on AI security, agent sandboxes, edge inference
- Lab: nrl.ai — Neural Research Lab
- HuggingFace: @vietanhdev
- LinkedIn: vietanhdev
Based in Hanoi, Vietnam (UTC+7) · 2+ years async-first collaboration with US-based team · Open to technical conversations.