AI software engineer working on inference engineering, model optimization, and edge AI for robotics: making capable models run fast on real hardware.
/\ /\
/ \__/ \
/ O O \
| ︶ |
| \____/ |
\ ~~~~~~ /
\________/
vla.cpp: Vision-Language-Action models on local hardware, in the spirit ofllama.cpp.vla.simd: Efficient CPU inference for language-conditioned manipulation - SIMD micro-kernels (AVX2 / NEON) running 30+ actions per second on a Raspberry Pi 5.ggml-compiler: Compiles PyTorch and ONNX models into ggml programs for CPU and CUDA inference without Python.- XPU Arch: Architecture diagrams of CPUs, GPUs, NPUs, and SoCs, from core clusters and caches down to register files.
- VLA Arch: Architecture diagrams of Vision-Language-Action policies supported by vla.cpp and vla.simd, drawn from their C++ forward passes.
- VLA Hub: Explore measured latency and memory usage of Vision-Language-Action models across hardware using
vla.cppandvla.simd.


