FastCrest Tether
Deployment confidence for vision-language-action robot policies: optimize a model for the target hardware, verify it still matches the reference policy, and produce evidence that it is safe to promote.
Buyer / user
Robotics and embodied-AI engineers moving VLA policies from PyTorch research code onto Jetson, RTX, Apple Silicon, AMD, ROS 2, and production serving infrastructure.
The hard problem
A policy can export successfully and still be wrong, slow, incompatible with the device, or operationally unsafe. Existing tools fragment export, runtime selection, parity checks, rollout evidence, and rollback.
Core operating loop
- 1Inspect hardware, Python, CUDA, TensorRT, providers, and model compatibility.
- 2Export monolithic ONNX graphs and choose the best available runtime path.
- 3Prove reference-vs-optimized parity with seeded inputs and numerical receipts.
- 4Benchmark latency, promote a proof packet, and retain rollback/reproduction evidence.
Evidence / shipped depth
- 75 GitHub stars and 17 forks on the public repository.
- End-to-end cosine parity +1.000000 on SmolVLA, π0, π0.5, and GR00T N1.6.
- Measured 19.49 ms TensorRT vs 108.11 ms ORT-CUDA on SmolVLA/A10G: 5.55×.
- Fast-kernel gate: 91.3% vs 85.3% native ORT across 600 LIBERO episodes.
- PyPI distribution, clean-install bootstrap, ZMQ transport, ROS 2 starter adapters.