Context
3LYTRA is a personal robot you drive and talk to from your phone over the internet. I built the robot software, its hardware integration, and the companion app, and shipped the app to the App Store and Google Play in January 2026.
What I built
- WebRTC remote control with end-to-end video, audio, and joystick control over the internet, using aiortc on the robot and react-native-webrtc in the app, with Firebase Realtime Database signaling and Metered TURN for NAT traversal.
- A real-time drive interface with dual-joystick tank control, live 30 fps MJPEG streaming, a servo gimbal, and bidirectional push-to-talk audio as 16 kHz PCM over WebSocket.
- BLE and WiFi onboarding: a custom BLE GATT peripheral built with bluezero for secure WiFi provisioning, plus mDNS discovery and token-based auth for local and remote fallback.
- An on-device LLM: Dockerized llama.cpp with CUDA on a Jetson Orin Nano, behind a FastAPI proxy with persistent per-user memory and a streaming chat endpoint.
- Computer vision: YOLO object detection and color-histogram tracking that power an interactive Hide and Seek game mode.
Results
- Launched on the App Store and Google Play in January 2026.
- Runs the language model and the vision models on the robot’s own hardware.