System integration · 2024
Mobile Manipulation & Language Interfaces
Connecting robot hardware, perception and task-level intelligence.
The platform
The integration work brings together a Franka Panda arm, a Continental mobile base, RealSense D435 and Livox Mid-360 sensing, computation, communication and control interfaces.
From instruction to execution
The software connects speech input and task decomposition with open-vocabulary detection, grasp proposals and physical execution. System work spans interface design, communication and practical debugging.
Research connection
This platform supports manipulation experiments and complements the long-horizon skill learning work: the learning project focuses on reusable task knowledge, while this project focuses on integrating the components needed to run it.