TAN RUNJIAARMINE · ROBOTICS & EMBODIED AI
← ALL PROJECTS

ICRA 2026 · CO-FIRST AUTHOR

Vision-Servoed Microdevice Injection.

Automating microscale device placement with visual feedback and accessible laboratory hardware.

Research focus
Precision manipulation
Approach
Closed-loop visual feedback
Validation
Tissue-mimicking agarose samples

01 · THE SYSTEM

Precision through vision

Placing a tiny implantable device requires coordinated motion at a scale that is difficult to handle manually. This work brings cameras, micromanipulators and an injector together into an automated laboratory system built with commercial off-the-shelf components.

Optical-table setup with contextual cameras, a stereoscope-mounted camera, two micromanipulators and a nano injector.
System layout from manuscript Figure 2. Three contextual cameras cover the workspace, while the stereoscope camera provides a close view of the target. Full-size figure ↗

See at two scales

Three contextual cameras guide motion across the workspace. A fixed-field stereoscope view supports focusing, centering and final alignment.

Close the loop visually

The two micromanipulators move the sample and injector. Their control interface does not provide direct position readback, so the system uses visual feedback to guide motion.

Make the target readable

A custom biocompatible, 3D-printed holder supports the sample and provides visible features for locating its center.

02 · THE WORKFLOW

From coarse positioning to controlled delivery

After the operator places the prepared sample holder on the stage, four stages progressively align the sample and the device-loaded pipette.

Four stages of the visual pipeline: coarse positioning, autofocus, centering and injection.
The automated pipeline, from manuscript Figure 1. Full-size figure ↗
  1. Position the stage

    Contextual camera views and ArUco markers estimate the stage pose and move the holder into the stereoscope’s field of view.

  2. Find the focus

    The system adjusts the sample position using image feedback to bring it into focus without motorized microscope zoom or focus.

  3. Center the sample

    Features on the sample holder are matched to estimate its center, then aligned with the camera view.

  4. Align and deliver

    Object detection and segmentation locate the pipette tip and gel. Visual contact detection stops the approach, then the nano injector advances the device with a silver wire.

03 · UNDER THE MICROSCOPE

Delivering a MOTE into agarose

A microscale optoelectronic tetherless electrode (MOTE) is loaded into a pulled glass pipette and delivered into a tissue-mimicking agarose sample. The sequence below shows the injection and subsequent withdrawal steps.

MOTE delivery into agarose, followed by retraction of the silver wire and withdrawal of the glass pipette, with microscopic views of the implanted device.
An example from manuscript Figure 7: delivery, wire retraction and pipette withdrawal. The 100× and 200× microscope views show the implanted device; the 200× view uses depth composition. Full-size figure ↗

Under optical illumination, the implanted MOTE emitted the expected pulses during the post-injection check. This confirms that the device remained functional in the gel; the experiment does not record biological neural signals.

04 · EVALUATION

Less operating time, stage by stage

47.2%Lower operating time than the experienced-user manual reference reported in the study

The study reports 30 automated injection trials using two MOTEs, alternated and reused after each injection.

The average times below sum to 158.2 seconds, or about 2.6 minutes. The paper compares this with an experienced user’s manual procedure of approximately five minutes.

Average stage times · manuscript Table I
StageTime (seconds)
Stage alignment30.5
Autofocus24.2
Centering56.3
Injection47.2
Sum of reported stage averages158.2

What has been demonstrated

The system was also demonstrated with a 008004 surface-mount capacitor measuring 250 × 125 × 125 µm. The experiments use tissue-mimicking agarose, and loading devices into the pipette still requires preparation. The reported time reduction is an efficiency result, not an injection success rate.

PUBLICATION

Read the research

ICRA 2026

An Autonomous and Hardware-Agnostic Vision-Servoed System for Microdevice Injection

Yumin Zheng†, Runjia Tan†, Rui Jiao, Sunwoo Lee

† Equal contribution. The official ICRA 2026 title is shown above; figures and detailed results follow the research manuscript.