Human context for
machine intelligence.

Desmo brings gaze, pupil and EMG signals together to help machines understand human attention and effort, learn from demonstrations, and work alongside people.

Desmo’s translucent glasses, showing the integrated cameras and electronics
Muscle activity8 × sEMG
01
02
03
04
05
06
07
08

More of what makes
an action human.

A camera can see the movement. Human signals add the attention, muscle activity and physiological response around it.

Attention

Where the eyes settle. What matters in a crowded scene.

Gaze · pupil response

Interaction

The reach, the contact, the release. An action in its surroundings.

Scene · motion · hand pose

Effort & response

Muscle activity and physiology. A path to the force behind the action.

sEMG · PPG · IMUs

Help the robot
follow the work.

We’re developing a context layer for cobots: what step a worker is on, where their attention goes, and when help could be useful.

The next part. Already in reach.

As a worker populates a circuit board, gaze helps locate the next insertion point on its pad map. The robot presents the matching component when the worker is ready. Reusable board recipes can reduce reaching, part errors and changeover time across small batches.

Discuss this workflow

Demonstrations with
the human context left in.

The scene tells you what happened. Gaze adds attention. Motion adds movement. Muscle activity opens a path to the effort a task takes.

Egocentric illustration of hands working on an electronic circuit board

What mattered

Attention registered against the scene.

How the action unfolded

Hands, motion and events on a shared timeline.

The effort behind it

sEMG and motion for exploring calibrated force estimates.

Explore the signals and outputs

Meet Desmo.

A connected wearable system. Each part brings a different view of the person doing the work.

Explore the hardware

Real Eyes Realize Faster

Gaze stability and pupil novelty for efficient egocentric learning.

Read the paper

What are you working on?

Bring a workcell, a demonstration task, or a question we haven’t thought of yet.

Discuss your workflow