Jelly-Flow! Through-Table Interaction (No Camera)

jellyflow

An invisible user interaction surface using an array of radio-frequency doppler sensors to capture the motion of a user’s arm and hand above a table. The 10GHz RF signal passes through obstructions like drywall and wood, enabling a camera-less, hidden-device surface. Demo at the MIT Media Lab Pavillion at Siggraph 2015. See here

The key piece behind this is a set of 4 HB100 RF motion detectors mounted underneath the table. Each one measures the velocity of objects which are in front of it by recording the doppler shift caused by moving reflectors. The transmitted frequency is 10.2 GHz, so the signal easily passes through the wooden table. The reflected signal is then mixed (multiplied) with the originally transmitted signal. Any velocity toward or away from the sensor will be captured as a <100Hz sinusoid, with faster movements resulting in higher frequency sine waves. Furthermore, the amplitude of the wave correlates with the distance of objects from the transmitter. This can be sampled by an ADC.

 

The 4 HB100’s are connected to an ADS1120 ADC/amplifier which is sampled via Matlab and connected to a game running in Unity. The files can be found below, and more details are to follow.

Zip file with matlab, arduino, and unity files: https://dl.dropboxusercontent.com/u/110033260/projects/blog_files/jelly_flow.zip

 

 

 

 

 

Advertisements

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s