Design World

  • Home
  • Technologies
    • ELECTRONICS • ELECTRICAL
    • Fastening • joining
    • FLUID POWER
    • LINEAR MOTION
    • MOTION CONTROL
    • SENSORS
    • TEST & MEASUREMENT
    • Factory automation
    • Warehouse automation
    • DIGITAL TRANSFORMATION
  • Learn
    • Tech Toolboxes
    • Learning center
    • eBooks • Tech Tips
    • Podcasts
    • Videos
    • Webinars • general engineering
    • Webinars • Automated warehousing
    • Voices
  • LEAP Awards
  • 2025 Leadership
    • 2024 Winners
    • 2023 Winners
    • 2022 Winners
    • 2021 Winners
  • Design Guides
  • Resources
    • Subscribe
    • 3D Cad Models
      • PARTsolutions
      • TraceParts
    • Digital Issues
      • Design World
      • EE World
    • Engineering diversity
    • Trends
  • Supplier Listings
  • Advertise
  • Subscribe

Turning the Human Hand into a User Interface

By Kaylie Duffy | September 10, 2015

Project Soli aims to turn hands and fingers into virtual dials and touchpads. (All image credit: Google ATAP)

Google’s Advanced Technology and Projects (ATAP) group is tasked with developing new mobile computing and communication technology.

The projects at ATAP exist at the intersection of ambitious science and a precise, use-inspired application. One such project plans to turn the human hand into a versatile user interface.

Project Soli is a gesture radar small enough to fit in a wearable device that captures the motions of fingers and hands at resolutions and speeds of up to 10,000 frames per second – essentially turning a hand into a virtual dial or touchpad.

“Our hands are very fast and precise instruments, but we’re still not able to capture this sensitivity and accuracy in our current user interfaces,” explains Ivan Poupyrev, Project Soli technical project lead. “There’s a natural vocabulary of hand movements we’ve learned from using familiar tools, like knobs, dials, sliders, and even smartphone touchscreens – and we wanted to explore using these fast and precise motions in touchless gesture control of various other devices.”

Improving Gesture-Sensing Technology

Project Soli’s ultimate goal is to take the human hand’s finesse and apply it to the virtual world. In order to turn hands into complete, self-contained interface controls, ATAP needed a sensor that could capture sub-millimeter motions of overlapping fingers in 3D space.

“Radar fit all of these requirements, but it was a little … big,” says Poupyrev. “With Project Soli, we created the first gesture radar small enough to fit into a wearable device.”

Fundamentally, the team has created a new interaction sensor category, which uses 60 GHz electromagnetic waves that can capture finger motions at resolutions and speeds that, until now, have been unattainable.

Project Soli’s radar chip can capture hand motions at resolutions and speeds up to 10,000 frames per second.

ATAP has been able to collect radar data at 10,000 frames per second between distances of 5 mm and 100 cm, which allows for incredibly precise and responsive interactions. The gesture radar sensor is also able to run on low-power ARM Cortex-A7 chips that are commonly used in smart watches.

Traditional radar bounces a signal from an object and provides a single return. Using this technique to capture complex moving shapes (e.g. the human hand) at close distances would require scanning the signal in X and Y directions, which would have been very challenging to recreate at such a small scale, from a hardware and computation perspective.

“To capture the complexity of hand movements at close range, we illuminate the whole hand with a broad beam, using a modulated radio signal at a high frequency, and measure return signals reflected by the hand,” explains Poupyrev. “By using complex signal processing techniques we can extract signal components that characterize the specific properties of motions of the human hand.”

The extracted characteristics are then classified using machine learning algorithms, allowing the researchers to recognize complex interactions, hand gestures, and micro-motions.

An Ambitious Prototype

The team built its prototype – a 5 x 5 mm piece of silicon packaged with antennas into a 12 x 12 mm IC – in just 10 months. “We’re working on finalizing the development board and software API that we’re planning to release to developers later this year,” says Poupyrev.

All projects at ATAP are slated to last for two years, and because Project Soli is only about one year into development, there is still a lot of information the researchers are unable to share. That being said, the team has already overcome multiple obstacles.

“This is an ambitious project, and there are many aspects of the technology that are difficult. One example is shrinking a radar into a 5 x 5 mm piece of silicon,” says Poupyrev. “Developing a software pipeline for gesture tracking using an RF signal was also very challenging because it had not been done before; therefore, we had to invent gesture tracking algorithms from scratch.”

The gesture sensing technology can also work in any lighting conditions as well as complete darkness. “[It] can even be embedded into devices and work through materials such as glass,” adds Poupyrev. “It’s very small and potentially inexpensive.”

Project Soli is still in the development phase, making it too early to speculate when the gesture technology will enter the market. However, Project Soli demonstrates new gesture sensor technologies for wearables, mobile devices, as well as the Internet of Things.

                                                                                                                                                                       

This article originally appeared in the September 2015 print edition of PD&D.


Filed Under: Rapid prototyping

 

LEARNING CENTER

Design World Learning Center
“dw
EXPAND YOUR KNOWLEDGE AND STAY CONNECTED
Get the latest info on technologies, tools and strategies for Design Engineering Professionals.

Design World Digital Edition

cover

Browse the most current issue of Design World and back issues in an easy to use high quality format. Clip, share and download with the leading design engineering magazine today.

EDABoard the Forum for Electronics

Top global problem solving EE forum covering Microcontrollers, DSP, Networking, Analog and Digital Design, RF, Power Electronics, PCB Routing and much more

EDABoard: Forum for electronics

Sponsored Content

  • Sustainability, Innovation and Safety, Central to Our Approach
  • Why off-highway is the sweet spot for AC electrification technology
  • Looking to 2025: Past Success Guides Future Achievements
  • North American Companies Seek Stronger Ties with Italian OEMs
  • Adapt and Evolve
  • Sustainable Practices for a Sustainable World
View More >>
Engineering Exchange

The Engineering Exchange is a global educational networking community for engineers.

Connect, share, and learn today »

Design World
  • About us
  • Contact
  • Manage your Design World Subscription
  • Subscribe
  • Design World Digital Network
  • Control Engineering
  • Consulting-Specifying Engineer
  • Plant Engineering
  • Engineering White Papers
  • Leap Awards

Copyright © 2025 WTWH Media LLC. All Rights Reserved. The material on this site may not be reproduced, distributed, transmitted, cached or otherwise used, except with the prior written permission of WTWH Media
Privacy Policy | Advertising | About Us

Search Design World

  • Home
  • Technologies
    • ELECTRONICS • ELECTRICAL
    • Fastening • joining
    • FLUID POWER
    • LINEAR MOTION
    • MOTION CONTROL
    • SENSORS
    • TEST & MEASUREMENT
    • Factory automation
    • Warehouse automation
    • DIGITAL TRANSFORMATION
  • Learn
    • Tech Toolboxes
    • Learning center
    • eBooks • Tech Tips
    • Podcasts
    • Videos
    • Webinars • general engineering
    • Webinars • Automated warehousing
    • Voices
  • LEAP Awards
  • 2025 Leadership
    • 2024 Winners
    • 2023 Winners
    • 2022 Winners
    • 2021 Winners
  • Design Guides
  • Resources
    • Subscribe
    • 3D Cad Models
      • PARTsolutions
      • TraceParts
    • Digital Issues
      • Design World
      • EE World
    • Engineering diversity
    • Trends
  • Supplier Listings
  • Advertise
  • Subscribe
We use cookies to personalize content and ads, to provide social media features, and to analyze our traffic. We share information about your use of our site with our social media, advertising, and analytics partners who may combine it with other information you’ve provided to them or that they’ve collected from your use of their services. You consent to our cookies if you continue to use this website.OkNoRead more