Controlling Your Car With Gestures

The use case involved swiping your hand to receive or cancel calls with a SmartWatch as the device for gesture recognition. The information would be sent directly to the car.

We created a deep learning model to recognize some predefined hand gestures like swipe right/left, tap, etc. As a result, we converted that model to Apple’s own CoreML model that allowed us to run the neural network directly on the Apple Watch.

This project was a technical Proof of Concept showcasing a unique user interface: gesture recognition while driving.Users were able to control the entertainment system of the car with simple hand gestures.