Gesture Tracking Glove Prototype

Description

In the Electronic System Design Course II at Northwestern University, my partner and I undertook the project of developing a prototype glove for tracking hand and finger gestures to visualize in real-time on web platforms: via Javascript and Unity.

Our work centered around the integration of an ESP32 with various sensors, the design of a custom PCB, and Machine Learning implementation for gesture recognition. To allow the seamless use of implementation fo these various features, we also used FreeRTOS for dual-core concurrency.

Despite encountering major challenges like sensor noise and deviations from our original plan, the project provided a valuable learning opportunity in embedded systems and the basics of wearable technology development.

Date: April 2023 - June 2023

Gallery

Images

Full Glove Setup

Custom PCB Design

Webserver Visualization

Machine Learning Implementation (Edge Impulse)