Hand Gesture Recognition & Color Detection
A Jetbot robot you command with your fingers. Show it 1, 2, 3, or 4 fingers and it reads the command, then searches for the colored target by itself and drives to it. No controller needed.
- CNN gesture classifier trained with cross-entropy loss and the Adam optimizer
- Checked with 5-fold cross-validation so it holds up on new data
- Understands 4 gestures: 1, 2, 3, or 4 fingers, each a different command
Camera sees your hand
The camera grabs a frame and maps the key points of your hand.