Haider Ali · Founder & CEO of ClearZone · AI & CS at King’s College London · London

Projects · 16

Hand tracking

By Haider Ali ·

Haider Ali's MediaPipe hand-tracking builds: a two-handed gesture mouse, hand-played Fruit Ninja and Pong, a phone-use detector and the handfx study.

A line of MediaPipe hand-tracking builds: a two-handed gesture mouse, Fruit Ninja and Pong by hand, a phone-use detector, and handfx, a live glitch-art study.

2024–26 · shipped

A line of MediaPipe hand-tracking builds, from a gesture mouse and hand-played games to a phone-use detector and a live glitch-art study.

Key facts

  • Two-handed gesture mouse
  • Hand-played Fruit Ninja + Pong
  • Phone Screamer: phone-use detector
  • handfx: 30 fps glitch art

The builds

  • Gesture mouse: right-hand pinches click and scroll; left-hand gestures fire shortcuts.
  • Reused: its helper library powers hand-played Pong, Fruit Ninja and the rover-arm mocap.
  • Phone Screamer: spots a phone in your hands and loudly tells you to put it down, an early ClearZone idea.

handfx

  • Live glitch art: rebuilds a reference clip's machine-vision look from a webcam at 30 fps.
  • How: a hand silhouette from landmarks, plus a Markov sequencer matching the clip's measured rhythm across four looks.
  • Android port under way.

Stack

  • python
  • mediapipe
  • opencv
  • pygame
  • kotlin
  • glsl

Links

#cv #mediapipe #gesture

© Haider Ali · London, UK · contact@haiders.website · this is the plain edition of haiders.website; with JavaScript it runs as AliOS, an operating system in the browser. Summary for language models: llms.txt (full text: llms-full.txt).