SuperTime Motion

Play music with
hand gestures

Hold your hands up to your webcam. Raise fingers to play chords. Move your other hand to change the sound.

Free, no signup. Your video stays on this device unless you choose to share a take.

How to Play Music with Hand Gestures: A Beginner’s Guide

You can play a chord progression with your hands without knowing piano or any music theory. In Motion, the free camera instrument, each finger count plays a chord, a pointing finger plays a melody, and your other hand changes the tone. Learn them in that order.

Updated

How to begin

  1. Start the camera: Open Motion and start the camera. The key of G is already selected.
  2. Play one chord: Hold up one finger, keep your hand relaxed and wait for the chord name to settle.
  3. Play three chords: Move to four fingers, then an open hand, then back to one finger. Stay on each shape until the change feels easy.
  4. Stop the sound: Make a fist, then start again from one finger.
  5. Add a melody: Switch to Air Melody, point one finger and tilt it up or down. The notes stay in key.
  6. Add a beat: Press Play beat or B, and keep the tempo slow enough to hold each shape clearly.
  7. Record it: Press Record when you have something you like.

Tips for playing

  • Learn one gesture at a time. A new shape is easier to hold steady with no beat running.
  • Spread your fingers a little so the camera can count them.
  • Start Air Melody on a pentatonic scale. It has fewer notes, so more of what you play will sound right.
  • If a shape will not register, slow down and check the light before you try moving faster.
  • On a phone, prop it up securely and keep both hands in the frame.

Which hand shape plays which chord

Motion starts in G major. Each shape plays the chord on that number of the scale.

Hand shapeChordRole in the key
One fingerGI
Two fingersAmii
Three fingersBmiii
Four fingersCIV
Open handDV
Thumb and index circleEmvi
Index and little fingerF♯dimvii°

One finger, four fingers and an open hand give you G, C and D, the three chords behind thousands of songs. Add the thumb and index circle for Em and you can play I–V–vi–IV, the loop behind “Let It Be” and “No Woman, No Cry”. If you change the key, each shape keeps its number. What the numbers mean.

Chords

Seven hand shapes play the seven chords of the key, in order. One to four fingers and an open hand are chords one to five. A thumb and index circle is six, and index and little finger is seven. Change the key and every shape keeps its number.

Melody

Air Melody moves through a scale as your pointing hand rises and falls. Move a short distance, listen to the new note, then go further. Your other hand can hold a chord underneath.

Tone

Your second hand changes the sound while the first plays. Open and close it to move the filter, and raise or lower it to change the resonance.

Beats

Add a metronome, drum groove or arpeggiator. Beat lock moves each new chord onto the next beat, which keeps your changes in time while you learn them.

Recording

Press Record to make a take with your camera and the instrument. You can review it and download it. Publishing a share link is a separate step that uploads it.

Hand-gesture music questions

Can a beginner play music with hand gestures?
Yes. You do not need theory or keyboard skills. Every shape already has a chord in the same key, so any change you make will fit. Start with one finger, then count up.
How do hand gestures become music?
Motion uses MediaPipe hand tracking to find 21 points on each hand in the camera image. It counts your raised fingers to pick a chord and reads the height of your pointing finger to pick a melody note. All of this runs on your device.
Which hand plays the chords?
Either one. Raise a finger on whichever hand you like. With both hands in view, Motion gives one the chords and the other the tone, and Swap hands reverses them.
Can I make music without touching a keyboard?
Yes. After you start the camera, you can play chords and melody with your hands alone. While you play chords, Air Dock also lets you start the beat and play fills by pointing.
Do I need to touch the screen while playing?
Only to set things up. You use the screen to allow the camera, change modes and sounds, and start a recording. Once you are playing, your hands do the rest.

Your hands are ready.

Play with your hands