Can a beginner play music with hand gestures?

Yes. Start with Easy mode and one relaxed chord shape. The instrument keeps the harmony stable while you learn the hand positions, and the on-screen controls let you hear each chord before trying its gesture.

How do hand gestures become music?

Motion maps recognised shapes to chord slots and uses the melody hand’s height to select notes in Air Melody while the other hand holds the chord bed.

Can I make music without touching a keyboard?

Yes. Camera mode lets you play core chords and melody through hand movement after enabling the camera. Chords mode also offers Air Dock actions for tone, beats, and fills.

Do I need to touch the screen while playing?

Core camera gestures let you play without touching the screen. Camera permission, mode choices, sound settings, and recording still have on-screen controls. You can also choose touch or keyboard input instead of live gestures.

Motion · Playing guide

How to Play Music with Hand Gestures

You do not need piano fingering or a MIDI controller to start. Motion gives each clear gesture a musical job: a hand shape holds harmony, a pointing finger moves through a scale, and the other hand shapes the sound or triggers a groove. Learn one job at a time.

Start with harmony

Begin with the relaxed chord shapes in Easy mode. Watch the chord label settle before changing shape. Expressive mode adds more shapes when you want extra colour.

Move through melody

Air Melody turns a gentle raise or lower into a scale-aware lead. Point one finger, move a small distance, and listen to the note before adding another.

Shape a sound

In Chords mode, hand height, openness, distance, and palm turn can influence filter, resonance, volume, and ambience. Change one movement at a time to learn its effect.

Build a groove

Add a metronome, drum groove, arpeggiator, or 3:2 and 4:3 pattern. Keep the pulse comfortable enough to hold each hand shape clearly.

Record a take

Cover Studio combines camera, optional microphone, synth, beat, and overlays after you start recording. Review and download locally; publishing a share link separately uploads the take.

How to begin

Start simple: Open Motion, enable the camera, and choose Easy mode with a familiar key and progression.
Learn the chord shapes: Show one relaxed shape at a time and wait for the chord label to settle.
Add a lead: Switch to Air Melody, point one finger, and move through the same key and scale.
Shape the groove: Add a drum pattern, arpeggiator, filter movement, or polyrhythm at a comfortable tempo.
Save a performance: Open Cover Studio, record when ready, review the take, and download it locally.

Tips for playing

Learn one gesture at a time. Use a fist to release the melody, or press Stop to end the sound.
Choose a pentatonic scale first to explore a small set of notes.
Use the on-screen chord label and tracking status as feedback rather than moving your hand faster.
On mobile, prop the device securely and keep both hands inside the camera frame. Try on-screen controls while learning if tracking is difficult.

Hand-gesture music questions

Can a beginner play music with hand gestures?: Yes. Start with Easy mode and one relaxed chord shape. The instrument keeps the harmony stable while you learn the hand positions, and the on-screen controls let you hear each chord before trying its gesture.
How do hand gestures become music?: Motion maps recognised shapes to chord slots and uses the melody hand’s height to select notes in Air Melody while the other hand holds the chord bed.
Can I make music without touching a keyboard?: Yes. Camera mode lets you play core chords and melody through hand movement after enabling the camera. Chords mode also offers Air Dock actions for tone, beats, and fills.
Do I need to touch the screen while playing?: Core camera gestures let you play without touching the screen. Camera permission, mode choices, sound settings, and recording still have on-screen controls. You can also choose touch or keyboard input instead of live gestures.