Airpluck

Design Research
Product Design
System Design
Circular Design
Design Strategy

Airpluck is an innovative cyber-physical design exploration that reimagines how we interact with string instruments. By combining hand gesture recognition, machine learning, and mechanical engineering, the project creates a playful new way to play music without traditional plucking.

An intuitive way to play string instruments.

The interaction is intuitive and engaging: a user performs hand gestures in front of a camera, which uses image processing and machine learning to recognise and interpret the gesture. Based on the detected hand position and movement, the system maps each gesture to a specific musical note. This input then triggers a mechanical hand equipped with robotic fingers that physically plucks the strings of the instrument, producing the corresponding sound.

Credit:

Innovation Design Engineer:
Wigy R
Yuyao Lin
Xinyi