• Umme sara
• Sowjanya Rai
• Tejaswini R
• Rachana Jagannath
• Mrs Sangeetha V

This project introduces a gesture-controlled virtual musical instrument designed to empower motor-impaired individuals to engage in musical creation and performance. Utilizing a Raspberry Pi 4 and a Pi Camera, the system captures and processes hand gestures in real-time using computer vision and machine learning techniques via the MediaPipe framework. Each gesture corresponds to musical notes or instrument actions, enabling intuitive control of rhythm, pitch, and instrument selection. Unlike traditional MIDI-based systems, this project uses FluidSynth and custom soundfonts to produce high-quality audio output without external hardware. The system supports multiple instruments, including piano, guitar, drums, and violin, and enables users to seamlessly switch between them using gestures. This cost-effective, open-source solution enhances accessibility and fosters creative expression for individuals with limited mobility, making it valuable in music therapy, education, and inclusive performances.

This project introduces a gesture-controlled virtual musical instrument designed to empower motor-impaired individuals to engage in musical creation and performance. Utilizing a Raspberry Pi 4 and a Pi Camera, the system captures and processes hand gestures in real-time using computer vision and machine learning techniques via the MediaPipe framework. Each gesture corresponds to musical notes or instrument actions, enabling intuitive control of rhythm, pitch, and instrument selection. Unlike traditional MIDI-based systems, this project uses FluidSynth and custom soundfonts to produce high-quality audio output without external hardware. The system supports multiple instruments, including piano, guitar, drums, and violin, and enables users to seamlessly switch between them using gestures. This cost-effective, open-source solution enhances accessibility and fosters creative expression for individuals with limited mobility, making it valuable in music therapy, education, and inclusive performances.

"Gesture Controlled Virtual Instrument For Motor Impaired Users ", International Journal of Emerging Technologies and Innovative Research (www.jetir.org), ISSN:2349-5162, Vol.12, Issue 5, page no.j894-j900, May-2025, Available :http://www.jetir.org/papers/JETIR2505A83.pdf

"Gesture Controlled Virtual Instrument For Motor Impaired Users ", International Journal of Emerging Technologies and Innovative Research (www.jetir.org | UGC and issn Approved), ISSN:2349-5162, Vol.12, Issue 5, page no. ppj894-j900, May-2025, Available at : http://www.jetir.org/papers/JETIR2505A83.pdf