This AI generates music from silent piano performances

Scientists have developed an AI that can generate music from silent piano performances, just by watching the movements of the player’s hands. The system, called Audeo, analyzes top-down videos of someone tickling the ivories to predict which keys are being pressed in each frame. It then produces a transcript of the music, which a synthesizer translates into […]