PianoVAM captures piano performance across every modality at once. Each of 107 practice recordings on a Yamaha Disklavier aligns top-view video, lossless audio, ground-truth MIDI, and 21-point hand landmarks to the same take. On top of the dataset we build models that read one modality from another, starting with V2N, which transcribes piano to complete MIDI from silent video alone.

PianoVAM

A multimodal piano performance dataset (ISMIR 2025). 🗂️ Dataset · 🎬 Live demo · 📄 Paper · 💻 Code

V2N (Video to Notes)

Visual piano transcription from silent video (ISMIR 2026). 🎬 Live demo · 📄 Paper · 💻 Code

PiaRec & ASDF

Web toolkits for dataset acquisition and fingering annotation (ISMIR 2025 LBD). 📄 Paper