Date post: | 22-Apr-2015 |
Category: |
Technology |
Upload: | montreal-python |
View: | 1,235 times |
Download: | 7 times |
Optical Music Recognition with Python
Andrew Hankinson
Optical Music Recogntionis
Optical Character Recognition for Music Notation
2
Building “Google Books” for music notation
3
4
Our Task:Tell a computer how to
understand music notation
5
Our Task:Teach a computer how to
understand music notation
6
pitc
h
time
6
pitc
h
time
clefs
barlinesdynamics (“loudness”)
durations articulations
key signature
implicit knowledge
6
♩�
6
♩�
7
Neume NotationLiturgical Use
~1100 to 1600 CE
Gamera
8
Python/C++ Framework fordocument image analysis and
shape recognition
(not just for music...)
Tasks...❖ Binarisation: Colour -> Black & White
❖ Staff Removal: Removing connected components
❖ Shape identification: Automatically classifying shapes
❖ Correction: Fixing machine errors
❖ Exporting: Encoding recognized music notation in XML
9
Demo
10
11
Recap❖ “Clean up” images -- binarization, etc.
❖ Remove staff lines
❖ Connected component analysis
❖ Classify shapes
❖ Recombine with staff lines for pitch finding
❖ Save image + musical data to a musical representation format (e.g., the Music Encoding Initiative XML schema)
12
Thank you.
13
github.com/DDMALgithub.com/ahankinson