Teaching AI to compose video game music
◍ Constrained and finite
◍ Visuals can’t be tightly scored
◍ Laborious composition and integration
Issues with human-composed VGM
Video game music
What does the Melodrive engine do?
Composition Performance ProductionEmotional
API MusicGame params
User input
What doesn’t work
Challenges building Melodrive
◍ Music is ill-defined
◍ No ground truth
◍ Subjective assessment
Reproducing the compositional process
Modular AI approach
Hybrid AI approach
Takeaway lessons
● Deep learning isn’t always the solution
● Complex problems benefit from domain-rich representations
● Modular architectures work well with ill-defined problems
https://medium.com/the-sound-of-ai
@musikalkemist
valerio_velardo