After 18 months of R&D, we've just released our project to the open source community. I wanted to share it with you too, hoping it might be helpful for your projects.
We started MusicLang with the aim of addressing the limitations of existing language models in music composition. Despite the increasing popularity of LLMs, none have fully met the requirements for music generation. Similarly, existing generative models for music mostly focus on audio and lack controllability over the output generated. This poor UX was the reason why we built MusicLang, which offers advanced control features over symbolic music generation. MusicLang is ideal if you:
- Want to generate music exportable to your favorite DAW in MIDI format; - Seek control over chord progressions in the generated music; - Need to create variations or extend existing music; - Require fast performance on a laptop without GPU.
MusicLang comprises several components:
1.MusicLang Foundation model: Our foundational model for creating and generating original MIDI soundtracks [0]; 2. MusicLang predict: Our AI prediction API for the MusicLang package [1]; 3. MusicLang Language: A new language for tonal music, enabling composers to load, write, transform, and predict symbolic music easily [2].
Instead of a long explanation, you can try MusicLang on our colab [3], explore our demo space [4], or our HuggingFace space [5]. For more technical details, visit our technical blog [6]. Mervin Prison also made a cool video showcasing our features [7].
We’re excited to hear your thoughts and feedback, this will help us a lot.
Thanks :-)
[0] MusicLang Foundation model:https://huggingface.co/musiclang/musiclang-v2 [1] MusicLang predict: https://github.com/musiclang/musiclang_predict?tab=readme-ov... [2] MusicLang language: https://github.com/MusicLang/musiclang [3] Colab:https://colab.research.google.com/drive/1MA2mek826c05BjbWk2n... [4] Demo space:https://huggingface.co/spaces/musiclang/musiclang-predict [5] HuggingFace space: https://huggingface.co/musiclang [6] Technical blog: https://musiclang.github.io/ [7] Mervin Praison’s video:https://www.youtube.com/watch?v=5lWgP4F5Q-o