Sounds like the future: AI that converts audio recordings into notes.
Sebastian Murgul and Alexander Lüngen have developed an AI application that automatically converts audio recordings of instruments into sheet music. Their idea combines the transcription of music with AI, successfully establishing the recent technology of machine learning in the world of music.
“Transcription the engineer’s way. There must be an easier way to do it, I thought to myself.”
It all began in 2016, when Sebastian Murgul’s sister wanted to play a song recorded in the memory of her e-piano for herself. As an electrical engineering graduate, Murgul did not have to deliberate for long, and transcribed the melody by measuring it with an oscilloscope. But it was a tedious process – there had to be an easier way. And so the idea of founding a company was born.
The start-up Klangio has set itself the goal of establishing AI in the world of music, to give musicians all over the world a means of automatically transcribing songs. To do this, an AI application has been taught to process notes, using a deep learning process with countless examples of music. In the meantime, the AI not only registers notes, but also understands complex musical patterns and rhythms.
“Our application to IDEENSTARK was really helpful [...], because we were not only coached by people with the technological know-how – but also by people active in the creative and cultural world.”
Their idea is particularly well-received in the technology-savvy city of Karlsruhe. In 2021, the founders applied for a state-run mentoring programme aimed at start-ups in the media and film cultural sector. Baden-Württemberg honours innovative personalities in the state’s cultural and creative industries with the IDEENSTARK promotional award. This was the opportunity for the founders of Klangio to exchange experiences with people outside the technology bubble, such as those working in the music and cultural sectors. Experiences like this allowed the project to mature, and in 2022 the founders won Baden-Württemberg’s “AI Champions” award.