Artificial intelligence in audio to sheet music converters

General music discussion in here please. All styles welcome.
Post Reply
Stephen
Should get out more!
Should get out more!
Posts: 1115
Joined: Wed Jan 15, 2014 4:49 pm

Artificial intelligence in audio to sheet music converters

Post by Stephen » Tue May 22, 2018 8:00 pm

Hi,

Is there any significant progress or innovation in audio to sheet music convertion software? Using artificial intelligence in music notation software, audio files to sheet music notation, ...
Any ScoreCloud users here?

New app Frettable?
http://www.cbc.ca/news/canada/edmonton/ ... -1.4653323
"Frettable uses artificial intelligence to analyze a recording and transform a melody into musical notes on the page. The more music it hears, the smarter the app gets at converting it."

Anyone having succesful results with ScoreCloud in audio to sheet music conversion?
Can it handle a CD player audio sound and automatically produce a sheet music of a(ny) song?

I have some old songs I can't find the sheet music, and automatic audio to sheet music conversion could be a great help.

kind regards
Stephen

User avatar
jozz
Star
Star
Posts: 481
Joined: Tue Nov 07, 2017 10:03 am
Location: Hilvarenbeek, Noord-Brabant, The Netherlands

Re: Artificial intelligence in audio to sheet music converters

Post by jozz » Wed May 23, 2018 7:24 am

Mechanical Turk? :P

Only if the music is monophonic it's okay to use things like Avid (Sibelius + AudioScore). If it gets more complex, there still is nothing out there that does the job well.

Stephen
Should get out more!
Should get out more!
Posts: 1115
Joined: Wed Jan 15, 2014 4:49 pm

Re: Artificial intelligence in audio to sheet music converters

Post by Stephen » Wed May 23, 2018 9:26 am

Is Avid (Sibelius + AudioScore) using artificial intelligence and deep learning technology?
(I'm not using sheet music notation software today, but I think in a few years, maybe we can get better software to handle complex polyphonic and harmonic music)

ScoreCloud 4 video:
https://www.youtube.com/watch?v=A15HVuF0FrA
ScoreCloud 4 - Now with polyphonic audio analysis

Looks like the program can manage to convert the piano solo playing with chords.
She still has to record the vocal part after the piano part.

I would like to see something that can handle vocals with piano.
Don't know if ScoreCloud 4 can do this, perhaps not yet.

User avatar
JeffJetton
Star
Star
Posts: 451
Joined: Wed Jul 27, 2016 9:28 pm
Location: Nashville, Tennessee, USA
Contact:

Re: Artificial intelligence in audio to sheet music converters

Post by JeffJetton » Wed May 23, 2018 11:10 pm

I don't have a problem just using my ears, a keyboard, and MuseScore to convert audio to sheet music.

Like OCR and speech-to-text, even if audio-to-notation improved, I can't imagine it getting any better than "sort of close but not perfect" for the foreseeable future. You're probably still going to have to go over it and clean/correct things. Not much more effort to just do it yourself from the get-go.

User avatar
jozz
Star
Star
Posts: 481
Joined: Tue Nov 07, 2017 10:03 am
Location: Hilvarenbeek, Noord-Brabant, The Netherlands

Re: Artificial intelligence in audio to sheet music converters

Post by jozz » Thu May 24, 2018 12:15 pm

Stephen wrote:
Wed May 23, 2018 9:26 am
Is Avid (Sibelius + AudioScore) using artificial intelligence and deep learning technology?
No, but try this:

search for 'optical music recognition' programs..most use some form of AI

your results may vary

Stephen
Should get out more!
Should get out more!
Posts: 1115
Joined: Wed Jan 15, 2014 4:49 pm

Re: Artificial intelligence in audio to sheet music converters

Post by Stephen » Thu May 24, 2018 9:01 pm

"sort of close but not perfect" is okay for me, I can do the finetuning and corrections myself.
I think an AI app or program would save me a lot of hours trying to notate the music from audio sources.

Actually a single line melody of a song is enough for me to work out the chords and harmony. Automatic monophonic audio analysis and sheet music convertion.

If it could be converted into numbered music notation, that would be great.
You know, the Rousseau-Galin-Paris-Chevé numbered music notation.

In China, the jianpu music notation system was formed after the Emile Chevé music notation, with some changes.
https://www.youtube.com/watch?v=D2_ycpfVY24
How To Read Numbered Musical Notation (简谱) - A Brief Primer (Viewer Request)

An app could automatically produce numbered music notation (jianpu, Chevé, ...) from live audio

Post Reply

Who is online

Users browsing this forum: No registered users and 1 guest