Stayin' Alive in MIDI hell

You must mean this right: https://www.youtube.com/watch?v=9qfFZfzPAOg

On the other hand, it seems slightly easier to play than Rachmininoff.

2 Likes

You watched Pink Flamingoes on that thing?? Gad.

It was done on a physical piano here: https://www.youtube.com/watch?v=muCPjK4nGY4

I think the idea is that you take the original audio, run it through an FFT to get the frequency spectrum at each timeslice, then quantize that spectrum to the 88 piano notes + relative amplitudes.

2 Likes

Ninjaā€™d me. :smile:

Yeah, it is a kind of quantisation of the speech formants. If Iā€™m reading Ablingerā€™s description correctly, it looks like he used a bank of band pass filters centered on semitone intervals to derive his MIDI data:

http://ablinger.mur.at/docu11.html - (Check ā€œMore technical detailsā€.)

1 Like

Yes, I would imagine that IS what Hell sounds like. Then againā€¦I would say that about most MIDI tunes.

Okay, maybe Iā€™ve been out of touch, but how has that not ended up being used in a haunted house movie yet?

Damn, if I were a particularly ambitious Phantom of any well-appointed opera house, and haunting the piano was my only way of communicating, you can be bloody well sure Iā€™d do it.

2 Likes

Not wavelet. FFT. Itā€™s basically making an 3D graph, x axis is time, y axis is frequency, z axis/brightness is intensity. Then basically painting the piano roll on top of the bright spots. Bam, youā€™ve got a piano roll that roughly matches the whole signal. If you have enough dynamic range, and can bang the piano fast enough, you can make it sound like pretty much anything.

1 Like

It is usually FFT, but you can use wavelets as well. Or even Walsh functions, if youā€™re feeling a bit mad!

1 Like

Iā€™m sure you are right in the sense of thatā€™s-how-they-implemented-it. I was thinking that, if you wanted a really good fit using the piano, you would need to use a transform that acknowledges that the piano doesnā€™t play pure tones. (Like FFT implicitly does; but computing the FFT is much easier because of it.)

2 Likes

Putting Conlon Nancarrowā€™s studies for player piano through an audio-to-MIDI converter would certainly not improve upon them. But performing a reading about him while vocoded through this would be a blast.

More than one way to skin that cat. Ablingerā€™s was evidently static analysis done with a series of digital bandpass filters at semitone intervals.

2 Likes

This topic was automatically closed after 5 days. New replies are no longer allowed.