Converting spectrogram images to sound

Effects, Recipes, Interfacing with other software, etc.

If you require help using Audacity, please post on the forum board relevant to your operating system:
Windows
Mac OS X
GNU/Linux and Unix-like

Converting spectrogram images to sound

Permanent link to this post Posted by unfa » Wed Mar 22, 2017 5:43 pm

ARSS is an opensource commandline program that can produce high quality black&white spectrograms, but more importantly: it can chew up images and synthesize sounds treating these images as spectrograms.

https://sourceforge.net/projects/arss/

It has some limitations - the input image has to be a specific type of BMP file, and it's a rather barebone commandline tool - however it does the job and allows users to convert image files into sound files.

I used that tool when to design some sound effects for games, and it is a very unique tool, giving you abilities that no synthesizer provides.

I think it might be a great idea to use the code and make this program a part of Audacity's toolset. Importing image files and synthesizing sound out of them would be a super cool thing. Being able to export the spectrograms out can be great too, because you can convert a sound into an image, then process the image with image-specific tools and then resynthesize the sound back. Have you ever tried pixelating a spectrgram or sharpening it to listen to the results?

Using the commandline program is a bit tedious, and also the need to convert all your images prior to the resynthesis is also tiresome.
Adding a capability to read major image formats (JPG, PNG) and convert them to grayscale automatically would be great.

Also R,G, B and A channels of an image file could be treated as separate audio channels this way - color of the pixels would translate to the stereo image of the sound (pun intended).

What do you think?
unfa
 
Posts: 16
Joined: Sat Mar 29, 2014 10:33 pm
Operating System: Linux Mint

Re: Converting spectrogram images to sound

Permanent link to this post Posted by steve » Wed Mar 22, 2017 9:41 pm

9/10 questions are answered in the FREQUENTLY ASKED QUESTIONS (FAQ)
steve
Site Admin
 
Posts: 44622
Joined: Sat Dec 01, 2007 11:43 am
Operating System: Linux *buntu


Return to Audio Processing



Who is online

Users browsing this forum: No registered users and 9 guests