This was a fun little weekend project I developed sometime in September 2020. I played around with an Android App called Spectroid. Its only purpose is making sound visible as a spectrum over time. After analyzing quite some machines and drawing basic shapes while whistling, I figured that there must be a way to draw more complex shapes or even entire pictures.
I started up Unity 3D and found out that I could easily play two frequencies at a time. These frequencies would appear as bright lines in Spectroid. To draw more complex shapes than perfect lines, I had to come up with a simple algorithm to change these frequencies rapidly.
The basic idea of the algorithm is the following.
The algorithm selects the first line.
Then the two brightest pixels are selected. If there are multiple winners, two winning pixels will be selected at random.
The further left a pixel is, the lower the played frequency, the further right, the higher.
With the same speed as Spectroid draws a line, the algorithm selects the next line and repeats this process.
Here are some of the resulting images:
The code to this project can be found on my github account: https://github.com/0x3b29/Image-To-Sound
If you are looking for a developer who can help you with the design and development of your app prototype, I would be happy to collaborate with you. Please contact me by mail using this link.
