Skip to main content

Designing the final project's visual in TouchDesigner

When creating the visuals for my final project, I was inspired by a 'Spectrum to TOPs' tutorial created by Bileam Tschepe on Youtube (I did a post about it here). The tutorial teaches the audiences explicitly to convert an audio spectrum directly to TOPs using the CHOP to TOP and compositing. Since Bileam Tschepe used audio as the source information for the visuals, I changed the former portion of the tutorial from audio data into OSC data (blog post here).

Since OSC and Audio data are in the CHOP section, and to create visuals are in the TOP section, a 'CHOP to TOP' node is required. Initially, the node is represented by one pixel high and in black and white; to adjust it, simply change the data format if necessary (for the color), and adding a composite node changes the pixel size. A Noise node is added because it is responsible for the output resolution of the project. The Noise node is also where the author attaches the OSC data in the transform section. This allows the OSC data streamed in real-time to be read for the movement of the visual. The chosen OSC data to be streamed in includes the Alpha wave, and movements of the head (left to right and front and back). From the previous section of the report, the Alpha wave is present in all parts of the brain and is heavily associated with meditation. Choosing the headset's movement as part of the data input also lets the user feel a bit in control of the visual they are creating.



Additional nodes such as Blur, Ramp, and Background are added to create a better visual; Blur nodes help combine the visuals and give a smoother look, Ramp node to change the colors, and Background node to display the visuals created on the background.


Comments

Popular posts from this blog

TouchDesigner Experiment: Inserting OSC data with OSCIn

From one of my last experiment , I tried to change the data input. Instead of using audio, I replaced it with OSC data from my Muse headset. To connect your OSC device to TouchDesigner, make sure that the IP address and port number is the same so the data transfer can be accurate. In this case, I use a third-party app called Mind Monitor (available on iOS devices) to connect my Muse headset to the TouchDesigner software. Below are screenshots and videos from my experiment. You can see that the brainwave data is already recorded in real-time in the software. Then I used the alpha, beta, and theta brainwave to change the movement of the visuals (the chosen brainwave data I used are just placeholders for now to see the movement). Then the data is connected with 'noise', which is like the fluid/abstract visuals you see on the background. I also set the colors to be moving/changing over time.

TouchDesigner Experiment: Audio Reactive Particle Cloud

My second experiment with TouchDesigner is creating this audio-reactive particle visual by following Bileam Tschepe 's tutorial on Youtube. Again, I just followed his tutorial step by step. This tutorial is a little different because it uses both audio and visuals. The visual follows the music in real-time. Other than audio, we are also introduced with the element 'Math' to add the channels of the audio together. This is the end product. Music is FriendsV2 by Muskatt.

Arduino Experiments (pt. 1)

Earlier this week, I bought my first Arduino Kit . Since this is week 6 of term, our lecturer has asked us to display an experiment by week 7. It could be any type of experiment, and it doesn't even have to be related to our project. The reason why I picked to try on Arduino is that I think it's the closest medium I'll be using for my actual work. But I was kind of worried about this, mainly it is because I've never used or tried it before. I've only heard about it but never actually played around with it. So this is the kit I bought. It costs SGD 70 at one of the shops in Sim Lim Tower. It contains a lot of items to try out experiments. It also includes several tutorial cards that can be successfully running with the items provided in the kit. For more detailed tutorials and the codes of each project, we are asked to go to their website and search for the complete step by step tutorials. Thus far, I have tried several projects, and for ...