C@t Project
Nicholas Socha
Music Visualization
- Traditional music visualization analyze the current piece of music in real time
- My project is concerned with creating an offline version which analyzes the entire piece of music extracting data and then creating the visualization accordingling
- This approach create a more responsive visualization
- The intensity of the music overtime can be addressed
- Quick beat changes can drive a drastic change in the visualization
Audio
- The entire music track will be analyzed to extract information such as beat and intensity that will drive the visualization
- This mapping will be extracted using MatLab, a scientific computing platform
- MatLab has the ability to conveniently manipulate audio data generated from a FFT (Fast Fourier Transformation)
- A FFT deconstructs an audio signal into its constituent frequency
Visual
- 3D graphics will be used to visualize the music
- The extracted mapped music features will be converted to a script format that the animation program Maya can understand
- Animations will then be created in Maya that will be key framed by the script
- Simple example of an animation would be a ball bouncing to the beat of the music while its color or size reflects the current intensity