B1 Bachelor Bloompipe  

Team

  • Max Blank
  • Jonas Blome
  • Max Decken
  • Eero Kaan
  • Liav Keren
  • Ben Lippold
  • Anh Nguyen
  • Martin Schmidt

Supervision

Prof. Dr. Kai-Uwe Barthel, Konstantin Schall

WebApp

Our WebApp is part of our website which guides you through the process of creating your own music video. Within there, you are enabled to select different video generation styles and AI presets of varying degrees of complexity. Whether you are a casual music fan or a proficient digital artist - Bloompipe will suit your needs.

Styles

To have the style of the video match your taste, we are providing different options, with which the music videos can be generated. You can imagine this to be the “theme”, of your generated videos so to speak. Choose one of the styles and you will get a video with imagery fitting the theme that you selected.

Presets

With the presets you have a set of tools, with which you can automatically match the video output to the dynamics and genre of your track. For every preset we suggest different genres and types of music that fit for it. For instance, you can choose what dynamics your video should have to match your song.

Expert Settings

With the expert settings you can tweak the dynamics of the video to your liking with even higher precision. For every option-parameter, we have a detailed explanation on our tutorial site to help you understand what the expert settings are capable of. Use these sliders and switches to further improve the videos that you generate and exactly match them to your imagination.

Audio Analysis

The audio analysis, takes a good look into the features of your song. Through the expert settings you can tweak how much the bass, mid and high frequencies should influence the dynamics of your video. Our analysis also detects characteristic changes in the song and segments the audio into parts that can then be individually visualized. The final loudness curve and each characteristic change in the music is finally passed onto the video generation to create a video that ultimately plays back along your music.

Video Generation

The video generation of our tool represents the most important part of Bloompipe. Here the image generation takes place within a special type of neural network by Nvidia called StyleGAN2-ADA-PyTorch. StyleGAN is designed to generate beautiful images from random input vectors. For your video, we are calculating a set of input vectors that represent the dynamics in your music. This vector set can be influenced by choosing one of our presets or using the expert settings. We then generate images for every frame in the video. At the end in our post production stage, these images are then consolidated into a final video. Further image manipulation steps, such as constrast, saturation or resizing tweaks are also applied. After all is done, your track will be underlayed. Et Voila, your video is now being presented to you on the webpage.
Step by Step Instructions
Step by Step Instructions