< Back to IRCAM Forum

MuBu video integration question

MuBu
#1

Hello everyone,

My name is Veronika and for a study that I am doing for my PhD, I am using MuBu to record and synchronize MIDI, TouchKeys data, audio, and video. I was, for now, not able to integrate video recording into the MuBu container. Does anyone know how to do that? Or at least make the video record and save at the same time with the other data. Currently even the saving of the video is not working properly, I believe.

You can find the patch here: https://www.dropbox.com/scl/fi/4zrduqpofkqrnrd0plyb1/mubutry2-video-starts-working.maxpat?rlkey=pmkf0oh94paer9ub3su602b7m&st=b43hrtmo&dl=0

Best,
Veronika

#2

Hi Veronika,
your patch goes into the right direction of recording video in parallel to mubu. (I think saving the video frame to a matrix in a track would not be very practical, albeit possible.)

You can resynchronise playback by using the time output from mubu.play (or the imubu cursor for scrubbing) to drive jit.movie. (there shouldn’t be much drift, but this is something you could verify with a long recording of a video showing a timecode.)

Alternatively, you could count the frames from qmetro and record that number to a timetagged mubu track, and use it for playback.

You can put the movie file name as buffer info to save it with the whole mubu data.

Some patch simplifications:

  • the tracks created by the addtrack commands can also be created by mubu.track objects with @predef yes. Makes things tidier and gives you a track-only view on doubleclick.
  • I don’t know what exactly the touchkeys send, but the tk_on and tk_off could possibly be combined into one track with 0 or 1 values (unless these are velocities)
  • if any data is synchronous (perhaps tk_pitchbend and tk_vibrato?) then if could go into 2 columns of one track

HTH, best!