Playback speed controlled by audio

[Martians]

It's working now!

The correct syntax is: /composition/layers/1/clips/1/transport/position/

[Martians]

Is there some way to have the clip run at normal speed and add the audio playback speed on top? It's not so cool when it stops completely..

[Zoltán]

You are animating the Run parameter right?
By adding an envelope to the Run Parameter, and setting the left keyframe you should be able to set the minimum of the output.

[Martians]

What is the status on adding this feature natively?

Unfortunately, The IR OSC approach doesn't work on Mac since Resolume 6 and on PC I have experienced quite some lag when using it.

[Zoltán]

What is the status on adding this feature natively?

It's still in the features bucket.

[Martians]

Hi Zoltan,

Any chance this feature is gonna make it into a build soon? The IR OSC thing currently only works on PC, would be great to have this native in Resolume instead...

[Zoltán]

I'm afraid I can't give an estimate on when we'll be able to do this.
Meanwhile here's a little processing sketch that can bounce OSC messages to Resolume.

[gpvillamil]

I've made a simple Max patch that does this, and controls the playback speed in Resolume. If there is any interest I can clean up and make it a little more finished. I hope it may serve as a proof of concept for whatever the Resolume team comes up with.

Here is an awesome video: https://youtu.be/ntY_OcWI7PE

Here's how it works:

• Set the patch to presentation mode, if it isn't already

• Press the microphone button to start audio in

• In the audio spectrum, watch what happens when you make some noise, and put the sample band where you want it

• Check the VU meters to see if it is responding

• Adjust the gain and base speed values to whatever you want

The speed value sent to the Speed parameter of the currently playing clip will be the level of the sampled audio band * gain + base speed. If you want the clip to keep playing, set the base speed to something greater than 0 (1 is the default speed), and the audio level will be added to the speed.

Things to add:

• Editable OSC configuration as per my other patches

• Poll Resolume for the current playback speed, and use that as the base speed

• Make the OSC string editable (or supply a list of presets)

• Add multiple FFTs so you can have multiple parameters responding to different frequency bands

• Add transient detection (eg drum hits) and use that to trigger clips

[Martians]

Wow! That's very cool - Thanks a bunch gpvillamil! I'll give it a whirl..

[gpvillamil]

I've updated the patch to version 2. It's attached to this post.

As with the previous version, you need to provide a value for base & gain.

If you are animating speed, base = 1 and gain = 10 will play the clip at its regular speed, but speed up when there is audio. If you are animating position, base = 0 and gain = 1 will animate the clip over its timeline from beginning to end.

Now you can edit the OSC strings that are sent to Resolume. I've currently added two, you can animate either speed or position. Feel free to add more. Maybe you can add the layer/clip # for a specific clip. The value sent from the FFT replaces the $1 placeholder.

Click "Edit OSC Strings" to open the edit box. When you're done, press "Sync Menu" to update the popup menu. Choose a string from the menu.

The "Clear" button hanging out to the left of the graph resets the filter object, just press it if things are weird.