Gorgeous AV Production by Bob White
Occasionally, a certain project will catch your eye. When you start watching and listening, you find yourself drifting away for a few minutes. The acoustic and the optic will blend together to one beautiful harmony.
Such a project is Intermittently Intertwined by Bob White. Take a moment out of your day, and watch this in HD with some good speakers.
[youtubeshort]http://youtu.be/acqIfU-UsaI[/youtubeshort]
We were even more amazed when we found out that the video above is actually created in realtime. It's not often someone is equally talented at music, motion design as well as coding. So we had to find out more about the project.
[fold][/fold]
Bob explains:
Check out more of Bob's work at http://www.bobwhitemedia.com
Such a project is Intermittently Intertwined by Bob White. Take a moment out of your day, and watch this in HD with some good speakers.
[youtubeshort]http://youtu.be/acqIfU-UsaI[/youtubeshort]
We were even more amazed when we found out that the video above is actually created in realtime. It's not often someone is equally talented at music, motion design as well as coding. So we had to find out more about the project.
[fold][/fold]
Bob explains:
The basic rig is:
Ableton > Network Midi > ofApp > Syphon > Resolume > Avermedia GameHD
In Maya I make a series of quick geometric loft animations and export these as alembic files (.abc). Alembic files are point cache animation files that are typically used to transfer dynamic simulations from say Houdini to Maya. Because I wanted the geometric element to "grow", alembic is a good vehicle as I'm animating vertices.
The brilliant ofxalembic addon loads alembic files as meshes in OpenFrameworks. Because my geometry is fairly low poly count, I can run a lot of them at the same time triggered by Midi notes. Surprisingly even with a lot of polys, playback of abc files is very fast.
My ofApp is very much a work in progress and the code is sketchy at best. The app has ~25 slots for abc files per scene. Additionally, I setup 6 scenes that can be switched with OSC messages. Each abc file can be triggered by an incoming Midi note and there are controls to randomize the playing of single abc files (single actions) or triggering sections of an abc file in sequence (sequence of actions).
I recorded a song I wrote in Ableton and setup a number of Network Midi tracks to send data to my ofApp. I then paint notes that drive the animation. The network midi sends trigger data directly to ofApp. Additionally I send minimal OSC messages to change scenes in my app.
I love the Resolume M4L devices and I would use them, but because I've finalised the song mix in the session view I used the showsync.info M4L devices to convert midi notes to OSC. The OSC changes scenes, clears the screen, and moves the camera. Alternatively, if I were working in the session view, perhaps looping or performing live, I would use the Resolume M4L on clip launch to send OSC.
The ofApp has Syphon enabled so I can display it in Resolume. I have some effects on it like Mirror and Edge Detection to sweeten it up. Like I said, next i would love to explore Ableton control more of the params in Resolume. I would also love to make put this whole app in a FFGL plugin that way I wouldn't have to rely on Syphon. So much to learn :)
Alone the animation is kinda static if it were not for the mirror effect. It's refreshing to be able to easily change the character of the animation using Resolume in real time. Having the ability to "paint" the animation, see the layered effects in real time, I think allows for a more immediate process. For me it's important to be able to work fast so not to get caught up in minutia.
Check out more of Bob's work at http://www.bobwhitemedia.com
Resolume Blog
This blog is about Resolume, VJ-ing and the inspiring things the Resolume users make. Do you have something interesting to show the community? Send in your work!
Highlights
Spout - Sharing Video between Applications on Windows
Do you like stringing apps together like they are sneakers? Do you like the wonderful Syphon framework, but don’t have a Mac?
Then rejoice. Thanks to the efforts of Lynn and Robert Jarvis, there is now an easy way of doing exactly that.
It's called Spout.
[fold][/fold]
For Resolume users, the system works by installing two FFGL plugins and a utility app. You can then play the output of any Spout enabled application like a camera in Resolume. This means you can use all the effects in Resolume on your generative visuals made in Processing or VVVV. You can also map your projection easily, without having to write your own projection mapping tool while you're at it.
The other way also works. You can apply the Spout effect anywhere in Resolume to send the output to another Spout Receiver.
The real beauty of the framework is that its well documented and easy to use. Setting up takes less than a minute. Using it is a matter of filling out the correct sender and receiver names. This really makes Spout worth its weight in gold ( “But it’s software, so it really doesn’t really weigh anything. That analogy doesn’t make any sense.” “Shut up inner voice! I do what I want! ”)
Supported apps include Processing, VVVV, Jitter and VIZZable. Example code is available for openFrameworks and Cinder. Support in Isadora and Touch Designer is rumoured to be on the way.
Head over to http://spout.zeal.co/ to read more, ask questions on their forum and of course download. But not before you’ve pressed that Donate button, because quality work like this deserves your support.
Now let's make some awesome things happen.
Then rejoice. Thanks to the efforts of Lynn and Robert Jarvis, there is now an easy way of doing exactly that.
It's called Spout.
[fold][/fold]
For Resolume users, the system works by installing two FFGL plugins and a utility app. You can then play the output of any Spout enabled application like a camera in Resolume. This means you can use all the effects in Resolume on your generative visuals made in Processing or VVVV. You can also map your projection easily, without having to write your own projection mapping tool while you're at it.
The other way also works. You can apply the Spout effect anywhere in Resolume to send the output to another Spout Receiver.
The real beauty of the framework is that its well documented and easy to use. Setting up takes less than a minute. Using it is a matter of filling out the correct sender and receiver names. This really makes Spout worth its weight in gold ( “But it’s software, so it really doesn’t really weigh anything. That analogy doesn’t make any sense.” “Shut up inner voice! I do what I want! ”)
Supported apps include Processing, VVVV, Jitter and VIZZable. Example code is available for openFrameworks and Cinder. Support in Isadora and Touch Designer is rumoured to be on the way.
Head over to http://spout.zeal.co/ to read more, ask questions on their forum and of course download. But not before you’ve pressed that Donate button, because quality work like this deserves your support.
Now let's make some awesome things happen.
Tagtool <3 Resolume <3 Neonrost
We're very excited to bring you a guest tutorial on how to use the wonderful Tagtool for iPad as a source in Resolume, using the magic of Syphon.
But before we dive in to the techy goodness, you may be wondering what Tagtool is. I'm glad you asked!
Tagtool is a wonderfully fun application for the iPad, which allows you to unleash your painting skills, and animate and play with the result, all within a simple and intuitive interface. [fold][/fold]You can even link up multiple iPads via Wifi and draw and play collaboratively. We've had a lot of fun with Tagtool, and we're sure you'll agree.
For more info on Tagtool check out http://www.tagtool.at
Then before I leave you with the tutorial itself, I just wanted to say Tagtool one more time. Tagtool. Now I'm done.
Using Resolume & Tagtool
Workshop at the University of Applied Arts on the 22nd May 2013
This tutorial will guide you to the basic steps of how to setup a Tagtool session within Resolume. We use a Macbook Pro – 2.66 GHz – Intel Core 2 Duo – 4GB Ram (DDR3) connected to one projector and one iPad 4 running the latest Tagtool version.
Download the free trial-version of Air Server (4.6.5) to receive the video signal of the iPad. Configure the software settings>Mirroring and change to optimise for “Projector (1024×768)”. It´s important that Laptop and iPad are connected via the same wireless network.
On the iPad open the Airplay settings and select the laptop as the streaming device.
To finally receive the Tagtool output in Resolume Arena just enable the built-in Syphon module within the Preferences>Video Preferences.
Now fire up your iPad and launch the Tagtool app – the laptop is already getting the desktop screen transmitted. Create a new composition according to the size of the syphon stream – 1024×768. In the very right area select the “sources” tab and left-click the syphon source. Render settings and transform settings are correct – so we simply drag&drop this item into the video layer.
Depending on the WiFi signal strength and the resolution size we had a good performance with 1024×768 – but the laptop was struggling with performance as soon as more video layers or effects were added. The frame rate dropped at 3 layers to 14 fps and we stopped the experiment there.
You will get better performance with project sizes like 640×480, but you will have to crop the video stream of the Tagtool. Anyway! Endless fun ahead!
Thanks to the lovely folks at Tagtool and Neonrost for providing this wonderful app and tutorial. Austria VJ maffia!
But before we dive in to the techy goodness, you may be wondering what Tagtool is. I'm glad you asked!
Tagtool is a wonderfully fun application for the iPad, which allows you to unleash your painting skills, and animate and play with the result, all within a simple and intuitive interface. [fold][/fold]You can even link up multiple iPads via Wifi and draw and play collaboratively. We've had a lot of fun with Tagtool, and we're sure you'll agree.
For more info on Tagtool check out http://www.tagtool.at
Then before I leave you with the tutorial itself, I just wanted to say Tagtool one more time. Tagtool. Now I'm done.
Using Resolume & Tagtool
Workshop at the University of Applied Arts on the 22nd May 2013
This tutorial will guide you to the basic steps of how to setup a Tagtool session within Resolume. We use a Macbook Pro – 2.66 GHz – Intel Core 2 Duo – 4GB Ram (DDR3) connected to one projector and one iPad 4 running the latest Tagtool version.
Download the free trial-version of Air Server (4.6.5) to receive the video signal of the iPad. Configure the software settings>Mirroring and change to optimise for “Projector (1024×768)”. It´s important that Laptop and iPad are connected via the same wireless network.
On the iPad open the Airplay settings and select the laptop as the streaming device.
To finally receive the Tagtool output in Resolume Arena just enable the built-in Syphon module within the Preferences>Video Preferences.
Now fire up your iPad and launch the Tagtool app – the laptop is already getting the desktop screen transmitted. Create a new composition according to the size of the syphon stream – 1024×768. In the very right area select the “sources” tab and left-click the syphon source. Render settings and transform settings are correct – so we simply drag&drop this item into the video layer.
Depending on the WiFi signal strength and the resolution size we had a good performance with 1024×768 – but the laptop was struggling with performance as soon as more video layers or effects were added. The frame rate dropped at 3 layers to 14 fps and we stopped the experiment there.
You will get better performance with project sizes like 640×480, but you will have to crop the video stream of the Tagtool. Anyway! Endless fun ahead!
Thanks to the lovely folks at Tagtool and Neonrost for providing this wonderful app and tutorial. Austria VJ maffia!
Resolume 4.1 Released!
We rarely are as excited about an update as we are about this one. Resolume 4.1 comes guns blazing with new additions to the arsenal, and shows everyone there's a new sheriff in town. So strap on your boots and put on your cowboy hat, because here we go!
By popular demand we added masking and cropping to the Advanced Output of Arena.
Also you can now route layers directly to slices, saving composition real estate and generally making your life easier.
Syphon is now natively supported on MacOSX. No more mucking about with 3rd party plugins. Just enable it via the preferences and check them thumbnails!
You can drop the bass like Paris with the new AV example set by Dan Wise.
With the new Layer Router you can now create a clip that takes the input from any layer below. For instance you can take layer 1 and and display it again as layer 4 but perhaps smaller or with a different effect. This is also really handy to create picture in picture compositions. Because the world needs more picture in picture effects.
This is a long wish come true. Like, over 10 year wish come true. Ever since Composite Station, we wanted to have a Japanese version of Resolume, and now that dream has finally come true. Konichiwa, Resolume-san! Thanks to the Projection Mapping Association of Japan.
Besides that of course there's a bunch of improvements to help improve your workflow and the ever important bug fixes. Check the full list below, or head over the download page: http://www.resolume.com/download/
New Features & Improvements
Draw mask & crop shapes in advanced output (Arena)
Direct layer input to slices in advanced output (Arena)
Reorder slices & masks by dragging & dropping in the list (Arena)
Native Syphon Input & Output (Mac)
Direct layer input to other layers via router source
Blackmagic capture speed and image quality improved!
Japanese translation and interface
Russian translation and interface
Support for 14 bit Midi via Pitch Bend
Show time remaining on clip timeline (click the time to switch between two modes)
Stop MIDI mapping with the escape key
Drop an effect directly on a layer or composition
Play once & hold for AV clips
Number of steps and Step size values for relative MIDI controller
New AV demo clips by Dan Wise
New B&W mixer
Fixed Bugz
[FIXED] Some plugins do not load on OS X 10.5
[FIXED] Some mixers do not load on win 7
[FIXED] DMX channel number sheet has been updated (again)
[FIXED] Crash with using some AV clips
[FIXED] AV clip set to play once and hold switches back to play once
[FIXED] MIDI out on APC40 makes the slider get stuck on min or max
[FIXED] Crash when triggering a column while low fps
[FIXED] Right click to reset layer AV slider no worky
[FIXED] /2 *2 buttons for BPM sync are not mappable
[FIXED] SMPTE Crashes
[FIXED] Crash when changing composition resolution
[FIXED] USB DisplayLink devices don't work (cause crash on startup)
[FIXED] After triggering a column the clip panel shows the wrong clip
[FIXED] Preview with SHIFT Arrow Keys does not show the clip in the preview monitor
[FIXED] Parameter reset by right click does not work on the name of the parameter in the advanced output
[FIXED] Crash when moving QC clip with parameter linked to audio FFT
[FIXED] Memory leak on shutdown
[FIXED] DMX shortcut for select deck is not remembered
[FIXED] Closing Resolume when QuickLook is open causes crash on shutdown
[FIXED] Add date to Screenshots file names instead of all the 1's
[FIXED] Decks disappear
[FIXED] CMD + A select all clips but does not show multiclipsettings panel
[FIXED] AV slider is not sent via OSC out when V slider is moved
[FIXED] Layer direction shortcuts (MIDI out) are not sent out correctly when clip is in ping pong mode
[FIXED] Column names are disappearing (again sigh!)
[FIXED] After relocating, resolume jumps back to first deck...
[FIXED] PNG image without extension causes crash when added as mask
[FIXED] Input field calculations do not work in the composition settings window
[FIXED] Load folder from Finder
[FIXED] OSC /activeclip/quicklook/0 does not turn quick look off
[FIXED] Closed Decks are coloured too dark
[FIXED] When you drag something over a clip, select the clip for easier drag & drop behaviour
[FIXED] Layer name label is midi mappable
[FIXED] Switch to 2 property panel layout when "Show layer property panel" is disabled and the layout is set to 3 panels
[FIXED] Video panel is unfolded by default (to keep Freek sane. Relatively speaking.)
Resolume 4.1.1 bug fixes:
[FIXED] Potential crash when using composition MIDI mapping
[FIXED] Composition MIDI mappings duplicated when switching decks
[FIXED] Serial number registration only valid for one user
[FIXED] APC40 controller dial has incorrect range
By popular demand we added masking and cropping to the Advanced Output of Arena.
Also you can now route layers directly to slices, saving composition real estate and generally making your life easier.
Syphon is now natively supported on MacOSX. No more mucking about with 3rd party plugins. Just enable it via the preferences and check them thumbnails!
You can drop the bass like Paris with the new AV example set by Dan Wise.
With the new Layer Router you can now create a clip that takes the input from any layer below. For instance you can take layer 1 and and display it again as layer 4 but perhaps smaller or with a different effect. This is also really handy to create picture in picture compositions. Because the world needs more picture in picture effects.
This is a long wish come true. Like, over 10 year wish come true. Ever since Composite Station, we wanted to have a Japanese version of Resolume, and now that dream has finally come true. Konichiwa, Resolume-san! Thanks to the Projection Mapping Association of Japan.
Besides that of course there's a bunch of improvements to help improve your workflow and the ever important bug fixes. Check the full list below, or head over the download page: http://www.resolume.com/download/
New Features & Improvements
Draw mask & crop shapes in advanced output (Arena)
Direct layer input to slices in advanced output (Arena)
Reorder slices & masks by dragging & dropping in the list (Arena)
Native Syphon Input & Output (Mac)
Direct layer input to other layers via router source
Blackmagic capture speed and image quality improved!
Japanese translation and interface
Russian translation and interface
Support for 14 bit Midi via Pitch Bend
Show time remaining on clip timeline (click the time to switch between two modes)
Stop MIDI mapping with the escape key
Drop an effect directly on a layer or composition
Play once & hold for AV clips
Number of steps and Step size values for relative MIDI controller
New AV demo clips by Dan Wise
New B&W mixer
Fixed Bugz
[FIXED] Some plugins do not load on OS X 10.5
[FIXED] Some mixers do not load on win 7
[FIXED] DMX channel number sheet has been updated (again)
[FIXED] Crash with using some AV clips
[FIXED] AV clip set to play once and hold switches back to play once
[FIXED] MIDI out on APC40 makes the slider get stuck on min or max
[FIXED] Crash when triggering a column while low fps
[FIXED] Right click to reset layer AV slider no worky
[FIXED] /2 *2 buttons for BPM sync are not mappable
[FIXED] SMPTE Crashes
[FIXED] Crash when changing composition resolution
[FIXED] USB DisplayLink devices don't work (cause crash on startup)
[FIXED] After triggering a column the clip panel shows the wrong clip
[FIXED] Preview with SHIFT Arrow Keys does not show the clip in the preview monitor
[FIXED] Parameter reset by right click does not work on the name of the parameter in the advanced output
[FIXED] Crash when moving QC clip with parameter linked to audio FFT
[FIXED] Memory leak on shutdown
[FIXED] DMX shortcut for select deck is not remembered
[FIXED] Closing Resolume when QuickLook is open causes crash on shutdown
[FIXED] Add date to Screenshots file names instead of all the 1's
[FIXED] Decks disappear
[FIXED] CMD + A select all clips but does not show multiclipsettings panel
[FIXED] AV slider is not sent via OSC out when V slider is moved
[FIXED] Layer direction shortcuts (MIDI out) are not sent out correctly when clip is in ping pong mode
[FIXED] Column names are disappearing (again sigh!)
[FIXED] After relocating, resolume jumps back to first deck...
[FIXED] PNG image without extension causes crash when added as mask
[FIXED] Input field calculations do not work in the composition settings window
[FIXED] Load folder from Finder
[FIXED] OSC /activeclip/quicklook/0 does not turn quick look off
[FIXED] Closed Decks are coloured too dark
[FIXED] When you drag something over a clip, select the clip for easier drag & drop behaviour
[FIXED] Layer name label is midi mappable
[FIXED] Switch to 2 property panel layout when "Show layer property panel" is disabled and the layout is set to 3 panels
[FIXED] Video panel is unfolded by default (to keep Freek sane. Relatively speaking.)
Resolume 4.1.1 bug fixes:
[FIXED] Potential crash when using composition MIDI mapping
[FIXED] Composition MIDI mappings duplicated when switching decks
[FIXED] Serial number registration only valid for one user
[FIXED] APC40 controller dial has incorrect range