Performance Benchmarks

Stay up to date with important updates, artist showcases and more
Post Reply
Joris
Doesn't Know Jack about VJ'ing or Software Development and Mostly Just Gets Coffee for Everyone
Posts: 5180
Joined: Fri May 22, 2009 11:38

Performance Benchmarks

Post by Joris » Tue Apr 29, 2014 13:42

'What computer do I need to run 12 layers of HD?'

'I need to send 3 videos to 3 outputs, what graphic card do I need?'

We get these questions a lot and there is no easy answer for them. Performance depends on a lot of factors, and any recommendations we make are usually outdated a week later.

So we thought we'd try a different approach: the Resolume Benchmark, patent pending.

Click here to view the results in a handy spreadsheet!


The idea is simple. You run our test compositions and content, on your own computer. You start with no clips playing and you keep triggering clips, one at a time. The moment you cannot play more clips without dropping below 30fps, you got the benchmark for that computer. Then you post results.

This way, hopefully we'll get a good overview of how well different computers perform.

You'll notice that each resolution has two benchmarks, Clean and Noise. This is done because typical VJ content is easy to compress and decompress. Photographic content is usually a bit harder to process. To give an accurate overview, we made separate test material for each type of footage.

Now let's get this benchmark party started!
Download the comps and content and mark some benches!

Benchmark files and composition for 1080p ( this is the main benchmark test, now updated with DXV3 files )
Benchmark files and composition for 4K part 1 and part 2
Benchmark files and composition for 480p

Add your own results via this handy Google Form!




Or read on below for extended results and discussion!

Model: Mac Pro desktop
Operating System: OSX 10.9.2
GPU: ATI Radeon HD 5770, 1024 MB
Harddisk: Samsung SSD 840, 512 GB
Processor: 2.8 GHz Quad-Core Intel Xeon
Memory: 8GB RAM
Resolume: 4.1.8

Output Setup: 1 Control Monitor at 1920x1200, 2 Fullscreen Outputs at 1920x1200

Benchmark 1920x1080
Minimal content: 5 layers
Noise content: 3 layers

Benchmark 640x480
Minimal content: 20+
Noise content: 20+


Model: Anttec desktop
OS: Windows 8
GPU: NVidia Geforce GTX 770
Harddisk: Samsung SSD 840
CPU: Intel Core i7 3.20GHz
RAM: 16GB
Resolume: 4.1.7

Setup: 1 Output Monitor at 1920x1200, 2 fullscreen outputs at 1920x1200

Benchmark 1920x1080
Clean: 20+ layers
Noise: 17 layers

Benchmark 640x480
Clean: 20+ layers
Noise: 20+ layers


Model: BTO laptop
OS: Windows 8 Pro
GPU: Nvidia Quadro K3000M 2048MB
Harddrive
CPU: Intel i7, 2.8GHz
RAM: 32GB
Resolume: Arena 4.1.8

Setup: 1 Control Monitor at 1920x1080, 1 Fullscreen Output at 1920x1080

Benchmark 1920x1080
Clean: 8 layers
Noise: 7 layers

Benchmark 640x480
Clean: 9 layers
Noise: 9 layers

( This really shows that the Quadro cards are not really performing that well at the moment. This thing should burn through the 640x480 clips )


Model: MackBookPro Retina Mid 2012
OS: OSX 10.9.2
GPU: NVidia Geforce GT650M 1024MB
Harddisk: Apple SSD 500GB
CPU: 2,6GHz Core Intel i7
RAM: 16GB
Resolume: 4.1.8

Setup: 1 control monitor at Best (Retina), 3 fullscreen outputs at 1920x1200.

Benchmark 1920x1080
Clean: 12 layers
Noise: 10 layers

Benchmark 640x480
Clean: 20+ layers
Noise: 20+ layers

Model: MacBookPro laptop, Mid 2010
OS: Mac OSX 10.8.5
GPU: NVIDIA GeForce GT 330M 512 MB
Harddisk: SAMSUNG SSD 830 512 GB
CPU: 2.53 GHz Intel Core i5
Memory: 8GB
Resolume: 4.1.8

Setup: 1 control monitor at 1920x1200, 1 fullscreen output at 1920x1080

Benchmarks 1920x1080
Clean: 2 layers
Noise: 2 layers

Benchmarks 640x480
Clean: 12 layers
Noise: 12 layers

There you have it...

rene van dijk
Met Resolume in a bar the other day
Posts: 1
Joined: Tue Feb 18, 2014 17:00

Re: Performance Benchmarks

Post by rene van dijk » Tue Apr 29, 2014 14:40

Model: Mac Pro Late 2013
OS: OSX 10.9.2
Graphic card: 2x AMD FirePro D700 6144 MB (total 12288mb)
Harddisk: Apple Flash storage 500GB
Processor: 3,5 GHz 6-Core Intel Xeon E5
Memory: 32 GB 1867 MHz DDR3 ECC
Resolume 4.1.8

Output Setup: 1 Control monitor at 1920x1080, 1 Fullscreen output at 2560x1440

Benchmark for 1920x1080
Clean content: 15 layers
Noise content: 17 layers

Benchmark for 640x480
Clean content: 20+ layers
Noise content: 20+ layers

Note: Am not quite sure if resolume uses 1 graphic card or 2....
And kinda strange that this machine was better with the HD noise content then the clean content.

to be honest, I had expected better results of this monster machine!

lsslss
Met Resolume in a bar the other day
Posts: 1
Joined: Tue Apr 29, 2014 14:40

Re: Performance Benchmarks

Post by lsslss » Tue Apr 29, 2014 14:57

Here is my first computer, it's my main desktop, that I use for After Effects, Cinema4D and all the regular stuff. Have Resolume installed on it, for testing purposes.

Model: Self build, SuperMicro MotherBoard
OS: Win 7 64 bit
Graphic card: NVidia Geforce GTX 680 (4Gb RAM)
Harddisk: Intel SSD 520 series 180GB (2x in RAID)
Processor: AMD Opteron 6272 16core (2x) = total of 32 cores
Memory: 64GB 1600 MHz DDR3 ECC Reg
Resolume 4.1.7

Output Setup: 1 Control monitor at 1920x1080, 1 Fullscreen output at 1920x1200

Benchmark for 1920x1080
Clean content: 15 layers
Noise content: 6 layers

Benchmark for 640x480
Clean content: 20+ layers
Noise content: 20+ layers

Will test on my 2 veejay laptops soon...

gerbyzation
Met Resolume in a bar the other day
Posts: 5
Joined: Thu Aug 09, 2012 13:41

Re: Performance Benchmarks

Post by gerbyzation » Tue Apr 29, 2014 18:49

Model: Macbook Pro 15” Retina late 2013
Operating System: OS X 10.9.2
Graphic card: NVidia GeForce GT 750M 2048MB
Harddisk: 500GB Flash
Processor: 2.3 GHz Intel core i7
Memory: 16GB 1600MHz
Resolume: Arena 4.1.8

Output Setup:
Macbook at 1920x1200 HiDPI and output to second screen at 1920x1080
Benchmark for 1920x1080
Clean content: 10
Noise content: 10

Benchmark for 640x480
Clean content: 20+
Noise content: 20+

Outperformed by the previous model... :( I'm having some jittery scrolling & stuff going on, seems to be a hardware problem so that could be an explanation
Last edited by gerbyzation on Wed Apr 30, 2014 08:32, edited 1 time in total.

thedawjones
Hasn't felt like this about software in a long time
Posts: 56
Joined: Thu Jan 24, 2013 16:27
Location: Seattle, Washington

Re: Performance Benchmarks

Post by thedawjones » Tue Apr 29, 2014 21:16

Time for the cyclops to enter the coliseum:

Dell Inc. Precision WorkStation 390
Windows 7 Professional (x64) Service Pack 1 (build 7601)
2.40 gigahertz Intel Core 2 Duo
64 kilobyte primary memory cache
4096 kilobyte secondary memory cache
Multi-core (2 total)
Not hyper-threaded
PC2 8500 (ddr2)
8126 Megabytes Usable Installed Memory
Bus Clock: 1066 megahertz
BIOS: Dell Inc. 2.1.2 11/30/2006 :o
SAMSUNG HD080HJ/P SATA Hard drive :roll:
AMD Radeon HD 5770 Display adapter 1 gb ddr5

NEC LCD1560V+ Monitor 14.9" (x2split) 1024x768 with Samsung 1920x1080 control monitor
480 clean 20+
480 noise 20+
1080 clean 9
1080 noise 8
Samsung SyncMaster Monitor 24.0" 1920x1080 with NEC 1024x768 control monitor
480 clean 20+
480 noise 20+
1080 clean 11
1080 noise 8

Not bad for a pc from 2005.....

User avatar
yochee
Hasn't felt like this about software in a long time
Posts: 117
Joined: Sun Sep 28, 2008 18:49
Location: Münster | Germany

Re: Performance Benchmarks

Post by yochee » Wed Apr 30, 2014 00:48

Model: ASUS K53SV (Mid2011 Laptop without USB3.0 or eSATA)
OS: Win7 Home Premium 64Bit
GPU: NVIDIA GeForce GT540M - 2048MB DDR3 RAM
Harddisk see below
CPU: Intel Core i5-2410M CPU @2.30GH
Memory: 8GB Ram
Resolume: 4.1.8
Output Setup: internal 1366x768 and external 1680x1050
(btw: i usually use a 2400x800 external setup)

-------------------------

Harddrive: external 1tb HDD 5400rpm (2") via USB2.0
480p:
clean 16
noise 4

1080p:
clean 4
noise 1

----------

Harddrive: external 300GB HDD 7200rpm via USB2.0 (Maxtor 6 V300F0)
480p:
clean 20
noise 5

1080p:
clean 5 (i can hear you ;))
noise 1

----------

Harddrive: external 500GB HDD 7200rpm via USB2.0 (TrekStor WD5000AAJB-00UHA)
480p:
clean 20
noise 5

1080p:
clean 5
noise 1

same with internal SD Card Reader & 3TB HDD

----------

Harddrive: internal 120GB SSD (Intel SSD SC2CT120A3 // SSD 330 series)
480p:
clean 20+
noise 20+

1080p
clean 5 (29,35fps)
noise 5 (28,63fps)


--> bottle neck with external USB2.0 harddrive @ 480p. performs best with internal SSD
--> almost no difference at 1080p with internal harddrive between clean & noisy clips (bottleneck GPU i guess)
--> interesting: with 6 clips 480p clean the framerate almost drops to 35fps, when starting another clips the fps get faster again. maybe then the GPU turns on?!
--> i usually use 800x600 clips or bigger. only a few old 480p clips have survived
--> not bad for a three year old 600€ consumer lappy :lol:

martie
Met Resolume in a bar the other day
Posts: 8
Joined: Fri Jun 29, 2012 13:59

Re: Performance Benchmarks

Post by martie » Wed Apr 30, 2014 15:19

A xNotebooks.com notebook with 2 GPU's (integrated/dedicated)

Model: Xnotebooks Turbine
OS: Win7 Ultimate X64
GPU: NVIDIA GeForce GT650M - 2048MB DDR3, GDDR5
Harddisk: ST750LX003 Hybrid disk
CPU: Intel Core i7-3740QM CPU @2.7GHz
Memory: 8GB Ram
Resolume: 4.1.8
Output Setup: internal 1920x1080 and external 1920x1080

Integrated Intel HD graphics 4000
480: 8
480n: 8
1080: 2
1080n:2

Dedicated Nvidia GeForce GT 650M
480:14
480n: 15
1080: 5
1080n: 4

Zoltán
Team Resolume
Posts: 3883
Joined: Thu Jan 09, 2014 13:08
Location: Székesfehérvár, Hungary

Re: Performance Benchmarks

Post by Zoltán » Thu May 01, 2014 19:10

Model: Dell vostro 3560
Operating System: windows 7 x64
Graphic card: ATI radeon 7670m 1GB
Harddisk: Kingston ssdnow V300 120GB
Processor: i7-3630QM
Memory: 8GB
Resolume: 4.1.8

Output Setup: internal 1920x1080, output to 1920x1080

Benchmark for 1920x1080
Clean content: 7
Noise content: 7
(between 29.6-30.8 fps, 8 clips down to 26 fps.)

Benchmark for 640x480
Clean content: 20+
Noise content: 20+
Theatre sound engineer, photographer, programmer, aka ravensc.
Control Your show with ”Enter” - multiple Resolume servers at once - SMPTE/MTC column launch
try for free: http://programs.palffyzoltan.hu
VJ footage: https://goo.gl/58oHy7

sleepytom
Hasn't felt like this about software in a long time
Posts: 231
Joined: Fri Sep 12, 2008 11:11
Location: sussex by the sea

Re: Performance Benchmarks

Post by sleepytom » Fri May 02, 2014 11:13

Macbook Pro Unibody -Late 2011
2.5ghz i7
16GB Ram
Radeon HD 6770M 1GB
Samsung 750GB "evo" SSD. (internal in place of original boot drive)

Clean 1080p - 5 layers
Noise 1080p - 5 layers

didn't benchmark 640x480 as it is not 2003 any more.

I'm not quite sure what the bottleneck on this machine is, i guess GPU power to decode more? But logically we should be able to do some more on the CPU when the GPU is near capacity. Running activity monitor shows that Resolume is seriously under utilising the CPU. (50% useage - and it doesn't increase when we add some animation codec clips to the deck. I was hoping to see that I'd max out at 5 DXV but could then add 1 or two extra animation codec clips to make use of the CPU decode.) It looks like there could be some considerable gains from better CPU utilisation.

Cheers
Tom

dradutu
Is taking Resolume on a second date
Posts: 35
Joined: Tue Jul 13, 2010 15:04

Re: Performance Benchmarks

Post by dradutu » Fri May 02, 2014 15:38

Model: Custom build Gigabyte Ga-X58A-UD7 Mainboard & Antec Sonata III 500
Operating System: Windows 7 x64 Ultimate
GPU: Asus nVidia GTX 275 896MB
Harddisk: 128 GB SSD OCZ Vertex 450
Processor:Intel I7 930 [Hyperthreaded Quad Core, 8 MB L3] & H50 Cooler
Memory: 24 GB RAM [3x8 GB DDR3 Kingston HyperX Blu]
Resolume: 4.1.8

1080 Noise 14 layers over 30fps [11 layers over 60fps, 20 layers over 21 fps]
All other tests ran at 60 fps
Tested at default settings, no overclock. I can do the benchmark with overclock or in Hackintosh mode on request.

Post Reply