Just got this problem. I have videofile (clip with sound). Everything is smooth in quicktime/mediaplayer/grandvj. But stutters in resolume. Small but stable and visible effect. No matter what framerate is reported by counter it looks like 12-15 fps.
Tested dxv, h264, photojpeg, different resolutions, v-sync, tripple buffering etc. off/on, aero off/on, etc. etc. etc. All this on different laptops.
In my case solution was to change audio preferences in resolume - set buffer size to 1024 (if i remember right default value is 2560) and changed sample rate to 48000. Can not say that it is 100% smooth but much much better. When change buffer size to extreme values video is massively stuttering. Don't understand nature of this. But may be this information will help.
p.s. another sound card may have different sweet spot. for example macbook retina runs this video smooth out of the box.