The 500GB hard drive on the current Mac Minis is 5400rpm which will definitely reduce your performance.
The 256MB graphics card on the Mac Mini isn't great either, especially if you are comparing it to the 1GB card on the Retinas...
If you're not using many layers or HD content, it might be okay?