My host indicated that the site was taking up a lot of resources, I have caching enabled, CDN configured and other optimizations.
After lots of testing we determined that RokNavMenu is really slowing the site down. We are using it as a module rather than calling it from the template settings.
On some pages we are showing 2 instances of the module (to get the appropriate look) on the home page where most of the testing is taking place you will see only one instance of the module.
I feel we have all the gantry stuff set up according to best practices and a menu system should not increase page loads by 30 to 40%