I'd say it depends on what you need to use both the CMS and the CRM for.
Joomla-Civi doesn't have the equivalent Drupal's Civi WebForms integration - so if you want to get, say, event or profile data out of Civi and have full control over styling to integrate that with your site's content views, there is no existing extension to do that. I think there is a CiviCRM Gravity Forms integration for Wordpress.
If you're just using Civi to take payments, newsletter signups, sell memberships, or have standard Civi events/profile pages, then that will work fine with either CMS, ie go with the CMS that best suits your needs. Certainly Joomla Civi upgrades are quick (unless something has gone wrong with the install) and for access control, such as selling Membership to access certain parts of your website is straightforward on Joomla with the CiviAuthenticate plugin.