I saw a bug out there on this but it's old and claims to be fixed. I keep thinking the next time I do an upgrade, it'll be fixed.
So for example: upgrading from 5.9.1 to 5.10.0
drush civicrm-upgrade --tarfile=~/civicrm-5.10.0-drupal.tar.gz
Which outputs a bunch of normal messages and then
You are already upgraded to CiviCRM 5.9.1
Which is true, but I'm trying to upgrade to 5.10. When I run the exact same command again, it works.