When a user cancels his registration in Drupal, the pertaining Civi Contact remains.
How can I have both deleted simultaneously ?
You could implement this with the Rules module if you have the CiviCRM Entity module installed.
I, personally, wouldn't want the contact deleted. Maybe tag or group them differently but I'd want the history that is contained within the contact record.