Issue causing this:
In PHP logs I found out Symphony was mentioned along with Flexmailer. We had alpha outdated version of Flexmailer causing issues. Disabling it/ updating it seems to work as solution.
After that I could update CiviCRM smoothly and works!
Hopefully someone will need this in the future!
I was setting this up in a staging environment which is not up to date with the latest versions of CiviCRM. If you go are running a version of CiviCRM earlier than 5.24 then you need to apply this patch which solves the problem. The issue is not seen in versions of CiviCRM 5.25 and later.
Scheduled reminders should provide you the required functionality.
Administer -> Communications -> Schedule Reminder
You should be able to set up the required reminders from there. Hopefully it's pretty self explanatory - however there is more information here: