Remove access from workflow

Yes, you should be able to remove roles. Are you able to share the details of your failed workflow?