Try to delete via API if it is not allowing in UI.
You can try to find any long running aggregation related tasks are still pending by using get-pending-tasks | SailPoint Developer Community and try to clean up. Also, try to reset the identity profile source and try the delete. I would also ensure no other source aggregations are processing when you are deleting the identity profile.