I understand the goal you are trying to achieve, but Segments currently doesn’t work the way you are wanting it to. Again, I encourage you to submit an idea so that our product team will be made aware of the ask.
In the meantime, one potential solution is to leverage the access request preapproval trigger to autodeny requests based on your criteria. You can watch my talk on how to use this particular trigger: Event Triggers: Getting Started and Advanced. You could also use a low code tool, like Workato, to setup the preapproval trigger. You can find our Workato connector here: Login to build your integrations, automations | Workato