Authorization at BP Group level

Hello

We have multiple BP Groups created. We want to restrict the access of certain BP Groups to a set of users only.

I understand that BP Group is not available as auth object in transaction BP.

Is there a way to handle this ?

Thanks

Rakesh