I think that would be gender nullarity (a gender arity that is null/absent, as in, you can’t be classified as trinary, binary, unary, etc.). You can read more here and here. There’s also equary. Being nullary not essentially means you are agender, anyways it’s an a-gender arity (anarity/anariality/aleptarity/aleptary).
But just because you are unconfident of using gendered bathrooms, doesn’t mean anything about experiencing a gender identity. There are several reasons for it, specially local transgendercide statistics and cultural exorsexism or transmisogyny (transphobia/cissexism/transmisia or binarism/enbyphobia).
Are you neutral/epicene or indifferent/apathic or to genders? Just because I don’t feel okay in bathrooms with 🚹 icons, doesn’t mean you aren’t male. It could be because external non-consensual objectifying, fetishizing and condemnatory looks/judgements. That’s why unisex/gender-neutral public toilets are healthier than gender-based bathrooms, even the inclusive-intended ones. It’s like separating them into hair types, that would be unconfortable/offensive for a lot of people, that doesn’t mean they are hairless.
You could be pronoun non-conforming and pronoun questioning.