Labels have use.
Two somewhat opposing uses: Label-as-categorisation and label-as-exploration.
Sometimes people just want to know what box to put an interaction in. Low ceremony, just-so kind of conversations.
Sometimes people want to use labels to explore the edges of understanding between people, and as a way to expose identity.
When one person asks for categorisation and you answer with exploration: Then labels have little use.