@UlrikeHahn @dingemansemark @davidschlangen @dcm I am very sympathetic to this line of thought. Here is an objection I anticipate.
It's one thing to say that not all uses of language must be X (where X whatever is supposed to be what an LLM can't do and humans can). It's another to say that not all users of language must be at least capable of uses of language that are X.
I think some people would accept the former, weaker claim and still want to reject the latter, stronger claim.