@UlrikeHahn @philosophy
I would say no, or perhaps 'impossible to say'. Nobody knows how humans recognise a table, but its likely to be very different from the way that a computer does it. One problem: neuroscientists are every bit as susceptible to hype as #AI
Posts
-
Do #LLMs have mental states? -
new blog post on whether LLMs really reason, think, summarise etc.@UlrikeHahn
Sure. I appreciate the depth of your discussion. I take a more experimental approach, triggered by ads in X for software that claims to summarise scientific papers. That's easily tested by giving it a paper about which you have detailed technical knowledge. I expected a poor result and that's what I got. Perhaps someone can test it more thoroughly. For me, that would be a waste of time -
new blog post on whether LLMs really reason, think, summarise etc.@UlrikeHahn
I guess the problem could be put this way. If I asked a scientist in a different field to summarise that paper, they would probably say "sorry, I don't understand well enough to do that", But AI just goes ahead and produces an ill-understood summary -like a 1st year undergraduate with google. It's dangerous and it's fraudulent, -
new blog post on whether LLMs really reason, think, summarise etc.@UlrikeHahn As you'd expect from the way it works, it just strings together sciencey-sounding words that it's found on the web. The fact that it does so in reasonably goof English lends it plausibility that it doesn't deserve.
-
new blog post on whether LLMs really reason, think, summarise etc.@UlrikeHahn I asked two of the #AI services that are advertised on Twitter to summarise one of my papers https://onemol.org.uk/burzomato-2004.pdf
The results were very poor. So I asked it to discuss "cooperativity" in general. Results were like a poor undergrad who strings together bits that he's found on the web, with no understanding of them (which is what AI does). -
new blog post on whether LLMs really reason, think, summarise etc.@UlrikeHahn @cogsci @philosophy
NO!
For scientific questions they are just auto-complete on steroids. Zero understanding. Zero critical thinking. The claim that they can summarise papers is fraudulent.