Why AI language models choke on too much text

[arstechnica@mastodon.social]

Why AI language models choke on too much text
Compute costs scale with the square of the input size. That's not great.
https://arstechnica.com/ai/2024/12/why-ai-language-models-choke-on-too-much-text/?utm_brand=arstechnica&utm_social-type=owned&utm_source=mastodon&utm_medium=social

https://files.mastodon.social/media_attachments/files/113/685/304/201/114/247/original/3fc52edeac0f9a52.jpg