They’re all stating this to hide from the reality that llm development has nearly hit the upper limits of what these models can do. The hope was that big data would indefinitely sustain the progress of these models but we are seeing diminishing returns. They projected exponential returns back in 2020 but the reality is that these are hill curves. We’ll continue to see incremental progress with llms but academic AI progress will come from exploration of other novel techniques.

deleted by creator

No, misinformation is worse.

I don’t really understand how your 6 questions evaluate a growth or plateau in llm model performance. They did perform a certain way with your questions but growth has to be evaluated through the lens of time, whether literally or evaluating multiple versions of the same model.