Efficient computation of MMLU-scores
Published:
Relinking the blog post I wrote at Vijil where we enabled scoring against benchmarks (MMLU) by using the tinyBenchmark methodology. Combined with Vijil engine, we can much more quickly get an accurate estimate all kinds of metrics one might want to evaluate.