The Kaitchup – AI on a Budget

The Kaitchup – AI on a Budget

Share this post

The Kaitchup – AI on a Budget
The Kaitchup – AI on a Budget
Do Bigger Evaluation Datasets Make Your Results More Significant?

Do Bigger Evaluation Datasets Make Your Results More Significant?

A very common belief among AI practitioners

Benjamin Marie's avatar
Benjamin Marie
May 13, 2023
∙ Paid
1

Share this post

The Kaitchup – AI on a Budget
The Kaitchup – AI on a Budget
Do Bigger Evaluation Datasets Make Your Results More Significant?
Share

A very common belief among AI practitioners

I made a tweet poll asking the following questions:

What the results say is that many machine translation researchers think that increasing the size of the evaluation data makes the results more significant…

The size of the test set shouldn’t have any impact on the evaluation, provided that the test set has been …

This post is for paid subscribers

Already a paid subscriber? Sign in
© 2025 The Kaitchup
Privacy ∙ Terms ∙ Collection notice
Start writingGet the app
Substack is the home for great culture

Share