Can we be sure GPT-4o hasn’t been trained on the public test set? | Hacker News

Hacker Timesnew | past | comments | ask | show | jobs | submit

bjornsing on June 18, 2024 | parent | context | favorite | on: Getting 50% (SoTA) on Arc-AGI with GPT-4o

Can we be sure GPT-4o hasn’t been trained on the public test set?

ivalm on June 18, 2024 [–]

It has been trained on public test set as it’s on github

free_bip on June 18, 2024 | [–]

This isn't necessarily true, OpenAI isn't open about how their data cleaning process works.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact