47/50 for the grand prize is definitely a hard challenge. The best team in Progress Prize 1 only scored 29/50.
YetAnotherNick 477 days ago [-]
1.5M is kaggle competition is also high. And progress is non linear in the field of reasoning.
benopal64 477 days ago [-]
Good point. Maybe the hosts are assuming mathematicians and other folks will benefit from LLMs or the o1 OpenAI model? Kind of like raising the bar based on the technology available to the participants.
kevinventullo 477 days ago [-]
The 47/50 bar for the Overall Progress Prize was actually set in the first competition, it’s just that no one got it. Interestingly, the purse for the prize has doubled from “at least $794,624” to “at least $1,589,248”.
Perhaps intended as an Easter egg, those numbers are equal to 97*2^13 and 97*2^14, respectively.
Jianghong94 477 days ago [-]
I assume 97 <- 47+50? (although I'm not sure where the 13 and 14 respectively come from)
trott 477 days ago [-]
And the problems are much harder now.
Rendered at 06:26:29 GMT+0000 (Coordinated Universal Time) with Vercel.
Perhaps intended as an Easter egg, those numbers are equal to 97*2^13 and 97*2^14, respectively.