How was the model operated? Was it someone prompting it continuously or was it just given the initial prompt?
chmod775 34 minutes ago [-]
Ten hours is a decent amount of time, so I'm not too surprised the human won. LLMs don't really tend to improve the longer they get to chew on a problem (often the opposite in fact).
The LLM was probably getting nowhere trying to improve after the first few minutes.
crmi 24 minutes ago [-]
Really feels like it could be an onion title.
geephroh 10 minutes ago [-]
Ha! Came here to say the same thing...
ChrisMarshallNY 50 minutes ago [-]
I'm old enough to remember being taught the Ballad of John Henry...
esseph 16 minutes ago [-]
The article mentions it...
ChrisMarshallNY 14 minutes ago [-]
Yup. I was talking about how they taught it to us, in school. It actually had an emotional place in my heart. For some reason, I found the story compelling.
nuifldpei 14 minutes ago [-]
I despise the company that competed, but I feel obligated to acknowledge that headline buries the lede that their bot got SECOND place, and their 2nd place was closer to first than 3rd was to 2nd.
Are the submissions available online without needing to become a member of AtCoder?
I want to see what these 'heuristic' solutions look like.
Is it just that the ai precomputed more states and shoved their solutions in as the 'heuristic' or did it come up with novel, more broad, heuristics? Did the human and ai solutions have overlapping heuristics?
317070 44 minutes ago [-]
Does someone know the problem/challenge being solved?
Damn I feel exhausted reading that problem, seeing the input/output... what. Granted I skimmed it for like 20 seconds but yeah.
flanbiscuit 6 minutes ago [-]
This reminds me of many a challenge on Advent of Code
hyperhello 30 minutes ago [-]
I'm at a complete loss to discern why this would be a useful task to solve. It seems like the equivalent of elementary schoolers saying "OK, if you're so smart, what's 9,203,278,023 times 3,333,300,209?"
TrackerFF 2 minutes ago [-]
Say you have a bunch of warehouse robots, some which work on different sections in the warehouse. Maybe one section has less things to do, while another section has more things to do - and thus needs more help. So you need to move a bunch of robots there, in groups.
Something like that.
margalabargala 14 minutes ago [-]
It's more the equivalent of "why would anyone race the 400m on a standard track, you just wind up back where you started!"
LeoPanthera 29 minutes ago [-]
It's a problem that has no perfect solution, only incremental improvements. So it's really not like your example at all.
lovich 15 minutes ago [-]
I feel like if that question was asked when calculators were invented, and someone was claiming humans were still better at arithmetic than machines, that it would be appropriate.
I was surprised reading through this problem that the machine solved it well at all.
I get that it’s a leet code style question but it’s got a lot of specifics and I assumed the corpus of training data on optimizing this type of problem was several orders of magnitude too small to train an LLM on and have good results.
TrackerFF 11 minutes ago [-]
Now imagine where we'll be in 10 years, and where we were 10 years ago. Things move, fast.
18 minutes ago [-]
Rendered at 21:51:31 GMT+0000 (Coordinated Universal Time) with Vercel.
The LLM was probably getting nowhere trying to improve after the first few minutes.
Are the submissions available online without needing to become a member of AtCoder?
I want to see what these 'heuristic' solutions look like.
Is it just that the ai precomputed more states and shoved their solutions in as the 'heuristic' or did it come up with novel, more broad, heuristics? Did the human and ai solutions have overlapping heuristics?
Something like that.
I was surprised reading through this problem that the machine solved it well at all.
I get that it’s a leet code style question but it’s got a lot of specifics and I assumed the corpus of training data on optimizing this type of problem was several orders of magnitude too small to train an LLM on and have good results.