Can we learn permutation matrices? Something like this but applied to learning order that maximizes some objective. Off the cuff it sounds like an NP problem but seems that people have tried before with some success. https://arxiv.org/abs/2205.00242v1
It also reminds me of tuning random seeds (can't find the arxiv link)
Overall this stuff seems highly intractable in today's world but the humans are trying to make headway. Such is research.
melony 699 days ago [-]
Is there a generating function for it?
gillesjacobs 699 days ago [-]
If someone controls the ordering of samples in training code, you have a compromised pipeline. Owning a codebase and underlying dataset to steer towards likely but uncertain model predictions seems like a far-fetched threat model.
Still interesting research in its own right and goes to show it is worth testing for randomness of all system components.
NonNefarious 699 days ago [-]
Why are the data ordering attacks? Do they hate neural networks or something?
Rendered at 08:29:58 GMT+0000 (Coordinated Universal Time) with Vercel.
It also reminds me of tuning random seeds (can't find the arxiv link)
Or things like this: https://arxiv.org/abs/2104.06338
Overall this stuff seems highly intractable in today's world but the humans are trying to make headway. Such is research.
Still interesting research in its own right and goes to show it is worth testing for randomness of all system components.